Cellular tagging as a neural network mechanism for behavioural tagging

Engram mechanisms of memory linking and identity

Memories are thought to be stored in neuronal ensembles referred to as engrams. Studies have suggested that when two memories occur in quick succession, a proportion of their engrams overlap and the memories become linked (in a process known as prospective linking) while maintaining their individual identities. In this Review, we summarize the key principles of memory linking through engram overlap, as revealed by experimental and modelling studies. We describe evidence of the involvement of synaptic memory substrates, spine clustering and non-linear neuronal capacities in prospective linking, and suggest a dynamic somato-synaptic model, in which memories are shared between neurons yet remain separable through distinct dendritic and synaptic allocation patterns. We also bring into focus retrospective linking, in which memories become associated after encoding via offline reactivation, and discuss key temporal and mechanistic differences between prospective and retrospective linking, as well as the potential differences in their cognitive outcomes.

Maladaptation of dentate gyrus mossy cells mediates contextual discrimination deficit after traumatic stress

Fear overgeneralization is a maladaptive response to traumatic stress that is associated with the inability to discriminate between threat and safety contexts, a hallmark feature of post-traumatic stress disorder (PTSD). However, the neural mechanisms underlying this deficit remain unclear. Here, we show that traumatic stress exposure impairs contextual discrimination between threat and safety contexts in the learned helplessness (LH) model. Mossy cells (MCs) in the dorsal hippocampus are suppressed in response to traumatic stress. Bidirectional manipulation of MC activity in the LH model reveals that MC inhibition is causally linked to impaired contextual discrimination. Mechanistically, MC inhibition increases the number of active granule cells in a given context, significantly overlapping context-specific ensembles. Our study demonstrates that maladaptive inhibition of MCs after traumatic stress is a substantial mechanism underlying fear overgeneralization with contextual discrimination deficit, suggesting a potential therapeutic target for cognitive symptoms of PTSD.

Contextual memory engrams, and the neuromodulatory influence of the locus coeruleus

Here, we review the basis of contextual memory at a conceptual and cellular level. We begin with an overview of the philosophical foundations of traversing space, followed by theories covering the material bases of contextual representations in the hippocampus (engrams), exploring functional characteristics of the cells and subfields within. Next, we explore various methodological approaches for investigating contextual memory engrams, emphasizing plasticity mechanisms. This leads us to discuss the role of neuromodulatory inputs in governing these dynamic changes. We then outline a recent hypothesis involving noradrenergic and dopaminergic projections from the locus coeruleus (LC) to different subregions of the hippocampus, in sculpting contextual representations, giving a brief description of the neuroanatomical and physiological properties of the LC. Finally, we examine how activity in the LC influences contextual memory processes through synaptic plasticity mechanisms to alter hippocampal engrams. Overall, we find that phasic activation of the LC plays an important role in promoting new learning and altering mnemonic processes at the behavioral and cellular level through the neuromodulatory influence of NE/DA in the hippocampus. These findings may provide insight into mechanisms of hippocampal remapping and memory updating, memory processes that are potentially dysregulated in certain psychiatric and neurodegenerative disorders.

Novelty facilitates the persistence of aversive memory extinction by dopamine regulation in the hippocampus and ventral tegmental area

Aversive memory extinction comprises a novel learning that blocks retrieving a previously formed traumatic memory. In this sense, aversive memory extinction is an excellent tool for decreasing fear responses. However, this tool it's not effective in the long term because of original memory spontaneous recovery. Thus, searching for alternative strategies that strengthen extinction learning is essential. In the current study, we evaluated the effects of a novel context (i.e., novelty) exposure on aversive memory extinction enhancement over days and the dopaminergic system requirement. Given the purpose, experiments were conducted using 3-month-old male Wistar rats. Animals were trained in inhibitory avoidance (IA). Twenty-four hours later, rats were submitted to a weak extinction protocol. Still, 30 min before the first extinction session, animals were submitted to an exploration of a novel context for 5 min. After, memory retention and persistence were evaluated 24 h, 3, 7, 14, and 21 days later. The exposition of a novel context caused a decrease in aversive responses in all days analyzed and an increase in dopamine levels in the hippocampus. The intrahippocampal infusion of dopamine in the CA1 area or the stimulation of the ventral tegmental area (VTA) by a glutamatergic agonist (NMDA) showed similar effects of novelty. In contrast, VTA inhibition by a gabaergic agonist (muscimol) impaired the persistence of extinction learning induced by novelty exposition and caused a decrease in hippocampal dopamine levels. In summary, we show that novel context exposure promotes persistent aversive memory extinction, revealing the significant role of the dopaminergic system.

Modulation of memory reconsolidation by adjacent novel tasks: timing defines the nature of change

Reconsolidation turns memories into a responsive state that allows their modulation until they stabilize again. This phenomenon attracted remarkable attention due to its potential impact on therapeutics and education. Recent evidence revealed that different memories undergo reconsolidation via a behavioral tagging process. Thus, their re-stabilization involves setting "reconsolidation-tags" and synthesizing plasticity-related proteins for their capture at the tagged sites. Here, we studied the possibility of affecting these fundamental mechanisms to modulate reconsolidation. Our findings, in laboratory rats, indicate that exploring a novel environment 60 min before or after memory reactivation improves spatial object recognition memory by promoting protein synthesis. Conversely, experiencing novelty immediately after reactivation impairs the reconsolidation by affecting the tags. Similar effects, but with a different optimal time window for improvement, occur in inhibitory avoidance memory. These results highlight the possibility of modulating existing memories using non-invasive interventions that selectively affect the fundamental mechanisms of behavioral tagging during their reconsolidation.

Novelty-induced memory consolidation is accompanied by increased Agap3 transcription: a cross-species study

Novelty-induced memory consolidation is a well-established phenomenon that depends on the activation of a locus coeruleus-hippocampal circuit. It is associated with the expression of activity-dependent genes that may mediate initial or cellular memory consolidation. Several genes have been identified to date, however, to fully understand the mechanisms of memory consolidation, additional candidates must be identified. In this cross-species study, we used a contextual novelty-exploration paradigm to identify changes in gene expression in the dorsal hippocampus of both mice and rats. We found that changes in gene expression following contextual novelty varied between the two species, with 9 genes being upregulated in mice and 3 genes in rats. Comparison across species revealed that ArfGAP with a GTPase domain, an ankyrin repeat and PH domain 3 (Agap3) was the only gene being upregulated in both, suggesting a potentially conserved role for Agap3. AGAP3 is known to regulate α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA)-type glutamate receptor trafficking in the synapse, which suggests that increased transcription of Agap3 may be involved in maintaining functional plasticity. While we identified several genes affected by contextual novelty exploration, we were unable to fully reverse these changes using SCH 23390, a dopamine D1/D5 receptor antagonist. Further research on the role of AGAP3 in novelty-induced memory consolidation could lead to better understanding of this process and guide future research.

Adaptive expression of engrams by retroactive interference

Long-term memories are stored as configurations of neuronal ensembles, termed engrams. Although investigation of engram cell properties and functionality in memory recall has been extensive, less is known about how engram cells are affected by forgetting. We describe a form of interference-based forgetting using an object memory behavioral paradigm. By using activity-dependent cell labeling, we show that although retroactive interference results in decreased engram cell reactivation during recall trials, optogenetic stimulation of the labeled engram cells is sufficient to induce memory retrieval. Forgotten engrams may be reinstated via the presentation of similar or related environmental information. Furthermore, we demonstrate that engram activity is necessary for interference to occur. Taken together, these findings indicate that retroactive interference modules engram expression in a manner that is both reversible and updatable. Inference may constitute a form of adaptive forgetting where, in everyday life, new perceptual and environmental inputs modulate the natural forgetting process.

A behavioral tagging account of kinase contribution to memory formation after spaced aversive training

Long-term memory (LTM) can be induced by repeated spaced training trials. Using the weak inhibitory avoidance (wIA) task, we showed that one wIA session does not lead to a 24-h LTM, whereas two identical wIA sessions spaced by 15 min to 6 h induce a 24-h LTM. This LTM promotion depends both on hippocampal protein synthesis and the activity of several kinases. In agreement with the behavioral tagging (BT) hypothesis, our results suggest that the two training sessions induce transient learning tags and lead, via a cooperative effect, to the synthesis of plasticity-related proteins (PRPs) that become available and captured by the tag from the second session. Although ERKs1/2 are needed for PRPs synthesis and CaMKs are required for tag setting, PKA participates in both processes. We conclude that the BT mechanism accounts for the molecular constraints underlying the classic effect of spaced learning on LTM formation.

Cognitive rescue in aging through prior training in rats

Cognitive decline in spatial memory is seen in aging. Understanding affected processes in aging is vital for developing methods to improve wellbeing. Daily memory persistence can be influenced by events around the time of learning or by prior experiences in early life. Fading memories in young can last longer if a novel event is introduced around encoding, a process called behavioral tagging. Based on this principle, we asked what processes are affected in aging and if prior training can rescue them. Two groups of aged rats received training in an appetitive delayed matching-to-place task. One of the groups additionally received prior training of the same task in young and in mid-life, constituting a longitudinal study. The results showed long-term memory decline in late aging without prior training. This would reflect affected encoding and consolidation. On the other hand, short-term memory was preserved and novelty at memory reactivation and reconsolidation enabled memory maintenance in aging. Prior training improved cognition through facilitating task performance, strengthening short-term memory and intermediate memory, and enabling encoding-boosted long-term memory. Implication of these findings in understanding brain mechanisms in cognitive aging and in beneficial effects of prior training is discussed.

Mbnl2 loss alters novel context processing and impairs object recognition memory

Patients with myotonic dystrophy type I (DM1) demonstrate visuospatial dysfunction and impaired performance in tasks requiring recognition or memory of figures and objects. In DM1, CUG expansion RNAs inactivate the muscleblind-like (MBNL) proteins. We show that constitutive Mbnl2 inactivation in Mbnl2ΔE2/ΔE2 mice selectively impairs object recognition memory in the novel object recognition test. When exploring the context of a novel arena in which the objects are later encountered, the Mbnl2ΔE2/ΔE2 dorsal hippocampus responds with a lack of enrichment for learning and memory-related pathways, mounting instead transcriptome alterations predicted to impair growth and neuron viability. In Mbnl2ΔE2/ΔE2 mice, saturation effects may prevent deployment of a functionally relevant transcriptome response during novel context exploration. Post-novel context exploration alterations in genes implicated in tauopathy and dementia are observed in the Mbnl2ΔE2/ΔE2 dorsal hippocampus. Thus, MBNL2 inactivation in patients with DM1 may alter novel context processing in the dorsal hippocampus and impair object recognition memory.

Standardized extract of Ginkgo biloba treatment and novelty on the weak encoding of spatial recognition memory in rats

Long-term memory (LTM) formation is dependent on neurochemical changes that guarantee that a recently formed memory (short-term memory [STM]) remains in the specific neural circuitry via the consolidation process. The persistence of recognition memory has been evidenced by using behavioral tagging in young adult rats, but it has not been effective on aging. Here, we investigated the effects of treatment with a standardized extract of Ginkgo biloba (EGb) associated with novelty on the consolidation of object location memory (OLM) and its persistence after weak training of spatial object preference in young adult and aged rats. The object location task used in this study included two habituation sessions, training sessions associated or not associated with EGb treatment and contextual novelty, and short-term or long-term retention testing sessions. Altogether, our data showed that treatment with EGb associated with novelty close to the time of encoding resulted in STM that lasted for 1 h and persisted for 24 h for both young adult and aged rats. In aged rats, the cooperative mechanisms induced robust long-term OLM. Our findings support and extend our knowledge about recognition memory in aged rats and the modulating effects of EGb treatment and contextual novelty on the persistence of memory.

Requirement for hippocampal CA3 NMDA receptors in artificial association of memory events stored in CA3 cell ensembles

The N-methyl-D-aspartate receptors (NRs) in hippocampal CA3 are crucial for the synaptic transmission and plasticity within the CA3 recurrent circuit, which supports the hippocampal functions, such as pattern completion, and reverberatory association of sensory inputs. Previous study showed that synchronous activation of distinct cell populations in CA3, which correspond to distinct events, associated independent events, suggesting that the recurrent circuit expressing NRs in CA3 mediates the artificial association of memory events stored in CA3 ensembles. However, it is still unclear whether CA3 NRs are crucial for the artificial association of memory events stored in the CA3 ensembles. Here we report that the triple transgenic mice (cfos-tTA/KA1-Cre/NR1 flox/flox), which specifically lack NRs in the CA3 cell ensembles, showed impairment in artificial association between two events, which in control mice triggered artificial association. This result indicates that NRs in the hippocampal CA3 are required for the artificial association of memory events stored in the CA3 cell ensembles.

Memory reactivations during sleep

Neuronal activities that occur during awake periods are often reactivated again during sleep, to consolidate recently encoded memories, a process known as consolidation. In recent years, advanced tools, specially optical techniques and in-vivo live Ca²⁺ imaging, have revealed a deeper understanding to the offline periods' neuronal activities and their correspondence to later awake behavioral outputs. Recently, there is a growing consensus that sleep is more of an active process. Sleep has been associated with various functions, memory updating, future imaginations of possible familiar scenarios, decision making and planning by replaying past memories. Also, boosting insightful thoughts, creative thinking and problem solving by forming new associations and connections that were not present in awake states. Sleep activities have been directly associated with many "EUREKA" or "AHA" moments. Here, we describe recent views on memory reactivations during sleep and their implications on learning and memory.

Impairment in novelty-promoted memory via behavioral tagging and capture before apparent memory loss in a knock-in model of Alzheimer's disease

Alzheimer's disease (AD) is associated with cognitive impairments and age-dependent memory deficits which have been studied using genetic models of AD. Whether the processes for modulating memory persistence are more vulnerable to the influence of amyloid pathology than the encoding and consolidation of the memory remains unclear. Here, we investigated whether early amyloid pathology would affect peri-learning novelty in promoting memory, through a process called behavioral tagging and capture (BTC). App^{NL-G-F/NL-G-F} mice and wild-type littermates were trained in an appetitive delayed matching-to-place (ADMP) task which allows for the assessment of peri-learning novelty in facilitating memory. The results show that novelty enabled intermediate-term memory in wild-type mice, but not in App^{NL-G-F/NL-G-F} mice in adulthood. This effect preceded spatial memory impairment in the ADMP task seen in middle age. Other memory tests in the Barnes maze, Y-maze, novel object or location recognition tasks remained intact. Together, memory modulation through BTC is impaired before apparent deficits in learning and memory. Relevant biological mechanisms underlying BTC and the implication in AD are discussed.

Hippocampus as a sorter and reverberatory integrator of sensory inputs

The hippocampus must be capable of sorting and integrating multiple sensory inputs separately but simultaneously. However, it remains to be elucidated how the hippocampus executes these processes simultaneously during learning. Here we found that synchrony between conditioned stimulus (CS)-, unconditioned stimulus (US)- and future retrieval-responsible cells occurs in the CA1 during the reverberatory phase that emerges after sensory inputs have ceased, but not during CS and US inputs. Mutant mice lacking N-methyl-D-aspartate receptors (NRs) in CA3 showed a cued-fear memory impairment and a decrease in synchronized reverberatory activities between CS- and US-responsive CA1 cells. Optogenetic CA3 silencing at the reverberatory phase during learning impaired cued-fear memory. Thus, the hippocampus uses reverberatory activity to link CS and US inputs, and avoid crosstalk during sensory inputs.

A short-term memory trace persists for days in the mouse hippocampus

Active recall of short-term memory (STM) is known to last for a few hours, but whether STM has long-term functions is unknown. Here we show that STM can be optogenetically retrieved at a time point during which natural recall is not possible, uncovering the long-term existence of an STM engram. Moreover, re-training within 3 days led to natural long-term recall, indicating facilitated consolidation. Inhibiting offline CA1 activity during non-rapid eye movement (NREM) sleep, N-methyl-D-aspartate receptor (NMDAR) activity, or protein synthesis after first exposure to the STM-forming event impaired the future re-exposure-facilitated consolidation, which highlights a role of protein synthesis, NMDAR and NREM sleep in the long-term storage of an STM trace. These results provide evidence that STM is not completely lost within hours and demonstrates a possible two-step STM consolidation, first long-term storage as a behaviorally inactive engram, then transformation into an active state by recurrence within 3 days.

Short-term memory (STM) forms a protein synthesis-, NMDAR- and NREM sleep-dependent engram which lasts at least 3 days in the mouse hippocampus following a novel object location task, suggesting that STM is not completely lost within hours.

Tag and capture: how salient experiences target and rescue nearby events in memory

The long-term fate of a memory is not exclusively determined by the events occurring at the moment of encoding. Research at the cellular, circuit, and behavioral levels is beginning to reveal how neurochemical activations in the moments surrounding an event can retroactively and proactively rescue weak memory for seemingly mundane experiences. We review emerging evidence showing enhancement of weakly formed memories encoded minutes to hours before or after a related motivationally relevant experience. We discuss proposed neurobiological mechanisms for strengthening weak memories formed in temporal proximity to a strong event, and how this knowledge could be leveraged to improve memory for information that is prone to forgetting.

3D Neural Network Composed of Neurospheroid and Bionanohybrid on Microelectrode Array to Realize the Spatial Input Signal Recognition in Neurospheroid

There have been several studies for demonstration of 2D neural network using living cells or organic/inorganic molecules, but to date, there is no report of development of a 3D neural network in vitro. Based on developed bionanohybrid composed of protein, DNA, molybdenum disulfide nanoparticles, and peptides for controlling electrophysiological states of living cells, here, the in vitro 3D neural network composed of the bionanohybrid, 3D neurospheroid and the microelectrode array (MEA) is developed. After production of the 3D neurospheroid derived from human neural stem cells, the bionanohybrid developed on the MEA successfully semi-penetrates the neurites of the 3D neurospheroid and forms the 3D neural network. The developed 3D neural network successfully exhibited the electrophysiological output signals of the 3D neurospheroid by transmitting the input signal applied by the bionanohybrid. Moreover, by using the selectively immobilized bionanohybrid on the MEA, the spatial input signal recognition in the neurospheroid of 3D neural network is realized for the first time. This newly developed in vitro 3D neural network provides a promising strategy to be applied in brain-on-a-chip, brain disease-related drug efficacy evaluation, bioelectronics, and bioelectronic medicine.

Behavioral and Cellular Tagging in Young and in Early Cognitive Aging

The ability to maintain relevant information on a daily basis is negatively impacted by aging. However, the neuronal mechanism manifesting memory persistence in young animals and memory decline in early aging is not fully understood. A novel event, when introduced around encoding of an everyday memory task, can facilitate memory persistence in young age but not in early aging. Here, we investigated in male rats how sub-regions of the hippocampus are involved in memory representation in behavioral tagging and how early aging affects such representation by combining behavioral training in appetitive delayed-matching-to-place tasks with the “cellular compartment analysis of temporal activity by fluorescence in situ hybridization” technique. We show that neuronal assemblies activated by memory encoding were also partially activated by novelty, particularly in the distal CA1 and proximal CA3 subregions in young male rats. In early aging, both encoding- and novelty-triggered neuronal populations were significantly reduced with a more profound effect in encoding neurons. Thus, memory persistence through novelty facilitation engages overlapping hippocampal assemblies as a key cellular signature, and cognitive aging is associated with underlying reduction in neuronal activation.

A cortical cell ensemble in the posterior parietal cortex controls past experience-dependent memory updating

When processing current sensory inputs, animals refer to related past experiences. Current information is then incorporated into the related neural network to update previously stored memories. However, the neuronal mechanism underlying the impact of memories of prior experiences on current learning is not well understood. Here, we found that a cellular ensemble in the posterior parietal cortex (PPC) that is activated during past experience mediates an interaction between past and current information to update memory through a PPC-anterior cingulate cortex circuit in mice. Moreover, optogenetic silencing of the PPC ensemble immediately after retrieval dissociated the interaction without affecting individual memories stored in the hippocampus and amygdala. Thus, a specific subpopulation of PPC cells represents past information and instructs downstream brain regions to update previous memories.

Animals refer to related past experiences when processing sensory inputs. The authors show that a cellular ensemble in the posterior parietal cortex that is activated during past experience mediates an interaction between past and current information to update memory through a circuit including the anterior cingulate cortex.

Novelty promotes recognition memory persistence by D1 dopamine receptor and protein kinase A signalling in rat hippocampus

Strategies for improving memory are increasingly studied, and exposure to a novel experience can be an efficient neuromodulator. Novelty effects on memory depend on D1-family dopamine receptors (D1Rs) activation. Here, we evaluated the novelty effect on memory persistence of Wistar rats and investigated the contribution of D1Rs and their signalling pathways by protein kinase A (PKA) and C (PKC). Animals with infusion cannulae inserted into the CA1 hippocampus area were trained on the novel object recognition (NOR) task, which involved exploring two different objects. After training, some rats received intrahippocampal infusions of vehicle or D1Rs agonist; others explored a novel environment for 5 min and were infused with a variety of drugs targeting D1Rs and their signalling pathways. We demonstrated that pharmacological stimulation of D1Rs or novelty exposure promoted NOR memory persistence for 14 days and that the novelty effect depended on D1Rs activation. To determine if the D1 and D5 receptor subtypes were necessary for the impact of novelty exposure on memory, we blocked or stimulated PKA or PKC-protein kinases activated mainly by D1 and D5, respectively. Only PKA inhibition impaired the effect of novelty on memory persistence. After novelty and D1Rs blocking, PKA but not PKC stimulation maintained the memory persistence effect. Thus, we concluded that novelty promoted memory persistence by a mechanism-dependent on activating hippocampal D1Rs and PKA pathway.

Dimensions and mechanisms of memory organization

Memory formation is dynamic in nature, and acquisition of new information is often influenced by previous experiences. Memories sharing certain attributes are known to interact so that retrieval of one increases the likelihood of retrieving the other, raising the possibility that related memories are organized into associative mnemonic structures of interconnected representations. Although the formation and retrieval of single memories have been studied extensively, very little is known about the brain mechanisms that organize and link related memories. Here we review studies that suggest the existence of mnemonic structures in humans and animal models. These studies suggest three main dimensions of experience that can serve to organize related memories: time, space, and perceptual/conceptual similarities. We propose potential molecular, cellular, and systems mechanisms that might support organization of memories according to these dimensions.

Neuronal ensembles in memory processes

A neuronal ensemble represents the concomitant activity of a specific group of neurons that could encompass a broad repertoire of brain functions such as motor, perceptual, memory or cognitive states. On the other hand, a memory engram portrays the physical manifestation of memory or the changes that enable learning and retrieval. Engram studies focused for many years on finding where memories are stored as in, which cells or brain regions represent a memory trace, and disregarded the investigation of how neuronal activity patterns give rise to such memories. Recent experiments suggest that the association and reactivation of specific neuronal groups could be the main mechanism underlying the brain's ability to remember past experiences and envision future actions. Thus, the growing consensus is that the interaction between neuronal ensembles could allow sequential activity patterns to become memories and recurrent memories to compose complex behaviors. The goal of this review is to propose how the neuronal ensemble framework could be translated and useful to understand memory processes.

Engram cell connectivity: an evolving substrate for information storage

Understanding memory requires an explanation for how information can be stored in the brain in a stable state. The change in the brain that accounts for a given memory is referred to as an engram. In recent years, the term engram has been operationalized as the cells that are activated by a learning experience, undergoes plasticity, and are sufficient and necessary for memory recall. Using this framework, and a growing toolbox of related experimental techniques, engram manipulation has become a central topic in behavioral, systems, and molecular neuroscience. Recent research on the topic has provided novel insights into the mechanisms of long-term memory storage, and its overlap with instinct. We propose that memory and instinct may be embodied as isomorphic topological structures within the brain's microanatomical circuitry.

Neuropsin-dependent and -independent behavioral tagging

Aim

The consolidation of short‐term memories into long‐term memories is promoted by associations with novel environmental stimuli. This phenomenon is known as behavioral tagging. Neuropsin, a plasticity‐related serine protease in the hippocampus and amygdala, is involved in memory formation. This study investigated how neuropsin affects associative long‐term memory.

Methods

Short‐term and long‐term memory were assessed in control and neuropsin‐deficient mice by investigating their performance in inhibitory avoidance and spatial object recognition tasks. The effect of exposure to novelty on the conversion of short‐term memory to associative long‐term memory was also examined.

Results

The consolidation of task‐related short‐term memories into long‐term memories was facilitated by exposing the animals to a novel environment 1 hour before training. However, this long‐term memory conversion was impaired in neuropsin‐deficient mice performing the inhibitory avoidance task but not the spatial object recognition task.

Conclusion

Behavioral tagging occurs via neuropsin‐dependent and neuropsin‐independent processes for different behavioral tasks.

The consolidation of task‐related short‐term memories into long‐term memories was facilitated by exposing the animals to a novel environment 1 hour before training. However, this long‐term memory conversion was impaired in neuropsin‐deficient mice performing the inhibitory avoidance task but not the spatial object recognition task. Behavioral tagging occurs via neuropsin‐dependent and neuropsin‐independent processes for different behavioral tasks.

Initial memory consolidation and the synaptic tagging and capture hypothesis

Everyday memories are retained automatically in the hippocampus and then decay very rapidly. Memory retention can be boosted when novel experiences occur shortly before or shortly after the time of memory encoding via a memory stabilization process called "initial memory consolidation." The dopamine release and new protein synthesis in the hippocampus during a novel experience are crucial for this novelty-induced memory boost. The mechanisms underlying initial memory consolidation are not well-understood, but the synaptic tagging and capture (STC) hypothesis provides a conceptual basis of synaptic plasticity events occurring during initial memory consolidation. In this review, we provide an overview of the STC hypothesis and its relevance to dopaminergic signalling, in order to explore the cellular and molecular mechanisms underlying initial memory consolidation in the hippocampus. We summarize electrophysiological STC processes based on the evidence from two-pathway experiments and a behavioural tagging hypothesis, which translates the STC hypothesis into a related behavioural hypothesis. We also discuss the function of two types of molecules, "synaptic tags" and "plasticity-related proteins," which have a crucial role in the STC process and initial memory consolidation. We describe candidate molecules for the roles of synaptic tag and plasticity-related proteins and interpret their candidacy based on evidence from two-pathway experiments ex vivo, behavioural tagging experiments in vivo and recent cutting-edge optical imaging experiments. Lastly, we discuss the direction of future studies to advance our understanding of molecular mechanisms underlying the STC process, which are critical for initial memory consolidation in the hippocampus.

Subjective feeling of re-experiencing past events using immersive virtual reality prevents a loss of episodic memory

INTRODUCTION

Personally meaningful past episodes, defined as episodic memories (EM), are subjectively re-experienced from the natural perspective and location of one's own body, as described by bodily self-consciousness (BSC). Neurobiological mechanisms of memory consolidation suggest how initially irrelevant episodes may be remembered, if related information makes them gain importance later in time, leading for instance, to a retroactive memory strengthening in humans.

METHODS

Using an immersive virtual reality system, we were able to directly manipulate the presence or absence of one's body, which seems to prevent a loss of initially irrelevant, self-unrelated past events.

RESULTS AND CONCLUSION

Our findings provide an evidence that personally meaningful memories of our past are not fixed, but may be strengthened by later events, and that body-related integration is important for the successful recall of episodic memories.

Nrf2 Deficiency Exacerbates Cognitive Impairment and Reactive Microgliosis in a Lipopolysaccharide-Induced Neuroinflammatory Mouse Model

The transcription factor Nrf2 is a central regulator of anti-inflammatory and antioxidant mechanisms that contribute to the development and progression of various neurological disorders. Although the direct and indirect Nrf2 regulatory roles on inflammation have been reviewed in recent years, the in vivo evidence of Nrf2 function on lipopolysaccharide (LPS)-induced cognitive decline and characteristic alterations of reactive microglia and astrocytes remains incomplete. During the 3-5 days after LPS or saline injection, 5-6-month-old wildtype (WT) and Nrf2^-/- C57BL/6 mice were subjected to the novel object recognition task. Immunohistochemistry staining was employed for analyses of brain cells. The Nrf2^-/- mice displayed exacerbated LPS-induced cognition impairment (28.1 ± 9.6% in the discrimination index of the novel object recognition task), enhanced hippocampal reactive microgliosis and astrogliosis, and an increased expression level of the water channel transmembrane protein aquaporin 4 when compared with WT controls. In addition, similar overt effects of Nrf2 deficiency on LPS-induced characteristic alterations of brain cells were observed in the cortex and striatum regions of mice. In summary, this transgenic loss-of-function study provides direct in vivo evidence that highlights the functional importance of Nrf2 activation in regulating LPS-induced cognitive alteration, glial responses, and aquaporin 4 expression. This finding provides a better understanding of the complex nature of Nrf2 signaling and neuroprotection.

The temporal effect of hippocampal Arc in the working memory paradigm during novelty exploration

Arc (activity-regulated cytoskeleton-associated protein) is one of the neuronal Immediate Early Genes (IEG), which is involved in the consolidation of memory and is an essential factor in the induction of Long-term Potentiation (LTP), Long-term Depression (LTD) and homeostatic synaptic plasticity. It has also been implicated in the increased familiarization of novel environments during reference memory paradigms. However, the Arc associated temporal effects in a working memory paradigm during novelty exploration are not well studied. Therefore, in the present study, we used spontaneous alternation behavior (SAB) test along with the expression analysis of Arc to study its temporal effects on the working memory paradigms. Using a modified SAB test, we found that the increase in the duration of exposure to a novel environment in the short time-scale (<min) increases the alternations showing that short-term habituation increases the alternation rate. Additionally, during repeated exposure to a novel environment, the alternation rates decrease after shorter inter-session interval. Parallelly, we observed the upregulation of Arc mRNA and protein level 30 min after the SAB test in the cortex and hippocampus of mice, which returns to near-basal level after two hours. The novel experience, associated with the enhanced expression of Arc, helps in the decrease of alternations in subsequent sessions. This change in alternations was absent if the environment was familiar. Further, the role of Arc during these SAB test was confirmed by the inhibition of hippocampal Arc protein through the stereotaxic infusion of Arc antisense oligodeoxynucleotides. We observed that the Arc is involved in the temporal decrease of spontaneous alternations during a series of exposures to a novel environment. Finally, the significance of these results has been discussed in the light of Wagner's Sometimes Opponent Processes model, where we suggest that Arc reduces the ability for short-term habituation during repeated exposures in the working memory paradigm, and the loss of this ability is more prominent when subjected to a novel environment.

Comparison of kainate-induced seizures, cognitive impairment and hippocampal damage in male and female mice

Kainate (KA) mouse model induced by intraperitoneal injection has been widely used for epilepsy and neurodegeneration studies. KA elicits sustained epileptic activity in mouse brain revealed by recurrent behavioral seizures, deteriorative neurodegeneration and various neurological deficits. However, to date, the vast majority of the studies used male mice only, and few studies on the comparison of brain injury between male and female mice in this model were reported. Epidemiological studies indicate that sex may affect the susceptibility to seizure response and neurodegeneration process. Therefore, this study focused on the effect of sex difference on KA-induced recurrent seizures and mortality, locomotor activity and cognitive impairment, and hippocampal neurodegeneration and reactive gliosis in mice. Our results showed that, compared to females, adult male mice exhibited worse performance in mortality rate, severity of epileptic seizures, and cognitive impairment indicated by novel object recognition task. Unexpectedly, post-KA male and female mice underwent similar decline and recovery of locomotor activity. KA-induced neurodegeneration in the whole hippocampus, particularly in CA1 and CA3 subregions, along with the deteriorative reactive gliosis in astrocytes and microglia, was more severe in males than that in females. These data provided the direct in vivo evidence that indicates the key role of sex difference in studies with KA mouse model, and this could be beneficial for optimizing the design of future studies.

Orchestrated ensemble activities constitute a hippocampal memory engram

The brain stores and recalls memories through a set of neurons, termed engram cells. However, it is unclear how these cells are organized to constitute a corresponding memory trace. We established a unique imaging system that combines Ca²⁺ imaging and engram identification to extract the characteristics of engram activity by visualizing and discriminating between engram and non-engram cells. Here, we show that engram cells detected in the hippocampus display higher repetitive activity than non-engram cells during novel context learning. The total activity pattern of the engram cells during learning is stable across post-learning memory processing. Within a single engram population, we detected several sub-ensembles composed of neurons collectively activated during learning. Some sub-ensembles preferentially reappear during post-learning sleep, and these replayed sub-ensembles are more likely to be reactivated during retrieval. These results indicate that sub-ensembles represent distinct pieces of information, which are then orchestrated to constitute an entire memory.

The brain stores memories through a set of neurons known as engram cells. Here, the authors show that engram cells in the mouse hippocampus are organized into sub-ensembles representing distinct pieces of information, which are then orchestrated to constitute an entire memory.

Artificial association of memory events by optogenetic stimulation of hippocampal CA3 cell ensembles

Previous gain-of-function studies using an optogenetic technique showed that manipulation of the hippocampal dentate gyrus or CA1 cell ensembles is important for memory reactivation and to generate synthetic or false memory. However, gain-of-function study manipulating CA3 cell ensembles has not been reported. The CA3 area of the hippocampus comprises a recurrent excitatory circuit, which is thought to be important for the generation of associations among the stored information within one brain region. We investigated whether the coincident firing of cell ensembles in one brain region, hippocampal CA3, associates distinct events. CA3 cell ensembles responding to context exploration and during contextual fear conditioning were labeled with channelrhodopsin-2 (ChR2)-mCherry. The synchronous activation of these ensembles induced freezing behavior in mice in a neutral context, in which a foot shock had never been delivered. The recall of this artificial associative fear memory was context specific. In vivo electrophysiological recordings showed that 20-Hz optical stimulation of ChR2-mCherry-expressing CA3 neurons, which is the same stimulation protocol used in behavioral experiment, induced long-term potentiation at CA3-CA3 synapses. Altogether, these results demonstrate that the synchronous activation of ensembles in one brain region, CA3 of the hippocampus, is sufficient for the association of distinct events. The results of our electrophysiology potentially suggest that this artificial association of memory events might be induced by the strengthening of synaptic efficacy between CA3 ensembles via recurrent circuit.

Dual roles of anterior cingulate cortex neurons in pain and pleasure in adult mice

Human and animal studies indicate that some brain regions are activated during painful and pleasant situations, such as the anterior cingulate cortex (ACC). In the present study, we wanted to determine if some of the same neurons in the ACC may be activated by both pain and pleasure. We labeled neurons activated by two stimuli by using two immediate early genes (IEGs), Arc and Homer1a, and detected the intranuclear transcription of the IEG mRNA in situ. We found that there are double-labeling neurons in the ACC after the mice received pain and sexual attraction stimulation. The double-labeling ACC neurons were higher in male mice exposed to female mice (attractive stimulus) than the group exposed to male mice (normal stimulus). The IEG, which indicates the sexual attraction, were also higher in the female exposing group, while the IEG indicating pain showed no significant variance between two groups. Our findings suggest that ACC neurons play important roles in the process of both pain and pleasure.

Novelty and Dopaminergic Modulation of Memory Persistence: A Tale of Two Systems

Adaptation to the ever-changing world is critical for survival, and our brains are particularly tuned to remember events that differ from previous experiences. Novel experiences induce dopamine release in the hippocampus, a process which promotes memory persistence. While axons from the ventral tegmental area (VTA) were generally thought to be the exclusive source of hippocampal dopamine, recent studies have demonstrated that noradrenergic neurons in the locus coeruleus (LC) corelease noradrenaline and dopamine in the hippocampus and that their dopamine release boosts memory retention as well. In this opinion article, we propose that the projections originating from the VTA and the LC belong to two distinct systems that enhance memory of novel events. Novel experiences that share some commonality with past ones (‘common novelty’) activate the VTA and promote semantic memory formation via systems memory consolidation. By contrast, experiences that bear only a minimal relationship to past experiences (‘distinct novelty’) activate the LC to trigger strong initial memory consolidation in the hippocampus, resulting in vivid and long-lasting episodic memories.

Novelty induces dopamine release in the hippocampus, triggering memory consolidation to boost memory persistence.

Two dopaminergic systems (the ventral tegmental area- and locus coeruleus-hippocampus systems) can stabilise memory through novelty-induced dopamine release in the hippocampus.

Novel experiences can be viewed as a spectrum, from experiences that, while clearly novel, share some commonality with past experiences (‘common novelty’), to more fundamentally distinct experiences that bear minimal relationships to past experiences (‘distinct novelty’).

We propose that events characterised by ‘common novelty’ boost memory retention via activation of the ventral tegmental area-hippocampus system, resulting in initial consolidation followed by systems consolidation to create neocortical, semantic, long-term memories.

We further propose that events characterised by ‘distinct novelty’ lead to the boost of detailed hippocampal, episodic, long-term memory via activation of the locus coeruleus-hippocampus system through strong upregulation of the synaptic tagging and capture mechanism.

Bridging Synaptic and Epigenetic Maintenance Mechanisms of the Engram

How memories are maintained, and how memories are lost during aging or disease, are intensely investigated issues. Arguably, the reigning theory is that synaptic modifications allow for the formation of engrams during learning, and sustaining engrams sustains memory. Activity-regulated gene expression profiles have been shown to be critical to these processes, and their control by the epigenome has begun to be investigated in earnest. Here, we propose a novel theory as to how engrams are sustained. We propose that many of the genes that are currently believed to underlie long-term memory are actually part of a “plasticity transcriptome” that underpins structural and functional modifications to neuronal connectivity during the hours to days following learning. Further, we hypothesize that a “maintenance transcriptome” is subsequently induced that includes epigenetic negative regulators of gene expression, particularly histone deacetylases. The maintenance transcriptome negatively regulates the plasticity transcriptome, and thus the plastic capability of a neuron, after learning. In this way, the maintenance transcriptome would act as a metaplasticity mechanism that raises the threshold for change in neurons within an engram, helping to ensure the connectivity is stabilized and memory is maintained.

Behavioral tagging and capture: long-term memory decline in middle-aged rats

Decline in cognitive functions, including hippocampus-dependent spatial memory, is commonly observed at a later stage of aging (e.g., >20 months old in rodents) and typically studied after a discrete learning event. How normal aging, particularly at an early stage, affects the modulatory aspect of memory persistence is underinvestigated. Previous studies in young animals show that weak, fading memories can last longer if a modulating event, such as spatial novelty, is introduced around memory encoding. This is known as behavioral tagging and capture (BTC). Here, we investigated how early aging (10-13 months old) affects BTC in an appetitive delayed-matching-to-place task. We trained rats when they were young and middle aged and found that novelty facilitated long-term memory persistence in young but not in middle-aged rats. However, re-exposure to the encoded environment after learning improved memory persistence in middle-aged rats. BTC, combined with memory reactivation, facilitated memory persistence through reconsolidation. Our results point toward a weakened tagging and capture mechanism before reduction of plasticity-related proteins at an early stage of aging.

Synapse-specific representation of the identity of overlapping memory engrams

Memories are integrated into interconnected networks; nevertheless, each memory has its own identity. How the brain defines specific memory identity out of intermingled memories stored in a shared cell ensemble has remained elusive. We found that after complete retrograde amnesia of auditory fear conditioning in mice, optogenetic stimulation of the auditory inputs to the lateral amygdala failed to induce memory recall, implying that the memory engram no longer existed in that circuit. Complete amnesia of a given fear memory did not affect another linked fear memory encoded in the shared ensemble. Optogenetic potentiation or depotentiation of the plasticity at synapses specific to one memory affected the recall of only that memory. Thus, the sharing of engram cells underlies the linkage between memories, whereas synapse-specific plasticity guarantees the identity and storage of individual memories.

Behavioral, cellular, and synaptic tagging frameworks

Behavioral tagging is the transformation of a short-term memory induced by a weak experience into a long-term memory through temporal association with a novel experience. This phenomenon was discovered to recapitulate synaptic tagging and capture at the behavioral level. Significant progress has been made in determining the molecular machinery associated with synaptic tagging and capture and behavioral tagging theories. However, the tag setting and recruitment of plasticity-related proteins that occur within the spatiotemporally constrained cell ensemble at the network level (cellular tagging) in the brain where multimodal sensory information is input are just beginning to be understood. Here, we review the evidence for behavioral tagging and the mechanism underlying memory allocation at the network level leading to the overlap of cell ensembles. We also discuss the functional significance of overlapping cell ensembles in association of standard Pavlovian conditioning and distinct memories. Finally, we describe the role of neuronal ensemble overlap in behavioral tagging.

Memory allocation mechanisms underlie memory linking across time

Memories are dynamic in nature. A cohesive representation of the world requires memories to be altered over time, linked with other memories and eventually integrated into a larger framework of sematic knowledge. Although there is a considerable literature on how single memories are encoded, retrieved and updated, little is known about the mechanisms that govern memory linking, e.g., linking and integration of various memories across hours or days. In this review, we present evidence that specific memory allocation mechanisms, such as changes in CREB and intrinsic excitability, ensure memory storage in ways that facilitate effective recall and linking at a later time. Beyond CREB and intrinsic excitability, we also review a number of other phenomena with potential roles in memory linking.

Dopaminergic innervation and modulation of hippocampal networks

The catecholamine dopamine plays an important role in hippocampus-dependent plasticity and related learning and memory processes. Dopamine secretion in the hippocampus is activated by, e.g., salient or novel stimuli, thereby helping to establish and to stabilize hippocampus-dependent memories. Disturbed dopaminergic function in the hippocampus leads to severe pathophysiological conditions. While the role and importance of dopaminergic modulation of hippocampal networks have been unequivocally proven, there is still a lack of detailed molecular and cellular mechanistic understanding of how dopamine orchestrates these hippocampal processes. In this chapter of the special issue "Hippocampal structure and function," we will discuss the current understanding of dopaminergic modulation of basal synaptic transmission and long-lasting, activity-dependent potentiation or depression.

Behavioral and neural mechanisms by which prior experience impacts subsequent learning

Memory is often thought about in terms of its ability to recollect and store information about the past, but its function likely rests with the fact that it permits adaptation to ongoing and future experience. Thus, the brain circuitry that encodes memory must act as if stored information is likely to be modified by subsequent experience. Considerable progress has been made in identifying the behavioral and neural mechanisms supporting the acquisition and consolidation of memories, but this knowledge comes largely from studies in laboratory animals in which the training experience is presented in isolation from prior experimentally-controlled events. Given that memories are unlikely to be formed upon a clean slate, there is a clear need to understand how learning occurs upon the background of prior experience. This article reviews recent studies from an emerging body of work on metaplasticity, memory allocation, and synaptic tagging and capture, all of which demonstrate that prior experience can have a profound effect on subsequent learning. Special attention will be given to discussion of the neural mechanisms that allow past experience to affect future learning and to the time course by which past learning events can alter subsequent learning. Finally, consideration will be given to the possible significance of a non-synaptic component of the memory trace, which in some cases is likely responsible for the priming of subsequent learning and may be involved in the recovery from amnestic treatments in which the synaptic mechanisms of memory have been impaired.

Overlapping memory trace indispensable for linking, but not recalling, individual memories

Memories are not stored in isolation from other memories but are integrated into associative networks. However, the mechanisms underlying memory association remain elusive. Using two amygdala-dependent behavioral paradigms-conditioned taste aversion (CTA) and auditory-cued fear conditioning (AFC)-in mice, we found that presenting the conditioned stimulus used for the CTA task triggered the conditioned response of the AFC task after natural coreactivation of the memories. This was accompanied through an increase in the overlapping neuronal ensemble in the basolateral amygdala. Silencing of the overlapping ensemble suppressed CTA retrieval-induced freezing. However, retrieval of the original CTA or AFC memory was not affected. A small population of coshared neurons thus mediates the link between memories. They are not necessary for recalling individual memories.

Neuronal Nitric Oxide Synthase Contributes to PTZ Kindling-Induced Cognitive Impairment and Depressive-Like Behavior

Epilepsy is a chronic neurological disease which is usually associated with psychiatric comorbidities. Depsression and cognition impairment are considered to be the most common psychiatric comorbidities in epilepsy patients. However, the specific contribution of epilepsy made to these psychiatric comorbidities remains largely unknown. Here we use pentylenetetrazole (PTZ) kindling, a chronic epilepsy model, to identify neuronal nitric oxide synthase (nNOS) as a signaling molecule triggering PTZ kindling-induced cognitive impairment and depressive-like behavior. Furthermore, we identified that both hippocampal MAPK and PI3K/AKT signaling pathways were activated in response to PTZ kindling, and the increased MAPK and PI3K/AKT signaling activation was paralleled by increased level of reactive oxygen species (ROS) in the hippocampus. However, the PTZ kindling-induced MAPK, PI3K/AKT signaling activities and the ROS level were attenuated by nNOS gene deficiency, suggesting that nNOS may act through ROS-mediated MAPK and PI3K/AKT signaling pathways to trigger cognition deficit and depressive-like behavior in PTZ-kindled mice. Our findings thus define a specific mechanism for chronic epilepsy-induced cognitive impairment and depressive-like behavior, and identify a potential therapeutic target for psychiatric comorbidities in chronic epilepsy patients.

Locus Coeruleus and Dopamine-Dependent Memory Consolidation

Most everyday memories including many episodic-like memories that we may form automatically in the hippocampus (HPC) are forgotten, while some of them are retained for a long time by a memory stabilization process, called initial memory consolidation. Specifically, the retention of everyday memory is enhanced, in humans and animals, when something novel happens shortly before or after the time of encoding. Converging evidence has indicated that dopamine (DA) signaling via D₁/D₅ receptors in HPC is required for persistence of synaptic plasticity and memory, thereby playing an important role in the novelty-associated memory enhancement. In this review paper, we aim to provide an overview of the key findings related to D₁/D₅ receptor-dependent persistence of synaptic plasticity and memory in HPC, especially focusing on the emerging evidence for a role of the locus coeruleus (LC) in DA-dependent memory consolidation. We then refer to candidate brain areas and circuits that might be responsible for detection and transmission of the environmental novelty signal and molecular and anatomical evidence for the LC-DA system. We also discuss molecular mechanisms that might mediate the environmental novelty-associated memory enhancement, including plasticity-related proteins that are involved in initial memory consolidation processes in HPC.