Anisomycin infused into the hippocampus fails to block "reconsolidation" but impairs extinction: the role of re-exposure duration

The molecular memory code and synaptic plasticity: A synthesis

The most widely accepted view of memory in the brain holds that synapses are the storage sites of memory, and that memories are formed through associative modification of synapses. This view has been challenged on conceptual and empirical grounds. As an alternative, it has been proposed that molecules within the cell body are the storage sites of memory, and that memories are formed through biochemical operations on these molecules. This paper proposes a synthesis of these two views, grounded in a computational model of memory. Synapses are conceived as storage sites for the parameters of an approximate posterior probability distribution over latent causes. Intracellular molecules are conceived as storage sites for the parameters of a generative model. The model stipulates how these two components work together as part of an integrated algorithm for learning and inference.

Forget the stress: retrograde amnesia for the stress-induced impairment of extinction retrieval

We investigated whether cycloheximide (CHX) would induce amnesia for the stress-induced impairment of extinction retrieval. First, a single restraint stress session was demonstrated to impair extinction retrieval, but not fear conditioning. A second experiment showed that when CHX was administered immediately after restraint, rats exhibited significant extinction retrieval at test (i.e., retrograde amnesia for the stress). In a third experiment, the stress session impaired various amounts of extinction durations, suggesting that the stress inhibited extinction retrieval rather than enhancing the original fear learning. These results suggest memories for acute stress are susceptible to disruption, which could have clinical implications.

Monosomes actively translate synaptic mRNAs in neuronal processes

To accommodate their complex morphology, neurons localize messenger RNAs (mRNAs) and ribosomes near synapses to produce proteins locally. However, a relative paucity of polysomes (considered the active sites of translation) detected in electron micrographs of neuronal processes has suggested a limited capacity for local protein synthesis. In this study, we used polysome profiling together with ribosome footprinting of microdissected rodent synaptic regions to reveal a surprisingly high number of dendritic and/or axonal transcripts preferentially associated with monosomes (single ribosomes). Furthermore, the neuronal monosomes were in the process of active protein synthesis. Most mRNAs showed a similar translational status in the cell bodies and neurites, but some transcripts exhibited differential ribosome occupancy in the compartments. Monosome-preferring transcripts often encoded high-abundance synaptic proteins. Thus, monosome translation contributes to the local neuronal proteome.

Limited replicability of drug-induced amnesia after contextual fear memory retrieval in rats

With the ultimate goal of investigating boundary conditions for post-reactivation amnesia, we set out to replicate studies in which systemic, post-reactivation administration of midazolam, propranolol, or cycloheximide resulted in amnesia for contextual fear memories. Our experiments involved conceptual as well as exact replications of previously published studies. In most of our experiments, we adopted a procedure that conformed to the standard 3-day protocol typically used in the literature, with contextual fear conditioning on day 1, unreinforced re-exposure to the conditioning context followed by systemic injection of the amnestic drug on day 2, and a memory retention test on day 3. Given the plethora of successful studies with large effects sizes and the absence of any failed replications in the literature, we were surprised to find that we were generally unable to replicate those findings. Our results suggest that post-reactivation amnesia by systemic drug administration in rats is more difficult to obtain than what would be expected based on published empirical reports. At present, it remains unclear which conditions determine the success of this procedure.

Liposome-Encapsulated Morphine Affords a Prolonged Analgesia While Facilitating Extinction of Reward and Aversive Memories

Morphine is thoroughly used for pain control; however, it has a high addictive potential. Opioid liposome formulations produce controlled drug release and have been thoroughly tested for pain treatment although their role in addiction is still unknown. This study investigated the effects of free morphine and morphine encapsulated in unilamellar and multilamellar liposomes on antinociception and on the expression and extinction of the positive and negative memories associated with environmental cues. The hot plate test was used to measure central pain. The rewarding effects of morphine were analyzed by the conditioned-place preference (CPP) test, and the aversive aspects of naloxone-precipitated morphine withdrawal were evaluated by the conditioned-place aversion (CPA) paradigm. Our results show that encapsulated morphine yields prolonged antinociceptive effects compared with the free form, and that CPP and CPA expression were similar in the free- or encapsulated-morphine groups. However, we demonstrate, for the first time, that morphine encapsulation reduces the duration of reward and aversive memories, suggesting that this technological process could transform morphine into a potentially less addictive drug. Morphine encapsulation in liposomes could represent a pharmacological approach for enhancing extinction, which might lead to effective clinical treatments in drug addiction with fewer side effects.

Memory integration: An alternative to the consolidation/reconsolidation hypothesis

The original concept of consolidation considers that memory requires time to be fixed. Since 2000, a comparable protein-dependent re-stabilization phase, called reconsolidation, has been assumed to take place after memory retrieval. This consolidation/reconsolidation hypothesis, has dominated the literature for more than 50 years, despite compelling evidence that is inconsistent with it. In this review, we present an historical overview and explain how, despite serious criticisms, this hypothesis has persisted for decades and become accepted as a dogma. Based on both older and more recent evidence, we next propose the concept of memory integration which involves the linkage or embedding of new material into an already existing representation. We believe integration provides a viable explanation for retrograde amnesia in place of the consolidation/reconsolidation hypothesis. Integration can further be the basis for several major cases of memory alteration such as time dependent memory enhancement, interference, counter-conditioning, updating and other instances of memory malleability. In a final section we consider the implications this new concept may have for memory processes and its translational applications.

The Possible Role of Neurobeachin in Extinction of Contextual Fear Memory

Established fear memory becomes vulnerable to disruption after memory retrieval and extinction; this labile state is critical for inhibiting the return of fear memory. However, the labile state has a very narrow time window after retrieval, and underlying molecular mechanisms are not well known. To that end, we isolated the hippocampus immediately after fear memory retrieval and performed proteomics. We identified Neurobeachin (NBEA), an autism-related regulator of synaptic protein trafficking, to be upregulated after contextual fear memory retrieval. NBEA protein expression was rapid and transient after fear memory retrieval at the synapse. Nbea mRNA was enriched at the synapses, and the rapid induction of NBEA expression was blocked by inhibition of the mammalian target of rapamycin (mTOR)-dependent signaling pathway. Mice with cornu ammonis 1 (CA1)-specific Nbea shRNA knockdown showed normal fear acquisition and contextual fear memory but impaired extinction, suggesting an important role of Nbea in fear memory extinction processes. Consistently, Nbea heterozygotes showed normal fear acquisition and fear memory recall but showed impairment in extinction. Our data suggest that NBEA is necessary either for induction of memory lability or for the physiological process of memory extinction.

Genetic rodent models of brain disorders: Perspectives on experimental approaches and therapeutic strategies

Neurobehavioral disorders comprised of neurodegenerative, neurodevelopmental, and psychiatric disorders together represent leading causes of morbidity and mortality. Despite significant academic research and industry efforts to elucidate the disease mechanisms operative in these disorders and to develop mechanism‐based therapies, our understanding remains incomplete and our access to tractable therapeutic interventions severely limited. The magnitude of these short‐comings can be measured by the growing list of disappointing clinical trials based on initially promising compounds identified in genetic animal models. This review and commentary will explore why this may be so, focusing on the central role that genetic models of neurobehavioral disorders have come to occupy in current efforts to identify disease mechanisms and therapies. In particular, we will highlight the unique pitfalls and challenges that have hampered success in these models as compared to genetic models of non‐neurological diseases as well as to symptom‐based models of the early 20th century that led to the discovery of all major classes of psychoactive pharmaceutical compounds still used today. Using examples from specific genetic rodent models of human neurobehavioral disorders, we will highlight issues of reproducibility, construct validity, and translational relevance in the hopes that these examples will be instructive toward greater success in future endeavors. Lastly, we will champion a two‐pronged approach toward identifying novel therapies for neurobehavioral disorders that makes greater use of the historically more successful symptom‐based approaches in addition to more mechanism‐based approaches.

An Additional Prior Retrieval Alters the Effects of a Retrieval-Extinction Procedure on Recent and Remote Fear Memory

Several studies have shown that the isolated retrieval of a consolidated fear memory can induce a labile phase, during which extinction training can prevent the reinstatement, a form of relapse in which fear response to a fear-provoking context returns when a mild shock is presented. However, fear memory retrieval may also have another opposing result: the enhancement of fear memory. This implies that the fear memory trace can be modified by a brief retrieval. Unclear is whether the fear-impairing effect of retrieval-extinction (RE) is altered by a prior brief retrieval. The present study investigated the responses of recent and remote fear memories to the RE procedure after the presentation of an additional prior retrieval (priRet). We found that a single RE procedure effectively blocked the reinstatement of 2-day recent contextual fear memory. The memory-impairing effect of the RE procedure on recent fear was not observed when priRet was presented 6 or 24 h before the RE procedure. In contrast to the 2-day recent memory, the RE procedure failed to block the reinstatement of 36-day remote fear memory but successfully disrupted the return of remote fear memory after priRet. This memory-disruptive effect on remote memory did not occur when priRet was performed in a novel context. Nimodipine administration revealed that the blockade of priRet-induced processes recovered the effects of the RE procedure on both recent and remote fear memories. Our findings suggest that the susceptibility of recent and remote fear memories to RE procedures can be altered by an additional retrieval.

Can Memories of Traumatic Experiences or Addiction Be Erased or Modified? A Critical Review of Research on the Disruption of Memory Reconsolidation and Its Applications

Recent research suggests that the mere act of retrieving a memory can temporarily make that memory vulnerable to disruption. This process of "reconsolidation" will typically restabilize the neural representation of the memory and foster its long-term storage. However, the process of reconsolidating the memory takes time to complete, and during this limited time window, the original memory may be modified either by the presentation of new information or with pharmacological agents. Such findings have prompted rising interest in using disruption during reconsolidation as a clinical intervention for anxiety, posttraumatic stress, and substance use disorders. However, "boundary conditions" on memory reconsolidation may pose significant obstacles to clinical translation. The aim of this article is to critically examine the nature of these boundary conditions, their neurobiological substrates, and the potential effect they may have on disruption of reconsolidation as a clinical intervention. These boundary conditions also highlight potential constraints on the reconsolidation phenomenon and suggest a limited role for memory updating consistent with evolutionary accounts of associative learning for threat and reward. We conclude with suggestions for future research needed to elucidate the precise conditions under which reconsolidation disruption may be clinically useful.

Prior Learning of Relevant Nonaversive Information Is a Boundary Condition for Avoidance Memory Reconsolidation in the Rat Hippocampus

Reactivated memories can be modified during reconsolidation, making this process a potential therapeutic target for posttraumatic stress disorder (PTSD), a mental illness characterized by the recurring avoidance of situations that evoke trauma-related fears. However, avoidance memory reconsolidation depends on a set of still loosely defined boundary conditions, limiting the translational value of basic research. In particular, the involvement of the hippocampus in fear-motivated avoidance memory reconsolidation remains controversial. Combining behavioral and electrophysiological analyses in male Wistar rats, we found that previous learning of relevant nonaversive information is essential to elicit the participation of the hippocampus in avoidance memory reconsolidation, which is associated with an increase in theta- and gamma-oscillation power and cross-frequency coupling in dorsal CA1 during reactivation of the avoidance response. Our results indicate that the hippocampus is involved in memory reconsolidation only when reactivation results in contradictory representations regarding the consequences of avoidance and suggest that robust nesting of hippocampal theta-gamma rhythms at the time of retrieval is a specific reconsolidation marker.SIGNIFICANCE STATEMENT Posttraumatic stress disorder (PTSD) is characterized by maladaptive avoidance responses to stimuli or behaviors that represent or bear resemblance to some aspect of a traumatic experience. Disruption of reconsolidation, the process by which reactivated memories become susceptible to modifications, is a promising approach for treating PTSD patients. However, much of what is known about fear-motivated avoidance memory reconsolidation derives from studies based on fear conditioning instead of avoidance-learning paradigms. Using a step-down inhibitory avoidance task in rats, we found that the hippocampus is involved in memory reconsolidation only when the animals acquired the avoidance response in an environment that they had previously learned as safe and showed that increased theta- and gamma-oscillation coupling during reactivation is an electrophysiological signature of this process.

The computational nature of memory modification

Retrieving a memory can modify its influence on subsequent behavior. We develop a computational theory of memory modification, according to which modification of a memory trace occurs through classical associative learning, but which memory trace is eligible for modification depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience into statistically distinct clusters (latent causes). New memories are formed when the structure learning mechanism infers that a new latent cause underlies current sensory observations. By the same token, old memories are modified when old and new sensory observations are inferred to have been generated by the same latent cause. We derive this framework from probabilistic principles, and present a computational implementation. Simulations demonstrate that our model can reproduce the major experimental findings from studies of memory modification in the Pavlovian conditioning literature.

Translational Approaches Targeting Reconsolidation

Maladaptive learned responses and memories contribute to psychiatric disorders that constitute a significant socio-economic burden. Primary treatment methods teach patients to inhibit maladaptive responses, but do not get rid of the memory itself, which explains why many patients experience a return of symptoms even after initially successful treatment. This highlights the need to discover more persistent and robust techniques to diminish maladaptive learned behaviours. One potentially promising approach is to alter the original memory, as opposed to inhibiting it, by targeting memory reconsolidation. Recent research shows that reactivating an old memory results in a period of memory flexibility and requires restorage, or reconsolidation, for the memory to persist. This reconsolidation period allows a window for modification of a specific old memory. Renewal of memory flexibility following reactivation holds great clinical potential as it enables targeting reconsolidation and changing of specific learned responses and memories that contribute to maladaptive mental states and behaviours. Here, we will review translational research on non-human animals, healthy human subjects, and clinical populations aimed at altering memories by targeting reconsolidation using biological treatments (electrical stimulation, noradrenergic antagonists) or behavioural interference (reactivation-extinction paradigm). Both approaches have been used successfully to modify aversive and appetitive memories, yet effectiveness in treating clinical populations has been limited. We will discuss that memory flexibility depends on the type of memory tested and the brain regions that underlie specific types of memory. Further, when and how we can most effectively reactivate a memory and induce flexibility is largely unclear. Finally, the development of drugs that can target reconsolidation and are safe for use in humans would optimize cross-species translations. Increasing the understanding of the mechanism and limitations of memory flexibility upon reactivation should help optimize efficacy of treatments for psychiatric patients.

Immediate Extinction Attenuates Spontaneous Recovery and Reinstatement in a Passive Avoidance Paradigm

Recent research suggests that extinction occurring shortly after fear conditioning attenuates spontaneous recovery and reinstatement of fear. Two experiments investigated whether immediate extinction would prevent spontaneous recovery and reinstatement of fear using a passive avoidance paradigm. In Experiment 1, naive female adult rats (N = 40) received extinction training either immediately or 24 hours (delayed) after fear conditioning. Both extinction groups showed a significant reduction in fear at a 1-day test. At a 15-day test, spontaneous recovery was observed in the delayed extinction group while the immediate extinction group continued to show significant extinction. In Experiment 2, using a naive group of adult female rats (N = 16), the extinction result was replicated in both the immediate and delayed extinction groups at the 1-day interval. Reinstatement of fear, elicited by foot-shock in a neutral environment, was observed for the delayed group but not for the immediate group. By utilizing the passive-avoidance paradigm, these experiments replicate and extend previous findings that immediate extinction attenuates spontaneous recovery and reinstatement of fear.

The Regulation of Cytokine Networks in Hippocampal CA1 Differentiates Extinction from Those Required for the Maintenance of Contextual Fear Memory after Recall

We investigated the distinctiveness of gene regulatory networks in CA1 associated with the extinction of contextual fear memory (CFM) after recall using Affymetrix GeneChip Rat Genome 230 2.0 Arrays. These data were compared to previously published retrieval and reconsolidation-attributed, and consolidation datasets. A stringent dual normalization and pareto-scaled orthogonal partial least-square discriminant multivariate analysis together with a jack-knifing-based cross-validation approach was used on all datasets to reduce false positives. Consolidation, retrieval and extinction were correlated with distinct patterns of gene expression 2 hours later. Extinction-related gene expression was most distinct from the profile accompanying consolidation. A highly specific feature was the discrete regulation of neuroimmunological gene expression associated with retrieval and extinction. Immunity-associated genes of the tyrosine kinase receptor TGFβ and PDGF, and TNF families' characterized extinction. Cytokines and proinflammatory interleukins of the IL-1 and IL-6 families were enriched with the no-extinction retrieval condition. We used comparative genomics to predict transcription factor binding sites in proximal promoter regions of the retrieval-regulated genes. Retrieval that does not lead to extinction was associated with NF-κB-mediated gene expression. We confirmed differential NF-κBp65 expression, and activity in all of a representative sample of our candidate genes in the no-extinction condition. The differential regulation of cytokine networks after the acquisition and retrieval of CFM identifies the important contribution that neuroimmune signalling plays in normal hippocampal function. Further, targeting cytokine signalling upon retrieval offers a therapeutic strategy to promote extinction mechanisms in human disorders characterised by dysregulation of associative memory.

Postretrieval new learning does not reliably induce human memory updating via reconsolidation

Reconsolidation theory proposes that retrieval can destabilize an existing memory trace, opening a time-dependent window during which that trace is amenable to modification. Support for the theory is largely drawn from nonhuman animal studies that use invasive pharmacological or electroconvulsive interventions to disrupt a putative postretrieval restabilization ("reconsolidation") process. In human reconsolidation studies, however, it is often claimed that postretrieval new learning can be used as a means of "updating" or "rewriting" existing memory traces. This proposal warrants close scrutiny because the ability to modify information stored in the memory system has profound theoretical, clinical, and ethical implications. The present study aimed to replicate and extend a prominent 3-day motor-sequence learning study [Walker MP, Brakefield T, Hobson JA, Stickgold R (2003) Nature 425(6958):616-620] that is widely cited as a convincing demonstration of human reconsolidation. However, in four direct replication attempts (n = 64), we did not observe the critical impairment effect that has previously been taken to indicate disruption of an existing motor memory trace. In three additional conceptual replications (n = 48), we explored the broader validity of reconsolidation-updating theory by using a declarative recall task and sequences similar to phone numbers or computer passwords. Rather than inducing vulnerability to interference, memory retrieval appeared to aid the preservation of existing sequence knowledge relative to a no-retrieval control group. These findings suggest that memory retrieval followed by new learning does not reliably induce human memory updating via reconsolidation.

Rescue of long-term memory after reconsolidation blockade

Memory reconsolidation is considered to be the process whereby stored memories become labile on recall, allowing updating. Blocking the restabilization of a memory during reconsolidation is held to result in a permanent amnesia. The targeted knockdown of either Zif268 or Arc levels in the brain, and inhibition of protein synthesis, after a brief recall results in a non-recoverable retrograde amnesia, known as reconsolidation blockade. These experimental manipulations are seen as key proof for the existence of reconsolidation. However, here we demonstrate that despite disrupting the molecular correlates of reconsolidation in the hippocampus, rodents are still able to recover contextual memories. Our results challenge the view that reconsolidation is a separate memory process and instead suggest that the molecular events activated initially at recall act to constrain premature extinction.

Memory acquisition and retrieval impact different epigenetic processes that regulate gene expression

Background

A fundamental question in neuroscience is how memories are stored and retrieved in the brain. Long-term memory formation requires transcription, translation and epigenetic processes that control gene expression. Thus, characterizing genome-wide the transcriptional changes that occur after memory acquisition and retrieval is of broad interest and importance. Genome-wide technologies are commonly used to interrogate transcriptional changes in discovery-based approaches. Their ability to increase scientific insight beyond traditional candidate gene approaches, however, is usually hindered by batch effects and other sources of unwanted variation, which are particularly hard to control in the study of brain and behavior.

Results

We examined genome-wide gene expression after contextual conditioning in the mouse hippocampus, a brain region essential for learning and memory, at all the time-points in which inhibiting transcription has been shown to impair memory formation. We show that most of the variance in gene expression is not due to conditioning and that by removing unwanted variance through additional normalization we are able provide novel biological insights. In particular, we show that genes downregulated by memory acquisition and retrieval impact different functions: chromatin assembly and RNA processing, respectively. Levels of histone 2A variant H2AB are reduced only following acquisition, a finding we confirmed using quantitative proteomics. On the other hand, splicing factor Rbfox1 and NMDA receptor-dependent microRNA miR-219 are only downregulated after retrieval, accompanied by an increase in protein levels of miR-219 target CAMKIIγ.

Conclusions

We provide a thorough characterization of coding and non-coding gene expression during long-term memory formation. We demonstrate that unwanted variance dominates the signal in transcriptional studies of learning and memory and introduce the removal of unwanted variance through normalization as a necessary step for the analysis of genome-wide transcriptional studies in the context of brain and behavior. We show for the first time that histone variants are downregulated after memory acquisition, and splicing factors and microRNAs after memory retrieval. Our results provide mechanistic insights into the molecular basis of cognition by highlighting the differential involvement of epigenetic mechanisms, such as histone variants and post-transcriptional RNA regulation, after acquisition and retrieval of memory.

An isolated retrieval trial before extinction session does not prevent the return of fear

Several studies have shown that an isolated retrieval trial before the extinction session (retrieval-extinction) prevents the return of fear memory by inhibition of reconsolidation. Other studies have reported that retrieval-extinction did not prevent the return of the fear. To date, it is still unclear whether retrieval-extinction prevents the return of the original fear memory. A previous study revealed that reconsolidation of conditioned fear memory was not induced by the brevity of the retrieval session. Thus, we examined whether the number of retrievals in the retrieval-extinction paradigm was involved in the prevention of return of fear (Experiment 1). Furthermore, studies with different-age experimental subjects have shown conflicting results. We investigated the potential impact of age on the inhibitory effect of retrieval-extinction on the return of fear (Experiment 2). Our major findings were as follows: (1) Retrieval-extinction procedure did not prevent the return of fear, regardless of the intensity (number of presentations) of the stimulus inducing retrieval of fear memory. (2) The mice in both juvenile and adult age groups (4 and 8 weeks old) retrieved fear memory after retrieval-extinction. These results suggest the possibility that extinction after retrieval does not inhibit reconsolidation of previously consolidated fear memory.

Propranolol, post-traumatic stress disorder, and intensive care: incorporating new advances in psychiatry into the ICU

Post-traumatic stress disorder (PTSD) is a common complication of an ICU admission. Rarely is there a continuation of care, which is aimed at screening for and treating this debilitating disease. Current treatment options for PTSD are held back by inconsistent efficacy, poor evidence, and a lack of understanding of its psychopathology. Without 'gold standard' assessment techniques to diagnose PTSD after an ICU admission, the development of care pathways is hindered. This paper advocates for two interwoven advances in psychiatric care (specifically for PTSD) after ICU: (1) incorporate the monitoring and treating of psychiatric co-morbidities during extended patient follow-up, and (2) rapidly adopting the latest research to maximize its benefit. The discovery that memories were not fixed, but malleable to change, set off a sequence of experiments that have revolutionized the approach to treating PTSD. It is hoped that the phenomenon of reconsolidation can be exploited therapeutically. In the act of remembering and re-storing traumatic memories, propranolol can act to dissociate the state of sympathetic arousal from their recollection. Often, ICU patients have multiple physical co-morbidities that may be exacerbated, or their treatment disrupted, by such a pervasive psychological condition. The rapid uptake of new techniques, aimed at reducing PTSD after ICU admission, is necessary to maximize the quality of care given to patients. Increasingly, the realization that the role of intensive care specialists may extend beyond the ICU is changing clinical practice. As this field advances, intensivists and psychiatrists alike must collaborate by using the latest psychopharmacology to treat their patients and combat the psychological consequences of experiencing the extremes of physiological existence.

Epigenetic mechanisms of memory formation and reconsolidation

Memory consolidation involves transcriptional control of genes in neurons to stabilize a newly formed memory. Following retrieval, a once consolidated memory destabilizes and again requires gene transcription changes in order to restabilize, a process referred to as reconsolidation. Understanding the molecular mechanisms of gene transcription during the consolidation and reconsolidation processes could provide crucial insights into normal memory formation and memory dysfunction associated with psychiatric disorders. In the past decade, modifications of epigenetic markers such as DNA methylation and posttranslational modifications of histone proteins have emerged as critical transcriptional regulators of gene expression during initial memory formation and after retrieval. In light of the rapidly growing literature in this exciting area of research, we here examine the most recent and latest evidence demonstrating how memory acquisition and retrieval trigger epigenetic changes during the consolidation and reconsolidation phases to impact behavior. In particular we focus on the reconsolidation process, where we discuss the already identified epigenetic regulators of gene transcription during memory reconsolidation, while exploring other potential epigenetic modifications that may also be involved, and expand on how these epigenetic modifications may be precisely and temporally controlled by important signaling cascades critical to the reconsolidation process. Finally, we explore the possibility that epigenetic mechanisms may serve to regulate a system or circuit level reconsolidation process and may be involved in retrieval-dependent memory updating. Hence, we propose that epigenetic mechanisms coordinate changes in neuronal gene transcription, not only during the initial memory consolidation phase, but are triggered by retrieval to regulate molecular and cellular processes during memory reconsolidation.

Retrieval-induced NMDA receptor-dependent Arc expression in two models of cocaine-cue memory

The association of environmental cues with drugs of abuse results in persistent drug-cue memories. These memories contribute significantly to relapse among addicts. While conditioned place preference (CPP) is a well-established paradigm frequently used to examine the modulation of drug-cue memories, very few studies have used the non-preference-based model conditioned activity (CA) for this purpose. Here, we used both experimental approaches to investigate the neural substrates of cocaine-cue memories. First, we directly compared, in a consistent setting, the involvement of cortical and subcortical brain regions in cocaine-cue memory retrieval by quantifying activity-regulated cytoskeletal-associated (Arc) protein expression in both the CPP and CA models. Second, because NMDA receptor activation is required for Arc expression, we investigated the NMDA receptor dependency of memory persistence using the CA model. In both the CPP and CA models, drug-paired animals showed significant increases in Arc immunoreactivity in regions of the frontal cortex and amygdala compared to unpaired controls. Additionally, administration of a NMDA receptor antagonist (MK-801 or memantine) immediately after cocaine-CA memory reactivation impaired the subsequent conditioned locomotion associated with the cocaine-paired environment. The enhanced Arc expression evident in a subset of corticolimbic regions after retrieval of a cocaine-context memory, observed in both the CPP and CA paradigms, likely signifies that these regions: (i) are activated during retrieval of these memories irrespective of preference-based decisions, and (ii) undergo neuroplasticity in order to update information about cues previously associated with cocaine. This study also establishes the involvement of NMDA receptors in maintaining memories established using the CA model, a characteristic previously demonstrated using CPP. Overall, these results demonstrate the utility of the CA model for studies of cocaine-context memory and suggest the involvement of an NMDA receptor-dependent Arc induction pathway in drug-cue memory interference.

The strength of aversive and appetitive associations and maladaptive behaviors

Certain maladaptive behaviors are thought to be acquired through classical Pavlovian conditioning. Exaggerated fear response, which can develop through Pavlovian conditioning, is associated with acquired anxiety disorders such as post-traumatic stress disorders (PTSDs). Inflated reward-seeking behavior, which develops through Pavlovian conditioning, underlies some types of addictive behavior (e.g., addiction to drugs, food, and gambling). These maladaptive behaviors are dependent on associative learning and the development of long-term memory (LTM). In animal models, an aversive reinforcer (fear conditioning) encodes an aversive contextual and cued LTM. On the other hand, an appetitive reinforcer results in conditioned place preference (CPP) that encodes an appetitive contextual LTM. The literature on weak and strong associative learning pertaining to the development of aversive and appetitive LTM is relatively scarce; thus, this review is particularly focused on the strength of associative learning. The strength of associative learning is dependent on the valence of the reinforcer and the salience of the conditioned stimulus that ultimately sways the strength of the memory trace. Our studies suggest that labile (weak) aversive and appetitive LTM may share similar signaling pathways, whereas stable (strong) aversive and appetitive LTM is mediated through different pathways. In addition, we provide some evidence suggesting that extinction of aversive fear memory and appetitive drug memory is likely to be mediated through different signaling molecules. We put forward the importance of studies aimed to investigate the molecular mechanisms underlying the development of weak and strong memories (aversive and appetitive), which would ultimately help in the development of targeted pharmacotherapies for the management of maladaptive behaviors that arise from classical Pavlovian conditioning.

Neuropharmacology of memory consolidation and reconsolidation: Insights on central cholinergic mechanisms

Central cholinergic system is critically involved in all known memory processes. Endogenous acetylcholine release by cholinergic neurons is necessary for modulation of acquisition, encoding, consolidation, reconsolidation, extinction, retrieval and expression. Experiments from our laboratory are mainly focused on elucidating the mechanisms by which acetylcholine modulates memory processes. Blockade of hippocampal alpha-7-nicotinic receptors (α7-nAChRs) with the antagonist methyllycaconitine impairs memory reconsolidation. However, the administration of a α7-nAChR agonist (choline) produce a paradoxical modulation, causing memory enhancement in mice trained with a weak footshock, but memory impairment in animals trained with a strong footshock. All these effects are long-lasting, and depend on the age of the memory trace. This review summarizes and discusses some of our recent findings, particularly regarding the involvement of α7-nAChRs on memory reconsolidation.

Mechanisms governing the reactivation-dependent destabilization of memories and their role in extinction

The extinction of learned associations has traditionally been considered to involve new learning, which competes with the original memory for control over behavior. However, a recent resurgence of interest in reactivation-dependent amnesia has revealed that the retrieval of fear-related memory (with what is essentially a brief extinction session) can result in its destabilization. This review discusses some of the cellular and molecular mechanisms that are involved in the destabilization of a memory following its reactivation and/or extinction, and investigates the evidence that extinction may involve both new learning as well as a partial destabilization-induced erasure of the original memory trace.

Memory reconsolidation in aversive and appetitive settings

Memory reconsolidation has been observed across species and in a number of behavioral paradigms. The majority of memory reconsolidation studies have been carried out in Pavlovian fear conditioning and other aversive memory settings, with potential implications for the treatment of post-traumatic stress disorder. However, there is a growing literature on memory reconsolidation in appetitive reward-related memory paradigms, including translational models of drug addiction. While there appears to be substantial similarity in the basic phenomenon and underlying mechanisms of memory reconsolidation across unconditioned stimulus valence, there are also notable discrepancies. These arise both when comparing aversive to appetitive paradigms and also across different paradigms within the same valence of memory. We review the demonstration of memory reconsolidation across different aversive and appetitive memory paradigms, the commonalities and differences in underlying mechanisms and the conditions under which each memory undergoes reconsolidation. We focus particularly on whether principles derived from the aversive literature are applicable to appetitive settings, and also whether the expanding literature in appetitive paradigms is informative for fear memory reconsolidation.

Competitive Trace Theory: A Role for the Hippocampus in Contextual Interference during Retrieval

Much controversy exists regarding the role of the hippocampus in retrieval. The two dominant and competing accounts have been the Standard Model of Systems Consolidation (SMSC) and Multiple Trace Theory (MTT), which specifically make opposing predictions as to the necessity of the hippocampus for retrieval of remote memories. Under SMSC, memories eventually become independent of the hippocampus as they become more reliant on cortical connectivity, and thus the hippocampus is not required for retrieval of remote memories, only recent ones. MTT on the other hand claims that the hippocampus is always required no matter the age of the memory. We argue that this dissociation may be too simplistic, and a continuum model may be better suited to address the role of the hippocampus in retrieval of remote memories. Such a model is presented here with the main function of the hippocampus during retrieval being "recontextualization," or the reconstruction of memory using overlapping traces. As memories get older, they are decontextualized due to competition among partially overlapping traces and become more semantic and reliant on neocortical storage. In this framework dubbed the Competitive Trace Theory (CTT), consolidation events that lead to the strengthening of memories enhance conceptual knowledge (semantic memory) at the expense of contextual details (episodic memory). As a result, remote memories are more likely to have a stronger semantic representation. At the same time, remote memories are also more likely to include illusory details. The CTT is a novel candidate model that may provide some resolution to the memory consolidation debate.

Reconsolidation and extinction of an appetitive pavlovian memory

When memories are retrieved, they can enter a labile state during which the memory may be modified and subsequently restabilized through the process of reconsolidation. However, this does not occur in all situations, and certain "boundary conditions" determine whether a memory will undergo reconsolidation. Naïve male lister hooded rats were trained for 5 days to press a lever in order to retrieve a food reward associated with a pavlovian light stimulus. Three days post-training, animals were injected with either MK-801 (0.1 mgkg(-1); i.p.) or saline vehicle, 30 min before they were placed back into the training context for a retrieval session. Lever pressing was reinforced only by the light stimulus and was restricted to either 10, 30 or 50 presentations of the light conditioned stimulus. After 48 h, animals were again returned to the boxes and light-reinforced lever-pressing activity was recorded. MK-801-treated animals in the 10CS group significantly reduced lever pressing at test, compared to saline controls. In contrast, MK-801-treated rats in the 50CS group demonstrated a significant increase. There was no effect of MK-801 in the 30CS group. Additionally, there were no effects of MK-801 in an analogous, pure instrumental, setting when the cue lights were omitted. The opposing effects of MK-801 under different parametric conditions likely reflect impairments of appetitive pavlovian memory reconsolidation and extinction, respectively. These results demonstrate a competition between reconsolidation and extinction. However, there are also conditions under which MK-801 fails to impair either process.

Post-retrieval extinction as reconsolidation interference: methodological issues or boundary conditions?

Memories that are emotionally arousing generally promote the survival of species; however, the systems that modulate emotional learning can go awry, resulting in pathological conditions such as post-traumatic stress disorders, phobias, and addiction. Understanding the conditions under which emotional memories can be targeted is a major research focus as the potential to translate these methods into clinical populations carries important implications. It has been demonstrated that both fear and drug-related memories can be destabilised at their retrieval and require reconsolidation to be maintained. Therefore, memory reconsolidation offers a potential target period during which the aberrant memories underlying psychiatric disorders can be disrupted. Monfils et al. (Science 324:951-955, 2009) have shown for the first time that safe information provided through an extinction session after retrieval (during the reconsolidation window) may update the original memory trace and prevent the return of fear in rats. In recent years, several authors have then tested the effect of post-retrieval extinction on reconsolidation of either fear or drug-related memories in both laboratory animals and humans. In this article, we review the literature on post-reactivation extinction, discuss the differences across studies on the methodological ground, and review the potential boundary conditions that may explain existing discrepancies and limit the potential application of post-reactivation extinction approaches.

Learning to forget: manipulating extinction and reconsolidation processes to treat addiction

Finding effective long-lasting treatments for drug addiction has been an elusive goal. Consequently, researchers are beginning to investigate novel treatment strategies including manipulations of drug-associated memories. When environmental stimuli (cues) become associated with drug use, they become powerful motivators of continued drug use and relapse after abstinence. Reducing the strength of these cue-drug memories could decrease the number of factors that induce craving and relapse to aid in the treatment of addiction. Enhancing the consolidation of extinction learning and/or disrupting cue-drug memory reconsolidation are two strategies that have been proposed to reduce the strength of cues in motivating drug-seeking and drug-taking behavior. Here, we review the latest basic and clinical research elucidating the mechanisms underlying consolidation of extinction and reconsolidation of cue-drug memories in the hopes of developing pharmacological tools that exploit these signaling systems to treat addiction.

The Plasticity of Extinction: Contribution of the Prefrontal Cortex in Treating Addiction through Inhibitory Learning

Theories of drug addiction that incorporate various concepts from the fields of learning and memory have led to the idea that classical and operant conditioning principles underlie the compulsiveness of addictive behaviors. Relapse often results from exposure to drug-associated cues, and the ability to extinguish these conditioned behaviors through inhibitory learning could serve as a potential therapeutic approach for those who suffer from addiction. This review will examine the evidence that extinction learning alters neuronal plasticity in specific brain regions and pathways. In particular, subregions of the prefrontal cortex (PFC) and their projections to other brain regions have been shown to differentially modulate drug-seeking and extinction behavior. Additionally, there is a growing body of research demonstrating that manipulation of neuronal plasticity can alter extinction learning. Therefore, the ability to alter plasticity within areas of the PFC through pharmacological manipulation could facilitate the acquisition of extinction and provide a novel intervention to aid in the extinction of drug-related memories.

The effect of phosphodiesterase inhibitors on the extinction of cocaine-induced conditioned place preference in mice

Several phosphodiesterase inhibitors (PDEis) improve cognition, suggesting that an increase in brain cAMP and cGMP facilitates learning and memory. Since extinction of drug-seeking behavior requires associative learning, consolidation and formation of new memory, the present study investigated the efficacy of three different PDEis in the extinction of cocaine-induced conditioned place preference (CPP) in B6129S mice. Mice were conditioned by escalating doses of cocaine which was resistant to extinction by free exploration. Immediately following each extinction session mice received (a) saline/vehicle, (b) rolipram (PDE4 inhibitor), (c) BAY-73-6691 (PDE9 inhibitor) or (d) papaverine (PDE10A inhibitor). Mice that received saline/vehicle during extinction training showed no reduction in CPP for >10 days. BAY-73-6691 (a) dose-dependently increased cGMP in hippocampus and amygdala, (b) significantly facilitated extinction and (c) diminished the reinstatement of cocaine CPP. Rolipram, which selectively increased brain cAMP levels, and papaverine which caused increases in both cAMP and cGMP levels, had no significant effect on the extinction of cocaine CPP. The results suggest that increase in hippocampal and amygdalar cGMP levels via blockade of PDE9 has a prominent role in the consolidation of extinction learning.

Facilitated extinction of morphine conditioned place preference with Tat-GluA2(3Y) interference peptide

Neuroplasticity including long-term depression (LTD) has been implicated in both learning processes and addiction. LTD can be blocked by intravenous administration of the interference peptide Tat-GluA2(3Y) that prevents regulated endocytosis of the alpha-amino-3-hydroxy-5-methyl-isoxazole-4-propionic acid (AMPA) receptor. In this study, Tat-GluA2(3Y) was used to assess the role of LTD in the induction, expression, extinction and reinstatement of morphine-induced conditioned place preference (CPP). CPP was established in rats by pairing morphine (5 mg/kg, i.p.) or saline with a specific environmental context using a balanced protocol. Tat-GluA2(3Y) (0; 1.5; 2.25 nmol/g; i.v.), scrambled peptide (Tat-GluA2(Sc)), or vehicle was administered during the acquisition phase or prior to the test for CPP. Tat-GluA2(3Y) had no effect on the induction or initial expression of morphine-induced CPP. Rats that received Tat-GluA2(3Y) or Tat-GluA2(Sc) during acquisition were subsequently tested for 11 consecutive days in order to extinguish morphine CPP. CPP was then reinstated by an injection of morphine (5 mg/kg, i.p.). Co-administration of morphine and Tat-GluA2(3Y) during acquisition greatly facilitated extinction of CPP without affecting morphine-induced reinstatement of CPP. Using an intermittent retest schedule with bi-weekly tests to measure the maintenance of CPP, Tat-GluA2(3Y) during the acquisition phase had no effect on the maintenance of CPP. We propose that co-administration of Tat-GluA2(3Y) with morphine during acquisition of CPP weakens the association between morphine and contextual cues leading to rapid extinction of morphine CPP with repeated daily testing.

The role of metaplasticity mechanisms in regulating memory destabilization and reconsolidation

Memory allows organisms to predict future events based on prior experiences. This requires encoded information to persist once important predictors are extracted, while also being modifiable in response to changes within the environment. Memory reconsolidation may allow stored information to be modified in response to related experience. However, there are many boundary conditions beyond which reconsolidation may not occur. One interpretation of these findings is that the event triggering memory retrieval must contain new information about a familiar stimulus in order to induce reconsolidation. Presently, the mechanisms that affect the likelihood of reconsolidation occurring under these conditions are not well understood. Here we speculate on a number of systems that may play a role in protecting memory from being destabilized during retrieval. We conclude that few memories may enter a state in which they cannot be modified. Rather, metaplasticity mechanisms may serve to alter the specific reactivation cues necessary to destabilize a memory. This might imply that destabilization mechanisms can differ depending on learning conditions.

Post-retrieval propranolol treatment does not modulate reconsolidation or extinction of ethanol-induced conditioned place preference

The reconsolidation hypothesis posits that established emotional memories, when reactivated, become labile and susceptible to disruption. Post-retrieval injection of propranolol (PRO), a nonspecific β-adrenergic receptor antagonist, impairs subsequent retention performance of a cocaine- and a morphine-induced conditioned place preference (CPP), implicating the noradrenergic system in the reconsolidation processes of drug-seeking behavior. An important question is whether post-retrieval PRO disrupts memory for the drug-cue associations, or instead interferes with extinction. In the present study, we evaluated the role of the β-adrenergic system on the reconsolidation and extinction of ethanol-induced CPP. Male DBA/2J mice were trained using a weak or a strong conditioning procedure, achieved by varying the ethanol conditioning dose (1 or 2 g/kg) and the number of ethanol trials (2 or 4). After acquisition of ethanol CPP, animals were given a single post-retrieval injection of PRO (0, 10 or 30 mg/kg) and tested for memory reconsolidation 24 h later. Also, after the first reconsolidation test, mice received 18 additional 15-min choice extinction tests in which PRO was injected immediately after every test. Contrary to the prediction of the reconsolidation hypothesis, a single PRO injection after the retrieval test did not modify subsequent memory retention. In addition, repeated post-retrieval administration of PRO did not interfere with extinction of CPP in mice. Overall, our data suggest that the β-adrenergic receptor does not modulate the associative processes underlying ethanol CPP.

Inhibition of mTOR by rapamycin in the amygdala or hippocampus impairs formation and reconsolidation of inhibitory avoidance memory

Mammalian target of rapamycin (mTOR), a central regulator of protein synthesis in neurons, has been implicated in synaptic plasticity and memory. Here we show that mTOR inhibition by rapamycin in the basolateral amygdala (BLA) or dorsal hippocampus (DH) impairs both formation and reconsolidation of memory for inhibitory avoidance (IA) in rats. Male Wistar rats received bilateral infusions of vehicle or rapamycin into the BLA or DH before or after IA training or retrieval. Memory retention was tested at different time points after drug infusion. Rapamycin impaired long-term IA retention when given before or immediately after training or retrieval into the BLA. When infused into the DH, rapamycin produced memory impairment when given before training or immediately after retrieval. The impairing effects of post-retrieval rapamycin required memory retrieval and were not reversed by a reminder shock. The results provide the first evidence that mTOR in the BLA and DH might play a role in IA memory reconsolidation.

Consolidation and reconsolidation: two lives of memories?

Most studies on memory consolidation consider the new information as if it were imposed on a tabula rasa, but considerable evidence indicates that new memories must be interleaved within a large network of relevant pre-existing knowledge. Early studies on reconsolidation highlighted that a newly consolidated memory could be erased after reactivation, but new evidence has shown that an effective reactivation experience must also involve memory reorganization to incorporate new learning. The combination of these observations on consolidation and reconsolidation highlights the fundamental similarities of both phenomena as the integration of new information and old, and it suggests reconsolidation = consolidation as a neverending process of schema modification.

Generalization of fear inhibition by disrupting hippocampal protein synthesis-dependent reconsolidation process

Repetitive replay of fear memories may precipitate the occurrence of post-traumatic stress disorder and other anxiety disorders. Hence, the suppression of fear memory retrieval may help prevent and treat these disorders. The formation of fear memories is often linked to multiple environmental cues and these interconnected cues may act as reminders for the recall of traumatic experiences. However, as a convenience, a simple paradigm of one cue pairing with the aversive stimulus is usually used in studies of fear conditioning in animals. Here, we built a more complex fear conditioning model by presenting several environmental stimuli during fear conditioning and characterize the effectiveness of extinction training and the disruption of reconsolidation process on the expression of learned fear responses. We demonstrate that extinction training with a single-paired cue resulted in cue-specific attenuation of fear responses but responses to other cures were unchanged. The cue-specific nature of the extinction persisted despite training sessions combined with D-cycloserine treatment reveals a significant weakness in extinction-based treatment. In contrast, the inhibition of the dorsal hippocampus (DH) but not the basolateral amygdala (BLA)-dependent memory reconsolidation process using either protein synthesis inhibitors or genetic disruption of cAMP-response-element-binding protein-mediated transcription comprehensively disrupted the learned connections between fear responses and all paired environmental cues. These findings emphasize the distinct role of the DH and the BLA in the reconsolidation process of fear memories and further indicate that the disruption of memory reconsolidation process in the DH may result in generalization of fear inhibition.

Seeking a spotless mind: extinction, deconsolidation, and erasure of fear memory

Learning to contend with threats in the environment is essential to survival, but dysregulation of memories for traumatic events can lead to disabling psychopathology. Recent years have witnessed an impressive growth in our understanding of the neural systems and synaptic mechanisms underlying emotional memory formation. As a consequence, interest has emerged in developing strategies for suppressing, if not eliminating, fear memories. Here, I review recent work employing sophisticated behavioral, pharmacological, and molecular tools to target fear memories, placing these memories firmly behind the crosshairs of neurobiologically informed interventions.

Memory retrieval and the passage of time: from reconsolidation and strengthening to extinction

An established memory can be made transiently labile if retrieved or reactivated. Over time, it becomes again resistant to disruption and this process that renders the memory stable is termed reconsolidation. The reasons why a memory becomes labile after retrieval and reconsolidates still remains debated. Here, using inhibitory avoidance learning in rats, we provide evidence that retrievals of a young memory, which are accompanied by its reconsolidation, result in memory strengthening and contribute to its overall consolidation. This function associated to reconsolidation is temporally limited. With the passage of time, the stored memory undergoes important changes, as revealed by the behavioral outcomes of its retrieval. Over time, without explicit retrievals, memory first strengthens and becomes refractory to both retrieval-dependent interference and strengthening. At later times, the same retrievals that lead to reconsolidation of a young memory extinguish an older memory. We conclude that the storage of information is very dynamic and that its temporal evolution regulates behavioral outcomes. These results are important for potential clinical applications.

Extinction of appetitive learning is disrupted by cycloheximide and propranolol in the sand maze in rats

The present study investigated whether memory for extinction in an appetitive task (the sand maze) could be attenuated by administration of cycloheximide (protein synthesis inhibitor) or propranolol (β-adrenergic receptor antagonist). Ninety-day-old male Long-Evans rats were trained to retrieve a sweet cereal reinforcer from an open container in the sand maze. One day following this non-spatial training, rats received three extinction trials in which they were placed in the maze with the reinforcer present, but unattainable. Thirty minutes prior to the first extinction trial, rats received an intraperitoneal injection of cycloheximide (1mg/kg), propranolol (25mg/kg), or vehicle (1mg/kg distilled water). Twenty-four hours later, rats were tested in the sand maze with the reinforcer again available. Results from the test trial showed that both cycloheximide and propranolol groups found the reinforcer more quickly than controls. Two weeks later, rats were trained on a spatial version of the sand maze in which they had to search for a buried reinforcer using extramaze cues. Cycloheximide and propranolol groups learned this task significantly faster than the control group, demonstrating the long-lasting effect of cycloheximide and propranolol on the blocking of memory for extinction.