Updating appetitive memory during reconsolidation window: critical role of cue-directed behavior and amygdala central nucleus

Memory reactivation mediates emotional valence updating of contextual memory in mice with protracted morphine withdrawal

Mice subjected to morphine locomotor sensitization develop increased anxiety-behavior expression during protracted morphine withdrawal. This behavioral change is dependent on reexposure to the context of locomotor sensitization and reflects a state of conditioned anxiety. In this study, the effect of memory reconsolidation on the expression of conditioned anxiety in mice with protracted morphine withdrawal was examined. Five experimental protocols involving male C57BL/6 mice were used in which the animals were subjected to locomotor sensitization induced by morphine and reexposed to the context associated with the drug effect 28 days after locomotor sensitization and immediately after subjected to elevated plus maze. In experiment 1, mice were subjected or not to memory reactivation session and was observed that memory reactivation 27 days after sensitization reduced conditioned anxiety. In experiment 2, mice were subjected to memory reactivation, 24 h, 6 h or 1 h before contextual reexposure, and the effect of memory reactivation coincided with the temporal requirement for reconsolidation. In experiment 3, which involved exposure to a situation of acute stress immediately before memory reactivation, the mice demonstrated a return to increased conditioned anxiety. To confirm the influence of reconsolidation, in experiments 4 and 5, mice subjected to memory reactivation were treated with Nimodipine, diazepam or cyclohexamine, substances commonly used as pharmacological controls in reconsolidation experiments. Treatment with each substance separately inhibited the effect of reactivation in experiment 5 (presence of acute stressor) but not in experiment 4 (absence of acute stressor). These results suggest that, in our experimental model, reconsolidation is mediated through updating of the emotional valence of contextual memory associated with the administration of morphine.

Spatial contextual recognition memory updating is modulated by dopamine release in the dorsal hippocampus from the locus coeruleus

Detecting novelty is critical to consolidate declarative memories, such as spatial contextual recognition memory. It has been shown that stored memories, when retrieved, are susceptible to modification, incorporating new information through an updating process. Catecholamine release in the hippocampal CA1 region consolidates an object location memory (OLM). This work hypothesized that spatial contextual memory updating could be changed by decreasing catecholamine release in the hippocampal CA1 terminals from the locus coeruleus (LC). In a mouse model expressing Cre-recombinase under the control of the tyrosine hydroxylase (TH) promoter, memory updating was impaired by photoinhibition of the CA1 catecholaminergic terminals from the LC (LC-CA1) but not from the ventral tegmental area (VTA-CA1). In vivo microdialysis confirmed that the extracellular concentration of both dopamine (DA) and noradrenaline (NA) decreased after photoinhibition of the LC-CA1 terminals (but not VTA-CA1) during the OLM update session. Furthermore, DA D1/D5 and beta-adrenergic receptor antagonists disrupted behavior, but only the former impaired memory updating. Finally, photoinhibition of LC-CA1 terminals suppressed long-term potentiation (LTP) induction in Schaffer's collaterals as a plausible mechanism for memory updating. These data will help understand the underpinning mechanisms of DA in spatial contextual memory updating.

Friend recollections, and a collection of collaborations with Nadia

In this selective review article, we showcase our collaborations with our colleague, Dr. Nadia Chaudhri. Dr. Chaudhri was an esteemed colleague and researcher who contributed greatly to our understanding of Pavlovian alcohol conditioning. From 2014 to 2019, we collaborated with Nadia. Here, we reflect on our friendship, the work we did together, and the continued impact on the field.

Basolateral amygdala corticotropin-releasing factor receptor type 1 regulates context-cocaine memory strength during reconsolidation in a sex-dependent manner

The basolateral amygdala (BLA) is a critical brain region for cocaine-memory reconsolidation. Corticotropin-releasing factor receptor type 1 (CRFR1) is densely expressed in the BLA, and CRFR1 stimulation can activate intra-cellular signaling cascades that mediate memory reconsolidation. Hence, we tested the hypothesis that BLA CRFR1 stimulation is necessary and sufficient for cocaine-memory reconsolidation. Using an instrumental model of drug relapse, male and female Sprague-Dawley rats received cocaine self-administration training in a distinct environmental context over 10 days followed by extinction training in a different context over 7 days. Next, rats were re-exposed to the cocaine-paired context for 15 min to initiate cocaine-memory retrieval and destabilization. Immediately or 6 h after this session, the rats received bilateral vehicle, antalarmin (CRFR1 antagonist; 500 ng/hemisphere), or corticotropin-releasing factor (CRF; 0.2, 30 or 500 ng/hemisphere) infusions into the BLA. Resulting changes in drug context-induced cocaine seeking (index of context-cocaine memory strength) were assessed three days later. Female rats self-administered more cocaine infusions and exhibited more extinction responding than males. Intra-BLA antalarmin treatment immediately after memory retrieval (i.e., when cocaine memories were labile), but not 6 h later (i.e., after memory reconsolidation), attenuated drug context-induced cocaine seeking at test independent of sex, relative to vehicle. Conversely, intra-BLA CRF treatment increased this behavior selectively in females, in a U-shaped dose-dependent fashion. In control experiments, a high (behaviorally ineffective) dose of CRF treatment did not reduce BLA CRFR1 cell-surface expression in females. Thus, BLA CRFR1 signaling is necessary and sufficient, in a sex-dependent manner, for regulating cocaine-memory strength.

Positive and Neutral Updating Reconsolidate Aversive Episodic Memories via Different Routes

Aversive memories are long-lasting and prone to burden our emotional wellbeing and mental health. Yet, how to remedy the maladaptive effects of aversive memories remains elusive. Using memory reactivation and emotional updating manipulations, we investigated how positive and neutral emotion may update aversive memories for reconsolidation in humans. We found that positive updating after reactivation was equivalent to neutral updating in impairing true memories of a previous aversive event after a 12-hour wakeful delay, but induced more false memory. Moreover, additional 12-hour delay with overnight sleep did not further enlarge true memory differences, but attenuated the effect of reactivation and updating on false memory. Interestingly, the neutral rather than the positive updating reduced the emotional arousal of the aversive memory 24 hours later. Our findings could serve as references for real-world therapeutic applications regarding how positive and neutral updating may reshape aversive memories, especially when taking wake- and sleep-filled reconsolidation into account.

Targeting the Reconsolidation of Licit Drug Memories to Prevent Relapse: Focus on Alcohol and Nicotine

Alcohol and nicotine are widely abused legal substances worldwide. Relapse to alcohol or tobacco seeking and consumption after abstinence is a major clinical challenge, and is often evoked by cue-induced craving. Therefore, disruption of the memory for the cue–drug association is expected to suppress relapse. Memories have been postulated to become labile shortly after their retrieval, during a “memory reconsolidation” process. Interference with the reconsolidation of drug-associated memories has been suggested as a possible strategy to reduce or even prevent cue-induced craving and relapse. Here, we surveyed the growing body of studies in animal models and in humans assessing the effectiveness of pharmacological or behavioral manipulations in reducing relapse by interfering with the reconsolidation of alcohol and nicotine/tobacco memories. Our review points to the potential of targeting the reconsolidation of these memories as a strategy to suppress relapse to alcohol drinking and tobacco smoking. However, we discuss several critical limitations and boundary conditions, which should be considered to improve the consistency and replicability in the field, and for development of an efficient reconsolidation-based relapse-prevention therapy.

Retrieval-Extinction and Relapse Prevention: Rewriting Maladaptive Drug Memories?

Addicted individuals are highly susceptible to relapse when exposed to drug-associated conditioned stimuli (CSs; "drug cues") even after extensive periods of abstinence. Until recently, these maladaptive emotional drug memories were believed to be permanent and resistant to change. The rediscovery of the phenomenon of memory reconsolidation-by which retrieval of the memory can, under certain conditions, destabilize the previously stable memory before it restabilizes in its new, updated form-has led to the hypothesis that it may be possible to disrupt the strong maladaptive drug-memories that trigger a relapse. Furthermore, recent work has suggested that extinction training "within the reconsolidation window" may lead to a long-term reduction in relapse without the requirement for pharmacological amnestic agents. However, this so-called "retrieval-extinction" effect has been inconsistently observed in the literature, leading some to speculate that rather than reflecting memory updating, it may be the product of facilitation of extinction. In this mini review article, we will focus on factors that might be responsible for the retrieval-extinction effects on preventing drug-seeking relapse and how inter-individual differences may influence this therapeutically promising effect. A better understanding of the psychological and neurobiological mechanisms underpinning the "retrieval-extinction" paradigm, and individual differences in boundary conditions, should provide insights with the potential to optimize the translation of "retrieval-extinction" to clinical populations.

Reactivation of the Unconditioned Stimulus Inhibits the Return of Fear Independent of Cortisol

Reconsolidation is the post-retrieval stabilization of memories, a time-limited process during which reactivated (i.e., retrieved) memories can be updated with new information, become stronger or weaker, depending on the specific treatment. We have previously shown that the stress hormone cortisol has an enhancing effect on the reconsolidation of fear memories in men. This effect was specific, i.e., limited to the conditioned stimulus (CS) that was reactivated, and did not generalize to other previously reinforced, but not reactivated CS. Based on these results, we suggested that cortisol plays a critical role in the continuous strengthening of reactivated emotional memories, contributing to their persistence and robustness. In the current study, we aimed to achieve a more generalized reconsolidation enhancement using an alternative reactivation method, i.e., by a low-intensity unconditioned stimulus (UCS) presentation instead of the more common unreinforced CS presentation. In previous studies, UCS reactivation was shown to lead to a more generalized reconsolidation effect. Therefore, we hypothesized that the combination of cortisol treatment and UCS reactivation would lead to an enhanced fear memory reconsolidation, which would generalize from previously reinforced CS to stimuli that resemble it. We tested 75 men in a 3-day fear conditioning paradigm: fear acquisition training on day 1; UCS reactivation/no reactivation and pharmacological treatment (20 mg hydrocortisone/placebo) on day 2; extinction training, reinstatement and test (of original and modified stimuli) on day 3. In contrast to our hypothesis, UCS reactivation prevented the return of fear [observed in skin conductance responses (SCR)] regardless of the pharmacological manipulation: while reinstatement to the original CS was found in the no-reactivation group, both reactivation groups (cortisol and placebo) showed no reinstatement. As the only methodological difference between our previous study and the current one was the reactivation method, we focus on UCS reactivation as the main explanation for these unexpected findings. We suggest that the robust prediction error generated by the UCS reactivation method (as opposed to CS reactivation), combined with the lower UCS intensity, has by itself weakened the emotional value of the UCS, thus preventing the return of fear to the CS that was associated with it. We call for future research to support these findings and to examine the potential of this reactivation method, or variations thereof, as a tool for therapeutic use.

Detrimental Effects of a Retrieval-Extinction Procedure on Nicotine Seeking, but Not Cocaine Seeking

Retrieval-extinction memory reactivation procedures have been used to prevent the return of learned fear and drug seeking in preclinical models. These procedures first reactivate the original memory with a brief cue exposure (i.e., retrieval) session, and then disrupt memory reconsolidation by conducting extinction training within the reconsolidation window. The original memory is thought to be updated with the new information conveyed by extinction learning, resulting in a persistent therapeutic effect beyond that observed with extinction training alone (i.e., no retrieval). Here, we attempted to replicate the therapeutic effects on cocaine seeking reported by Xue et al. (2012), and extend these findings to nicotine seeking. Rats self-administered either cocaine or nicotine with contingent cues for weeks, and were then divided into two groups. The retrieval group underwent a 10-min retrieval session wherein drug cues were available, but drug was not. Ten minutes later, they were allowed to continue cue extinction training for an additional 60 min. The no retrieval group underwent a contiguous 70-min cue extinction session. These procedures continued for weeks, followed by a test for spontaneous recovery of drug seeking. No group differences were observed on any measure of cocaine seeking, although both groups exhibited extinction and spontaneous recovery. By contrast, for nicotine seeking, the retrieval group exhibited resistance to extinction, an effect that persisted on the spontaneous recovery test. These findings underscore the importance of drug type in the outcome of retrieval-extinction procedures and moreover indicate that retrieval-extinction procedures can be detrimental to nicotine seeking.

Counterconditioning following memory retrieval diminishes the reinstatement of appetitive memories in humans

Appetitive memories play a crucial role in learning and behavior, but under certain circumstances, such memories become maladaptive and play a vital role in addiction and other psychopathologies. Recent scientific research has demonstrated that memories can be modified following their reactivation through memory retrieval in a process termed memory reconsolidation. Several nonpharmacological behavioral manipulations yielded mixed results in their capacity to alter maladaptive memories in humans. Here, we aimed to translate the promising findings observed in rodents to humans. We constructed a novel three-day procedure using aversive counterconditioning to alter appetitive memories after short memory retrieval. On the first day, we used appetitive conditioning to form appetitive memories. On the second day, we retrieved these appetitive memories in one group (Retrieval group) but not in a second group. Subsequently, all participants underwent counterconditioning. On the third day, we attempted to reinstate the appetitive memories from day one. We observed a significant reduction in the reinstatement of the original appetitive memory when counterconditioning was induced following memory retrieval. Here, we provide a novel human paradigm that models several memory processes and demonstrate memory attenuation when counterconditioned after its retrieval. This paradigm can be used to study complex appetitive memory dynamics, e.g., memory reconsolidation and its underlying brain mechanisms.

Differential effects of unipolar versus bipolar depression on episodic memory updating

Episodic memories, when reactivated, can be modified or updated by new learning. Since such dynamic memory processes remain largely unexplored in psychiatric disorders, we examined the impact of depression on episodic memory updating. Unipolar and bipolar depression patients, and age/education matched controls, first learned a set of objects (List-1). Two days later, participants in all three groups were either reminded of the first learning session or not followed by the learning of a new set of objects (List-2). Forty-eight hours later, List-1 recall was impaired in unipolar and bipolar patients compared to control participants. Further, as expected, control participants who received a reminder spontaneously recalled items from List-2 during recall of List-1, indicative of an updated List-1 memory. Such spontaneous intrusions were also seen in the unipolar and bipolar patients that received the reminder, suggesting that memory updating was unaffected in these two patient groups despite impaired recall of List 1. Unexpectedly, we observed a trend towards higher intrusions, albeit statistically insignificant, not only in the reminder but also in the no-reminder subgroups of bipolar patients. We probed this further in a second cohort by testing recall of List-2, which was also impaired in both depression groups. Again bipolar patients showed intrusions, but this time in the reverse order from List-1 into List-2, independent of a reminder. Taken together, despite impaired recall, updating of episodic memories was intact and unidirectional in unipolar depression. In contrast, indiscriminate updating, as evidenced by bidirectional interference between episodic memories, was seen in bipolar depression. These findings reveal a novel distinction between unipolar versus bipolar depression using a reactivation-dependent memory updating paradigm.

Extinction to amphetamine-associated context in female rats is dependent upon conditioned orienting

RATIONALE

Females are considered more susceptible to the reinforcing effects of drugs and subsequently at increased risk for drug abuse and relapse after treatment. Estrogen is known to facilitate drug effects in females. However, other factors which contribute to the incidence of drug abuse are important to identify in order to recognize early risk factors and develop effective prevention and treatment schemes. Cue-directed behavior (aka sign tracking) has been implicated as a behavioral phenotype which identifies populations susceptible to drug abuse, partly due to its association with impulsivity and heightened dopamine function.

OBJECTIVES AND METHODS

In this study, we investigate the viability of conditioned orienting (a form of cue-directed behavior) as a potential phenotype which predicts drug proclivity in female rats. In addition, we examine any influence endogenous female hormones across the estrous cycle may have on conditioned orienting and drug proclivity.

RESULTS AND CONCLUSIONS

Utilizing an amphetamine-conditioned place preference task, results suggest that the orienting phenotype is an effective predictor of drug proclivity in females. Rats exhibiting enhanced orienting behavior show more robust preference for an amphetamine-associated context and are more resistant to extinction of this preference than nonorienting counterparts. Furthermore, both conditioned orienting behavior and conditioned place preference are minimally influenced by the estrous cycle.

Disrupting reconsolidation: memory erasure or blunting of emotional/motivational value?

When memories are retrieved they become labile, and subject to alteration by a process known as reconsolidation. Disruption of memory reconsolidation decreases the performance of learned responses, which is often attributed to erasure of the memory; in the case of Pavlovian learning, to a loss of the association between a conditioned stimulus (CS) and unconditioned stimulus (US). However, an alternative interpretation is that disrupting reconsolidation does not erase memories, but blunts their emotional/motivational impact. It is difficult to parse the predictive vs. emotional/motivational value of CSs in non-human animals, but studies on variation in the form of conditioned responses (CRs) in a Pavlovian conditioned approach task suggest a way to do this. In this task a lever-CS paired with a food reward (US) acquires predictive value in all rats, but is attributed with emotional/motivational value to a greater extent in some rats (sign-trackers) than others (goal-trackers). We report that the post-retrieval administration of propranolol selectively attenuates a sign-tracking CR, and the associated neural activation of brain "motive circuits", while having no effect on conditioned orienting behavior in sign-trackers, or on goal-tracking CRs evoked by either a lever-CS or a tone-CS. We conclude that the disruption of reconsolidation by post-retrieval propranolol degrades the emotional/motivational impact of the CS, required for sign-tracking, but leaves the CS-US association intact. The possibility that post-retrieval interventions can reduce the emotional/motivational aspects of memories, without actually erasing them, has important implications for treating maladaptive memories that contribute to some psychiatric disorders.

Postretrieval Relearning Strengthens Hippocampal Memories via Destabilization and Reconsolidation

Memory reconsolidation is hypothesized to be a mechanism by which memories can be updated with new information. Such updating has previously been shown to weaken memory expression or change the nature of the memory. Here we demonstrate that retrieval-induced memory destabilization also allows that memory to be strengthened by additional learning. We show that for rodent contextual fear memories, this retrieval conditioning effect is observed only when conditioning occurs within a specific temporal window opened by retrieval. Moreover, it necessitates hippocampal protein degradation at the proteasome and engages hippocampal Zif268 protein expression, both of which are established mechanisms of memory destabilization-reconsolidation. We also demonstrate a conceptually analogous pattern of results in human visual paired-associate learning. Retrieval-relearning strengthens memory performance, again only when relearning occurs within the temporal window of memory reconsolidation. These findings link retrieval-mediated learning in humans to the reconsolidation literature, and have potential implications both for the understanding of endogenous memory gains and strategies to boost weakly learned memories.SIGNIFICANCE STATEMENT Memory reconsolidation allows existing memories to be updated with new information. Previous research has demonstrated that reconsolidation can be manipulated pharmacologically and behaviorally to impair problematic memories. In this article, we show that reconsolidation can also be exploited to strengthen memory. This is shown both in rats, in a fear memory setting, and in a human declarative memory setting. For both, the behavioral conditions necessary to observe the memory strengthening match those that are required to trigger memory reconsolidation. There are several behavioral approaches that have previously been shown convincingly to strengthen memory. The present demonstration that reconsolidation can underpin long-lasting memory improvements may both provide an underlying mechanism for such approaches and provide new strategies to boost memories.

Memory boundaries: opening a window inspired by reconsolidation to treat anxiety, trauma-related, and addiction disorders

Pioneering research over the past two decades has shown that memories are far more malleable than we once thought, thereby highlighting the potential for new clinical avenues for treatment of psychopathology. We first briefly review the historical foundation of memory reconsolidation-a concept that refers to hypothetical processes that occur when a memory is retrieved and restored. Then, we provide an overview of the basic research on memory reconsolidation that has been done with humans and other animals, focusing on models of fear, anxiety-related disorders, and addiction, from the perspective that they all involve disorders of memory. This basic research has fuelled early stage developments of novel treatment techniques. More specifically, we consider behavioural interventions inspired by reconsolidation updating, namely retrieval-extinction techniques. We discuss the set of principles that would be needed for memory modifications within a putative reconsolidation time window, and review research that employs reconsolidation-based strategies with clinical populations. We conclude by highlighting current pitfalls and controversies surrounding the use of reconsolidation-based approaches, but end on an optimistic note for clinical research going forward. Despite the challenges, we believe that drawing on ideas from psychological science can help open up treatment innovation.

Memory integration: An alternative to the consolidation/reconsolidation hypothesis

The original concept of consolidation considers that memory requires time to be fixed. Since 2000, a comparable protein-dependent re-stabilization phase, called reconsolidation, has been assumed to take place after memory retrieval. This consolidation/reconsolidation hypothesis, has dominated the literature for more than 50 years, despite compelling evidence that is inconsistent with it. In this review, we present an historical overview and explain how, despite serious criticisms, this hypothesis has persisted for decades and become accepted as a dogma. Based on both older and more recent evidence, we next propose the concept of memory integration which involves the linkage or embedding of new material into an already existing representation. We believe integration provides a viable explanation for retrograde amnesia in place of the consolidation/reconsolidation hypothesis. Integration can further be the basis for several major cases of memory alteration such as time dependent memory enhancement, interference, counter-conditioning, updating and other instances of memory malleability. In a final section we consider the implications this new concept may have for memory processes and its translational applications.

Positive emotional induction interferes with the reconsolidation of negative autobiographical memories, in women only

After reactivation, a previously consolidated memory can enter into a labile state followed by a re-stabilization process defined as reconsolidation. The aim of this study was to explore whether an existing negative autobiographical memory can be modified by using a non-invasive interference (audiovisual positive preparation) after reactivation and to determine if this effect could be dependent on the reconsolidation process. We found that the presentation of a positive inductor after a negative autobiographical memory reactivation may lead to a change in the emotional information of the original trace and that such effect can be mediated by the reconsolidation process. The modification of the memory has been shown in women only. These results suggest that a positive audiovisual induction may play a potential role in psychotherapeutic techniques for the modification of dysfunctional autobiographical memories.

Periodical reactivation under the effect of caffeine attenuates fear memory expression in rats

In the last decade, several studies have shown that fear memories can be attenuated by interfering with reconsolidation. However, most of the pharmacological agents used in preclinical studies cannot be administered to humans. Caffeine is one of the world’s most popular psychoactive drugs and its effects on cognitive and mood states are well documented. Nevertheless, the influence of caffeine administration on fear memory processing is not as clear. We employed contextual fear conditioning in rats and acute caffeine administration under a standard memory reconsolidation protocol or periodical memory reactivation. Additionally, potential rewarding/aversion and anxiety effects induced by caffeine were evaluated by conditioning place preference or open field, respectively. Caffeine administration was able to attenuate weak fear memories in a standard memory reconsolidation protocol; however, periodical memory reactivation under caffeine effect was necessary to attenuate strong and remote memories. Moreover, caffeine promoted conditioned place preference and anxiolytic-like behavior, suggesting that caffeine weakens the initial learning during reactivation through counterconditioning mechanisms. Thus, our study shows that rewarding and anxiolytic effects of caffeine during fear reactivation can change the emotional valence of fear memory. It brings a new promising pharmacological approach based on drugs widely used such as caffeine to treat fear-related disorders.

An Additional Prior Retrieval Alters the Effects of a Retrieval-Extinction Procedure on Recent and Remote Fear Memory

Several studies have shown that the isolated retrieval of a consolidated fear memory can induce a labile phase, during which extinction training can prevent the reinstatement, a form of relapse in which fear response to a fear-provoking context returns when a mild shock is presented. However, fear memory retrieval may also have another opposing result: the enhancement of fear memory. This implies that the fear memory trace can be modified by a brief retrieval. Unclear is whether the fear-impairing effect of retrieval-extinction (RE) is altered by a prior brief retrieval. The present study investigated the responses of recent and remote fear memories to the RE procedure after the presentation of an additional prior retrieval (priRet). We found that a single RE procedure effectively blocked the reinstatement of 2-day recent contextual fear memory. The memory-impairing effect of the RE procedure on recent fear was not observed when priRet was presented 6 or 24 h before the RE procedure. In contrast to the 2-day recent memory, the RE procedure failed to block the reinstatement of 36-day remote fear memory but successfully disrupted the return of remote fear memory after priRet. This memory-disruptive effect on remote memory did not occur when priRet was performed in a novel context. Nimodipine administration revealed that the blockade of priRet-induced processes recovered the effects of the RE procedure on both recent and remote fear memories. Our findings suggest that the susceptibility of recent and remote fear memories to RE procedures can be altered by an additional retrieval.

Memory Reconsolidation

Scientific advances in the last decades uncovered that memory is not a stable, fixed entity. Apparently stable memories may become transiently labile and susceptible to modifications when retrieved due to the process of reconsolidation. Here, we review the initial evidence and the logic on which reconsolidation theory is based, the wide range of conditions in which it has been reported and recent findings further revealing the fascinating nature of this process. Special focus is given to conceptual issues of when and why reconsolidation happen and its possible outcomes. Last, we discuss the potential clinical implications of memory modifications by reconsolidation.

Can Memories of Traumatic Experiences or Addiction Be Erased or Modified? A Critical Review of Research on the Disruption of Memory Reconsolidation and Its Applications

Recent research suggests that the mere act of retrieving a memory can temporarily make that memory vulnerable to disruption. This process of "reconsolidation" will typically restabilize the neural representation of the memory and foster its long-term storage. However, the process of reconsolidating the memory takes time to complete, and during this limited time window, the original memory may be modified either by the presentation of new information or with pharmacological agents. Such findings have prompted rising interest in using disruption during reconsolidation as a clinical intervention for anxiety, posttraumatic stress, and substance use disorders. However, "boundary conditions" on memory reconsolidation may pose significant obstacles to clinical translation. The aim of this article is to critically examine the nature of these boundary conditions, their neurobiological substrates, and the potential effect they may have on disruption of reconsolidation as a clinical intervention. These boundary conditions also highlight potential constraints on the reconsolidation phenomenon and suggest a limited role for memory updating consistent with evolutionary accounts of associative learning for threat and reward. We conclude with suggestions for future research needed to elucidate the precise conditions under which reconsolidation disruption may be clinically useful.

An Update on Memory Reconsolidation Updating

The reactivation of a stored memory in the brain can make the memory transiently labile. During the time it takes for the memory to restabilize (reconsolidate) the memory can either be reduced by an amnesic agent or enhanced by memory enhancers. The change in memory expression is related to changes in the brain correlates of long-term memory. Many have suggested that such retrieval-induced plasticity is ideally placed to enable memories to be updated with new information. This hypothesis has been tested experimentally, with a translational perspective, by attempts to update maladaptive memories to reduce their problematic impact. We review here progress on reconsolidation updating studies, highlighting their translational exploitation and addressing recent challenges to the reconsolidation field.

The computational nature of memory modification

Retrieving a memory can modify its influence on subsequent behavior. We develop a computational theory of memory modification, according to which modification of a memory trace occurs through classical associative learning, but which memory trace is eligible for modification depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience into statistically distinct clusters (latent causes). New memories are formed when the structure learning mechanism infers that a new latent cause underlies current sensory observations. By the same token, old memories are modified when old and new sensory observations are inferred to have been generated by the same latent cause. We derive this framework from probabilistic principles, and present a computational implementation. Simulations demonstrate that our model can reproduce the major experimental findings from studies of memory modification in the Pavlovian conditioning literature.

DOI:http://dx.doi.org/10.7554/eLife.23763.001

Our memories contain our expectations about the world that we can retrieve to make predictions about the future. For example, most people would expect a chocolate bar to taste good, because they have previously learned to associate chocolate with pleasure. When a surprising event occurs, such as tasting an unpalatable chocolate bar, the brain therefore faces a dilemma. Should it update the existing memory and overwrite the association between chocolate and pleasure? Or should it create an additional memory? In the latter case, the brain would form a new association between chocolate and displeasure that competes with, but does not overwrite, the original one between chocolate and pleasure.

Previous studies have shown that surprising events tend to create new memories unless the existing memory is briefly reactivated before the surprising event occurs. In other words, retrieving old memories makes them more malleable. Gershman et al. have now developed a computational model for how the brain decides whether to update an old memory or create a new one. The idea at the heart of the model is that the brain will attempt to infer what caused the surprising event. The reason the chocolate bar tastes unpalatable, for example, might be because it was old and had spoiled. Every time the brain infers a new possible cause for a surprising event, it will create an additional memory to store this new set of expectations. In the future we will know that spoiled chocolate bars taste bad.

However, if the brain cannot infer a new cause for the surprising event – because, for example, there appears to be nothing unusual about the unpalatable chocolate bar – it will instead opt to update the existing memory. The next time we buy a chocolate bar, we will have slightly lower expectations about how good it will taste. The dilemma of whether to update an existing memory or create a new one thus boils down to the question: is the surprising event the consequence of a new cause or an old one? This theory implies that retrieving a memory nudges the brain to infer that its associated cause is once again active and, since this is an old cause, it means that the memory will be eligible for updating.

Many experiments have been performed on the topic of modifying memories, but this is the first computational model that offers a unifying explanation for the results. The next step is to work out how to apply the model, which is phrased in abstract terms, to networks of neurons that are more biologically realistic.

DOI:http://dx.doi.org/10.7554/eLife.23763.002

Use of a Brief Fear Memory Reactivation Procedure for Enhancing Exposure Therapy

We tested postretrieval extinction as an augmentation strategy for enhancing in vivo exposure therapy for naturally acquired pathological fear. Participants displaying marked phobic responding to either spiders or snakes were randomized to receive a standard one session in vivo exposure therapy protocol under one of two conditions. The experimental group (RFM-EXP) completed a 10-s fear reactivation procedure 30 min prior to initiating exposure therapy. Controls (EXP-RFM) completed the reactivation procedure after completing exposure therapy. Expected and peak fear during confrontation with live spiders or snakes were collected at pretreatment, posttreatment, and 1-month follow-up. RFM-EXP participants displayed significantly lower phobic responding at the 1-month follow-up relative to EXP-RFM controls. Unexpectedly, RFM-EXP participants showed more rapid fear attenuation during exposure relative to controls. Results provide preliminary support for further investigation of this exposure augmentation strategy across a wider range of anxiety-related disorders.

Postretrieval Extinction Attenuates Alcohol Cue Reactivity in Rats

BACKGROUND

Conditioned responses to alcohol-associated cues can hinder recovery from alcohol use disorder (AUD). Cue exposure (extinction) therapy (CET) can reduce reactivity to alcohol cues, but its efficacy is limited by phenomena such as spontaneous recovery and reinstatement that can cause a return of conditioned responding after extinction. Using a preclinical model of alcohol cue reactivity in rats, we evaluated whether the efficacy of alcohol CET could be improved by conducting CET during the memory reconsolidation window after retrieval of cue-alcohol associations.

METHODS

Rats were provided with intermittent access to unsweetened alcohol. Rats were then trained to predict alcohol access based on a visual cue. Next, rats were treated with either standard extinction (n = 14) or postretrieval extinction (n = 13). Rats were then tested for long-term memory of extinction and susceptibility to spontaneous recovery and reinstatement.

RESULTS

Despite equivalent extinction, rats treated with postretrieval extinction exhibited reduced spontaneous recovery and reinstatement relative to rats treated with standard extinction.

CONCLUSIONS

Postretrieval CET shows promise for persistently attenuating the risk to relapse posed by alcohol cues in individuals with AUD.

Translational Approaches Targeting Reconsolidation

Maladaptive learned responses and memories contribute to psychiatric disorders that constitute a significant socio-economic burden. Primary treatment methods teach patients to inhibit maladaptive responses, but do not get rid of the memory itself, which explains why many patients experience a return of symptoms even after initially successful treatment. This highlights the need to discover more persistent and robust techniques to diminish maladaptive learned behaviours. One potentially promising approach is to alter the original memory, as opposed to inhibiting it, by targeting memory reconsolidation. Recent research shows that reactivating an old memory results in a period of memory flexibility and requires restorage, or reconsolidation, for the memory to persist. This reconsolidation period allows a window for modification of a specific old memory. Renewal of memory flexibility following reactivation holds great clinical potential as it enables targeting reconsolidation and changing of specific learned responses and memories that contribute to maladaptive mental states and behaviours. Here, we will review translational research on non-human animals, healthy human subjects, and clinical populations aimed at altering memories by targeting reconsolidation using biological treatments (electrical stimulation, noradrenergic antagonists) or behavioural interference (reactivation-extinction paradigm). Both approaches have been used successfully to modify aversive and appetitive memories, yet effectiveness in treating clinical populations has been limited. We will discuss that memory flexibility depends on the type of memory tested and the brain regions that underlie specific types of memory. Further, when and how we can most effectively reactivate a memory and induce flexibility is largely unclear. Finally, the development of drugs that can target reconsolidation and are safe for use in humans would optimize cross-species translations. Increasing the understanding of the mechanism and limitations of memory flexibility upon reactivation should help optimize efficacy of treatments for psychiatric patients.

An appetitive experience after fear memory destabilization attenuates fear retention: involvement GluN2B-NMDA receptors in the Basolateral Amygdala Complex

It is known that a consolidated memory can return to a labile state and become transiently malleable following reactivation. This instability is followed by a restabilization phase termed reconsolidation. In this work, we explored whether an unrelated appetitive experience (voluntary consumption of diluted sucrose) can affect a contextual fear memory in rats during the reactivation-induced destabilization phase. Our findings show that exposure to an appetitive experience following reactivation can diminish fear retention. This effect persisted after 1 wk. Importantly, it was achieved only under conditions that induced fear memory destabilization. This result could not be explained as a potentiated extinction, because sucrose was unable to promote extinction. Since GluN2B-containing NMDA receptors in the basolateral amygdala complex (BLA) have been implicated in triggering fear memory destabilization, we decided to block pharmacologically these receptors to explore the neurobiological bases of the observed effect. Intra-BLA infusion with ifenprodil, a GluN2B-NMDA antagonist, prevented the fear reduction caused by the appetitive experience. In sum, these results suggest that the expression of a fear memory can be dampened by an unrelated appetitive experience, as long as memory destabilization is achieved during reactivation. Possible mechanisms behind this effect and its clinical implications are discussed.

New Learning and Unlearning: Strangers or Accomplices in Threat Memory Attenuation?

To achieve greatest efficacy, therapies for attenuating fear and anxiety should preclude the re-emergence of emotional responses. Of relevance to this aim, preclinical models of threat memory reduction are considered to engage one of two discrete neural processes: either establishment of a new behavioral response that competes with, and thereby temporarily interferes with the expression of, threat memory (new learning) or one that modifies and thereby disrupts threat memory (unlearning). We contend that a strict dichotomy of new learning and unlearning does not provide a compelling explanation for current data. Instead, we suggest that the evidence warrants consideration of alternative models that assume cooperation rather than competition between formation of new cellular traces and the modification of preexisting ones.

Extinction and Retrieval + Extinction of Conditioned Fear Differentially Activate Medial Prefrontal Cortex and Amygdala in Rats

Pairing a previously neutral conditioned stimulus (CS; e.g., a tone) to an aversive unconditioned stimulus (US; e.g., a footshock) leads to associative learning such that the tone alone comes to elicit a conditioned response (e.g., freezing). We have previously shown that an extinction session that occurs within the reconsolidation window (termed retrieval + extinction) attenuates fear responding and prevents the return of fear in Pavlovian fear conditioning (Monfils et al., 2009). To date, the mechanisms that explain the different behavioral outcomes between standard extinction and retrieval + extinction remain poorly understood. Here we sought to examine the differential temporal engagement of specific neural systems by these two approaches using Arc catFISH (cellular compartment analysis of temporal activity using fluorescence in situ hybridization (FISH)). Our results demonstrate that extinction and retrieval + extinction lead to differential patterns of expression, suggesting that they engage different networks. These findings provide insight into the neural mechanisms that allow extinction during reconsolidation to prevent the return of fear in rodents.

Assessing Fear Following Retrieval + Extinction Through Suppression of Baseline Reward Seeking vs. Freezing

Freezing has become the predominant measure used in rodent studies of conditioned fear, but conditioned suppression of reward-seeking behavior may provide a measure that is more relevant to human anxiety disorders; that is, a measure of how fear interferes with the enjoyment of pleasurable activities. Previous work has found that an isolated presentation of a fear conditioned stimulus (CS) prior to extinction training (retrieval + extinction) results in a more robust and longer-lasting reduction in fear. The objective of this study was to assess whether the retrieval + extinction effect is evident using conditioned suppression of reward seeking, operationalized as a reduction in baseline licking (without prior water deprivation) for a 10% sucrose solution. We found that, compared to freezing, conditioned suppression of reward seeking was much more sensitive to fear conditioning and far less responsive to extinction training. As in previous work, we found that retrieval + extinction reduced post-extinction fear reinstatement when measured as freezing, but it did not reduce fear reinstatement when measured as conditioned suppression. This suggests that there is still residual fear following retrieval + extinction, or that this procedure only modifies memory traces in neural circuits relevant to the expression of freezing, but not to the suppression of reward seeking.

Harnessing reconsolidation to weaken fear and appetitive memories: A meta-analysis of post-retrieval extinction effects

A new understanding of the mechanisms of memory retrieval and reconsolidation holds the potential for improving exposure-based treatments. Basic research indicates that following fear extinction, safety and fear memories may compete, raising the possibility of return of fear. One possible solution is to modify original fear memories through reconsolidation interference, reducing the likelihood of return of fear. Postretrieval extinction is a behavioral method of reconsolidation interference that has been explored in the context of conditioned fear and appetitive memory paradigms. This meta-analysis examines the magnitude of postretrieval extinction effects and potential moderators of these effects. A PubMed and PsycINFO search was conducted through June 2014. Sixty-three comparisons examining postretrieval extinction for preventing the return of fear or appetitive responses in animals or humans met inclusion criteria. Postretrieval extinction demonstrated a significant, small-to-moderate effect (g = .40) for further reducing the return of fear in humans and a significant, large effect (g = 0.89) for preventing the return of appetitive responses in animals relative to standard extinction. For fear outcomes in animals, effects were small (g = 0.21) and nonsignificant, but moderated by the number of animals housed together and the duration of time between postretrieval extinction/extinction and test. Across paradigms, these findings support the efficacy of this preclinical strategy for preventing the return of conditioned fear and appetitive responses. Overall, findings to date support the continued translation of postretrieval extinction research to human and clinical applications, with particular application to the treatment of anxiety, traumatic stress, and substance use disorders.

Reconsolidation and the regulation of plasticity: moving beyond memory

Memory reconsolidation is a protein synthesis-dependent process that preserves, in some form, memories that have been destabilized through recall. Reconsolidation is a nearly universal phenomenon, occurring in a diverse array of species and learning tasks. The function of reconsolidation remains unclear but it has been proposed as a mechanism for updating or strengthening memories. Observations of an analog of reconsolidation in vitro and in sensory systems indicate that reconsolidation is unlikely to be a learning-specific phenomenon and may serve a broader function. We propose that reconsolidation arises from the activity-dependent induction of two coincident but opposing processes: the depotentiation and repotentiation of strengthened synapses. These processes suggest that reconsolidation reflects a fundamental mechanism that regulates and preserves synaptic strength.

Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence

Sign- and goal-tracking are differentially associated with drug abuse-related behavior. Recently, it has been hypothesized that sign- and goal-tracking behavior are mediated by different neurobehavioral valuation systems, including differential incentive salience attribution. Herein, we used different conditioned stimuli to preferentially elicit different response types to study the different incentive valuation characteristics of stimuli associated with sign- and goal-tracking within individuals. The results demonstrate that all stimuli used were equally effective conditioned stimuli; however, only a lever stimulus associated with sign-tracking behavior served as a robust conditioned reinforcer and was preferred over a tone associated with goal-tracking. Moreover, the incentive value attributed to the lever stimulus was capable of promoting suboptimal choice, leading to a significant reduction in reinforcers (food) earned. Furthermore, sign-tracking to a lever was more persistent than goal-tracking to a tone under omission and extinction contingencies. Finally, a conditional discrimination procedure demonstrated that sign-tracking to a lever and goal-tracking to a tone were dependent on learned stimulus–reinforcer relations. Collectively, these results suggest that the different neurobehavioral valuation processes proposed to govern sign- and goal-tracking behavior are independent but parallel processes within individuals. Examining these systems within individuals will provide a better understanding of how one system comes to dominate stimulus–reward learning, thus leading to the differential role these systems play in abuse-related behavior.

Amygdala Dopamine Receptors Are Required for the Destabilization of a Reconsolidating Appetitive Memory

Disrupting maladaptive memories may provide a novel form of treatment for neuropsychiatric disorders, but little is known about the neurochemical mechanisms underlying the induction of lability, or destabilization, of a retrieved consolidated memory. Destabilization has been theoretically linked to the violation of expectations during memory retrieval, which, in turn, has been suggested to correlate with prediction error (PE). It is well-established that PE correlates with dopaminergic signaling in limbic forebrain structures that are critical for emotional learning. The basolateral amygdala is a key neural substrate for the reconsolidation of pavlovian reward-related memories, but the involvement of dopaminergic mechanisms in inducing lability of amygdala-dependent memories has not been investigated. Therefore, we tested the hypothesis that dopaminergic signaling within the basolateral amygdala is required for the destabilization of appetitive pavlovian memories by investigating the effects dopaminergic and protein synthesis manipulations on appetitive memory reconsolidation in rats. Intra-amygdala administration of either the D1-selective dopamine receptor antagonist SCH23390 or the D2-selective dopamine receptor antagonist raclopride prevented memory destabilization at retrieval, thereby protecting the memory from the effects of an amnestic agent, the protein synthesis inhibitor anisomycin. These data show that dopaminergic transmission within the basolateral amygdala is required for memory labilization during appetitive memory reconsolidation.

Reconsolidation allows fear memory to be updated to a less aversive level through the incorporation of appetitive information

The capacity to adapt to new situations is one of the most important features of memory. When retrieved, memories may undergo a labile state that is sensitive to modification. This process, called reconsolidation, can lead to memory updating through the integration of new information into a previously consolidated memory background. Thus reconsolidation provides the opportunity to modify an undesired fear memory by updating its emotional valence to a less aversive level. Here we evaluated whether a fear memory can be reinterpreted by the concomitant presentation of an appetitive stimulus during its reactivation, hindering fear expression. We found that memory reactivation in the presence of appetitive stimuli resulted in the suppression of a fear response. In addition, fear expression was not amenable to reinstatement, spontaneous recovery, or rapid reacquisition. Such effect was prevented by either systemic injection of nimodipine or intra-hippocampal infusion of ifenprodil, indicating that memory updating was mediated by a reconsolidation mechanism relying on hippocampal neuronal plasticity. Taken together, this study shows that reconsolidation allows for a 're-signification' of unwanted fear memories through the incorporation of appetitive information. It brings a new promising cognitive approach to treat fear-related disorders.

Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors

When a neutral cue is followed by a significant event such as food delivery, some animals become engaged with the cue itself and acquire cue-directed behaviors. One type of cue-directed behavior is observed following insertion of a lever used as a conditioned stimulus (CS). Rats showing robust approach behavior to the lever also display impulsivity and altered attention, as compared to rats showing behavior directed toward the reward delivery location. The current study used a light CS to categorize rats' propensity for cue-directed behavior, and assessed whether individual differences in impulsivity and related behaviors still emerged. During the light-food pairings, some rats displayed enhanced rearing or orienting to the light (Orienters) prior to showing food cup approach behavior, while other rats only showed food cup approach behavior (Nonorienters). Our results showed that Orienters made more impulsive and risky decisions in two different choice tasks, and were quicker to leave a familiar dark environment to enter a novel bright field. Orienters also showed less accurate target detection when a visual distractor was introduced during an attentional challenge. Our current study suggests that light CS-induced rearing/orienting behavior might not necessarily share an identical mechanism with lever CS-approach behavior in predicting impulsivity-related behaviors.

Appetitive behavioral traits and stimulus intensity influence maintenance of conditioned fear

Individual differences in appetitive learning have long been reported, and generally divide into two classes of responses: cue- vs. reward-directed. The influence of cue- vs. reward-directed phenotypes on aversive cue processing, is less well understood. In the current study, we first categorized rats based on their predominant cue-directed orienting responses during appetitive Pavlovian conditioning. Then, we investigated the effect of phenotype on the latency to exit a familiar dark environment and enter an unfamiliar illuminated open field. Next, we examined whether the two phenotypes responded differently to a reconsolidation updating manipulation (retrieval+extinction) after fear conditioning. We report that the rats with a cue-directed (“orienting”) phenotype differentially respond to the open field, and also to fear conditioning, depending on US-intensity. In addition, our findings suggest that, regardless of appetitive phenotype or shock intensity, extinction within the reconsolidation window prevents spontaneous recovery of fear.