Reconsolidation of a well-learned instrumental memory

Perineuronal nets in the rat medial prefrontal cortex alter hippocampal-prefrontal oscillations and reshape cocaine self-administration memories

The medial prefrontal cortex (mPFC) is a major contributor to relapse to cocaine in humans and to reinstatement behavior in rodent models of cocaine use disorder. Output from the mPFC is modulated by parvalbumin (PV)-containing fast-spiking interneurons, the majority of which are surrounded by perineuronal nets (PNNs). Here we tested whether chondroitinase ABC (ABC)- mediated removal of PNNs prevented the acquisition or reconsolidation of a cocaine self-administration memory. ABC injections into the dorsal mPFC prior to training attenuated the acquisition of cocaine self-administration. Also, ABC given 3 days prior to but not 1 hr after memory reactivation blocked cue-induced reinstatement. However, reduced reinstatement was present only in rats given a novel reactivation contingency, suggesting that PNNs are required for the updating of a familiar memory. In naive rats, ABC injections into mPFC did not alter excitatory or inhibitory puncta on PV cells but reduced PV intensity. Whole-cell recordings revealed a greater inter-spike interval 1 hr after ABC, but not 3 days later. In vivo recordings from the mPFC and dorsal hippocampus (dHIP) during novel memory reactivation revealed that ABC in the mPFC prevented reward-associated increases in beta and gamma activity as well as phase-amplitude coupling between the dHIP and mPFC. Together, our findings show that PNN removal attenuates the acquisition of cocaine self-administration memories and disrupts reconsolidation of the original memory when combined with a novel reactivation session. Further, reduced dHIP/mPFC coupling after PNN removal may serve as a key biomarker for how to disrupt reconsolidation of cocaine memories and reduce relapse.

Drug memory reconsolidation: from molecular mechanisms to the clinical context

Since its rediscovery at the beginning of the 21st Century, memory reconsolidation has been proposed to be a therapeutic target for reducing the impact of emotional memories that can go awry in mental health disorders such as drug addiction (substance use disorder, SUD). Addiction can be conceptualised as a disorder of learning and memory, in which both pavlovian and instrumental learning systems become hijacked into supporting drug-seeking and drug-taking behaviours. The past two decades of research have characterised the details of the molecular pathways supporting the reconsolidation of pavlovian cue-drug memories, with more recent work indicating that the reconsolidation of instrumental drug-seeking memories also relies upon similar mechanisms. This narrative review considers what is known about the mechanisms underlying the reconsolidation of pavlovian and instrumental memories associated with drug use, how these approaches have translated to experimental medicine studies, and the challenges and opportunities for the clinical use of reconsolidation-based therapies.

Role of dopamine D1 receptor in the modulation of memory consolidation by passive and self-administered heroin and associated conditioned stimuli

It has been proposed that opiates modulate memory consolidation, but recent work has indicated that this effect may be mediated by how the drug is experienced (i.e., passive injections vs. self-administration). Because the dopamine (DA) D1 receptor is involved in processing of learning signals and attribution of salience to events experienced by an organism, two studies in male Sprague-Dawley rats tested the effect of blocking this receptor on modulation of memory consolidation by passive and self-administered heroin, in addition to conditioned memory modulation by heroin-paired cues. Using the object location memory task, Study 1 employed SCH23390 (0, 0.05, 0.10 mg/kg, SC) to modulate enhancement of memory consolidation induced by post-training injections of heroin (1 mg/kg, SC) as well as by exposure to the environment paired with heroin injections (6 pairings, 1 h each, 1 mg/kg). Study 2 was conducted in rats that could self-administer heroin (0.05 mg/kg/infusion, IV) and tested whether SCH23390 (0 and 0.1 mg/kg, SC) could prevent memory modulation induced by a change in schedule of self-administration (from fixed to variable ratio). It was found that while repeated passive injections of heroin retained their enhancing effect on memory, when self-administered, heroin enhanced consolidation of object location memory only at the beginning of self-administration and after a change in schedule. Importantly, SCH23390 blocked memory modulation by heroin when passively administered and when the drug was self-administered on a novel schedule. SCH23390 also blocked conditioned memory modulation induced by post-training exposure to heroin-paired cues. Taken together, these results suggest that modulation of memory consolidation by unconditioned and conditioned opiate reinforcers involve a D1-dependent mechanism of salience attribution linked to the anticipation of drug effects.

Making Leaps and Hitting Boundaries in Reconsolidation: Overcoming Boundary Conditions to Increase Clinical Translatability of Reconsolidation-based Therapies

Reconsolidation results in the restabilisation, and thus persistence, of a memory made labile by retrieval, and interfering with this process is thought to enable modification or weakening of the original trace. As such, reconsolidation-blockade has been a focus of research aiming to target the maladaptive memories underlying mental health disorders, including post-traumatic stress disorder and drug addiction. Current first-line therapies are not effective for all patients, and a substantial proportion of those for whom therapies are effective later relapse. A reconsolidation-based intervention would be invaluable as an alternative treatment for these conditions. However, the translation of reconsolidation-based therapies to the clinic presents a number of challenges, with arguably the greatest being the overcoming of the boundary conditions governing the opening of the reconsolidation window. These include factors such as the age and strength of memory, and can broadly be divided into two categories: intrinsic features of the targeted memory itself, and parameters of the reactivation procedure used. With maladaptive memory characteristics inevitably varying amongst individuals, manipulation of the other limitations imposed by procedural variables have been explored to circumvent the boundary conditions on reconsolidation. Although several apparently discrepant results remain to be reconciled and these limitations yet to be truly defined, many studies have produced successful results which encouragingly demonstrate that boundary conditions may be overcome using various proposed strategies to enable translation of a reconsolidation-based intervention to clinical use.

Alcohol and cannabinoid binges and daily exposure to nicotine in adolescent/young adult rats induce sex-dependent long-term appetitive instrumental learning impairment

Adolescence is a critical developmental period, concerning anatomical, neurochemical and behavioral changes. Moreover, adolescents are more sensitive to the long-term deleterious effects of drug abuse. Binge-like consumption of alcohol and marijuana, along with tobacco smoking, is a dangerous pattern often observed in adolescents during weekends. Nevertheless, the long-term effect of their adolescent co-exposure has not been yet experimentally investigated. Long-Evans adolescent male (n = 20) and female (n = 20) rats from postnatal day 30 (P30) until P60 were daily treated with nicotine (0.3 mg/kg, i.p.), and, on two consecutive 'binging days' per week (for a total of eight times), received an intragastric ethanol solution (3 g/kg) and an intraperitoneal (i.p.) dose of cannabinoid 1/2 receptor agonist WIN55,212-2 (1.2 mg/kg). These rats were tested after treatment discontinuation at > P90 for associative food-rewarded operant learning in the two-lever conditioning chambers for six consecutive days on a fixed ratio 1 (FR1) schedule followed by another six days of daily FR2 schedule testing, after 42 days rest. We found the main effects of sex x treatment interactions in FR1 but not in FR2 experiments. Treated females show attenuated operant responses for food pellets during all FR1 and the FR2 schedule, whilst the treated males show an impairment in FR2 but not in the FR1 schedule. Moreover, the treated females' percentage of learners was significantly lower than female controls in FR1 while treated males were lower than controls in FR2. Our findings suggest that intermittent adolescent abuse of common drugs, such as alcohol and marijuana, and chronic tobacco exposure can cause significant long-term effects on motivation for natural reinforcers later in adulthood in both sexes. Females appear to be sensitive earlier to the deleterious effects of adolescent polydrug abuse, with both sexes having an increased likelihood of developing lifelong brain alterations.

New Approaches for Alcohol Use Disorder Treatment via Memory Retrieval and Reconsolidation Manipulations

Relapse to alcohol seeking and drinking is a major clinical challenge in alcohol use disorder and is frequently brought about by cue-induced craving, caused by exposure to cues that evoke alcohol-related memories. It has been postulated that memories become labile for manipulation shortly after their retrieval and then restabilize in a "memory reconsolidation" process. Disruption or interference with the reconsolidation of drug-associated memories has been suggested as a possible strategy to reduce or even prevent cue-induced craving and relapse. Here, we review literature demonstrating the capacity of behavioral or pharmacological manipulations to reduce relapse in animal models and humans when applied after a short retrieval of memories associated with alcohol, suggestively disrupting the reconsolidation of such memories. We suggest that while there is a clear potential of using post-retrieval manipulations to target specific relapse-evoking memories, future research should be more systematic, standardized, and translational. Specifically, we discuss several critical limitations and boundary conditions, which should be addressed to improve consistency and replicability in the field and lead to the development of an efficient reconsolidation-based relapse prevention therapy.

Temporal prediction error triggers amygdala-dependent memory updating in appetitive operant conditioning in rats

Reinforcement learning theories postulate that prediction error, i.e., a discrepancy between the actual and expected outcomes, drives reconsolidation and new learning, inducing an updating of the initial memory. Pavlovian studies have shown that prediction error detection is a fundamental mechanism in triggering amygdala-dependent memory updating, where the temporal relationship between stimuli plays a critical role. However, in contrast to the well-established findings in aversive situations (e.g., fear conditioning), only few studies exist on prediction error in appetitive operant conditioning, and even less with regard to the role of temporal parameters. To explore if temporal prediction error in an appetitive operant paradigm could generate an updating and consequent reconsolidation and/or new learning of temporal association, we ran four experiments in adult male rats. Experiment 1 verified whether an unexpected delay in the time of reward's availability (i.e., a negative temporal prediction error) in a single session produces an updating in long-term memory of temporal expectancy in an appetitive operant conditioning. Experiment 2 showed that negative prediction errors, either due to the temporal change or through reward omission, increased in the basolateral amygdala nucleus (BLA) the activation of a protein that is critical for memory formation. Experiment 3 revealed that the presence of a protein synthesis inhibitor (anisomycin) in the BLA during the session when the reward was delayed (Error session) affected the temporal updating. Finally, Experiment 4 showed that anisomycin, when infused immediately after the Error session, interfered with the long-term memory of the temporal updating. Together, our study demonstrated an involvement of BLA after a change in temporal and reward contingencies, and in the resulting updating in long-term memory in appetitive operant conditioning.

Procedures between training and reactivation influence the destabilization of instrumental sucrose memory

Memory destabilization and reconsolidation is hypothesized to be a fundamental mnemonic process that can underpin memory updating. Instrumental memories have been shown recently to be destabilized following a reactivation session that involves a change in instrumental reward contingency. However, the acquisition and performance of an instrumental response occurs in the presence of the learning of other reward-related memories. This may influence the ability of a given reactivation session to destabilize the previously learned instrumental memory. Here we present a series of experiments in male rats involving an instrumental memory trained on an FR1 schedule over 10 days, and then reactivated in a session that imposed a VR5 schedule of reinforcement. When MK-801 was injected prior to the VR5 reactivation session, it reliably impaired subsequent instrumental performance at test only when the reactivation session occurred 48 h, and not 24 h, after the end of training. The interposition between the end of training and the reactivation session of a context extinction session, an additional VR5 reactivation session, or indeed the simple experience of being handled and injected with vehicle, resulted in MK-801 no longer having an amnestic effect on test performance. While we do not have a clear account for the process and mechanism underpinning this apparent selectivity of the effect of the VR5 session to destabilize the instrumental memory, it does additionally highlight the need for greater understanding of the conditions that facilitate reactivation-induced memory destabilization.

The evidence for and against reactivation-induced memory updating in humans and nonhuman animals

Systematic investigation of reactivation-induced memory updating began in the 1960s, and a wave of research in this area followed the seminal articulation of "reconsolidation" theory in the early 2000s. Myriad studies indicate that memory reactivation can cause previously consolidated memories to become labile and sensitive to weakening, strengthening, or other forms of modification. However, from its nascent period to the present, the field has been beset by inconsistencies in researchers' abilities to replicate seemingly established effects. Here we review these many studies, synthesizing the human and nonhuman animal literature, and suggest that these failures-to-replicate reflect a highly complex and delicately balanced memory modification system, the substrates of which must be finely tuned to enable adaptive memory updating while limiting maladaptive, inaccurate modifications. A systematic approach to the entire body of evidence, integrating positive and null findings, will yield a comprehensive understanding of the complex and dynamic nature of long-term memory storage and the potential for harnessing modification processes to treat mental disorders driven by pervasive maladaptive memories.

Role of prediction error and the cholinergic system on memory reconsolidation processes in mice

The ability to make predictions based on stored information is a general coding strategy. A prediction error (PE) is a mismatch between expected and current events. Our memories, like ourselves, are subject to change. Thus, an acquired memory can become active and update its content or strength by a labilization-reconsolidation process. Within the reconsolidation framework, PE drives the updating of consolidated memories. In the past our lab has made key progresses showing that a blockade in the central cholinergic system during reconsolidation can cause memory impairment, while reinforcement of cholinergic activity enhances it. In the present work we determined that PE is a necessary condition for memory to reconsolidate in an inhibitory avoidance task using both male and female mice. Depending on the intensity of the unconditioned stimulus (US) used during training, a negative (higher US intensity) or positive (lower US intensity/no US) PE on a retrieval session modified the behavioral response on a subsequent testing session. Furthermore, we demonstrated that the cholinergic system modulates memory reconsolidation only when PE is detected. In this scenario administration of oxotremorine, scopolamine or nicotine after memory reactivation either enhanced or impaired memory reconsolidation in a sex-specific manner.

The Mechanisms and Boundary Conditions of Drug Memory Reconsolidation

Drug addiction can be seen as a disorder of maladaptive learning characterized by relapse. Therefore, disrupting drug-related memories could be an approach to improving therapies for addiction. Pioneering studies over the last two decades have revealed that consolidated memories are not static, but can be reconsolidated after retrieval, thereby providing candidate pathways for the treatment of addiction. The limbic-corticostriatal system is known to play a vital role in encoding the drug memory engram. Specific structures within this system contribute differently to the process of memory reconsolidation, making it a potential target for preventing relapse. In addition, as molecular processes are also active during memory reconsolidation, amnestic agents can be used to attenuate drug memory. In this review, we focus primarily on the brain structures involved in storing the drug memory engram, as well as the molecular processes involved in drug memory reconsolidation. Notably, we describe reports regarding boundary conditions constraining the therapeutic potential of memory reconsolidation. Furthermore, we discuss the principles that could be employed to modify stored memories. Finally, we emphasize the challenge of reconsolidation-based strategies, but end with an optimistic view on the development of reconsolidation theory for drug relapse prevention.

Apparent reconsolidation interference without generalized amnesia

Memories remain dynamic after consolidation, and when reactivated, they can be rendered vulnerable to various pharmacological agents that disrupt the later expression of memory (i.e., amnesia). Such drug-induced post-reactivation amnesia has traditionally been studied in AAA experimental designs, where a memory is initially created for a stimulus A (be it a singular cue or a context) and later reactivated and tested through exposure to the exact same stimulus. Using a contextual fear conditioning procedure in rats and midazolam as amnestic agent, we recently demonstrated that drug-induced amnesia can also be obtained when memories are reactivated through exposure to a generalization stimulus (GS, context B) and later tested for that same generalization stimulus (ABB design). However, this amnestic intervention leaves fear expression intact when at test animals are instead presented with the original training stimulus (ABA design) or a novel generalization stimulus (ABC design). The underlying mechanisms of post-reactivation memory malleability and of MDZ-induced amnesia for a generalization context remain largely unknown. Here, we evaluated whether, like typical CS-mediated (or AAA) post-reactivation amnesia, GS-mediated (ABB) post-reactivation amnesia displays key features of a destabilization-based phenomenon. We first show that ABB post-reactivation amnesia is critically dependent on prediction error at the time of memory reactivation and provide evidence for its temporally graded nature. In line with the known role of GluN2B-NMDA receptor activation in memory destabilization, we further demonstrate that pre-reactivation administration of ifenprodil, a selective antagonist of GluN2B-NMDA receptors, prevents MDZ-induced ABB amnesia. In sum, our data reveal that ABB MDZ-induced post-reactivation amnesia exhibits the hallmark features of a destabilization-dependent phenomenon. Implication of our findings for a reconsolidation-based account of post-reactivation amnesia are discussed.

Disruption of relapse to alcohol seeking by aversive counterconditioning following memory retrieval

Relapse to alcohol abuse is often caused by exposure to potent alcohol-associated cues. Therefore, disruption of the cue-alcohol memory can prevent relapse. It is believed that memories destabilize and become prone for updating upon their reactivation through retrieval and then restabilize within 6 h during a "reconsolidation" process. We recently showed that relapse to cocaine seeking in a place-conditioning paradigm could be prevented by counterconditioning the cocaine cues with aversive outcomes following cocaine-memory retrieval. However, to better model addiction-related behaviors, self-administration models are necessary. Here, we demonstrate that relapse to alcohol seeking can be prevented by aversive counterconditioning conducted during alcohol-memory reconsolidation, in the place conditioning and operant self-administration paradigms, in mice and rats, respectively. We found that the reinstatement of alcohol-conditioned place preference was abolished only when aversive counterconditioning with water flooding was given shortly after alcohol-memory retrieval. Furthermore, rats trained to lever press for alcohol showed decreased context-induced renewal of alcohol-seeking responding when the lever pressing was punished with foot-shocks, shortly, but not 6 h, after memory retrieval. These results suggest that aversive counterconditioning can prevent relapse to alcohol seeking only when performed during alcohol-memory reconsolidation, presumably by updating, or replacing, the alcohol memory with aversive information. Finally, we found that aversive counterconditioning preceded by alcohol-memory retrieval was characterized by the upregulation of brain-derived neurotrophic factor (Bdnf) mRNA expression in the medial prefrontal cortex, suggesting that BDNF may play a role in the memory updating process.

Targeting the Reconsolidation of Licit Drug Memories to Prevent Relapse: Focus on Alcohol and Nicotine

Alcohol and nicotine are widely abused legal substances worldwide. Relapse to alcohol or tobacco seeking and consumption after abstinence is a major clinical challenge, and is often evoked by cue-induced craving. Therefore, disruption of the memory for the cue–drug association is expected to suppress relapse. Memories have been postulated to become labile shortly after their retrieval, during a “memory reconsolidation” process. Interference with the reconsolidation of drug-associated memories has been suggested as a possible strategy to reduce or even prevent cue-induced craving and relapse. Here, we surveyed the growing body of studies in animal models and in humans assessing the effectiveness of pharmacological or behavioral manipulations in reducing relapse by interfering with the reconsolidation of alcohol and nicotine/tobacco memories. Our review points to the potential of targeting the reconsolidation of these memories as a strategy to suppress relapse to alcohol drinking and tobacco smoking. However, we discuss several critical limitations and boundary conditions, which should be considered to improve the consistency and replicability in the field, and for development of an efficient reconsolidation-based relapse-prevention therapy.

Propranolol-induced inhibition of unconditioned stimulus-reactivated fear memory prevents the return of fear in humans

Fear memories can be reactivated by a fear-associated conditioned stimulus (CS) or unconditioned stimulus (US) and then undergo reconsolidation. Propranolol administration during CS retrieval-induced reconsolidation can impair fear memory that is specific to the reactivated CS. However, from a practical perspective, the US is often associated with multiple CSs, and each CS can induce a fear response. The present study sought to develop and test a US-based memory retrieval interference procedure with propranolol to disrupt the original fear memory and eliminate all CS-associated fear responses in humans. We recruited 127 young healthy volunteers and conducted three experiments. All of the subjects acquired fear conditioning, after which they received the β-adrenergic receptor antagonist propranolol (40 mg) or placebo (vitamin C) and were exposed to the US or CS to reactivate the original fear memory. Fear responses were measured. Oral propranolol administration 1 h before US retrieval significantly decreased subsequent fear responses and disrupted associations between all CSs and the US. However, propranolol administration before CS retrieval only inhibited the fear memory that was related to the reactivated CS. Moreover, the propranolol-induced inhibition of fear memory reconsolidation that was retrieved by the US had a relatively long-lasting effect (at least 2 weeks) and was also effective for remote fear memory. These findings indicate that the US-based memory retrieval interference procedure with propranolol can permanently decrease the fear response and prevent the return of fear for all CSs in humans. This procedure may open new avenues for treating fear-related disorders.

Investigating the efficacy of the reminder-extinction procedure to disrupt contextual threat memories in humans using immersive Virtual Reality

Upon reactivation, consolidated memories can enter a temporary labile state and require restabilisation, known as reconsolidation. Interventions during this reconsolidation period can disrupt the reactivated memory. However, it is unclear whether different kinds of memory that depend on distinct brain regions all undergo reconsolidation. Evidence for reconsolidation originates from studies assessing amygdala-dependent memories using cue-conditioning paradigms in rodents, which were subsequently replicated in humans. Whilst studies providing evidence for reconsolidation of hippocampus-dependent memories in rodents have predominantly used context conditioning paradigms, studies in humans have used completely different paradigms such as tests for wordlists or stories. Here our objective was to bridge this paradigm gap between rodent and human studies probing reconsolidation of hippocampus-dependent memories. We modified a recently developed immersive Virtual Reality paradigm to test in humans whether contextual threat-conditioned memories can be disrupted by a reminder-extinction procedure that putatively targets reconsolidation. In contrast to our hypothesis, we found comparable recovery of contextual conditioned threat responses, and comparable retention of subjective measures of threat memory, episodic memory and exploration behaviour between the reminder-extinction and standard extinction groups. Our result provide no evidence that a reminder before extinction can prevent the return of context conditioned threat memories in humans.

Parameters of Memory Reconsolidation: Learning Mode Influences Likelihood of Memory Modification

When previously consolidated hippocampally dependent memory traces are reactivated they enter a vulnerable state in which they can be altered with new information, after which they must be re-consolidated in order to restabilize the trace. The existing body of literature on episodic reconsolidation largely focuses on the when and how of successful memory reactivation. What remains poorly understood is how the nature of newly presented information affects the likelihood of a vulnerable episodic memory being altered. We used our episodic memory reconsolidation paradigm to investigate if the intention to encode impacts what subsequently becomes attributed to an older, reactivated memory. Participants learned two lists of objects separated by 48 h. We integrated a modified item-list directed-forgetting paradigm into the encoding of the second object list by cueing participants to learn some of the objects intentionally (intentional learning), while other objects were presented without a cue (incidental learning). Under conditions of memory reactivation, subjects showed equal rates of memory modification for intentionally- and incidentally-learned objects. However, in the absence of reactivation we observed high misattribution rates of incidentally-learned objects. We consider two interpretations of these data, with contrasting implications for understanding the conditions that influence memory malleability, and suggest further work that should help decide between them.

Targeting drug memory reconsolidation: a neural analysis

Addiction can be conceptualised as a disorder of maladaptive learning and memory. Therefore, maladaptive drug memories supporting drug-seeking and relapse behaviours may present novel treatment targets for therapeutic approaches based upon reconsolidation-blockade. It is known that different structures within the limbic corticostriatal system contribute differentially to different types of maladaptive drug memories, including pavlovian associations between environmental cues and contexts with the drug high, and instrumental memories underlying drug-seeking. Here, we review the mechanisms underlying drug memory reconsolidation in the amygdala, striatum, and hippocampus, noting similarities and differences, and opportunities for future research.

Molecular Mechanisms of Reconsolidation-Dependent Memory Updating

Memory is not a stable record of experience, but instead is an ongoing process that allows existing memories to be modified with new information through a reconsolidation-dependent updating process. For a previously stable memory to be updated, the memory must first become labile through a process called destabilization. Destabilization is a protein degradation-dependent process that occurs when new information is presented. Following destabilization, a memory becomes stable again through a protein synthesis-dependent process called restabilization. Much work remains to fully characterize the mechanisms that underlie both destabilization and subsequent restabilization, however. In this article, we briefly review the discovery of reconsolidation as a potential mechanism for memory updating. We then discuss the behavioral paradigms that have been used to identify the molecular mechanisms of reconsolidation-dependent memory updating. Finally, we outline what is known about the molecular mechanisms that support the memory updating process. Understanding the molecular mechanisms underlying reconsolidation-dependent memory updating is an important step toward leveraging this process in a therapeutic setting to modify maladaptive memories and to improve memory when it fails.

Memory reconsolidation impairments in sign-tracking to an audiovisual compound stimulus

Studies of memory reconsolidation of pavlovian memories have typically employed unimodal conditioned stimuli, despite the use of multimodal compound stimuli in other settings. Here we studied sign-tracking behaviour to a compound audiovisual stimulus. First, we observed not unexpectedly that sign-tracking was poorer to the audiovisual compound than to unimodal visual stimuli. Then, we showed that, depending on the parameters of compound stimulus re-exposure at memory reactivation, systemic MK-801 treatment either impaired extinction to improve sign-tracking at test, or disrupted reconsolidation to impair test behaviour. When memory reactivation consisted of re-exposure to only the auditory component of the compound stimulus, we observed sign-tracking impairments following MK-801 treatment, but only under certain test conditions. This was in contrast to the consistent impairment following reactivation with the full audiovisual compound. Moreover, the parameters of auditory stimulus presentation to enable MK-801-induced impairment at test varied depending on whether the stimulus was presented within or outside the training context. These findings suggest that behaviour under the control of appetitive pavlovian compound stimuli can be modulated by targeting both extinction and reconsolidation, and that it is not necessary to re-expose to the full compound stimulus in order to achieve a degree of modulation of behaviour.

Protocols for instrumental memory reconsolidation in rodents: A methodological review

BACKGROUND

Memory reconsolidation enables the update of a previously consolidated memory trace after its reactivation. Although Pavlovian memory reconsolidation has been widely demonstrated, instrumental memory reconsolidation is still debated. Early studies suggested that instrumental memories did not undergo reconsolidation and therefore could not be disrupted, whereas other authors suggested that these memories are just more resistant to destabilization and reconsolidation in comparison to Pavlovian memories.

AIM AND RESULTS

The present paper reviews the behavioral protocols used to investigate appetitive instrumental memory reconsolidation in rodents and describes in detail the specific methods used for memory retrieval, with a critical analysis of the different experimental parameters.

CONCLUSIONS

The modalities under which the reconsolidation of appetitive (sucrose or drugs of abuse) instrumental memories occurs have been explored and partially elucidated. Further investigations are recommended on the boundary conditions that constrain instrumental memory reactivation.

On the Resistance to Relapse to Cocaine-Seeking Following Impairment of Instrumental Cocaine Memory Reconsolidation

Reconsolidation normally functions to update and maintain memories in the long-term. However, this process can be disrupted pharmacologically to weaken memories. Exploiting such experimental amnesia to disrupt the maladaptive reward memories underpinning addiction may provide a novel therapeutic avenue to prevent relapse. Here, we tested whether targeted disruption of the reconsolidation of instrumental (operant) lever pressing for cocaine resulted in protection against different forms of relapse in a rat self-administration model. We first confirmed that systemic injection of the non-competitive N-methyl–D-aspartate receptor (NMDAR) antagonist MK-801 did impair reconsolidation to reduce spontaneous instrumental drug-seeking memory at test. This deficit was not rescued by pharmacological induction of stress with the anxiogenic α₂-noradrenergic receptor antagonist yohimbine. In contrast, cocaine-seeking was restored to control levels following priming with cocaine itself, or presentation of a cocaine-associated cue. These results suggest that while stress-induced relapse can be reduced by disruption of instrumental memory reconsolidation, the apparent sparing of the pavlovian cue-drug memory permitted other routes to relapse. Therefore, future reconsolidation-based therapeutic strategies for addictive drug-seeking may need to target both instrumental and pavlovian memories.

Detrimental Effects of a Retrieval-Extinction Procedure on Nicotine Seeking, but Not Cocaine Seeking

Retrieval-extinction memory reactivation procedures have been used to prevent the return of learned fear and drug seeking in preclinical models. These procedures first reactivate the original memory with a brief cue exposure (i.e., retrieval) session, and then disrupt memory reconsolidation by conducting extinction training within the reconsolidation window. The original memory is thought to be updated with the new information conveyed by extinction learning, resulting in a persistent therapeutic effect beyond that observed with extinction training alone (i.e., no retrieval). Here, we attempted to replicate the therapeutic effects on cocaine seeking reported by Xue et al. (2012), and extend these findings to nicotine seeking. Rats self-administered either cocaine or nicotine with contingent cues for weeks, and were then divided into two groups. The retrieval group underwent a 10-min retrieval session wherein drug cues were available, but drug was not. Ten minutes later, they were allowed to continue cue extinction training for an additional 60 min. The no retrieval group underwent a contiguous 70-min cue extinction session. These procedures continued for weeks, followed by a test for spontaneous recovery of drug seeking. No group differences were observed on any measure of cocaine seeking, although both groups exhibited extinction and spontaneous recovery. By contrast, for nicotine seeking, the retrieval group exhibited resistance to extinction, an effect that persisted on the spontaneous recovery test. These findings underscore the importance of drug type in the outcome of retrieval-extinction procedures and moreover indicate that retrieval-extinction procedures can be detrimental to nicotine seeking.

Reconsolidation of sucrose instrumental memory in rats: The role of retrieval context

Memory reconsolidation enables the update of a previously consolidated memory trace after its reactivation. Although Pavlovian memory reconsolidation has been widely demonstrated, instrumental memory reconsolidation is still debated. The most critical issue on instrumental memory reconsolidation findings have mainly been linked to the presence of specific boundary conditions for reactivation, for instance contextual parameters. In this study, we investigated the role of the spatial context on molecular markers of sucrose instrumental memory reactivation. Following withdrawal, rats previously conditioned to sucrose self-administration underwent either instrumental memory retrieval or no-retrieval in the conditioned context (Context A, AA condition) or in a modified version of the conditioned context (Context B, AB condition). Two hours later, the level of GluA1 and GluN2B receptors, Zif268 and phosphorylated-rpS6 (rpS6P) was measured in key brain areas for memory reactivation. Retrieval in Context A significantly increased GluA1Rs and GluN2BRs in amygdala compared to no-retrieval, indicating that memory successfully reactivated and destabilized. Moreover, Zif268 level was significantly increased after retrieval in Context A in the nucleus accumbens shell, central and basolateral amygdala but not in the hippocampus, while retrieval in Context B significantly increased Zif268 level in all brain areas. On the other hand, rpS6P level was increased in the nucleus accumbens shell and central amygdala, but decreased in the hippocampus, after retrieval in Context A, while retrieval in Context B did not change rpS6P level in brain areas, except for a small but significant decrease in hippocampus. While the increase of Zif268 level indicated that memory reactivation has been triggered in both the conditions, the lack of change in rpS6P levels after retrieval in Context B - in particular in the central amygdala - suggests that the reconsolidation process could not occur after memory reactivation in a context different from the conditioned one.

Reconsolidation blockade for the treatment of addiction: challenges, new targets, and opportunities

Addiction is a chronic, relapsing disorder. The progression to pathological drug-seeking is thought to be driven by maladaptive learning processes which store and maintain associative memory, linking drug highs with cues and actions in the environment. These memories can encode Pavlovian associations which link predictive stimuli (e.g., people, places, and paraphernalia) with a hedonic drug high, as well as instrumental learning about the actions required to obtain drug-associated incentives. Learned memories are not permanent however, and much recent interest has been generated in exploiting the process of reconsolidation to erase or significantly weaken maladaptive memories to treat several mental health disorders, including addictions. Normally reconsolidation serves to update and maintain the adaptive relevance of memories, however administration of amnestic agents within the critical "reconsolidation window" can weaken or even erase maladaptive memories. Here we discuss recent advances in the field, including ongoing efforts to translate preclinical reconsolidation research in animal models into clinical practice.

Modulating reconsolidation and extinction to regulate drug reward memory

Drug addiction is an aberrant memory that shares the same memory processes as other memories. Brief exposure to drug-associated cues could result in reconsolidation, a hypothetical process during which original memory could be updated. In contrast, longer exposure times to drug-associated cues could trigger extinction, a process that decreases the conditioned responding. In this review, we discuss the pharmacological and non-pharmacological manipulations on the reconsolidation and extinction that could be used to interfere with drug reward memories. Pharmacological agents such as β-adrenergic receptor antagonist propranolol can interfere with reconsolidation to disrupt drug reward memory. Pharmacological agents such as the NMDA receptor glycine site agonists d-cycloserine and d-serine can facilitate extinction and then attenuate the expression of drug reward memory. Besides pharmacological interventions, drug-free behavioral approaches by utilizing the reconsolidation and extinction, such as 'post-retrieval extinction' and 'UCS-retrieval extinction', are also effective to erase or inhibit the recall of drug reward memory. Taken together, pharmacological modulation and non-pharmacological modulation of reconsolidation and extinction are promising approaches to regulate drug reward memory and prevent relapse.

Surprise and destabilize: prediction error influences episodic memory reconsolidation

Through the process of "reconsolidation," reminders can temporarily destabilize memories and render them vulnerable to change. Recent rodent research has proposed that prediction error, or the element of surprise, is a key component of this process; yet, this hypothesis has never before been extended to complex episodic memories in humans. In our novel paradigm, we used naturalistic stimuli to demonstrate that prediction error enables adaptive updating of episodic memories. In Study 1, participants (N = 48) viewed 18 videos, each depicting an action-outcome event. The next day, we reactivated these memories by presenting the videos again. We found that incomplete reminders, which interrupted videos before the outcome, made memories vulnerable to subsequent interference from a new set of videos, producing false memories. In Study 2 (N = 408), an independent sample rated qualities of the stimuli. We found that videos that were more surprising when interrupted produced more false memories. Last, in Study 3 (N = 24), we tested competing predictions of reconsolidation theory and the Temporal Context Model, an alternative account of source confusion. Consistent with the mechanistic time-course of reconsolidation, our effects were crucially time-dependent. Overall, we synthesize prior animal and human research to present compelling evidence that prediction error destabilizes episodic memories and drives dynamic updating in the face of new information.

Saccharin fading is not required for the acquisition of alcohol self-administration, and can alter the dynamics of cue-alcohol memory reconsolidation

RATIONALE

Animal models of alcohol-seeking are useful for understanding alcohol addiction and for treatment development, but throughput in these models is limited by the extensive pretraining required to overcome the aversive taste of ethanol. Work by Augier et al. (Psychopharmacology 231: 4561-4568, 2014) indicates that Wistar rats will self-administer alcohol without water deprivation, exposure to sweetened ethanol solutions or intermittent access to ethanol.

OBJECTIVES AND METHODS

We sought to replicate and extend the work of Augier et al. by comparing the acquisition of instrumental self-administration of ethanol in Lister-Hooded rats that had been previously saccharin faded (SF group) or not (NSF group). We also aimed to determine whether NMDA receptor antagonism with MK-801, given at memory reactivation, reduced subsequent ethanol-seeking behaviour in both groups of animals. Finally, we assessed the ethanol preference of SF and NSF rats using the two-bottle choice procedure.

RESULTS

Both SF and NSF groups acquired instrumental self-administration of ethanol, though SF rats consumed fewer of the earned reinforcers. MK-801, given at memory reactivation, had different effects on NSF and SF rats: impairing the capacity of an ethanol-paired conditioned stimulus (CS) to support reinstatement in NSF rats, and enhancing it in SF rats. Finally, neither SF nor NSF rats showed a preference for ethanol.

CONCLUSIONS

Our data support those of Augier et al. (Psychopharmacology 231: 4561-4568, 2014) that pretraining is unnecessary for rats to acquire instrumental self-administration of ethanol. Indeed, saccharin fading may produce a weaker memory that extinguishes more readily, thus accounting for the different effects of MK-801 on SF and NSF rats.

Changes in the element concentration of the dorsal hippocampus CA1 region during memory consolidation and reconsolidation

The concentration and distribution of Mg, P, Cl, K, Cu and Zn in the dorsal hippocampus CA1 region of rat brains were studied during memory consolidation and reconsolidation processes stimulated with inhibitory avoidance (IA) tests. Experimental rats were divided into four groups: i) group not submitted to inhibitory avoidance task (IA-N); ii) group submitted to inhibitory avoidance training session (IA-Y); iii) group submitted to inhibitory avoidance reactivation session but did not step down from the platform (IAR-N); and iv) group submitted to avoidance reactivation session and stepped down from the platform (IAR-Y). Elemental concentration and distribution in the CA1 hippocampus region were obtained through the Particle-Induced X-ray Emission (PIXE) technique. The results indicate that the concentration of Mg, P, Cl, K and Cu increased during memory consolidation. During the memory reconsolidation process, the concentrations of Mg, P, Cl and K increased, while Cu and Zn had no significant changes with respect to their basal condition. These results show that the major part of these elements may be engaged in memory consolidation could be also participating in memory reconsolidation. For all elements, the general trend related to their concentration did not change during reconsolidation regardless the presence of a novelty event, i.e. stepping down from the platform.

Knockdown of zif268 in the Posterior Dorsolateral Striatum Does Not Enduringly Disrupt a Response Memory of a Rewarded T-Maze Task

•

Zif268 expression in the pDLS is not required for retrieval of habit-like memory.

•

Knockdown of pDLS Zif268 expression reduces habit-like memory restabilization.

•

Zif268 expression increased in the BLA after reward memory retrieval.

•

Despite extended T-Maze training rats did not use a S-R strategy.

Under certain conditions pavlovian memories undergo reconsolidation, whereby the reactivated memory can be disrupted by manipulations such as knockdown of zif268. For instrumental memories, reconsolidation disruption is less well established. Our previous, preliminary data identified that there was an increase in Zif268 in the posterior dorsolateral striatum (pDLS) after expression of an instrumental habit-like 'response' memory, but not an instrumental goal-directed 'place' memory on a T-maze task. Here, the requirement for Zif268 in the reconsolidation of a response memory was tested by knockdown of Zif268, using antisense oligodeoxynucleotide infusion into the pDLS, at memory reactivation. Zif268 knockdown reduced response memory expression 72H, but not 7d later. Western blotting revealed a non-significant increase in Zif268 in the pDLS in rats using response memories, but there was no change in Zif268 expression in the hippocampus following retrieval of a place memory. Zif268 expression increased in the basolateral amygdala after memory reactivation whether a response or place strategy was used during reactivation. We propose that Zif268 expression in the basolateral amygdala may be linked to prediction error, generated by the absence of reward at reactivation. Taken together, these results suggest a complex role for Zif268 in the maintenance of instrumental memories.

Infralimbic GluN2A-Containing NMDA Receptors Modulate Reconsolidation of Cocaine Self-Administration Memory

Addiction is characterized by high relapse susceptibility, and relapse can be triggered by drug-associated cues. Cue presentation induces retrieval of the drug-cue memory, which becomes labile and must be reconsolidated into long-term storage. Repeated unpaired cue presentation, however, promotes extinction. Cue-reactivity can be reduced by blocking reconsolidation or facilitating extinction, which are mediated by NMDA receptors (NMDArs). However, the role of NMDArs in either process following self-administration is unclear. Thus, to determine their role in extinction, rats learned to self-administer cocaine before receiving injections of the NMDAr antagonist CPP immediately after four 45-min extinction sessions. During a subsequent 90-min extinction retention test, CPP-treated rats lever pressed less than saline-treated rats indicating that NMDAr blockade facilitated extinction or disrupted drug-cue memory reconsolidation. In addition, infusing CPP into the infralimbic medial prefrontal cortex (IL-mPFC), a structure implicated in extinction, before four 45-min or immediately after four 30min extinction sessions, had similar results during the extinction retention tests. Next, the GluN2A-selective antagonist NVP or GluN2B-selective antagonist Ro25 was infused into IL-mPFC or nucleus accumbens (NAc) shell, another structure implicated in extinction, after four 45-min extinction sessions. Blocking GluN2A-, but not GluN2B-, containing NMDArs, in IL-mPFC or NAc shell reduced lever pressing during the extinction retention tests. Finally, to dissociate reconsolidation from extinction, NVP was infused into IL-mPFC after four 10-min reactivation sessions, which resulted in reduced lever pressing during the retention test. These results indicate that IL-mPFC GluN2A-containing NMDArs modulate reconsolidation, and suggest a novel treatment strategy, as reducing cue reactivity could limit relapse susceptibility.

Postretrieval Extinction Attenuates Alcohol Cue Reactivity in Rats

BACKGROUND

Conditioned responses to alcohol-associated cues can hinder recovery from alcohol use disorder (AUD). Cue exposure (extinction) therapy (CET) can reduce reactivity to alcohol cues, but its efficacy is limited by phenomena such as spontaneous recovery and reinstatement that can cause a return of conditioned responding after extinction. Using a preclinical model of alcohol cue reactivity in rats, we evaluated whether the efficacy of alcohol CET could be improved by conducting CET during the memory reconsolidation window after retrieval of cue-alcohol associations.

METHODS

Rats were provided with intermittent access to unsweetened alcohol. Rats were then trained to predict alcohol access based on a visual cue. Next, rats were treated with either standard extinction (n = 14) or postretrieval extinction (n = 13). Rats were then tested for long-term memory of extinction and susceptibility to spontaneous recovery and reinstatement.

RESULTS

Despite equivalent extinction, rats treated with postretrieval extinction exhibited reduced spontaneous recovery and reinstatement relative to rats treated with standard extinction.

CONCLUSIONS

Postretrieval CET shows promise for persistently attenuating the risk to relapse posed by alcohol cues in individuals with AUD.

Reconsolidation and psychopathology: Moving towards reconsolidation-based treatments

Interfering with memory reconsolidation has valuable potential to be used as a treatment for maladaptive memories and psychiatric disorders. Numerous studies suggest that reconsolidation-based therapies may benefit psychiatric populations, but much remains unanswered. After reviewing the literature in clinical and healthy human populations, we discuss some of the major limitations to reconsolidation studies and clinical application. Finally, we provide recommendations for developing improved reconsolidation-based treatments, namely exploiting known boundary conditions and focusing on a novel unconditioned stimulus-retrieval paradigm.

Reward disrupts reactivated human skill memory

Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing reactivated memories did not strengthen the memory, but rather led to disruption of the memory trace, breaking down the link between memory reactivation and subsequent memory strength. Statistical modeling further revealed a strong mediating role for memory reactivation in linking between memory encoding and subsequent memory strength only when the memory was replayed without reinforcement. We suggest that, rather than reinforcing the existing memory trace, reward creates a competing memory trace, impairing expression of the original reward-free memory. This mechanism sheds light on the processes underlying skill acquisition, having wide translational implications.

Prediction error and trace dominance determine the fate of fear memories after post-training manipulations

Different mnemonic outcomes have been observed when associative memories are reactivated by CS exposure and followed by amnestics. These outcomes include mere retrieval, destabilization-reconsolidation, a transitional period (which is insensitive to amnestics), and extinction learning. However, little is known about the interaction between initial learning conditions and these outcomes during a reinforced or nonreinforced reactivation. Here we systematically combined temporally specific memories with different reactivation parameters to observe whether these four outcomes are determined by the conditions established during training. First, we validated two training regimens with different temporal expectations about US arrival. Then, using Midazolam (MDZ) as an amnestic agent, fear memories in both learning conditions were submitted to retraining either under identical or different parameters to the original training. Destabilization (i.e., susceptibly to MDZ) occurred when reactivation was reinforced, provided the occurrence of a temporal prediction error about US arrival. In subsequent experiments, both treatments were systematically reactivated by nonreinforced context exposure of different lengths, which allowed to explore the interaction between training and reactivation lengths. These results suggest that temporal prediction error and trace dominance determine the extent to which reactivation produces the different outcomes.

Anisomycin in the medial prefrontal cortex reduces reconsolidation of cocaine-associated memories in the rat self-administration model

We tested the hypothesis that infusion of anisomycin into the medial prefrontal cortex (mPFC) disrupts the reconsolidation of a cocaine-associated memory in the rat cocaine self-administration model. Male Sprague-Dawley rats were trained to lever press for cocaine self-administration (0.5 mg/kg/infusion) along with a cue light presentation on an FR1 followed by an FR3 schedule of reinforcement for 2 h/day. Rats were then given extinction sessions or an equivalent forced abstinence period followed by a 5 min memory reactivation session during which time they received an ip cocaine injection (10 mg/kg, ip) and were allowed to press for contingent cue light presentation. Immediately after reactivation, they were administered an intra-mPFC infusion of vehicle or anisomycin. Two additional control groups received extinction and either no memory reactivation and intra-mPFC infusions as above or intra-mPFC infusions 6 h after memory reactivation. A fourth group received forced abstinence and intra-mPFC infusions immediately after memory reactivation. Combined cocaine + cue-induced reinstatement was given 2-3 days (early) and 8-12 days (late) later. Rats given anisomycin in the Extinction + Reactivation demonstrated decreased reinstatement, while anisomycin treatment did not alter behavior in any of the other three groups. These results suggest that extinction training may recruit the mPFC such that it renders the memory susceptible to disruption by anisomycin. These findings have implications for using extinction training prior to or in conjunction with other therapies, including reconsolidation disruption, to enhance prefrontal control over drug-seeking behavior.

Reduction in Responding for Sucrose and Cocaine Reinforcement by Disruption of Memory Reconsolidation

Stored memories are dynamic and, when reactivated, can undergo a process of destabilization and reconsolidation to update them with new information. Reconsolidation has been shown for a variety of experimental settings; most recently for well-learned instrumental memories, a class of memory previously thought not to undergo reconsolidation. Here we tested, in rats, whether a weakly-trained lever-pressing memory destabilized following a shift in reinforcement contingency. We show that lever-pressing memory for both sucrose and cocaine reinforcement destabilized under appropriate conditions, and that the reconsolidation of this memory was impaired by systemic administration of the NMDA receptor (NMDAR) antagonist [5R,10S]-[+]-5-methyl-10,1-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine (MK-801). We went on to investigate the potential role of the nucleus accumbens (NAc) in the reconsolidation of sucrose-reinforced instrumental memories, showing that co-infusion of the NMDAR antagonist 2-amino-5-phosphonopentanoic acid (AP-5) and the dopamine-1 receptor (D1R) antagonist 7-chloro-3-methyl-1-phenyl-1,2,4,5-tetrahydro-3-benzazepin-8-ol (SCH23390) into the NAc prior to memory reactivation impaired reconsolidation; however, there was no effect when these drugs were infused alone. Further investigation of this effect suggests the combined infusion disrupted the reconsolidation of pavlovian components of memory, and we hypothesize that coactivation of accumbal D1Rs and NMDARs may contribute to both the destabilization and reconsolidation of appetitive memory. Our work demonstrates that weakly-trained instrumental memories undergo reconsolidation under similar parameters to well-trained ones, and also suggests that receptor coactivation in the NAc may contribute to memory destabilization. Furthermore, it provides an important demonstration of the therapeutic potential of reconsolidation-based treatments that target the instrumental components of memory in maladaptive drug seeking.