The role of prediction error and memory destabilization in extinction of cued-fear within the reconsolidation window

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Manipulating critical memory periods to treat psychiatry disorders

The persistence of pathological memory is the basis of several psychiatric disorders. Memory retrieval induces "reconsolidation", a time interval during which the original memory becomes labile and destabilized. Time- and retrieval-dependent processes and memory reconsolidation are critical periods for memory interference. Modulating memory reconsolidation has received considerable research attention as a treatment protocol for several psychiatric conditions such as posttraumatic stress disorder, addiction, anxiety, and trauma-related disorders. This specific time window provides an opportunity for intervention regarding mental diseases. This article reviews the effect of modulating memory reconsolidation using behavioral-, brain stimulation-, and pharmacological-based interventions, which may help bridge the gap between intervention in laboratories and application in clinical practice. The potential advantages, limitations, challenges, and opportunities for memory reconsolidation manipulations were discussed.

Closed-loop brain stimulation augments fear extinction in male rats

Dysregulated fear reactions can result from maladaptive processing of trauma-related memories. In post-traumatic stress disorder (PTSD) and other psychiatric disorders, dysfunctional extinction learning prevents discretization of trauma-related memory engrams and generalizes fear responses. Although PTSD may be viewed as a memory-based disorder, no approved treatments target pathological fear memory processing. Hippocampal sharp wave-ripples (SWRs) and concurrent neocortical oscillations are scaffolds to consolidate contextual memory, but their role during fear processing remains poorly understood. Here, we show that closed-loop, SWR triggered neuromodulation of the medial forebrain bundle (MFB) can enhance fear extinction consolidation in male rats. The modified fear memories became resistant to induced recall (i.e., 'renewal' and 'reinstatement') and did not reemerge spontaneously. These effects were mediated by D2 receptor signaling-induced synaptic remodeling in the basolateral amygdala. Our results demonstrate that SWR-triggered closed-loop stimulation of the MFB reward system enhances extinction of fearful memories and reducing fear expression across different contexts and preventing excessive and persistent fear responses. These findings highlight the potential of neuromodulation to augment extinction learning and provide a new avenue to develop treatments for anxiety disorders.

The challenge of memory destabilisation: From prediction error to prior expectations and biomarkers

The re-ignition of memory reconsolidation research sparked by Karim Nader in the early 2000s led to great excitement that 'reconsolidation-based' interventions might be developed for mental health disorders such as post-traumatic stress disorder and substance use disorder. Two decades on, it is clear that reconsolidation-based interventions have been more challenging to translate to the clinic than initially thought. We argue that this challenge could be addressed with a better understanding of how prior expectations interact with information presented in a putative memory reactivation / cue reminder session, and through the identification of non-invasive biomarkers for memory destabilisation that would allow reminder sessions to be 'tuned' to enhance memory lability in an ad hoc manner.

Reconsolidation and Fear Extinction: An Update

Fear memories can be updated behaviorally by delivering extinction trials during the reconsolidation window, which results in a persistent attenuation of fear memories (Monfils et al., Science 324:951-955, 2009). This safe and non-invasive paradigm, termed retrieval-extinction (or post-retrieval extinction), has also been found to be successful at preventing the return of fear in healthy fear conditioned humans (Schiller et al., Nature 463:49-53, 2010), and in the time since its discovery, there has been an explosion of research on the use of retrieval-extinction in fear memories in humans and other animals, some of which have found a long-term reduction in conditioned responding, and some who have not. These discrepant findings have raised concerns as to whether retrieval-extinction really results in updating of the original fear memory, or if it simply enhances extinction. We will first review the progress made on elucidating the cellular mechanisms underlying the fear attenuating effects of retrieval-extinction and how they differ from traditional extinction. Special attention will be paid to the molecular events necessary for retrieval-extinction to successfully occur and how these reconsolidated memories are represented in the brain. Next, we will examine the parameters that determine whether or not a memory will be updated via extinction during the reconsolidation window (also known as boundary conditions). These boundary conditions will also be discussed as possible explanations for discrepant findings of the retrieval-extinction effect. Then we will examine the factors that can determine whether an individual's fears will successfully be attenuated by retrieval-extinction. These individual differences include genetics, age, and psychopathology. Finally, we will discuss recent attempts to bring the retrieval-extinction paradigm from the bench to the bedside for the behavioral treatment of anxiety and trauma disorders.

Reconsolidation: A paradigm shift

This commentary is part of a special issue honoring Karim Nader and his focal role in igniting the reconsolidation field. The commentary describes in broad strokes the evolution of the field, its branches, major challenges, and future endeavors.

Appraising reconsolidation theory and its empirical validation

Re-exposure to elements of prior experiences can create opportunities for inducing amnesia for those events. The dominant theoretical framework posits that such re-exposure can result in memory destabilization, making the memory representation temporarily sensitive to disruption while it awaits reconsolidation. If true, such a mechanism that allows for memories to be permanently changed could have important implications for the treatment of several forms of psychopathology. However, there have been contradictory findings and elusive occurrences of replication failures within the "reconsolidation" field. Considering its potential relevance for clinical applications, the fact that this "hot" research area is being dominated by a single mechanistic theory, and the presence of unexplainable contradictory findings, we believe that it is both useful and timely to critically evaluate the reconsolidation framework. We discuss potential issues that may arise from how reconsolidation interference has typically been deducted from behavioral observations, and provide a principled assessment of reconsolidation theory that illustrates that the theory and its proposed boundary conditions are vaguely defined, which has made it close to impossible to refute reconsolidation theory. We advocate for caution, encouraging researchers not to blindly assume that a reconsolidation process must underlie their findings, and pointing out the risks of doing so. Finally, we suggest concrete theoretical and methodological advances that can promote a fruitful translation of reminder-dependent amnesia into clinical treatment.

Diverse therapeutic developments for post-traumatic stress disorder (PTSD) indicate common mechanisms of memory modulation

Post-traumatic stress disorder (PTSD), characterized by abnormally persistent and distressing memories, is a chronic debilitating condition in need of new treatment options. Current treatment guidelines recommend psychotherapy as first line management with only two drugs, sertraline and paroxetine, approved by U.S. Food and Drug Administration (FDA) for treatment of PTSD. These drugs have limited efficacy as they only reduce symptoms related to depression and anxiety without producing permanent remission. PTSD remains a significant public health problem with high morbidity and mortality requiring major advances in therapeutics. Early evidence has emerged for the beneficial effects of psychedelics particularly in combination with psychotherapy for management of PTSD, including psilocybin, MDMA, LSD, cannabinoids, ayahuasca and ketamine. MDMA and psilocybin reduce barrier to therapy by increasing trust between therapist and patient, thus allowing for modification of trauma related memories. Furthermore, research into the memory reconsolidation mechanisms has allowed for identification of various pharmacological targets to disrupt abnormally persistent memories. A number of pre-clinical and clinical studies have investigated novel and re-purposed pharmacological agents to disrupt fear memory in PTSD. Novel therapeutic approaches like neuropeptide Y, oxytocin, cannabinoids and neuroactive steroids have also shown potential for PTSD treatment. Here, we focus on the role of fear memory in the pathophysiology of PTSD and propose that many of these new therapeutic strategies produce benefits through the effect on fear memory. Evaluation of recent research findings suggests that while a number of drugs have shown promising results in preclinical studies and pilot clinical trials, the evidence from large scale clinical trials would be needed for these drugs to be incorporated in clinical practice.

Using Extinction-Renewal to Circumvent the Memory Strength Boundary Condition in Fear Memory Reconsolidation

Reconsolidation is a process by which memories are destabilized, updated, and then restabilized. Strong memories are resistant to undergoing reconsolidation. Here, we addressed whether an overtrained fear memory could be made susceptible to reconsolidation by first extinguishing, and then renewing, the memory. Rats were trained with ten tone-footshock pairings, followed by eight days of tone extinction in the training context. The next day, rats were placed into a second context and memory for the tone was renewed/reactivated with a single tone presentation. Immediately following reactivation, rats received an injection of midazolam or vehicle. Rats were then tested for freezing to the tone in a third context. Midazolam had no effect in rats that did not undergo tone extinction, but significantly attenuated freezing to the tone in extinguished rats. Thus, rats that received tone extinction underwent tone memory reconsolidation following its renewal. In a second experiment, we administered the reactivation session and midazolam injections prior to extinction. Midazolam had no effect and rats extinguished at a rate similar to controls. These data suggest that strong emotional memories are capable of updating following weakening of memory expression through extinction.

Understanding the dynamic and destiny of memories

Memory formation enables the retention of life experiences overtime. Based on previously acquired information, organisms can anticipate future events and adjust their behaviors to maximize survival. However, in an ever-changing environment, a memory needs to be malleable to maintain its relevance. In fact, substantial evidence suggests that a consolidated memory can become labile and susceptible to modifications after being reactivated, a process termed reconsolidation. When an extinction process takes place, a memory can also be temporarily inhibited by a second memory that carries information with opposite meaning. In addition, a memory can fade and lose its significance in a process known as forgetting. Thus, following retrieval, new life experiences can be integrated with the original memory trace to maintain its predictive value. In this review, we explore the determining factors that regulate the fate of a memory after its reactivation. We focus on three post-retrieval memory destinies (reconsolidation, extinction, and forgetting) and discuss recent rodent studies investigating the biological functions and neural mechanisms underlying each of these processes.

Investigating the efficacy of the reminder-extinction procedure to disrupt contextual threat memories in humans using immersive Virtual Reality

Upon reactivation, consolidated memories can enter a temporary labile state and require restabilisation, known as reconsolidation. Interventions during this reconsolidation period can disrupt the reactivated memory. However, it is unclear whether different kinds of memory that depend on distinct brain regions all undergo reconsolidation. Evidence for reconsolidation originates from studies assessing amygdala-dependent memories using cue-conditioning paradigms in rodents, which were subsequently replicated in humans. Whilst studies providing evidence for reconsolidation of hippocampus-dependent memories in rodents have predominantly used context conditioning paradigms, studies in humans have used completely different paradigms such as tests for wordlists or stories. Here our objective was to bridge this paradigm gap between rodent and human studies probing reconsolidation of hippocampus-dependent memories. We modified a recently developed immersive Virtual Reality paradigm to test in humans whether contextual threat-conditioned memories can be disrupted by a reminder-extinction procedure that putatively targets reconsolidation. In contrast to our hypothesis, we found comparable recovery of contextual conditioned threat responses, and comparable retention of subjective measures of threat memory, episodic memory and exploration behaviour between the reminder-extinction and standard extinction groups. Our result provide no evidence that a reminder before extinction can prevent the return of context conditioned threat memories in humans.

Retrieval-Dependent Mechanisms Affecting Emotional Memory Persistence: Reconsolidation, Extinction, and the Space in Between

Maladaptive emotional memories contribute to the persistence of many mental health disorders, and therefore the prospect of disrupting these memories to produce long-term reductions in relapse is of great clinical appeal. Reducing the impact of maladaptive emotional memories on behaviour could be achieved by two retrieval-dependent manipulations that engage separate mnemonic processes: "reconsolidation disruption" and "extinction enhancement." Extinction occurs during a prolonged re-exposure session in the absence of the expected emotional outcome and is widely accepted as reflecting the formation of a new, inhibitory memory that prevents behavioural expression of the original trace. Reconsolidation, by contrast, involves the destabilisation of the original memory, allowing for subsequent updating and restabilisation in specific brain regions, unless the re-stabilization process is prevented through specific pharmacological or behavioural interventions. Both destabilisation of the original memory and memory extinction require that re-exposure induces prediction error-a mismatch between what is expected and what actually occurs-but the parameters that allow reconsolidation and extinction to occur, and control the transition between them, have not been well-characterised. Here, we review what is known about the induction of memory destabilisation and extinction, and the transition period that separates these mnemonic processes, drawing on preclinical and clinical examples. A deeper understanding of the processes that determine the alternative routes to memory persistence or inhibition is critical for designing new and more reliable clinical treatments targeting maladaptive emotional memories.

Retrieval-Extinction and Relapse Prevention: Rewriting Maladaptive Drug Memories?

Addicted individuals are highly susceptible to relapse when exposed to drug-associated conditioned stimuli (CSs; "drug cues") even after extensive periods of abstinence. Until recently, these maladaptive emotional drug memories were believed to be permanent and resistant to change. The rediscovery of the phenomenon of memory reconsolidation-by which retrieval of the memory can, under certain conditions, destabilize the previously stable memory before it restabilizes in its new, updated form-has led to the hypothesis that it may be possible to disrupt the strong maladaptive drug-memories that trigger a relapse. Furthermore, recent work has suggested that extinction training "within the reconsolidation window" may lead to a long-term reduction in relapse without the requirement for pharmacological amnestic agents. However, this so-called "retrieval-extinction" effect has been inconsistently observed in the literature, leading some to speculate that rather than reflecting memory updating, it may be the product of facilitation of extinction. In this mini review article, we will focus on factors that might be responsible for the retrieval-extinction effects on preventing drug-seeking relapse and how inter-individual differences may influence this therapeutically promising effect. A better understanding of the psychological and neurobiological mechanisms underpinning the "retrieval-extinction" paradigm, and individual differences in boundary conditions, should provide insights with the potential to optimize the translation of "retrieval-extinction" to clinical populations.

Fear not: recent advances in understanding the neural basis of fear memories and implications for treatment development

Fear is a highly adaptive emotion that has evolved to promote survival and reproductive fitness. However, maladaptive expression of fear can lead to debilitating stressor-related and anxiety disorders such as post-traumatic stress disorder. Although the neural basis of fear has been extensively researched for several decades, recent technological advances in pharmacogenetics and optogenetics have allowed greater resolution in understanding the neural circuits that underlie fear. Alongside conceptual advances in the understanding of fear memory, this increased knowledge has clarified mechanisms for some currently available therapies for post-traumatic stress disorder and has identified new potential treatment targets.

Reactivation of the Unconditioned Stimulus Inhibits the Return of Fear Independent of Cortisol

Reconsolidation is the post-retrieval stabilization of memories, a time-limited process during which reactivated (i.e., retrieved) memories can be updated with new information, become stronger or weaker, depending on the specific treatment. We have previously shown that the stress hormone cortisol has an enhancing effect on the reconsolidation of fear memories in men. This effect was specific, i.e., limited to the conditioned stimulus (CS) that was reactivated, and did not generalize to other previously reinforced, but not reactivated CS. Based on these results, we suggested that cortisol plays a critical role in the continuous strengthening of reactivated emotional memories, contributing to their persistence and robustness. In the current study, we aimed to achieve a more generalized reconsolidation enhancement using an alternative reactivation method, i.e., by a low-intensity unconditioned stimulus (UCS) presentation instead of the more common unreinforced CS presentation. In previous studies, UCS reactivation was shown to lead to a more generalized reconsolidation effect. Therefore, we hypothesized that the combination of cortisol treatment and UCS reactivation would lead to an enhanced fear memory reconsolidation, which would generalize from previously reinforced CS to stimuli that resemble it. We tested 75 men in a 3-day fear conditioning paradigm: fear acquisition training on day 1; UCS reactivation/no reactivation and pharmacological treatment (20 mg hydrocortisone/placebo) on day 2; extinction training, reinstatement and test (of original and modified stimuli) on day 3. In contrast to our hypothesis, UCS reactivation prevented the return of fear [observed in skin conductance responses (SCR)] regardless of the pharmacological manipulation: while reinstatement to the original CS was found in the no-reactivation group, both reactivation groups (cortisol and placebo) showed no reinstatement. As the only methodological difference between our previous study and the current one was the reactivation method, we focus on UCS reactivation as the main explanation for these unexpected findings. We suggest that the robust prediction error generated by the UCS reactivation method (as opposed to CS reactivation), combined with the lower UCS intensity, has by itself weakened the emotional value of the UCS, thus preventing the return of fear to the CS that was associated with it. We call for future research to support these findings and to examine the potential of this reactivation method, or variations thereof, as a tool for therapeutic use.

Neurochemical and molecular mechanisms underlying the retrieval-extinction effect

Extinction within the reconsolidation window, or 'retrieval-extinction', has received much research interest as a possible technique for targeting the reconsolidation of maladaptive memories with a behavioural intervention. However, it remains to be determined whether the retrieval-extinction effect-a long-term reduction in fear behaviour, which appears resistant to spontaneous recovery, renewal and reinstatement-depends specifically on destabilisation of the original memory (the 'reconsolidation-update' account) or represents facilitation of an extinction memory (the 'extinction-facilitation' account). We propose that comparing the neurotransmitter systems, receptors and intracellular signalling pathways recruited by reconsolidation, extinction and retrieval-extinction will provide a way of distinguishing between these accounts.