Role of prediction error in destabilizing fear memories in retrieval extinction and its neural mechanisms

The journey within: mental navigation as a novel framework for understanding psychotherapeutic transformation

BACKGROUND

Despite the demonstrated efficacy of psychotherapy, the precise mechanisms that drive therapeutic transformations have posed a challenge and still remain unresolved. Here, we suggest a potential solution to this problem by introducing a framework based on the concept of mental navigation. It refers to our ability to navigate our cognitive space of thoughts, ideas, concepts, and memories, similar to how we navigate physical space. We start by analyzing the neural, cognitive, and experiential constituents intrinsic to mental navigation. Subsequently, we posit that the metaphoric spatial language we employ to articulate introspective experiences (e.g., "unexplored territory" or "going in circles") serves as a robust marker of mental navigation.

METHODS

Using large text corpora, we compared the utilization of spatial language between transcripts of psychotherapy sessions (≈ 12 M. words), casual everyday conversations (≈ 12 M. words), and fictional dialogues in movies (≈ 14 M. words). We also examined 110 psychotherapy transcripts qualitatively to discern patterns and dynamics associated with mental navigation.

RESULTS

We found a notable increase in the utilization of spatial metaphors during psychotherapy compared to casual everyday dialogues (U = 192.0, p = .001, d = 0.549) and fictional conversations (U = 211, p < .001, d = 0.792). In turn, analyzing the usage of non-spatial metaphors, we did not find significant differences between the three datasets (H = 0.682, p = 0.710). The qualitative analysis highlighted specific examples of mental navigation at play.

CONCLUSION

Mental navigation might underlie the psychotherapy process and serve as a robust framework for understanding the transformative changes it brings about.

Manipulating critical memory periods to treat psychiatry disorders

The persistence of pathological memory is the basis of several psychiatric disorders. Memory retrieval induces "reconsolidation", a time interval during which the original memory becomes labile and destabilized. Time- and retrieval-dependent processes and memory reconsolidation are critical periods for memory interference. Modulating memory reconsolidation has received considerable research attention as a treatment protocol for several psychiatric conditions such as posttraumatic stress disorder, addiction, anxiety, and trauma-related disorders. This specific time window provides an opportunity for intervention regarding mental diseases. This article reviews the effect of modulating memory reconsolidation using behavioral-, brain stimulation-, and pharmacological-based interventions, which may help bridge the gap between intervention in laboratories and application in clinical practice. The potential advantages, limitations, challenges, and opportunities for memory reconsolidation manipulations were discussed.

Making Leaps and Hitting Boundaries in Reconsolidation: Overcoming Boundary Conditions to Increase Clinical Translatability of Reconsolidation-based Therapies

Reconsolidation results in the restabilisation, and thus persistence, of a memory made labile by retrieval, and interfering with this process is thought to enable modification or weakening of the original trace. As such, reconsolidation-blockade has been a focus of research aiming to target the maladaptive memories underlying mental health disorders, including post-traumatic stress disorder and drug addiction. Current first-line therapies are not effective for all patients, and a substantial proportion of those for whom therapies are effective later relapse. A reconsolidation-based intervention would be invaluable as an alternative treatment for these conditions. However, the translation of reconsolidation-based therapies to the clinic presents a number of challenges, with arguably the greatest being the overcoming of the boundary conditions governing the opening of the reconsolidation window. These include factors such as the age and strength of memory, and can broadly be divided into two categories: intrinsic features of the targeted memory itself, and parameters of the reactivation procedure used. With maladaptive memory characteristics inevitably varying amongst individuals, manipulation of the other limitations imposed by procedural variables have been explored to circumvent the boundary conditions on reconsolidation. Although several apparently discrepant results remain to be reconciled and these limitations yet to be truly defined, many studies have produced successful results which encouragingly demonstrate that boundary conditions may be overcome using various proposed strategies to enable translation of a reconsolidation-based intervention to clinical use.

Muscarinic receptor activation overrides boundary conditions on memory updating in a calcium/calmodulin-dependent manner

Long-term memory storage is a dynamic process requiring flexibility to ensure adaptive behavioural responding in changing environments. Indeed, it is well established that memory reactivation can "destabilize" consolidated traces, leading to various forms of updating. However, the neurobiological mechanisms rendering long-term memories labile and modifiable remain poorly described. Moreover, boundary conditions, such as the age or strength of the memory, can reduce the likelihood of this destabilization; yet, intuitively, these most behaviourally influential of memories should also be modifiable under appropriate conditions. Here, we provide evidence that salient novelty at the time of memory reactivation promotes integrative updating of resistant object memories in rats. Furthermore, blockade of muscarinic acetylcholine receptors (mAChRs; with pirenzepine) or disruption of calcium/calmodulin (Ca²⁺/CaM) with KN-93, a Ca²⁺/CaM-binding molecule that inhibits calcium/calmodulin-dependent protein kinase II (CaMKII) activation, in perirhinal cortex (PRh) prevented novelty-induced destabilization and updating of resistant object memories. Finally, PRh M₁ mAChR activation (with CDD-0102A) was sufficient to destabilize resistant object memories for updating, and this effect was blocked by KN-93, possibly via inhibition of CaMKII activity. Thus, mAChRs and activation of CaMKII appear to interact as part of a mechanism to override boundary conditions on resistant object memories to ensure integrative modification with novel information. These findings therefore have important implications for understanding the dynamic nature of long-term memory storage and potential treatments for conditions characterized by maladaptive and inflexible memories.

Effects of the retrieval-extinction paradigm with abstract reminders on fear memory extinction

Reactivated fear memories may enter an unstable state that could be interrupted by behavioral interventions such as the retrieval-extinction procedure. Studies of pharmacological interventions have shown that retrieval cues are not necessarily an exact reduplication of initial conditioned stimuli (CSs); they can instead be abstract word cues. However, the effectiveness of using abstract reminder cues in behavioral intervention procedures remains unknown, as do the conditions under which they are effective. The typicality of CS and the abstraction level of reminders are also likely to be important in the paradigm but have not been investigated to date. Here, in three experiments (n = 107), we manipulate the fear conditioning process, including single CS-unconditioned stimulus (US) and multiple CS-US connections, as well as the CS typicality and abstraction level of reminder cues, to explore the conditions for adopting retrieval-extinction with abstract reminders. The results of Experiments 1 and 2 show that the abstract cue is ineffective for use as a reminder in the procedure; this is the case for single exemplar category learning and perceptual discriminative learning, independent of the typicality of CS+ or the abstraction level of reminder cues. Only the outcome of Experiment 3, which contains multiple CS-US connections, shows no indication of fear return. The limitations of the study and possible interpretations of the results are discussed.

A critical perspective on updating drug memories through the integration of memory editing and brain stimulation

Addiction is a persistent, recurring condition characterized by repeated relapses despite the desire to control drug use or maintain sobriety. The attainment of abstinence is hindered by persistent maladaptive drug-associated memories, which drive drug-seeking and use behavior. This article examines the preliminary evidence supporting the combination of non-invasive brain stimulation (NIBS) techniques and memory editing (or reconsolidation) interventions as add-on forms of treatment for individuals with substance-related disorders (SUD). Studies have shown that NIBS can modestly reduce drug use and craving through improved cognitive control or other undetermined reasons. Memory reconsolidation, a process by which a previously consolidated memory trace can be made labile again, can potentially erase or significantly weaken SUD memories underpinning craving and the propensity for relapse. This approach conveys enthusiasm while also emphasizing the importance of managing boundary conditions and null results for interventions found on fear memory reconsolidation. Recent studies, which align with the state-dependency and activity-selectivity hypotheses, have shown that the combination of NIBS and behavioral interventions holds promise for treating SUD by reducing self-reported and physiological aspects of craving. Effective long-term outcomes for this procedure require better identification of critical memories, a deeper understanding of the brain mechanisms underlying SUD and memory reconsolidation and overcoming any boundary conditions of destabilized memories. This will enable the procedure to be personalized to the unique needs of individual patients.

Dissociating the involvement of muscarinic and nicotinic cholinergic receptors in object memory destabilization and reconsolidation

The content of long-term memory is neither fixed nor permanent. Reminder cues can destabilize consolidated memories, rendering them amenable to change before being reconsolidated. However, not all memories destabilize following reactivation. Characteristics of a memory, such as its age or strength, impose boundaries on destabilization. Previously, we demonstrated that presentation of salient novel information at the time of reactivation can readily destabilize resistant object memories in rats and this form of novelty-induced destabilization is dependent upon acetylcholine (ACh) activity at muscarinic receptors (mAChRs). In the present study, we sought to determine if this same mechanism for initiating destabilization of resistant object memories is present in mice and further expand our understanding of the mechanisms through which ACh modulates object memory destabilization by investigating the role of nicotinic receptors (nAChRs). We provide evidence that in mice mAChRs are necessary for destabilizing object memories that are readily destabilized and those that are resistant to destabilization. Conversely, nAChRs were found to be necessary only when memories are readily destabilized. We then investigated the role of both receptors in the reconsolidation of destabilized object memory traces and determined that nAChRs, but not mAChRs, are necessary for object memory reconsolidation. Together, these results suggest that nAChRs may play a more selective role in the re-storage of object memories following destabilization and that ACh acts through mAChRs to act as an override signal to initiate destabilization of resistant object memories following reactivation with novelty. These findings expand our current understanding of the role of ACh in the dynamic storage of long-term memory.

Verbal manipulations of learning expectancy do not enhance reconsolidation

Objectives

Pharmacological studies using propranolol suggest that if reactivation signals that new information will be learned (i.e., there is an expectation for learning) reconsolidation can be enhanced. We examined if the verbal instructions to expect new learning will enhance reconsolidation of fear memories using the post-retrieval extinction paradigm.

Methods

On day one, participants (n = 48) underwent differential fear conditioning to two images (CS+ and CS-). On day two, participants were randomly assigned to one of three groups; groups one and two had their memory for the CS+ reactivated (i.e., a single presentation of the CS+) 10 minutes prior to extinction, whereas group three did not have their memory reactivated but went right to extinction (no reactivation group). One reactivation group was told that they would learn something new about the images (expectation for learning group), and the other group was told that they would not learn anything new (no expectation for learning group). On day three, return of fear was measured following reinstatement (i.e., four shocks). Fear potentiated startle (FPS) and skin conductance response (SCR) were measured throughout.

Results

There was evidence of fear acquisition for participants for SCR but not FPS. With regards to reconsolidation, SCR increased for the CS+ and CS-in all groups from the end of extinction to the beginning of re-extinction (i.e., return of fear). For FPS, post-hoc tests conducted on the sub-group of participants showing fear learning showed that FPS remained stable in the two reactivation groups, but increased to the CS+, but not the CS- in the no reactivation group.

Implications

These findings suggest that a verbal manipulation of the expectation for learning may not be salient enough to enhance reconsolidation. Results are discussed in relation to theories on differences in between SCR, as a measure of cognitive awareness, and FPS, as a measure of fear.

The evidence for and against reactivation-induced memory updating in humans and nonhuman animals

Systematic investigation of reactivation-induced memory updating began in the 1960s, and a wave of research in this area followed the seminal articulation of "reconsolidation" theory in the early 2000s. Myriad studies indicate that memory reactivation can cause previously consolidated memories to become labile and sensitive to weakening, strengthening, or other forms of modification. However, from its nascent period to the present, the field has been beset by inconsistencies in researchers' abilities to replicate seemingly established effects. Here we review these many studies, synthesizing the human and nonhuman animal literature, and suggest that these failures-to-replicate reflect a highly complex and delicately balanced memory modification system, the substrates of which must be finely tuned to enable adaptive memory updating while limiting maladaptive, inaccurate modifications. A systematic approach to the entire body of evidence, integrating positive and null findings, will yield a comprehensive understanding of the complex and dynamic nature of long-term memory storage and the potential for harnessing modification processes to treat mental disorders driven by pervasive maladaptive memories.

The influence of dispositional cognitive reappraisal and expressive suppression on post-retrieval and standard extinction

Individual differences in the ability to habitually regulate emotion may impact the efficacy of fear memory extinction. The aim of this study was to assess the relationship between dispositional cognitive reappraisal and expressive suppression with post-retrieval and standard extinction. Fear memory and extinction were measured with the recovery of skin conductance responses. We also examined the relationship between a temporal feature of electrodermal responding (half-recovery time) and each of the emotion regulation strategies. University students (N = 80) underwent a three-day fear conditioning procedure using a within-subject design consisting of acquisition on day one, post-retrieval extinction and standard extinction on day two, and recovery test on day three. Individual difference data on self-reported levels of cognitive reappraisal, expressive suppression, trait anxiety, and depression were collected. We did not detect a relationship between the two emotion regulation strategies measured in this study and acquisition or extinction. We found, however, that increased dispositional use of cognitive reappraisal was associated with lower spontaneous recovery to both the post-retrieval extinction and standard extinction stimulus after controlling for age, trait anxiety, and depression. There were no associations between expressive suppression and conditioned responses. We also observed patterns of faster dissipation of arousal for reappraisal and slower for suppression to the conditioned stimulus during extinction training, which may represent the unique influence of each emotion strategy on the regulation of fear. We conclude greater daily use of cognitive reappraisal, but not expressive suppression, associates with extinction retention after receiving both standard and post-retrieval extinction.

Continuous theta-burst stimulation over the right dorsolateral prefrontal cortex disrupts fear memory reconsolidation in humans

Continuous theta-burst stimulation (cTBS), a non-invasive brain stimulation technique, can induce long-lasting changes in synaptic plasticity, vital for memory reconsolidation. For this study, a total of 170 participants completed four experiments by a randomized controlled design. Succeeding fear conditioning, the subjects received cTBS over the right dorsolateral prefrontal cortex (dlPFC) or vertex (control) with or without exposure to the conditioned stimulus to reactivate the original fear memory, and then underwent fear response tests. Compared with cTBS over the vertex and without memory reactivation, only cTBS over the right dlPFC after reactivation decreased the fear response for both recent and remote fear memories. This procedure was effective only during the reconsolidation window. The disruptive effect of cTBS over the right dlPFC on fear memory reconsolidation was delay-dependent. These findings demonstrate that cTBS time-dependently and delay-dependently prevents the return of fear and may have clinical potential for treating fear-related disorders.

Can contingency rehearsal during the interval between a retrieval cue and extinction training change the effects of post-retrieval extinction?

Return of fear may be prevented by post-retrieval extinction (PRE), a procedure consisting of presenting a stimulus that was present during conditioning (retrieval cue) prior to extinction training. However, recent evidence suggests that there might be circumstances under which PRE is not effective to prevent the return of fear (boundary conditions), but some of these conditions remain unknown. We explored if rehearsing the CS, US or CS-US contingency during the interval between the retrieval cue and extinction training might change the effects of PRE. One day after differential fear conditioning, healthy human participants (n = 83) underwent either standard extinction (control condition, n = 31) or two different PRE procedures, one in which participants rehearsed the CS-US contingency during the interval between the retrieval cue and extinction (rehearsal condition, n = 25), or another in which they underwent a verbal fluency task directing their attention away from the experimental contingencies during this interval (nonrehearsal condition, n = 27). Return of fear in a reinstatement test was observed in both control and rehearsal conditions, whereas in the nonrehearsal condition there was a generalized increase in response to the CS+ and CS-. Differential response in the rehearsal condition had values slightly smaller than the control group with no significant differences from both control and nonrehearsal conditions. These results suggest that the overt behavior of participants during the interval between a retrieval cue and extinction training might change the effects of PRE in healthy human participants, but further manipulations of these variables are needed to confirm these findings.

Retrieval-extinction as a reconsolidation-based treatment for emotional disorders:Evidence from an extinction retention test shortly after intervention

The retrieval-extinction paradigm, a non-invasive memory intervention that is methodologically similar to exposure therapy, has significant clinical application prospects for targeting memory reconsolidation. However, it is difficult to distinguish whether the effect of preventing the return of fear by retrieval-extinction depends upon the reconsolidation-based mechanism or extinction-based mechanism. This study tested extinction retention shortly after intervention to determine whether retrieval-extinction is a reconsolidation-based approach or extinction-based approach as well as exploring the effect of sleep. In our experiment, the effects on fear conditional memory of standard extinction, retrieval-extinction, and extinction-retrieval were compared using the fear test at 3 h, 12 h without a night's sleep, and 12 h with a night's sleep after the intervention. The results showed that standard extinction and extinction-retrieval procedures reduce fear 3 h after intervention, while retrieval-extinction procedure reduces fear 12 h with a night's sleep after the intervention. The results suggest that standard extinction and extinction-retrieval create an extinction memory trace that competes with original memory trace, only retrieval-extinction update the original memory trace through memory reconsolidation. These findings provide solid evidence for the reconsolidation mechanism of the retrieval-extinction paradigm and highlight the effect of sleep on memory reconsolidation.

Destabilizing Different Strengths of Fear Memories Requires Different Degrees of Prediction Error During Retrieval

Reactivation of consolidated memories can induce a labile period, in which these reactivated memories might be susceptible to change and need reconsolidation. Prediction error (PE) has been recognized as a necessary boundary condition for memory destabilization. Moreover, memory strength is also widely accepted as an essential boundary condition to destabilize fear memory. This study investigated whether different strengths of conditioned fear memories require different degrees of PE during memory reactivation in order for the memories to become destabilized. Here, we assessed the fear-potentiated startle and skin conductance response, using the post-retrieval extinction procedure. A violation of expectancy (PE) was induced during retrieval to reactivate enhanced (unpredictable-shock) or ordinary (predictable-shock) fear memories that were established the day before. Results showed that a PE retrieval before extinction can prevent the return of predictable-shock fear memory but cannot prevent the return of unpredictable-shock fear memory, indicating that a single PE is insufficient to destabilize enhanced fear memory. Therefore, we further investigated whether increasing the degree of PE could destabilize enhanced fear memory using different retrieval strategies (multiple PE retrieval and unreinforced CS retrieval). We found that spontaneous recovery of enhanced fear memory was prevented in both retrieval strategies, but reinstatement was only prevented in the multiple PE retrieval group, suggesting that a larger amount of PE is needed to destabilize enhanced fear memory. The findings suggest that behavioral updating during destabilization requires PE, and the degree of PE needed to induce memory destabilization during memory retrieval depends on the strength of fear memory. The study indicates that memory reconsolidation inference can be used to destabilize stronger memories, and the findings shed lights on the treatment of posttraumatic stress disorders and anxiety disorders.

Investigating the efficacy of the reminder-extinction procedure to disrupt contextual threat memories in humans using immersive Virtual Reality

Upon reactivation, consolidated memories can enter a temporary labile state and require restabilisation, known as reconsolidation. Interventions during this reconsolidation period can disrupt the reactivated memory. However, it is unclear whether different kinds of memory that depend on distinct brain regions all undergo reconsolidation. Evidence for reconsolidation originates from studies assessing amygdala-dependent memories using cue-conditioning paradigms in rodents, which were subsequently replicated in humans. Whilst studies providing evidence for reconsolidation of hippocampus-dependent memories in rodents have predominantly used context conditioning paradigms, studies in humans have used completely different paradigms such as tests for wordlists or stories. Here our objective was to bridge this paradigm gap between rodent and human studies probing reconsolidation of hippocampus-dependent memories. We modified a recently developed immersive Virtual Reality paradigm to test in humans whether contextual threat-conditioned memories can be disrupted by a reminder-extinction procedure that putatively targets reconsolidation. In contrast to our hypothesis, we found comparable recovery of contextual conditioned threat responses, and comparable retention of subjective measures of threat memory, episodic memory and exploration behaviour between the reminder-extinction and standard extinction groups. Our result provide no evidence that a reminder before extinction can prevent the return of context conditioned threat memories in humans.