Extinction in multiple contexts reduces the return of extinguished responses: A multilevel meta-analysis

Extinguished responses have been shown to reappear under several circumstances, and this reappearance is considered to model behaviors such as relapse after exposure therapy. Conducting extinction in multiple contexts has been explored as a technique to decrease the recovery of extinguished responses. The present meta-analysis aimed to examine whether extinction in multiple contexts can consistently reduce the recovery of extinguished responses. After searching in several databases, experiments were included in the analysis if they presented extinction in multiple contexts, an experimental design, and an adequate statistical report. Cohen's d was obtained for each critical comparison and weighted to obtain the sample's average weighted effect size. Analyses were then performed using a multilevel meta-analytic approach. Twenty-five studies were included, with a total sample of 37 experiments or critical comparisons. The analyses showed a large effect size for the sample, moderated by the length of conditioned stimulus exposure, type of experimental subject, and type of recovery. The robust effect of extinction in multiple contexts on relapse should encourage clinicians to consider extinction in multiple contexts as a useful technique in therapy and research.

The impact of prolonging extinction on the ABC "super renewal" of instrumental responses in rats

Two free operant conditioning experiments with rats examined the impact of conducting a large amount of extinction training on situations that enhance the ABC renewal effect (ABC super renewal). In Experiment 1, ABC renewal was strengthened by conducting acquisition in multiple contexts. All rats were trained to press a lever for food. One group was trained in one context, while the other two groups were trained in three contexts. Then, all rats received extinction in context B. For two groups this phase lasted 4 sessions, whereas it lasted 36 sessions for the other group. In Experiment 2, ABC renewal was strengthened by using a large number of acquisition sessions. Rats were trained to perform an operant response to obtain food in context A. One group received a moderate amount of training, while the rest of the rats received a larger number of acquisition sessions. Responses underwent extinction in context B. Two groups received 4 sessions, while 36 extinction sessions were used for the remaining group. In both experiments, rats were tested in context B (extinction context) and C (renewal context). Greater ABC renewal occurred both when acquisition training was conducted in multiple contexts (Experiment 1) and by increasing the amount of acquisition training (Experiment 2). Nevertheless, we found that conducting a large number of extinction sessions reduced ABC super renewal in Experiment 1 only.

Transfer tests of an extinction cue in appetitive conditioning with rats

Two Pavlovian appetitive conditioning experiments with rats assessed extinction cue (EC) transfer using spontaneous recovery tests. In each experiment, after conditioned stimulus (CS) A-US pairings, an EC (X) was presented during A-extinction, followed by spontaneous recovery testing with A. Experiment 1 tested for transfer between ECs; the additional CS (B) was conditioned and then was extinguished with a second EC (Y). CS A was tested with X and with Y (the possible transfer EC). Experiment 2 tested for transfer between an EC and an explicitly trained serial negative occasion setter (OS). Prior to testing with A, Y was trained in a serial Y→C-, C + discrimination; a Z→B-, B + discrimination was also trained. A was tested with X and with Y (with Y as the possible transfer OS). X and Y were also tested with B (where X with B tests possible EC-OS transfer). In each experiment Y did not reduce spontaneous recovery to A, showing no transfer of one EC to another (Experiment 1) and no transfer of a serial negative OS to a CS (A) extinguished with an EC (X; Experiment 2). X did not reduce responding to B, showing no transfer of an EC to the target CS of a serial negative OS discrimination, although Y did transfer to B (Experiment 2) showing transfer between serial OSs. X did reduce responding to the CS (A) it had occurred with during extinction (Experiments 1 and 2). The results are discussed in terms of EC characteristics and regarding theories of an EC's possible mechanisms.

The effects of aversive-to-appetitive counterconditioning on implicit and explicit fear memory

Counterconditioning (CC) is a form of retroactive interference that inhibits expression of learned behavior. But similar to extinction, CC can be a fairly weak and impermanent form of interference, and the original behavior is prone to relapse. Research on CC is limited, especially in humans, but prior studies suggest it is more effective than extinction at modifying some behaviors (e.g., preference or valence ratings) than others (e.g., physiological arousal). Here, we used a within-subjects design to compare the effects of aversive-to-appetitive CC versus standard extinction on two separate tests of long-term memory in human adults: implicit physiological arousal and explicit episodic memory. Participants underwent Pavlovian fear conditioning to two semantic categories (animals, tools) paired with an electric shock. Conditioned stimuli (i.e., category exemplars) from one category were then extinguished, while stimuli from the other category were paired with a positive outcome. Participants returned 24-h later for a test of skin conductance responses (SCR) to the conditioned exemplars, as well as a surprise recognition memory test for stimuli encoded the previous day. Results showed reduced SCRs at a test for unique stimuli from a category that had undergone CC, relative to stimuli from a category that had undergone standard extinction. Additionally, participants selectively remembered more stimuli encoded during CC than extinction. These results provide new evidence that aversive-to-appetitive CC, as compared to extinction, strengthens memory for items directly associated with a positive outcome, which may provide stronger retrieval competition against a fear memory at test to help diminish fear relapse.

The sometimes competing retrieval and Van Hamme & Wasserman models predict the selective role of within-compound associations in retrospective revaluation

The correlation between blocking and within-compound memory is stronger when compound training occurs before elemental training (i.e., backward blocking) than when the phases are reversed (i.e., forward blocking; Melchers et al., 2004, 2006). This trial order effect is often interpreted as problematic for performance-focused models that assume a critical role for within-compound associations in both retrospective revaluation and traditional cue competition. The present manuscript revisits this issue using a computational modeling approach. The fit of sometimes competing retrieval (SOCR; Stout & Miller, 2007) was compared to the fit of an acquisition-focused model of retrospective revaluation and cue competition. These simulations reveal that SOCR explains this trial order effect in some situations based on its use of local error reduction.

Stepping back from 'persistence and relapse' to see the forest: Associative interference

Historically, there has been considerable interest in a large variety of forms of associative interference. However, various factors including interest in clinical application and perhaps recent funding priorities have resulted in a narrowed focus on one particular instance of interference, extinction, with relative neglect of other types of interference. We have been using the existing literature and conducting new experiments to determine whether there is a consistent set of rules governing the occurrence and persistence of two-phase associative interference across (a) proactive and retroactive interference, (b) cue and outcome interference, (c) the type of training in phase 1 (excitatory, inhibitory, or simple nonreinforcement), and (d) the type of training in phase 2 (excitatory, inhibitory, or simple nonreinforcement). Our hope is that a return to more general questions concerning associative interference might reveal broad truths concerning the nature of forgetting. Identifying global principles of associative interference may also help us better appreciate the nature of extinction, including how it can be enhanced and made more enduring, as well as how it can be minimized and made more fleeting.

The computational nature of memory modification

Retrieving a memory can modify its influence on subsequent behavior. We develop a computational theory of memory modification, according to which modification of a memory trace occurs through classical associative learning, but which memory trace is eligible for modification depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience into statistically distinct clusters (latent causes). New memories are formed when the structure learning mechanism infers that a new latent cause underlies current sensory observations. By the same token, old memories are modified when old and new sensory observations are inferred to have been generated by the same latent cause. We derive this framework from probabilistic principles, and present a computational implementation. Simulations demonstrate that our model can reproduce the major experimental findings from studies of memory modification in the Pavlovian conditioning literature.

DOI:http://dx.doi.org/10.7554/eLife.23763.001

Our memories contain our expectations about the world that we can retrieve to make predictions about the future. For example, most people would expect a chocolate bar to taste good, because they have previously learned to associate chocolate with pleasure. When a surprising event occurs, such as tasting an unpalatable chocolate bar, the brain therefore faces a dilemma. Should it update the existing memory and overwrite the association between chocolate and pleasure? Or should it create an additional memory? In the latter case, the brain would form a new association between chocolate and displeasure that competes with, but does not overwrite, the original one between chocolate and pleasure.

Previous studies have shown that surprising events tend to create new memories unless the existing memory is briefly reactivated before the surprising event occurs. In other words, retrieving old memories makes them more malleable. Gershman et al. have now developed a computational model for how the brain decides whether to update an old memory or create a new one. The idea at the heart of the model is that the brain will attempt to infer what caused the surprising event. The reason the chocolate bar tastes unpalatable, for example, might be because it was old and had spoiled. Every time the brain infers a new possible cause for a surprising event, it will create an additional memory to store this new set of expectations. In the future we will know that spoiled chocolate bars taste bad.

However, if the brain cannot infer a new cause for the surprising event – because, for example, there appears to be nothing unusual about the unpalatable chocolate bar – it will instead opt to update the existing memory. The next time we buy a chocolate bar, we will have slightly lower expectations about how good it will taste. The dilemma of whether to update an existing memory or create a new one thus boils down to the question: is the surprising event the consequence of a new cause or an old one? This theory implies that retrieving a memory nudges the brain to infer that its associated cause is once again active and, since this is an old cause, it means that the memory will be eligible for updating.

Many experiments have been performed on the topic of modifying memories, but this is the first computational model that offers a unifying explanation for the results. The next step is to work out how to apply the model, which is phrased in abstract terms, to networks of neurons that are more biologically realistic.

DOI:http://dx.doi.org/10.7554/eLife.23763.002

Cocaine cues retain silent traces of an excitatory history after conversion into conditioned inhibitors: 'the ghost in the addict'

The present experiment investigated the extent to which the A+/AB- conditioned inhibition procedure could counteract an excitatory drug-related conditioning history. In two groups of rats, a light stimulus was established as a signal for the absence of cocaine. For the History group, the light had previously been a discriminative stimulus (S) that occasioned cocaine self-administration and could thus be classified as a cocaine excitor. In comparison, the No-History group first encountered the light during conditioned inhibition training. During conditioned inhibition training, both groups self-administered cocaine during tone as well as during click Ss, whereas drug seeking was eliminated in click-plus-light, wherein cocaine was not available (A+/AB-). Drug seeking was essentially eliminated in both groups. Nevertheless, on a summation test the light reduced cocaine seeking occasioned by the tone S by 95% in the No-History group, but by less than 50% in the History group. This summation test result showed that the effects of a drug-related history persisted even after the light was converted into an effective conditioned inhibitor on the training baseline through the powerful A+/AB- procedure. Future research should seek procedures that produce even stronger conditioned inhibition that eliminates such residual 'silent' drug excitation, the 'ghost in the addict'.

Comparing the context specificity of extinction and latent inhibition

Exposure to a cue alone either before (i.e., latent inhibition treatment) or after (i.e., extinction) the cue is paired with an unconditioned stimulus results in attenuated conditioned responding to the cue. Here we report two experiments in which potential parallels between the context specificity of the effects of extinction and latent inhibition treatments were directly compared in a lick suppression preparation with rats. The reversed ordering of conditioning and nonreinforcement in extinction and latent inhibition designs allowed us to examine the effect of training order on the context specificity of what is learned given phasic reinforcement and nonreinforcement of a target cue. Experiment 1 revealed that when conditioned-stimulus (CS) conditioning and CS nonreinforcement were administered in the same context, both extinction and latent inhibition treatments had reduced impacts on test performance, relative to excitatory conditioning when testing occurred outside the treatment context. Similarly, Experiment 2 showed that when conditioning was administered in one context and nonreinforcement was administered in a second context, the effects of both extinction and latent inhibition treatments were attenuated when testing occurred in a neutral context, relative to the context in which the CS was nonreinforced. The observed context specificity of extinction and latent inhibition treatments has been previously reported in both cases, but not in a single experiment under otherwise identical conditions. The results of the two experiments convergently suggest that memory of nonreinforcement becomes context dependent after a cue is both reinforced and nonreinforced, independent of the order of training.

Retrospective revaluation of associative retroactive cue interference

Two fear-conditioning experiments with rats assessed whether retrospective revaluation, which has been observed in cue competition (i.e., when compounded cues are followed with an outcome), can also be observed in retroactive cue interference (i.e., when different cues are reinforced in separate phases with the same outcome). Experiment 1 found that after inducing retroactive cue interference (i.e., X-outcome followed by A-outcome), nonreinforced presentations of the interfering cue (A) decreases interference with responding to the target cue (X), just as has been observed in retrospective revaluation experiments in cue competition. Using the opposite manipulation (i.e., adding reinforced presentations of A), Experiment 2 demonstrated that after inducing retroactive cue interference, additional reinforced presentations of the interfering cue (A) increases interference with responding to the target cue (X); alternatively stated, the amount of interference increases with the amount of training with the interfering cue. Thus, both types of retrospective revaluation occur in retroactive cue competition. The results are discussed in terms of the possibility that similar associative mechanisms underlie cue competition and cue interference.

The Extinction and Return of Fear of Public Speaking

Prior studies indicate extinguished fear often partially returns when participants are later tested outside the extinction context. Cues carried from the extinction context to the test context sometimes reduce return of fear, but it is unclear whether such extinction cues (ECs) reduce return of fear of public speaking. Here we assessed return of fear of public speaking, and whether either of two types of ECs can attenuate it. Participants gave speeches of increasing difficulty during an exposure practice session and were tested 2 days later in a different context. Testing occurred in the presence of physical ECs, after mentally rehearsing the exposure session, or without either reminder. Practice reduced fear of public speaking, but fear partially returned at test. Neither physical nor mental ECs reduced partial return of fear of public speaking. The return of extinguished fear of public speaking, although small, was reliable, but not appreciably sensitive to presence of ECs.

Preventing the recovery of extinguished ethanol tolerance

There is substantial evidence that drug-paired cues become associated with drug effects. From a Pavlovian perspective, these cues act as conditioned stimuli and elicit conditioned compensatory responses that contribute to drug tolerance. Here we report two experiments with rats in which we studied the extinction of the associative tolerance to the ataxic effect of ethanol. Experiment 1 evaluated whether changes in the temporal and physical contexts after extinction training provoke recovery of the extinguished tolerance. The results showed successful extinction, spontaneous recovery and renewal of the extinguished tolerance, but no summation of renewal and spontaneous recovery. Experiment 2 evaluated whether using massive extinction trials and delivering extinction in multiple contexts attenuates the renewal effect. The results showed that both manipulations reduced renewal of the extinguished tolerance to the ataxic effect of ethanol; however, these manipulations used in combination did not appear to be more effective in reducing recovery than each by itself. The present results may help guide further research that evaluates behavioral ploys to prevent the recovery of extinguished responses.

The role of test context in latent inhibition of conditioned inhibition: Part of a search for general principles of associative interference

In two lick suppression experiments with rats, we assessed interference with behavior indicative of conditioned inhibition by a latent inhibition treatment as a function of test context. We asked what effect the test context has, given identical latent inhibition treatments in Phase 1 and identical conditioned inhibition trainings in Phase 2. In Experiment 1, an AAA versus AAB context-shift design determined that the latent inhibition treatment in Phase 1 attenuated behavior indicative of the conditioned inhibition training administered in Phase 2, regardless of the test context, which could reflect a failure to either acquire or express conditioned inhibition. In Experiment 2, an ABA versus ABB design showed that test performance in Contexts A and B reflected the treatments that had been administered in those contexts (i.e., conditioned inhibition was observed in Context B but not A), which could reflect either the context specificity of either latent inhibition or conditioned inhibition. In either case, latent inhibition of conditioned inhibition training in at least some situations was seen to reflect an expression deficit rather than an acquisition deficit. These data, in conjunction with prior reports, suggest that latent inhibition is relatively specific to the context in which it was administered, whereas conditioned inhibition is specific to its training context only when it is the second-learned relationship concerning the target cue. These experiments are part of a larger effort to delineate control by the test context of two-phase associative interference, as a function of the nature of target training and the nature of interference training.

Behavioral techniques for attenuating the expression of fear associations in an animal model of anxiety

BACKGROUND AND OBJECTIVES

Recent data indicate that extinguished fear often returns when the testing conditions differ from those of treatment. Several manipulations including extensive extinction training, extinction in multiple contexts, and spacing the extinction trials and sessions reduce the return of fear. Moreover, extensive extinction and extinction in multiple contexts summate in reducing return of fear, and the spacing of the extinction trials and the spacing of extinction sessions summate in reducing return of fear. Here we evaluated whether these techniques also attenuate the context specificity of latent inhibition, and whether they summate to further decrease fear responding at test.

METHODS

In two experiments, with rats as subjects in a lick suppression preparation, we assessed the effects of massive CS preexposure, CS preexposure in multiple contexts, and of spacing the CS-preexposure trials and sessions, in reducing the context specificity of latent inhibition.

RESULTS

Fear responding was attenuated by all four manipulations. Moreover, extensive CS preexposure in multiple contexts, and conjoint spacing of the CS-preexposure trials and sessions, were more effective in reducing the context specificity of latent inhibition than each manipulation alone.

LIMITATIONS

Our experimental designs evaluated degrees of context specificity of latent inhibition but omitted groups in which latent inhibition was assessed without a context shift away from the context of latent inhibition treatment. This precluded us from drawing conclusions concerning absolute (as opposed to relative) levels of recovery from latent inhibition.

CONCLUSIONS

Techniques effective in decreasing the return of conditioned fear following extinction are also effective in decreasing the context specificity of latent inhibition in an animal model of anxiety. Fear and anxiety disorders might be prevented in anxious human participants with the same techniques used here, but that is still an empirical question.

Enhancement and reduction of associative retroactive cue interference by training in multiple contexts

Retroactive cue interference refers to situations in which a target cue X is paired with an outcome in phase 1 and a nontarget cue Z is paired with the same outcome in phase 2, with less subsequent responding to X being seen as a result of the phase 2 training. Two conditioned suppression experiments with rats were conducted to determine whether retroactive cue interference is similarly modulated by a manipulation that influences retroactive outcome interference (e.g., extinction). Both experiments used an ABC renewal-like design in which phase 1 training, phase 2 training, and testing each occurred in different contexts. Experiment 1 found that training the target association in multiple contexts without altering the number of training trials during phase 1 decreased retroactive cue interference (i.e., increased responding consistent with the target association). Experiment 2 found that training the interfering association in multiple contexts without altering the number of interference trials during phase 2 increased retroactive cue interference (i.e., decreased responding consistent with the target association). The possibility of similar mechanisms underlying cue interference and outcome interference is discussed.

Failure to observe renewal following retrieval-induced forgetting

Recent studies have pursued the nature of inhibition observed in retrieval-induced forgetting (RIF) tasks. In a RIF paradigm, participants are trained on category-exemplar pairs in Phase 1. Then, some exemplars from select categories (Rp+ items) receive further practice in Phase 2. At test, impaired recall for non-practiced exemplars of the practiced categories (Rp- items) is observed relative to exemplars from non-practiced categories (Nrp items). This difference constitutes RIF. Prior reports of spontaneous recovery from RIF indicate that RIF represents a lapse rather than a loss of memory. Empirical analogs and theoretical considerations suggest that RIF should also be reversible through a change of context between Phase 2 and testing (i.e., renewal). We conducted two experiments using human participants to evaluate the context dependency of RIF. In both experiments, Phases 1 and 2 occurred in distinctly different contexts with subsequent testing occurring in either the Phase 1 context or the Phase 2 context. RIF was observed in both experiments. Experiment 1 additionally found that the magnitude of RIF was not reduced by testing in the Phase 1 context relative to testing in the Phase 2 context. Experiment 2 further tested context dependency of RIF by (1) increasing the dissimilarity between the two contexts and (2) inserting a retention interval between Phase 2 and test for half of the participants in each test context condition. The data again indicated no effect of the context manipulation. Thus, no renewal from RIF was observed in either experiment; moreover, these null findings were supported by Bayesian analyses. These results are compared with analogous inhibitory processes in the animal memory literature that typically show both physical and temporal context dependency.

Preventing return of fear in an animal model of anxiety: additive effects of massive extinction and extinction in multiple contexts

Fear conditioning and experimental extinction have been presented as models of anxiety disorders and exposure therapy, respectively. Moreover, the return of fear serves as a model of relapse after exposure therapy. Here we present two experiments, with rats as subjects in a lick suppression preparation, in which we assessed the additive effects of two different treatments to attenuate the return of fear. First, we evaluated whether two phenomena known to generate return of fear (i.e., spontaneous recovery and renewal) summate to produce a stronger reappearance of extinguished fear. At test, rats evaluated outside the extinction context following a long delay after extinction (i.e., a delayed context shift) exhibited greater return of extinguished fear than rats evaluated outside the extinction context alone, but return of extinguished fear following a delayed context shift did not significantly differ from the return of fear elicited in rats tested following a long delay after extinction alone. Additionally, extinction in multiple contexts and a massive extinction treatment each attenuated the strong return of fear produced by a delayed context shift. Moreover, the conjoint action of these treatments was significantly more successful in preventing the reappearance of extinguished fear, suggesting that extensive cue exposure administered in several different therapeutic settings has the potential to reduce relapse after therapy for anxiety disorders, more than either manipulation alone.

Reactivated memories compete for expression after Pavlovian extinction

We view the response decrement resulting from extinction treatment as an interference effect, in which the reactivated memory from acquisition competes with the reactivated memory from extinction for behavioral expression. For each of these memories, reactivation is proportional to both the strength of the stimulus-outcome association and the quality of the facilitatory cues for that association which are present at test. Here we review basic extinction and recovery-from-extinction phenomena, showing how these effects are explicable in this associative interference framework. Moreover, this orientation has and continues to dictate efficient manipulations for minimizing recovery from extinction. This in turn suggests procedures that might reduce relapse from exposure therapy for a number of psychological disorders. Some of these manipulations enhance the facilitatory cues from extinction that are present at test, others strengthen the extinction association (i.e., CS-no outcome), and yet others seem to work by a combination of these two processes.