A model for recovery-from-extinction effects in Pavlovian conditioning and exposure therapy

Exposure therapy is an effective intervention for anxiety-related problems. The mechanism of this intervention has been the extinction procedure in Pavlovian conditioning, and this application has provided many successful instances for the prevention of relapse. However, traditional associative theories cannot comprehensively explain many findings. In particular, it is difficult to explain the recovery-from-extinction effects, which is the reappearance of the conditioned response following extinction. In this paper, we propose an associative model that is a mathematical extension of Bouton's (1993, Psychological Bulletin, 114, 80-99) model for the extinction procedure. The core of our model is that the asymptotic strength of the inhibitory association depends on the degree of excitatory association retrieved in a context in which a conditioned stimulus (CS) is presented and that the retrieval is determined by the similarity between contexts during both reinforcement and non-reinforcement and the retrieval context. Our model provides an explanation of the recovery-from-extinction effects, and implications for exposure therapy.

The learning of prospective and retrospective cognitive maps within neural circuits

Brain circuits are thought to form a "cognitive map" to process and store statistical relationships in the environment. A cognitive map is commonly defined as a mental representation that describes environmental states (i.e., variables or events) and the relationship between these states. This process is commonly conceptualized as a prospective process, as it is based on the relationships between states in chronological order (e.g., does reward follow a given state?). In this perspective, we expand this concept on the basis of recent findings to postulate that in addition to a prospective map, the brain forms and uses a retrospective cognitive map (e.g., does a given state precede reward?). In doing so, we demonstrate that many neural signals and behaviors (e.g., habits) that seem inflexible and non-cognitive can result from retrospective cognitive maps. Together, we present a significant conceptual reframing of the neurobiological study of associative learning, memory, and decision making.

Learning to actively cope with stress in female mice

Repeated exposure to a same-sex resident stranger enhances subsequent indications of active coping that generalize across multiple contexts in intruder male mice. Here we investigate female mice for comparable learning to cope training effects. Stress coping research focused on females is important because stress related mood and anxiety disorders are more prevalent in women than men. Female mice were monitored for coping behavior in open-field, object-exploration, and tail-suspension tests conducted after repeated exposure to a same-sex resident stranger. During repeated exposure sessions of training staged in the resident's home cage, behavioral measures of aggression and risk assessment were collected and plasma measures of the stress hormone corticosterone were obtained from separate samples of mice. Repeated exposure to a same-sex resident stranger subsequently enhanced active coping behavior exemplified by diminished freezing and increased center entries in the open-field, shorter object-exploration latencies, and a tendency toward decreased immobility on tail-suspension tests. Open-field locomotion considered as an index of non-specific activity was not increased by repeated sessions of exposure and did not correlate significantly with any measure of active coping. During repeated sessions of exposure to a same-sex resident stranger, risk assessment behavior and consistent but limited aggression occurred and corticosterone responses increased over repeated sessions. Exposure to a same-sex resident stranger is mildly stressful and promotes learning to actively cope in mice assessed in three different contexts.

Context-dependent extinction of threat memories: influences of healthy aging

Although a substantial progress has been made in recent years on understanding the processes mediating extinction of learned threat, little is known about the context-dependent extinction of threat memories in elderly individuals. We used a 2-day differential threat conditioning and extinction procedure to determine whether young and older adults differed in the contextual recall of conditioned responses after extinction. On Day 1, conditioned stimuli were paired with an aversive electric shock in a 'danger' context and then extinguished in a different 'safe' context. On Day 2, the extinguished stimulus was presented to assess extinction recall (safe context), and threat renewal (danger context). Physiological and verbal report measures of threat conditioning were collected throughout the experiment. Skin conductance response (SCR data revealed no significant differences between age groups during acquisition and extinction of threat conditioning on Day 1. On Day 2, however, older adults showed impaired recall of extinction memory, with increased SCR to the extinguished stimulus in the 'safe' context, and reduced ability to process context properly. In addition, there were no age group differences in fear ratings and contingency awareness, thus revealing that aging selectively impairs extinction memories as indexed by autonomic responses. These results reveal that aging affects the capacity to use context to modulate learned responses to threat, possibly due to changes in brain structures that enable context-dependent behaviour and are preferentially vulnerable during aging.

Experimental extinction in Pavlovian conditioning: Behavioural and neuroscience perspectives

This paper reviews the behavioural and neuroscience literatures on extinction in Pavlovian conditioning with a view towards finding possible points of contact between these two often independent lines of investigation. Recent discoveries at the behavioural level indicate (1) that conditioned stimulus (CS)–unconditioned stimulus (US) associations specific in their sensory content are fully preserved during extinction, (2) that inhibitory stimulus-response associations appear to be learned during extinction, (3) that extinction is influenced by the level of activation of the US representation during nonreinforced trials, (4) that decreases in attention can influence conditioned performance during extinction, and (5) that contexts acquire an ability to modulate learning during both conditioning and extinction. Recent discoveries at the neural systems level suggest (1) that the hippocampus is important in context-specific learning during extinction, (2) that the prefrontal cortex is possibly important in long-term memory for extinction, (3) that the basolateral amygdala may be important in sustaining attention to a CS during extinction, (4) that NMDA receptors are important either in neural plasticity during extinction or by affecting the value of the US representation during extinction, and (5) that the GABAergic system may partially mediate inhibitory learning during extinction. It is concluded that both of these levels of analysis can benefit the other in the pursuit of a more comprehensive understanding of extinction.

Cocaine cues retain silent traces of an excitatory history after conversion into conditioned inhibitors: 'the ghost in the addict'

The present experiment investigated the extent to which the A+/AB- conditioned inhibition procedure could counteract an excitatory drug-related conditioning history. In two groups of rats, a light stimulus was established as a signal for the absence of cocaine. For the History group, the light had previously been a discriminative stimulus (S) that occasioned cocaine self-administration and could thus be classified as a cocaine excitor. In comparison, the No-History group first encountered the light during conditioned inhibition training. During conditioned inhibition training, both groups self-administered cocaine during tone as well as during click Ss, whereas drug seeking was eliminated in click-plus-light, wherein cocaine was not available (A+/AB-). Drug seeking was essentially eliminated in both groups. Nevertheless, on a summation test the light reduced cocaine seeking occasioned by the tone S by 95% in the No-History group, but by less than 50% in the History group. This summation test result showed that the effects of a drug-related history persisted even after the light was converted into an effective conditioned inhibitor on the training baseline through the powerful A+/AB- procedure. Future research should seek procedures that produce even stronger conditioned inhibition that eliminates such residual 'silent' drug excitation, the 'ghost in the addict'.

Transient inactivation of the pigeon hippocampus or the nidopallium caudolaterale during extinction learning impairs extinction retrieval in an appetitive conditioning paradigm

The majority of experiments exploring context-dependent extinction learning employ Pavlovian fear conditioning in rodents. Since mechanisms of appetitive and aversive learning are known to differ at the neuronal level, we sought to investigate extinction learning in an appetitive setting. Working with pigeons, we established a within-subject ABA renewal paradigm based on Rescorla (Q J Exp Psychol 61:1793) and combined it with pharmacological interventions during extinction. From the fear conditioning literature, it is known that both prefrontal cortex and the hippocampus are core structures for context-specific extinction learning. Accordingly, we transiently inactivated the nidopallium caudolaterale (NCL, a functional analogue of mammalian prefrontal cortex) and the hippocampus in separate experiments by intracranial infusion of the sodium-channel blocker tetrodotoxin immediately before extinction training. We find that TTX in both structures non-specifically suppresses conditioned responding, as revealed by a reduction of response rate to both the extinguished conditioned stimulus and a control stimulus which remained reinforced throughout the experiment. Furthermore, TTX during extinction training impaired later extinction retrieval assessed under drug-free conditions. This was true when responding to the extinguished stimulus was assessed in the context of extinction but not when tested in the context of acquisition, although both contexts were matched with respect to their history of conditioning. These results indicate that both NCL and hippocampus are involved in extinction learning under appetitive conditions or, more specifically, in the consolidation of extinction memory, and that their contribution to extinction is context-specific.

Animal models of fear relapse

Whereas fear memories are rapidly acquired and enduring over time, extinction memories are slow to form and are susceptible to disruption. Consequently, behavioral therapies that involve extinction learning (e.g., exposure therapy) often produce only temporary suppression of fear and anxiety. This review focuses on the factors that are known to influence the relapse of extinguished fear. Several phenomena associated with the return of fear after extinction are discussed, including renewal, spontaneous recovery, reacquisition, and reinstatement. Additionally, this review describes recent work, which has focused on the role of psychological stress in the relapse of extinguished fear. Recent developments in behavioral and pharmacological research are examined in light of treatment of pathological fear in humans.

Preventing return of fear in an animal model of anxiety: additive effects of massive extinction and extinction in multiple contexts

Fear conditioning and experimental extinction have been presented as models of anxiety disorders and exposure therapy, respectively. Moreover, the return of fear serves as a model of relapse after exposure therapy. Here we present two experiments, with rats as subjects in a lick suppression preparation, in which we assessed the additive effects of two different treatments to attenuate the return of fear. First, we evaluated whether two phenomena known to generate return of fear (i.e., spontaneous recovery and renewal) summate to produce a stronger reappearance of extinguished fear. At test, rats evaluated outside the extinction context following a long delay after extinction (i.e., a delayed context shift) exhibited greater return of extinguished fear than rats evaluated outside the extinction context alone, but return of extinguished fear following a delayed context shift did not significantly differ from the return of fear elicited in rats tested following a long delay after extinction alone. Additionally, extinction in multiple contexts and a massive extinction treatment each attenuated the strong return of fear produced by a delayed context shift. Moreover, the conjoint action of these treatments was significantly more successful in preventing the reappearance of extinguished fear, suggesting that extensive cue exposure administered in several different therapeutic settings has the potential to reduce relapse after therapy for anxiety disorders, more than either manipulation alone.

Chronic dietary magnesium-L-threonate speeds extinction and reduces spontaneous recovery of a conditioned taste aversion

Elevation of brain magnesium enhances synaptic plasticity and extinction of conditioned fear memories. This experiment examined the generalizability of this phenomenon by studying the effects of a novel magnesium compound, magnesium-L-threonate (MgT), on conditioned taste aversion (CTA) extinction and spontaneous recovery (SR). Adult male Sprague-Dawley rats were maintained on a 23-hour water deprivation cycle and acquired a CTA following the taste of a CS [0.3% saccharin+16 mg/ml MgT (SAC+MgT)] paired with a US [81 mg/kg (i.p.) lithium chloride (LiCl)]. Following CTA acquisition, rats drank a water+MgT solution for up to 1 hour/day over the next 31 days. For 14 additional days, some animals continued water+MgT treatment, but others drank water only to allow MgT to be eliminated from the body. We then employed 2 different extinction paradigms: (1) CS-Only (CSO), in which SAC was presented, every-other day, or (2) Explicitly Unpaired (EU), in which both SAC and LiCl were presented, but on alternate days. EU extinction procedures have been shown to speed CTA extinction and reduce spontaneous recovery of the aversion. Throughout extinction, half of the rats in each group continued to drink MgT (now in SAC or supplemental water+MgT solution), whereas the other half drank SAC only/water only until SAC drinking reached ≥90% of baseline (asymptotic extinction). Rats receiving MgT just before/during extinction drank less SAC on the first day of extinction suggesting that they had retained a stronger CTA. MgT enhanced the rate of extinction. Furthermore, the MgT-treated rats showed a relatively modest SR of the CTA 30 days later - indicating that the extinction procedure was more effective for these animals. Our data suggest that long-term dietary MgT may enhance the consolidation/retention of a CTA, speed extinction, and inhibit SR of this learned aversion.

Stimulation of the dorsal periaqueductal gray enhances spontaneous recovery of a conditioned taste aversion

Due to its relevance to clinical practice, extinction of learned fears has been a major focus of recent research. However, less is known about the means by which conditioned fears re-emerge (i.e., spontaneously recover) as time passes or contexts change following extinction. The periaqueductal gray represents the final common pathway mediating defensive reactions to fear and we have reported previously that the dorsolateral PAG (dlPAG) exhibits a small but reliable increase in neural activity (as measured by c-fos protein immunoreactivity) when spontaneous recovery (SR) of a conditioned taste aversion (CTA) is reduced. Here we extend these correlational studies to determine if inducing dlPAG c-fos expression through electrical brain stimulation could cause a reduction in SR of a CTA. Male Sprague-Dawley rats acquired a strong aversion to saccharin (conditioned stimulus; CS) and then underwent CTA extinction through multiple non-reinforced exposures to the CS. Following a 30-day latency period after asymptotic extinction was achieved; rats either received stimulation of the dorsal PAG (dPAG) or stimulation of closely adjacent structures. Sixty minutes following the stimulation, rats were again presented with the saccharin solution as we tested for SR of the CTA. The brain stimulation evoked c-fos expression around the tip of the electrodes. However, stimulation of the dPAG failed to reduce SR of the previously extinguished CTA. In fact, dPAG stimulation caused rats to significantly suppress their saccharin drinking (relative to controls) - indicating an enhanced SR. These data refute a cause-and-effect relationship between enhanced dPAG c-fos expression and a reduction in SR. However, they highlight a role for the dPAG in modulating SR of extinguished CTAs.

Reactivated memories compete for expression after Pavlovian extinction

We view the response decrement resulting from extinction treatment as an interference effect, in which the reactivated memory from acquisition competes with the reactivated memory from extinction for behavioral expression. For each of these memories, reactivation is proportional to both the strength of the stimulus-outcome association and the quality of the facilitatory cues for that association which are present at test. Here we review basic extinction and recovery-from-extinction phenomena, showing how these effects are explicable in this associative interference framework. Moreover, this orientation has and continues to dictate efficient manipulations for minimizing recovery from extinction. This in turn suggests procedures that might reduce relapse from exposure therapy for a number of psychological disorders. Some of these manipulations enhance the facilitatory cues from extinction that are present at test, others strengthen the extinction association (i.e., CS-no outcome), and yet others seem to work by a combination of these two processes.

Acute, but not chronic, exposure to d-cycloserine facilitates extinction and modulates spontaneous recovery of a conditioned taste aversion

D-cycloserine, the glutamate N-methyl-D-aspartate receptor partial agonist, has been reported to facilitate the extinction of learned fears acquired in both naturalistic and laboratory settings. The current study extended this literature by evaluating the ability of either chronic or acute administrations of DCS to modulate the extinction and spontaneous recovery of a conditioned taste aversion (CTA). Twenty-three hour fluid-deprived Sprague-Dawley rats acquired a strong CTA following 3 pairings of a conditioned stimulus (CS; 0.3% oral saccharin)+unconditioned stimulus [US; 81 mg/kg (i.p.) lithium chloride (LiCl)]. In separate groups of rats, we then employed 2 different extinction paradigms: (1) CS-only (CSO-EXT) in which saccharin was presented every-other day, or (2) Explicitly Unpaired (EU-EXT) in which both saccharin and LiCl were presented but on alternate days. Previous studies have indicated that the EU-EXT procedure speeds up the extinction process. Further, spontaneous recovery of a CTA emerges following CSO-EXT but the EU-EXT paradigm causes a suppression of spontaneous recovery. DCS (15 mg/kg, i.p.) was administered immediately after daily liquid presentations (saccharin or water, alternate days) during the extinction period. In an acute drug manipulation, DCS (15 mg/kg, i.p.) or saline control injections were administered for 4 days only. This was done during one of 3 different phases of extinction [i.e., static (2-5%), early dynamic (8-16%), or middle dynamic (20-40%) saccharin reacceptance]. Other animals assigned to the chronic DCS condition received daily DCS (15 mg/kg, i.p.) throughout extinction. Changes in saccharin drinking in these animals were compared to the data from rats that received no drug (saline controls). Once rats met our criterion for asymptotic extinction (90% reacceptance of the CS) they entered a 30-day latency period during which they received water for 1 h/day. The day after the completion of the latency period, a final opportunity to drink saccharin was provided (spontaneous recovery test). Saline-treated control rats that went through the EU-EXT procedure achieved asymptotic extinction more quickly than did the CSO-EXT rats and did not exhibit a spontaneous recovery of the CTA. Chronic DCS treatments did not significantly reduce the time to achieve asymptotic CTA extinction in rats exposed to either CSO or EU extinction methods. Further, animals treated with DCS throughout EU-EXT exhibited a spontaneous recovery of the CTA whereas the saline-treated, EU-EXT rats did not. Thus, chronic DCS treatment did not shorten the time to extinguish a CTA and this treatment eliminated the ability of EU-EXT to block spontaneous recovery of the CTA. Acute DCS treatments were more effective in reducing the time required to extinguish a CTA than were chronic drug treatments. Moreover, the timing of these acute DCS treatments affected spontaneous recovery of the CTA depending on the extinction method employed. Acute DCS administrations later in extinction were more effective in reducing spontaneous recovery than were early administrations if the rats went through the CSO-EXT procedure. However, late-in-extinction administrations of DCS facilitated spontaneous recovery of the CTA in rats that experienced the EU-EXT method. These data agree with other findings suggesting that DCS treatments are more effective when administered a limited number of times. Our data extend these findings to the CTA paradigm and further suggest that, depending on the extinction paradigm employed, acute exposure to DCS can speed up CTA extinction and reduce spontaneous recovery of the aversion. The timing of the acute DCS treatment during extinction is generally less important than its duration in predicting the rate of CTA extinction. However, the timing of acute DCS treatments during extinction and the method of extinction employed can interact to affect spontaneous recovery of a CTA.

Periaqueductal gray c-Fos expression varies relative to the method of conditioned taste aversion extinction employed

A conditioned taste aversion (CTA) is acquired when an animal consumes a novel taste (CS) and then experiences the symptoms of poisoning (US). Following CTA training, animals will avoid the taste that was previously associated with malaise. This defensive reaction to a learned fear can be extinguished by repeated exposure to the CS alone (CS-only; CSO-EXT). However, following a latency period in which the CS is not presented, the CTA will spontaneously recover (SR). Through the use of an explicitly unpaired extinction procedure (EU-EXT) we have shown that we can speed up extinction and attenuate SR of the CTA. Here we compared and contrasted the ability of CSO and EU extinction procedures to affect c-Fos expression in the periaqueductal gray (PAG). Fluid-deprived Sprague-Dawley rats acquired a strong CTA [via 3 pairings of 0.3% oral saccharin (SAC; the CS) and 81mg/kg i.p. lithium chloride (LiCl; the US)] followed by extinction trials consisting of multiple exposures to either, (a) the CS every-other day (CSO-EXT), or (b) CS and US on alternate days (EU-EXT). A different group of rats did not receive multiple CS exposures and served as a "no extinction" (NE) control. Both extinction procedures resulted in ≥90% reacceptance of SAC (achieving asymptotic extinction). Some of the animals were sacrificed for c-Fos immunohistochemical analysis following asymptotic extinction. Other rats entered a 30-day latency period where they drank water only. These remaining animals were then tested for SR with a final exposure to SAC before being sacrificed for c-Fos immunohistochemistry. As reported previously, rats in the CS-only group exhibited a significant SR of the CTA. However, animals in the EU extinction group reached asymptotic extinction more rapidly than did CSO rats and they did not show SR of the CTA. As compared to rats that retained their CTA, both groups of extinguished rats showed suppression in the number of c-Fos-labeled neurons in all 4 longitudinal columns of the PAG. The number of c-Fos-labeled cells in the PAG was generally low but there was a reliable increase in c-Fos expression in dorsolateral PAG (dlPAG) following the SR test in the brains of rats that went through the EU-EXT procedure as compared with those that either went through the more-traditional CSO extinction procedure or experienced no extinction at all. The number of c-Fos-labeled neurons in the dlPAG was significantly correlated with the amount of SAC consumed at the SR test. Surprisingly, the brains of EU-extinguished rats and CSO extinguished rats did not differ in the number of c-Fos-labeled neurons in gustatory neocortex, medial prefrontal cortex, basolateral amygdala, or the central nucleus of the amygdala. Thus, behavioral differences in SR between the EU and CSO extinction animals were not represented by corresponding changes in the neural activity of several brain nuclei classically associated with extinction learning. However a detailed analysis of PAG c-Fos expression provided hints about some of the physiological changes evoked by these 2 extinction paradigms that produce very different behavioral outcomes. The findings are clinically relevant as we seek the development of treatments for deficits in fear extinction (e.g. PTSD, phobias).

Preventing Recovery From Extinction and Relapse

When a cue ( X) and an outcome are paired, X comes to elicit responding similar to that elicited by the outcome. This potential is lessened if X is later presented by itself (i.e., experimental extinction). Extinction is interesting both for theoretical reasons and because it is a model for exposure therapy, which is used to treat numerous psychological disorders. Conventionally, extinction has been viewed as an isolated phenomenon unrelated to other response-attenuating treatments, whereas it is actually but one of several instances of associative interference that reduce conditioned responding. Although much has been learned about extinction from direct study, the larger associative-interference literature provides additional insight. Here we view extinction as new learning that is inconsistent with previously acquired knowledge (i.e., retroactive outcome interference). We provide an account of whether the acquisition or extinction memory will be expressed depending on the relative strengths of these two memories and the relative efficacies of their respective retrieval cues.

Modulation of fear memory by retrieval and extinction: a clue for memory deconsolidation

Memories are fragile and easily forgotten at first, but after a consolidation period of hours to weeks, are inscribed in our brains as stable traces, no longer vulnerable to conventional amnesic treatments. Retrieval of a memory renders it labile, akin to the early stages of consolidation. This phenomenon has been explored as memory reactivation, in the sense that the memory is temporarily 'deconsolidated', allowing a short time window for amnesic intervention. This window closes again after reconsolidation, which restores the stability of the memory. In contrast to this 'transient deconsolidation' and the short-spanned amnesic effects of consolidation blockers, some specific treatments can disrupt even consolidated memory, leading to apparent amnesia. We propose the term 'amnesic deconsolidation' to describe such processes that lead to disruption of consolidated memory and/or consolidated memory traces. We review studies of these 'amnesic deconsolidation' treatments that enhance memory extinction, alleviate relapse, and reverse learning-induced plasticity. The transient deconsolidation that memory retrieval induces and the amnesic deconsolidation that these regimes induce both seem to dislodge a component that stabilizes consolidated memory. Characterizing this component, at both molecular and network levels, will provide a key to developing clinical treatments for memory-related disorders and to defining the consolidated memory trace.

Repeated extinction and reversal learning of an approach response supports an arousal-mediated learning model

We assessed the effects of repeated extinction and reversals of two conditional stimuli (CS+/CS-) on an appetitive conditioned approach response in rats. Three results were observed that could not be accounted for by a simple linear operator model such as the one proposed by Rescorla and Wagner (1972): (1) responding to a CS- declined faster when a CS+ was simultaneously extinguished; (2) reacquisition of pre-extinction performance recovered rapidly within one session; and (3) reversal of CS+/CS- contingencies resulted in a more rapid recovery to the current CS- (former CS+) than the current CS+, accompanied by a slower acquisition of performance to the current CS+. An arousal parameter that mediates learning was introduced to a linear operator model to account for these effects. The arousal-mediated learning model adequately fit the data and predicted data from a second experiment with different rats in which only repeated reversals of CS+/CS- were assessed. According to this arousal-mediated learning model, learning is accelerated by US-elicited arousal and it slows down in the absence of US. Because arousal varies faster than conditioning, the model accounts for the decline in responding during extinction mainly through a reduction in arousal, not a change in learning. By preserving learning during extinction, the model is able to account for relapse effects like rapid reacquisition, renewal, and reinstatement.

A comparison of explicitly unpaired treatment and extinction: recovery of sign-tracking within a context renewal design

The present experiment compared the effectiveness of explicitly unpaired treatment and extinction in preventing the recovery of sign-tracking within a context renewal design. Three groups of rats were first trained on a sign-tracking procedure in Context A where insertions of a retractable lever were paired with food. In a second phase, the sign-tracking response was eliminated. One group received standard extinction of the CS in Context B, while another group received explicitly unpaired treatment in Context B where food was presented only during inter-trial intervals (and not paired with the lever). A third group received this explicitly unpaired treatment in Context A. After the sign-tracking response was eliminated, all groups received a test session in Context A where the lever was presented alone and no food was delivered at any time. Significantly more responding occurred in the group that received explicitly unpaired treatment in Context B than in either of the other groups. This demonstrates that there are situations where explicitly unpaired treatment is less effective than extinction in preventing the reappearance of previously eliminated responding.

Renewal of sucrose-seeking behavior in rats: Role of D(2) dopamine receptors

The present study characterized renewal of sucrose-seeking behavior in rats (Experiment 1). The role of the dopamine subtype-2 (D(2)) receptors in mediating renewal of sucrose-seeking behavior also was examined (Experiment 2). Rats were trained to respond for sucrose pellets (45mg each) on a fixed-ratio 25 (Experiments 1 and 2) schedule of reinforcement in Context A. Following acquisition, rats underwent extinction and 4 renewal tests in Contexts B and A, respectively. In Experiment 2, rats were pretreated with vehicle or the D(2) dopamine receptor antagonist eticlopride (5, 10, 20, or 40microg/kg) 30min prior to the first renewal test session. A follow-up experiment (Experiment 3) examined the effect of a high eticlopride dose (40microg/kg) on locomotor activity. Renewal of sucrose-seeking behavior persisted for 3 sessions. Eticlopride dose-dependently blocked renewal of sucrose-seeking behavior without suppressing locomotor activity, implicating a role of D(2) dopamine receptors in mediating renewal of sucrose-seeking behavior.

Extinction with varenicline and nornicotine, but not ABT-418, weakens conditioned responding evoked by the interoceptive stimulus effects of nicotine

The interoceptive stimulus effects of nicotine acquire control over behavior. This observation, among others, suggests that the stimulus effects of nicotine are important in the development and tenacity of tobacco dependence. Despite this importance, there has been little research examining whether non-reinforced presentations (extinction) of a ligand that share stimulus effects of nicotine will weaken responding controlled by nicotine. Rats were trained to discriminate nicotine (0.4 mg/kg) from saline using a discriminated goal-tracking task in which nicotine signaled intermittent access to sucrose; sucrose was withheld on saline sessions. Experiment 1 examined substitution for nicotine by ABT-418, nornicotine, epibatidine, varenicline, or cytisine in 4-min extinction tests. Experiments 2-5 [low-dose nicotine (0.05 mg/kg), ABT-418, nornicotine, or varenicline, respectively] examined whether substitution for nicotine would persist if extinction tests were increased to 20 min and repeated daily for 6 days. Finally, generalization of this extinction back to the nicotine training stimulus was assessed. Full substitution in brief 4-min extinction tests was seen for ABT-418, nornicotine, epibatidine, varenicline, and cytisine. Low-dose nicotine, ABT-418, nornicotine, and varenicline, evoked only a partial 'nicotine-like' response in the first 20-min extinction test. With repeated extinction, only low-dose nicotine, nornicotine, and varenicline continued to substitute. Extinction with nornicotine and varenicline transferred back to nicotine as indicated by a partial conditioned response to the training stimulus. Interpretations regarding 'nicotine-like' effects of a ligand depend on the nature of the test. Understanding the processes mediating transfer of extinction learning with potential pharmacotherapies may reveal new treatment targets.

Neuronal circuits of fear extinction

Fear extinction is a form of inhibitory learning that allows for the adaptive control of conditioned fear responses. Although fear extinction is an active learning process that eventually leads to the formation of a consolidated extinction memory, it is a fragile behavioural state. Fear responses can recover spontaneously or subsequent to environmental influences, such as context changes or stress. Understanding the neuronal substrates of fear extinction is of tremendous clinical relevance, as extinction is the cornerstone of psychological therapy of several anxiety disorders and because the relapse of maladaptative fear and anxiety is a major clinical problem. Recent research has begun to shed light on the molecular and cellular processes underlying fear extinction. In particular, the acquisition, consolidation and expression of extinction memories are thought to be mediated by highly specific neuronal circuits embedded in a large-scale brain network including the amygdala, prefrontal cortex, hippocampus and brain stem. Moreover, recent findings indicate that the neuronal circuitry of extinction is developmentally regulated. Here, we review emerging concepts of the neuronal circuitry of fear extinction, and highlight novel findings suggesting that the fragile phenomenon of extinction can be converted into a permanent erasure of fear memories. Finally, we discuss how research on genetic animal models of impaired extinction can further our understanding of the molecular and genetic bases of human anxiety disorders.

Explicit disassociation of a conditioned stimulus and unconditioned stimulus during extinction training reduces both time to asymptotic extinction and spontaneous recovery of a conditioned taste aversion

Conditioned taste aversions (CTAs) may be acquired when an animal consumes a novel taste (CS) and then experiences the symptoms of poisoning (US). This aversion may be extinguished by repeated exposure to the CS alone. However, following a latency period in which the CS is not presented, the CTA will spontaneously recover (SR). In the current study we employed an explicitly unpaired extinction procedure (EU-EXT) to determine if it could thwart SR of a CTA. Sprague-Dawley rats acquired a strong CTA after 3 pairings of saccharin (SAC the CS) and Lithium Chloride (LiCl the US). CTA acquisition was followed by extinction (EXT) training consisting of either (a) CS-only exposure (CSO) or, (b) exposure to saccharin and Lithium Chloride on alternate days (i.e., explicitly unpaired: EU). Both extinction procedures resulted in >/= 90% reacceptance of SAC, although the EU extinction procedure (EU-EXT) significantly decreased the time necessary for rats to reach this criterion (compared to CSO controls). Rats were subsequently tested for SR of the CTA upon re-exposure to SAC following a 30-day latency period of water drinking. Rats that acquired a CTA and then underwent the CSO extinction procedure exhibited a significant suppression of SAC drinking during the SR test (as compared to their SAC drinking at the end of extinction). However, animals in the EU-EXT group did not show such suppression in drinking compared to CSO controls. These data suggest that the EU-EXT procedure may be useful in reducing both time to extinction and the spontaneous recovery of fears.

Relapse of successfully treated anxiety and fear: theoretical issues and recommendations for clinical practice

Despite the existence of effective interventions for anxiety disorders, relapse--or the return of fear--presents a significant problem for patients and clinicians in the longer term. The present paper draws on the experimental and clinical behavioural literature, reviewing the mechanisms by which the return of fear can occur. The aim of the paper was to generate a list of treatment recommendations for clinicians aimed at reducing relapse in successfully treated anxiety disorders. Clinical and experimental literature on the mechanisms of renewal, reinstatement, spontaneous recovery and reacquisition are reviewed. These are linked with the clinical and experimental literature on the return of fear in successfully treated anxiety. A list of recommendations to assist in reducing the probability of relapse in successfully treated anxiety is presented. This list includes methods for use in behavioural (exposure) treatment of anxiety disorders that aim to enhance clinical outcomes. Despite the significant problem of relapse in successfully treated anxiety, there are methods available to reduce the probability of relapse through return of fear. Clinicians engaging in treatment of anxiety disorders should be mindful of these methods to ensure optimal patient outcome.

Differential roles for hippocampal areas CA1 and CA3 in the contextual encoding and retrieval of extinguished fear

Recent studies demonstrate that context-specific memory retrieval after extinction requires the hippocampus. However, the contribution of hippocampal subfields to the context-dependent expression of extinction is not known. In the present experiments, we examined the roles of areas CA1 and CA3 of the dorsal hippocampus in the context specificity of extinction. After pairing an auditory conditional stimulus (CS) with an aversive footshock (unconditional stimulus or US), rats received extinction sessions in which the CS was presented without the US. In Experiment 1, pretraining neurotoxic lesions in either CA1 or CA3 eliminated the context dependence of extinguished fear. In Experiment 2, lesions of CA1 or CA3 were made after extinction training. In this case, only CA1 lesions impaired the context dependence of extinction. Collectively, these results reveal that both hippocampal areas CA1 and CA3 contribute to the acquisition of context-dependent extinction, but that only area CA1 is required for contextual memory retrieval.

Hippocampal involvement in contextual modulation of fear extinction

Extinction of fear conditioning in animals is an excellent model for the study of fear inhibition in humans. Substantial evidence has shown that extinction is a new learning process that is highly context-dependent. Several recovery effects (renewal, spontaneous recovery, and reinstatement) after extinction suggest that the contextual modulation of extinction is a critical behavioral mechanism underlying fear extinction. In addition, recent studies demonstrate a critical role for hippocampus in the context control of extinction. A growing body of evidence suggests that the hippocampus not only plays a role in contextual encoding and retrieval of fear extinction memories, but also interacts with other brain structures to regulate context-specificity of fear extinction. In this article, the authors will first discuss the fundamental behavioral features of the context effects of extinction and its underlying behavioral mechanisms. In the second part, the review will focus on the brain mechanisms for the contextual control of extinction.

Contextual renewal of cocaine seeking in rats and its attenuation by the conditioned effects of an alternative reinforcer

The present experiment investigated contextual renewal of cocaine seeking and potential methods of attenuating this renewal. Rats were first trained in one context to self-administer cocaine when a discriminative stimulus (tone) was presented. Then, the ABA Group was placed in a second context and responses in tone no longer produced cocaine (extinction). The AAA Group received this extinction in the original context. For two additional groups, responding to the tone was eliminated in a second context by additionally presenting food in tone according to a differential-reinforcement-of-other-behavior (DRO Group) schedule or independently of the rats' behavior on a fixed-time (FT Group) schedule. Renewal of responding to the tone was observed when the ABA Group was returned to the original context for a renewal test, but no renewal was observed in the AAA Group. Renewal also occurred in the DRO and FT Groups upon returning to the original context, but this renewal was significantly less than that of the ABA Group. These results suggest that response elimination techniques that are more active than simple extinction, such as pairing drug-related stimuli with alternative reinforcement, could reduce renewal of drug seeking and thereby help prevent relapse.

Neural-network simulations of two context-dependence phenomena

This paper describes simulations of two context-dependence phenomena in Pavlovian conditioning, using a neural-network model that draws on knowledge from neuroscience and makes no distinction between operant and respondent learning mechanisms. One phenomenon is context specificity or the context-shift effect, the decrease of conditioned responding (CR) when the conditioned stimulus (CS) is tested in a context different from the one in which it had been paired with the unconditioned stimulus (US). The other effect is renewal, the recovery of CR in the training context after extinction in another context. For specificity (simulation 1), two neural networks were first given 200 CS-US pairings in a context. Then, the CS was tested either in the training context or a new context. Output activations in the new context were substantially lower. For renewal (simulation 2), two networks were first given 200 CS-US pairings in a context, then 100 extinction trials in either the same context or a new one, and then tested back in the training context. Output activations during the test phase were substantially higher after extinction in a new context. The results are interpreted in terms of the dynamics of activations and weights.

Mechanisms of fear extinction

Excessive fear and anxiety are hallmarks of a variety of disabling anxiety disorders that affect millions of people throughout the world. Hence, a greater understanding of the brain mechanisms involved in the inhibition of fear and anxiety is attracting increasing interest in the research community. In the laboratory, fear inhibition most often is studied through a procedure in which a previously fear conditioned organism is exposed to a fear-eliciting cue in the absence of any aversive event. This procedure results in a decline in conditioned fear responses that is attributed to a process called fear extinction. Extensive empirical work by behavioral psychologists has revealed basic behavioral characteristics of extinction, and theoretical accounts have emphasized extinction as a form of inhibitory learning as opposed to an erasure of acquired fear. Guided by this work, neuroscientists have begun to dissect the neural mechanisms involved, including the regions in which extinction-related plasticity occurs and the cellular and molecular processes that are engaged. The present paper will cover behavioral, theoretical and neurobiological work, and will conclude with a discussion of clinical implications.

The physical context of previous stress exposure modifies hypothalamic-pituitary-adrenal responses to a subsequent homotypic stress

The hypothalamic-pituitary-adrenal (HPA) axis becomes less responsive to some types of repeated stress over time, a process termed habituation. Many facets of the stressful stimulus can modify such HPA responses to stressors, such as predictability and controllability. However, the physical context in which the stressor occurred may also provide a discriminative stimulus that can affect the HPA response to that stressor. In the present study, we examined whether a change in the context in which stress exposure occurs can alter HPA responses to a subsequent [corrected] homotypic stressor. Three separate contexts were produced by manipulating odor cues. Rats housed in the 3 context rooms exhibited similar HPA responses to acute 30-min restraint or repeated (8th) 30-min restraint in their home environments. However, rats that were restrained for 30 min per day for 7 days in a room in one context and then restrained on day 8 in a novel context exhibited attenuated habituation compared to rats restrained on day 8 in the familiar context. These results provide evidence that repeated stress-induced HPA activity depends, in part, on the context in which the stress is experienced.

Different mechanisms of fear extinction dependent on length of time since fear acquisition

Fear extinction is defined as a decline in conditioned fear responses (CRs) following nonreinforced exposure to a feared conditioned stimulus (CS). Behavioral evidence indicates that extinction is a form of inhibitory learning: Extinguished fear responses reappear with the passage of time (spontaneous recovery), a shift of context (renewal), and unsignaled presentations of the unconditioned stimulus (reinstatement). However, there also is evidence to suggest that extinction is an "unlearning" process corresponding to depotentiation of potentiated synapses within the amygdala. Because depotentiation is induced more readily at short intervals following LTP induction and is not inducible at all at a sufficient delay, it may be that extinction initiated shortly following fear acquisition preferentially engages depotentiation/"unlearning," whereas extinction initiated at longer delays recruits a different mechanism. We investigated this possibility through a series of behavioral experiments examining the recoverability of conditioned fear following extinction. Consistent with an inhibitory learning mechanism of extinction, rats extinguished 24-72 h following acquisition exhibited moderate to strong reinstatement, renewal, and spontaneous recovery. In contrast, and consistent with an erasure mechanism, rats extinguished 10 min to 1 h after acquisition exhibited little or no reinstatement, renewal, or spontaneous recovery. These data support a model in which different neural mechanisms are recruited depending on the temporal delay of fear extinction.

Context and behavioral processes in extinction

This article provides a selective review and integration of the behavioral literature on Pavlovian extinction. The first part reviews evidence that extinction does not destroy the original learning, but instead generates new learning that is especially context-dependent. The second part examines insights provided by research on several related behavioral phenomena (the interference paradigms, conditioned inhibition, and inhibition despite reinforcement). The final part examines four potential causes of extinction: the discrimination of a new reinforcement rate, generalization decrement, response inhibition, and violation of a reinforcer expectation. The data are consistent with behavioral models that emphasize the role of generalization decrement and expectation violation, but would be more so if those models were expanded to better accommodate the finding that extinction involves a context-modulated form of inhibitory learning.

D-cycloserine and the facilitation of extinction of conditioned fear: consequences for reinstatement

Several recent studies have reported that D-cycloserine (DCS), a partial N-methyl-D-aspartate agonist, facilitates extinction of learned fear in rats. Other studies have shown that representation of the unconditioned stimulus (US) can reinstate learned fear after extinction. This study examined whether this reinstatement effect occurs in Sprague-Dawley rats given DCS at the time of extinction. Results showed that saline-treated rats exhibited the reinstatement effect but DCS-treated rats did not (Experiments 1 and 2). This lack of reinstatement in DCS-treated rats was not due to residual effects of DCS on either US or context processing (Experiment 3). Overall, these results (a) raise questions about the mechanisms underlying DCS facilitation of extinction and (b) suggest that DCS might have substantial practical benefit.

Context, ambiguity, and unlearning: sources of relapse after behavioral extinction

There is now ample evidence that extinction, the loss of learned performance that occurs when a Pavlovian signal or an instrumental action is repeatedly presented without its reinforcer, does not reflect a destruction of the original learning. This article summarizes the evidence and extends and updates earlier reviews. The main alternative to "unlearning" is the idea that extinction (as well as other retroactive interference processes, including counterconditioning) involves new learning that is stored along with the old. One consequence is that the Pavlovian signal or instrumental action has two available "meanings" and thus has the properties of an ambiguous word: its current meaning (and the resulting behavioral output) depends on what the current context retrieves. Contexts can be provided by a variety of background stimuli, including the physical environment, internal drug state, and time. The second thing learned (e.g., extinction, counterconditioning) seems especially dependent on the context for retrieval. A variety of evidence is consistent with this analysis, which highlights several important sources of relapse after extinction. The article concludes with several issues for future research, among them the question of how we can optimize extinction and other putative "unlearning" treatments so as to prevent the various forms of relapse discussed here.

Common processes may contribute to extinction and habituation

Psychologists routinely attribute the characteristics of conditioned behavior to complicated cognitive processes. For example, many of the characteristics of behavior undergoing extinction have been attributed to retrieval from memory. The authors argue that these characteristics may result from the simpler process of habituation. In particular, conditioned responding may decrease during extinction partially because habituation occurs to the stimuli that control responding when those stimuli are presented repeatedly or for a prolonged time (e.g., the experimental context, the conditioned stimulus in classical conditioning). This idea is parsimonious, has face validity, and evokes only processes that are well established by other evidence. In addition, behavior undergoing extinction shows 12 of the fundamental properties of behavior undergoing habituation. However, this model probably cannot provide a complete theory of extinction. It provides no obvious explanation for some of the other characteristics of extinguished behavior.