Compound tests for excitation in early acquisition and after prolonged extinction of conditioned suppression

Neural substrates of appetitive and aversive prediction error

Prediction error, defined by the discrepancy between real and expected outcomes, lies at the core of associative learning. Behavioural investigations have provided evidence that prediction error up- and down-regulates associative relationships, and allocates attention to stimuli to enable learning. These behavioural advances have recently been followed by investigations into the neurobiological substrates of prediction error. In the present paper, we review neuroscience data obtained using causal and recording neural methods from a variety of key behavioural designs. We explore the neurobiology of both appetitive (reward) and aversive (fear) prediction error with a focus on the mesolimbic dopamine system, the amygdala, ventrolateral periaqueductal gray, hippocampus, cortex and locus coeruleus noradrenaline. New questions and avenues for research are considered.

Augmenting exposure therapy with pre-extinction fear memory reactivation and deepened extinction: A randomized controlled trial

BACKGROUND

Pre-extinction fear memory reactivation (PE-FMR) and deepened extinction (DE) enhance long-term extinction of shock-conditioned fear, and may also enhance long-term extinction of naturally acquired fear. Preliminary data suggest that PE-FMR may additionally boost the speed of fear reduction during exposure therapy.

DESIGN

Randomized controlled trial, factorial design.

METHODS

Participants with elevated fears of either spiders or snakes were randomized to (1) exposure therapy alone (n = 41), (2) exposure therapy + PE-FMR (n = 42), (3) exposure therapy + DE (n = 41), or (4) exposure therapy + PE-FMR + DE (n = 42). Participants were assessed at baseline, post-treatment, and one-week follow-up on subjective and behavioral indices of phobia. Because treatment length was tailored to speed of fear reduction, survival analyses were used to examine the speed of fear reduction during treatment.

RESULTS

DE did not improve clinical outcomes at post-treatment or follow-up, whereas PE-FMR produced more rapid fear reduction and was able to achive equivalent outcomes even when the duration of exposure therapy (tailored to speed of fear reduction) was shortened by an average of 21%.

CONCLUSIONS

Data suggest that PE-FMR is a promising strategy for reducing the overall duration of exposure-based therapies.

CLINICAL TRIAL REGISTRATION

(clinicaltrials.gov)NCT02160470.

Different methods of fear reduction are supported by distinct cortical substrates

Understanding how learned fear can be reduced is at the heart of treatments for anxiety disorders. Tremendous progress has been made in this regard through extinction training in which the aversive outcome is omitted. However, current progress almost entirely rests on this single paradigm, resulting in a very specialized knowledgebase at the behavioural and neural level of analysis. Here, we used a dual-paradigm approach to show that different methods that lead to reduction in learned fear in rats are dissociated in the cortex. We report that the infralimbic cortex has a very specific role in fear reduction that depends on the omission of aversive events but not on overexpectation. The orbitofrontal cortex, a structure generally overlooked in fear, is critical for downregulating fear when novel predictions about upcoming aversive events are generated, such as when fear is inflated or overexpected, but less so when an expected aversive event is omitted.

Compound Stimulus Presentation Does Not Deepen Extinction in Human Causal Learning

Models of associative learning have proposed that cue-outcome learning critically depends on the degree of prediction error encountered during training. Two experiments examined the role of error-driven extinction learning in a human causal learning task. Target cues underwent extinction in the presence of additional cues, which differed in the degree to which they predicted the outcome, thereby manipulating outcome expectancy and, in the absence of any change in reinforcement, prediction error. These prediction error manipulations have each been shown to modulate extinction learning in aversive conditioning studies. While both manipulations resulted in increased prediction error during training, neither enhanced extinction in the present human learning task (one manipulation resulted in less extinction at test). The results are discussed with reference to the types of associations that are regulated by prediction error, the types of error terms involved in their regulation, and how these interact with parameters involved in training.

Cocaine cues retain silent traces of an excitatory history after conversion into conditioned inhibitors: 'the ghost in the addict'

The present experiment investigated the extent to which the A+/AB- conditioned inhibition procedure could counteract an excitatory drug-related conditioning history. In two groups of rats, a light stimulus was established as a signal for the absence of cocaine. For the History group, the light had previously been a discriminative stimulus (S) that occasioned cocaine self-administration and could thus be classified as a cocaine excitor. In comparison, the No-History group first encountered the light during conditioned inhibition training. During conditioned inhibition training, both groups self-administered cocaine during tone as well as during click Ss, whereas drug seeking was eliminated in click-plus-light, wherein cocaine was not available (A+/AB-). Drug seeking was essentially eliminated in both groups. Nevertheless, on a summation test the light reduced cocaine seeking occasioned by the tone S by 95% in the No-History group, but by less than 50% in the History group. This summation test result showed that the effects of a drug-related history persisted even after the light was converted into an effective conditioned inhibitor on the training baseline through the powerful A+/AB- procedure. Future research should seek procedures that produce even stronger conditioned inhibition that eliminates such residual 'silent' drug excitation, the 'ghost in the addict'.

Compound stimulus extinction reduces spontaneous recovery in humans

Fear-related behaviors are prone to relapse following extinction. We tested in humans a compound extinction design ("deepened extinction") shown in animal studies to reduce post-extinction fear recovery. Adult subjects underwent fear conditioning to a visual and an auditory conditioned stimulus (CSA and CSB, respectively) separately paired with an electric shock. The target CS (CSA) was extinguished alone followed by compound presentations of the extinguished CSA and nonextinguished CSB. Recovery of conditioned skin conductance responses to CSA was reduced 24 h after compound extinction, as compared with a group who received an equal number of extinction trials to the CSA alone.

Associative Accounts of Recovery-from-Extinction Effects

Recovery-from-extinction effects (e.g., spontaneous recovery, renewal, reinstatement, and facilitated reacquisition) have become the focus of much research in recent years. However, despite a great deal of empirical data, there are few theoretical explanations for these effects. This paucity poses a severe limitation on our understanding of these behavioral effects, impedes advances in uncovering neural mechanisms of response recovery, and reduces our potential to prevent relapse after exposure therapy. Towards correcting this oversight, this review takes prominent models of associative learning that have been used in the past and continue to be used today to explain Pavlovian conditioning and extinction, and assesses how each model can be applied to account for recovery-from-extinction effects. The models include the Rescorla-Wagner (1972) model, Mackintosh's (1975) attentional model, Pearce and Hall's (1980) attentional model, Wagner's (1981) SOP model, Pearce's (1987) configural model, McLaren and Mackintosh's (2002) elemental model, and Stout and Miller's (2007) SOCR (comparator hypothesis) model. Each model is assessed for how well it explains or does not explain the various recovery-from-extinction phenomena. We offer some suggestions for how the models might be modified to account for these effects in those instances in which they initially fail.

Contemporary Study of Pavlovian Conditioning

Pavlov's first report on conditioning emphasized its role in allowing the animal to adjust to its environment. Contemporary theories have seen this adjustment in terms of developing accurate knowledge of the environment. Three aspects of that thinking are explored: how the animal acquires initial knowledge, how it changes its knowledge when conditions of the world change, and how it makes use of multiple knowledge representations.

Psychological and neural mechanisms of experimental extinction: a selective review

The present review examines key psychological concepts in the study of experimental extinction and implications these have for an understanding of the underlying neurobiology of extinction learning. We suggest that many of the signature characteristics of extinction learning (spontaneous recovery, renewal, reinstatement, rapid reacquisition) can be accommodated by the standard associative learning theory assumption that extinction results in partial erasure of the original learning together with new inhibitory learning. Moreover, we consider recent behavioral and neural evidence that supports the partial erasure view of extinction, but also note shortcomings in our understanding of extinction circuits as these relate to the negative prediction error concept. Recent work suggests that common prediction error and stimulus-specific prediction error terms both may be required to explain neural plasticity both in acquisition and extinction learning. In addition, we suggest that many issues in the content of extinction learning have not been fully addressed in current research, but that neurobiological approaches should be especially helpful in addressing such issues. These include questions about the nature of extinction learning (excitatory CS-No US, inhibitory CS-US learning, occasion setting processes), especially as this relates to studies of the micro-circuitry of extinction, as well as its representational content (sensory, motivational, response). An additional understudied problem in extinction research is the role played by attention processes and their underlying neural networks, although some research and theory converge on the idea that extinction is accompanied by attention decrements (i.e., habituation-like processes).

On the differences in degree of renewal produced by the different renewal designs

This paper addresses sources contributing to the differences in the degree of recovery from extinction observed with different renewal paradigms. In two lick suppression experiments with rats, we assessed the role of the associative status of the acquisition context in both the weakness of AAC renewal and the sometimes observed weaker renewal resulting from an ABC design relative to an ABA design. In Experiment 1, we observed that AAC renewal relative to an AAA control group was small unless Context A had undergone associative deflation (i.e., extinction of Context A). Deflation of Context A not only decreased behavioral control by the CS in the AAA condition, but increased it in the AAC condition, thereby implicating a comparator process in addition to associative summation between the CS and test context. In Experiment 2, an excitatory acquisition context was found to enhance the difference between ABC and ABA renewal. Associative deflation of the acquisition context decreased ABA renewal more than ABC renewal. Thus, the associative value of the acquisition context (A) was more positively related to the level of renewal when the target CS (X) was tested in this context than when it was tested in a neutral but equally familiar context (C), consistent with the frequently observed greater renewal in an ABA condition than an ABC condition arising from associative summation of the CS and test context. These findings demonstrate that the excitatory status of the acquisition context influences the observed degree of renewal.

The metabotropic glutamate 5 receptor modulates extinction and reinstatement of methamphetamine-seeking in mice

Methamphetamine (METH) is a highly addictive psychostimulant with no therapeutics registered to assist addicts in discontinuing use. Glutamatergic dysfunction has been implicated in the development and maintenance of addiction. We sought to assess the involvement of the metabotropic glutamate 5 receptor (mGlu5) in behaviours relevant to METH addiction because this receptor has been implicated in the actions of other drugs of abuse, including alcohol, cocaine and opiates. mGlu5 knockout (KO) mice were tested in intravenous self-administration, conditioned place preference and locomotor sensitization. Self-administration of sucrose was used to assess the response of KO mice to a natural reward. Acquisition and maintenance of self-administration, as well as the motivation to self-administer METH was intact in mGlu5 KO mice. Importantly, mGlu5 KO mice required more extinction sessions to extinguish the operant response for METH, and exhibited an enhanced propensity to reinstate operant responding following exposure to drug-associated cues. This phenotype was not present when KO mice were tested in an equivalent paradigm assessing operant responding for sucrose. Development of conditioned place preference and locomotor sensitization were intact in KO mice; however, conditioned hyperactivity to the context previously paired with drug was elevated in KO mice. These data demonstrate a role for mGlu5 in the extinction and reinstatement of METH-seeking, and suggests a role for mGlu5 in regulating contextual salience.

Deepened extinction of cocaine cues

BACKGROUND

A method for reducing the power of drug cues could help in treating drug abuse and addiction. Extinction has been used, with mixed success, in such an effort. Research with non-drug cues has shown that simultaneously presenting (compounding) those cues during extinction can enhance the effectiveness of extinction. The present study investigated whether this procedure could be used to similarly deepen the extinction of cocaine cues.

METHODS

Rats were first trained to self-administer cocaine during tone, click, and light stimuli. Then, these stimuli were subjected to extinction in an initial phase where they were presented individually. In a second extinction phase, one of the auditory stimuli (counterbalanced) was compounded with the light. The other auditory stimulus continued to be presented alone. Rats were then given a week of rest in their homecages prior to testing for spontaneous recovery of cocaine seeking.

RESULTS

The cue that was compounded with the light during the second phase of extinction training occasioned less spontaneous recovery of cocaine seeking than the cue that was always presented individually during extinction. Increasing the number of compound cue extinction sessions did not produce a greater deepened extinction effect.

CONCLUSIONS

The present study showed that simultaneously presenting already-extinguished cocaine cues during additional extinction training enhanced extinction. This extends the deepened extinction effect from non-drug cues to drug cues and further confirms predictions of error-correction learning theory. Incorporating deepened extinction into extinction-based drug abuse treatments could help to reduce the power of drug cues.

Compound stimulus presentation and the norepinephrine reuptake inhibitor atomoxetine enhance long-term extinction of cocaine-seeking behavior

Drug abstinence is frequently compromised when addicted individuals are re-exposed to environmental stimuli previously associated with drug use. Research with human addicts and in animal models has demonstrated that extinction learning (non-reinforced cue-exposure) can reduce the capacity of such stimuli to induce relapse, yet extinction therapies have limited long-term success under real-world conditions (Bouton, 2002; O'Brien, 2008). We hypothesized that enhancing extinction would reduce the later ability of drug-predictive cues to precipitate drug-seeking behavior. We, therefore, tested whether compound stimulus presentation and pharmacological treatments that augment noradrenergic activity (atomoxetine; norepinephrine reuptake inhibitor) during extinction training would facilitate the extinction of drug-seeking behaviors, thus reducing relapse. Rats were trained that the presentation of a discrete cue signaled that a lever press response would result in cocaine reinforcement. Rats were subsequently extinguished and spontaneous recovery of drug-seeking behavior following presentation of previously drug-predictive cues was tested 4 weeks later. We find that compound stimulus presentations or pharmacologically increasing noradrenergic activity during extinction training results in less future recovery of responding, whereas propranolol treatment reduced the benefit seen with compound stimulus presentation. These data may have important implications for understanding the biological basis of extinction learning, as well as for improving the outcome of extinction-based therapies.

Extinguished cocaine cues increase drug seeking when presented simultaneously with a non-extinguished cocaine cue

BACKGROUND

Previous research with non-drug reinforcers has shown that simultaneously presenting (compounding) an extinguished cue with another cue formerly associated with the same reinforcer can increase rates of cue-controlled behavior. The present study investigated whether an extinguished cocaine cue would energize cocaine seeking when presented simultaneously with another cocaine cue. This study also investigated whether extinction could be enhanced by subjecting an extinguished cocaine cue to further extinction after administration of reinstating injections of cocaine.

METHODS

Rats were first trained to self-administer cocaine in the presence of three different cues. Then, one of the cues was subjected to the standard extinction treatment. Another cue was subjected to a modified extinction treatment where additional extinction sessions were preceded by non-contingent cocaine injections. The third cue was not extinguished.

RESULTS

The cue subjected to standard extinction ceased to control cocaine seeking when presented alone, but significantly increased cocaine seeking when compounded with the non-extinguished cocaine cue. The cocaine cue subjected to the modified extinction treatment also significantly increased cocaine seeking occasioned by the non-extinguished cocaine cue.

CONCLUSIONS

Extending results of previous studies involving non-drug stimuli, the present study showed that extinguished cocaine cues can enhance cocaine seeking when compounded with other cocaine cues. These results illustrate the persistence of drug cues in controlling behavior despite extinction and highlight the need for developing treatments that eliminate this residual energizing capacity that survives extinction.

Extinction of goal tracking also eliminates the conditioned reinforcing effects of an appetitive conditioned stimulus

Previous studies have suggested that the effects of extinction are response-specific. The present study investigated whether an extinction treatment that eliminated goal tracking elicited by an appetitive conditioned stimulus (CS) would also eliminate the conditioned reinforcing effects of that CS. Rats were first trained on a goal-tracking procedure in which an auditory CS was paired with a food unconditioned stimulus. Animals learned to approach the location where the food was delivered. In a subsequent phase, rats in one group received extinction training that eliminated the goal-tracking elicited by the CS. Rats in the other group did not experience extinction of the food-paired CS. Then, both groups received a test for conditioned reinforcement in which leverpresses resulted in the brief presentation of the stimulus previously paired with food. This stimulus did not act as a conditioned reinforcer in the group that had been subjected to extinction training, but did serve as a conditioned reinforcer in the group that did not experience extinction. These results indicate that the effects of extinction generalize from the approach-eliciting to the conditioned reinforcing effects of an appetitive CS.

Deepened extinction following compound stimulus presentation: noradrenergic modulation

Behavioral extinction is an active form of new learning involving the prediction of nonreward where reward has previously been present. The expression of extinction learning can be disrupted by the presentation of reward itself or reward-predictive stimuli (reinstatement) as well as the passage of time (spontaneous recovery) or contextual changes (renewal). The following experiments replicated the demonstration that presenting multiple previously rewarded stimuli in compound during extinction enhances extinction learning. To explore the pharmacological basis for this we next examined the effects of pharmacological treatments that either facilitated or blocked noradrenergic activity to test the hypothesis that increased noradrenergic activity at the time of extinction training would improve, whereas blockade of noradrenergic activity would impair the extinction of appetitive stimulus-reward memories. Different groups of rats were trained in a discriminative stimulus paradigm to lever-press for food reward. Once stable responding was achieved, responding was extinguished for 2 d. Prior to a third extinction session, rats received systemic administration of either saline, yohimbine (α2 antagonist), atomoxetine (norepinephrine reuptake inhibitor), or propranolol (β-receptor antagonist). Spontaneous recovery of responding to the stimuli was tested 4 wk later. Our results indicate that increasing noradrenergic activity during extinction augments extinction learning resulting in less recovery of responding at test. These results have important implications for models of relapse to drug seeking and the development of extinction-based therapies.

New findings on extinction of conditioned fear early in development: theoretical and clinical implications

Research with adult animals suggests that extinction depends, at least partly, on new inhibitory learning that is specific to the context in which it is learned. However, several recent studies show that extinction processes are dissociated across development. The present article reviews research on the behavioral and neurobiological mechanisms underlying extinction in developing rats. To summarize, postweanling aged rats (i.e., 24-day-olds) display adult-like extinction in that they show renewal, reinstatement, spontaneous recovery, and compound summation of extinguished stimuli. However, preweanling aged rats (i.e., 17-day-olds) do not show any of those behavioral phenomena. Pharmacological studies also show that reducing N-methyl-D-aspartate, gamma-aminobutryic acid, and opioid neurotransmission impairs extinction in 24-day-old rats, but extinction in P17 rats is only affected by the blocking of opioid neurotransmission. Lastly, extinction in 24-day-old rats involves the amygdala and the ventromedial prefrontal cortex (vmPFC), which are critical brain areas in the neural circuitry of extinction in adult rats. Interestingly, extinction in 17-day-old rats involves the amygdala but not the vmPFC. The existing models of extinction cannot account for these developmental differences. These findings showing that distinct processes mediate extinction at different stages of development may have significant clinical implications, which are discussed in this review.

Explicit disassociation of a conditioned stimulus and unconditioned stimulus during extinction training reduces both time to asymptotic extinction and spontaneous recovery of a conditioned taste aversion

Conditioned taste aversions (CTAs) may be acquired when an animal consumes a novel taste (CS) and then experiences the symptoms of poisoning (US). This aversion may be extinguished by repeated exposure to the CS alone. However, following a latency period in which the CS is not presented, the CTA will spontaneously recover (SR). In the current study we employed an explicitly unpaired extinction procedure (EU-EXT) to determine if it could thwart SR of a CTA. Sprague-Dawley rats acquired a strong CTA after 3 pairings of saccharin (SAC the CS) and Lithium Chloride (LiCl the US). CTA acquisition was followed by extinction (EXT) training consisting of either (a) CS-only exposure (CSO) or, (b) exposure to saccharin and Lithium Chloride on alternate days (i.e., explicitly unpaired: EU). Both extinction procedures resulted in >/= 90% reacceptance of SAC, although the EU extinction procedure (EU-EXT) significantly decreased the time necessary for rats to reach this criterion (compared to CSO controls). Rats were subsequently tested for SR of the CTA upon re-exposure to SAC following a 30-day latency period of water drinking. Rats that acquired a CTA and then underwent the CSO extinction procedure exhibited a significant suppression of SAC drinking during the SR test (as compared to their SAC drinking at the end of extinction). However, animals in the EU-EXT group did not show such suppression in drinking compared to CSO controls. These data suggest that the EU-EXT procedure may be useful in reducing both time to extinction and the spontaneous recovery of fears.

The role of temporal variables in inhibition produced through extinction

In two experiments with rats as subjects, the temporal characteristics of inhibition produced through extinction were investigated. Each experiment established two independent signals for unconditioned stimulus presentation, one trace and one delay. Following initial training, either the trace or the delay conditioned stimulus (CS) was massively extinguished. In Experiment 1, a summation test established that an extinguished delay CS (but not a neutral CS) passed a summation test with a delay, but not with a trace, transfer excitor, and an extinguished trace CS (but not a neutral CS) passed a summation test with a trace, but not with a delay, transfer excitor. In Experiment 2, a retardation test showed retarded behavioral control by an extinguished delay CS when the CS was retrained as a delay CS, but not as a trace CS, and by an extinguished trace CS when the CS was retrained as a trace CS, but not as a delay CS. The results are discussed in terms of contemporary theories of extinction.

Mechanisms of fear extinction

Excessive fear and anxiety are hallmarks of a variety of disabling anxiety disorders that affect millions of people throughout the world. Hence, a greater understanding of the brain mechanisms involved in the inhibition of fear and anxiety is attracting increasing interest in the research community. In the laboratory, fear inhibition most often is studied through a procedure in which a previously fear conditioned organism is exposed to a fear-eliciting cue in the absence of any aversive event. This procedure results in a decline in conditioned fear responses that is attributed to a process called fear extinction. Extensive empirical work by behavioral psychologists has revealed basic behavioral characteristics of extinction, and theoretical accounts have emphasized extinction as a form of inhibitory learning as opposed to an erasure of acquired fear. Guided by this work, neuroscientists have begun to dissect the neural mechanisms involved, including the regions in which extinction-related plasticity occurs and the cellular and molecular processes that are engaged. The present paper will cover behavioral, theoretical and neurobiological work, and will conclude with a discussion of clinical implications.

Timing of omitted events: an analysis of temporal control of inhibitory behavior

This paper reviews research designed to investigate the temporal control of inhibitory responding using rats as subjects. One area of investigation has focused on the role of temporal variables in conditioned inhibition produced using Pavlov's [Pavlov, I.P., 1927. Conditioned Reflexes. Oxford University Press, London, 430 pp.] procedure. These studies have found that evidence of conditioned inhibition obtained by negative summation testing is strongest when the conditioned inhibitor signals the omission of the unconditioned stimulus (US) at the same temporal location as a transfer excitor signals presentation of the US [e.g., Barnet, R.C., Miller, R.R., 1996. Temporal encoding as a determinant of inhibitory control. Learn. Motiv. 27, 73-91]. Similarly, retardation of acquisition of behavioral control by a previously inhibitory conditioned stimulus (CS) is maximal when the inhibitory CS is paired with the US at the same temporal location as the inhibitor had previously signaled US omission [Burger, D., Denniston, J.C., Miller, R.R., 2001. Temporal coding in condition inhibition: retardation tests. Anim. Learn. Behav. 29, 281-290]. Other lines of research designed to assess the associative structure of temporal control of inhibition [e.g., Denniston, J.C., Blaisdell, A.P., Miller, R.R., 2004. Temporal control in conditioned inhibition: analysis of associative structure of inhibition. J. Exp. Psychol. Anim. Behav. Process. 30, 190-202] are reviewed, as is the assessment of temporal control of inhibition produced through extinction [Denniston, J.C., Miller, R.R., 2003. The role of temporal variables in inhibition produced through extinction. Learn. Behav. 31, 35-48]. These collective observations are discussed in terms of the temporal coding hypothesis [Matzel, L.D., Held, F.P., Miller, R.R., 1988. Reexamination of simultaneous and backward conditioning: Implications for contiguity theory. Learn. Motiv. 19, 317-344].

Deepened extinction from compound stimulus presentation

Three experiments with rats and 2 with pigeons explored the effect of presenting 2 extinguished excitatory stimuli in compound. Four learning situations were used: Pavlovian magazine approach, Pavlovian fear conditioning, and instrumental discriminative instrumental learning in rats, as well as Pavlovian sign tracking in pigeons. All 5 experiments confirmed D. Reberg's (1972) observation that even after extinction of the individual stimuli, presenting them in compound evoked substantial responding. Moreover, nonreinforcement of that compound deepened extinction of an element more substantially than did additional presentation of that element alone. Such compound exposure reduced spontaneous recovery, reduced reinstatement, and slowed subsequent reconditioning. The primary determinant seemed to be the enhanced associative strength rather than the enhanced conditioned responding that occurred during the nonreinforced compound.

Stimulus generalization of excitation and inhibition

Five sign-tracking experiments with pigeons investigated the breadth of stimulus generalization of excitatory and inhibitory conditioning. Using a compound stimulus test procedure, these experiments found evidence for a narrower generalization of associative strength in excitation than in inhibition. They also found a narrower associative gradient with a more strongly conditioned excitatory stimulus, although this did not seem to account for the difference between exciters and inhibitors. These results confirm earlier findings comparing generalization after acquisition and extinction and raise various theoretical issues about generalization.

Different mechanisms of fear extinction dependent on length of time since fear acquisition

Fear extinction is defined as a decline in conditioned fear responses (CRs) following nonreinforced exposure to a feared conditioned stimulus (CS). Behavioral evidence indicates that extinction is a form of inhibitory learning: Extinguished fear responses reappear with the passage of time (spontaneous recovery), a shift of context (renewal), and unsignaled presentations of the unconditioned stimulus (reinstatement). However, there also is evidence to suggest that extinction is an "unlearning" process corresponding to depotentiation of potentiated synapses within the amygdala. Because depotentiation is induced more readily at short intervals following LTP induction and is not inducible at all at a sufficient delay, it may be that extinction initiated shortly following fear acquisition preferentially engages depotentiation/"unlearning," whereas extinction initiated at longer delays recruits a different mechanism. We investigated this possibility through a series of behavioral experiments examining the recoverability of conditioned fear following extinction. Consistent with an inhibitory learning mechanism of extinction, rats extinguished 24-72 h following acquisition exhibited moderate to strong reinstatement, renewal, and spontaneous recovery. In contrast, and consistent with an erasure mechanism, rats extinguished 10 min to 1 h after acquisition exhibited little or no reinstatement, renewal, or spontaneous recovery. These data support a model in which different neural mechanisms are recruited depending on the temporal delay of fear extinction.

Recovery of conditioned fear by a single postextinction shock: Effect of similarity of shock contexts and of time following extinction

Subjects in six experimental groups (n = 16 each) received one-trial passive avoidance (PA) training in which shock was delivered upon movement from a white wooden floor compartment to a black grid compartment. Then fear was extinguished (30 min) in the black compartment. After either 24 or 168 h, all the groups were treated in a room distinctively different from the training room. At each interval, one group received a shock in an apparatus similar to the conditioning box, another received a shock in a dissimilar apparatus, and another was placed in a neutral box. A PA test trial in the training apparatus indicated reinstatement of extinguished fear in all the groups given a postextinction shock except the 24-h dissimilar group. Control groups revealed that the extinction treatment was effective and that spontaneous recovery was not evident. The results were explained in terms of classical conditioning, stimulus generalization, and the broadening (flattening) of stimulus generalization gradients with time.

Reinstatement of a food-maintained operant produced by compounding discriminative stimuli

After a tone and a light were established as discriminative stimuli for food-reinforced responding in rats, presenting these stimuli simultaneously produced over three times as many responses as either the tone or light alone. Following this stimulus compounding test, responses during the tone and during the light were not reinforced (extinction) for 20 sessions, essentially eliminating responding. On stimulus compounding tests administered after the 10th and 20th extinction sessions, tone-plus-light continued to produce significantly more responding than the tone or light alone. The compound even produced responses when the individual stimuli no longer did. These results suggest that the simultaneous presentation of multiple extinguished discriminative stimuli may also contribute to the reinstatement of other positively-reinforced behaviors, such as drug taking.

Conditioned inhibition of cocaine seeking in rats

Despite its potential relevance to the treatment of drug abuse, conditioned inhibition of drug seeking has not been systematically investigated before. In this study, rats could self-administer cocaine by lever pressing whenever a click or tone was present. Responding was not reinforced when a light was present. The light was presented simultaneously with the click (i.e., in an excitatory context) in 1 group, but the light was always presented alone in another group. When it was later presented in compound with the tone, the light was a highly effective conditioned inhibitor, suppressing cocaine seeking by 92% in the former group and by 74% in the latter. These results suggest ways to improve cue-oriented behavioral treatments for drug abuse.

Spontaneous recovery

Spontaneous recovery from extinction is one of the most basic phenomena of Pavlovian conditioning. Although it can be studied by using a variety of designs, some procedures are better than others for identifying the involvement of underlying learning processes. A wide range of different learning mechanisms has been suggested as being engaged by extinction, most of which have implications for the nature of spontaneous recovery. However, despite the centrality of the notion of spontaneous recovery to the understanding of extinction, the empirical literature on its determinants is relatively sparse and quite mixed. Its very ubiquity suggests that spontaneous recovery has multiple sources.

A modified version of the unique cue theory accounts for olfactory compound processing in honeybees

We investigated the capability of honeybees to discriminate between single odorants, binary olfactory mixtures, and ternary olfactory mixtures in olfactory conditioning of the proboscis extension reflex. In Experiment 1, three single odorants (A+, B+, and C+) and three binary mixtures of these odors (AB+, AC+, and BC+) were reinforced while the ternary compound, consisting of all three odors (ABC-), was nonreinforced. In Experiment 2, only one single odorant (A+) and one binary olfactory compound (BC+) were reinforced while the ternary compound (ABC-) consisting of the single odor and the binary compound was nonreinforced. We studied whether bees can solve these problems and whether the course of differentiation can be predicted by the unique cue theory, a modified unique cue theory, or Pearce's configural theory. Honeybees were not able to differentiate reinforced from nonreinforced stimuli in Experiment 1. However, summation to ABC observed at the beginning of training contradicts the predictions of Pearce's configural theory. In Experiment 2, differentiation between the single odorant A and the ternary compound developed more easily than between the binary compound BC and ABC. This pattern of differentiation is in line with a modified unique cue theory and Pearce's configural theory. Summation to ABC at the beginning of training, however, again was at odds with Pearce's configural theory. Thus, olfactory compound processing in honeybees can best be explained by a modified unique cue theory.

A modern learning theory perspective on the etiology of panic disorder

Several theories of the development of panic disorder (PD) with or without agoraphobia have emerged in the last 2 decades. Early theories that proposed a role for classical conditioning were criticized on several grounds. However, each criticism can be met and rejected when one considers current perspectives on conditioning and associative learning. The authors propose that PD develops because exposure to panic attacks causes the conditioning of anxiety (and sometimes panic) to exteroceptive and interoceptive cues. This process is reflected in a variety of cognitive and behavioral phenomena but fundamentally involves emotional learning that is best accounted for by conditioning principles. Anxiety, an anticipatory emotional state that functions to prepare the individual for the next panic, is different from panic, an emotional state designed to deal with a traumatic event that is already in progress. However, the presence of conditioned anxiety potentiates the next panic, which begins the individual's spiral into PD. Several biological and psychological factors create vulnerabilities by influencing the individual's susceptibility to conditioning. The relationship between the present view and other views, particularly those that emphasize the role of catastrophic misinterpretation of somatic sensations, is discussed.