Experimental extinction in Pavlovian conditioning: Behavioural and neuroscience perspectives

This paper reviews the behavioural and neuroscience literatures on extinction in Pavlovian conditioning with a view towards finding possible points of contact between these two often independent lines of investigation. Recent discoveries at the behavioural level indicate (1) that conditioned stimulus (CS)–unconditioned stimulus (US) associations specific in their sensory content are fully preserved during extinction, (2) that inhibitory stimulus-response associations appear to be learned during extinction, (3) that extinction is influenced by the level of activation of the US representation during nonreinforced trials, (4) that decreases in attention can influence conditioned performance during extinction, and (5) that contexts acquire an ability to modulate learning during both conditioning and extinction. Recent discoveries at the neural systems level suggest (1) that the hippocampus is important in context-specific learning during extinction, (2) that the prefrontal cortex is possibly important in long-term memory for extinction, (3) that the basolateral amygdala may be important in sustaining attention to a CS during extinction, (4) that NMDA receptors are important either in neural plasticity during extinction or by affecting the value of the US representation during extinction, and (5) that the GABAergic system may partially mediate inhibitory learning during extinction. It is concluded that both of these levels of analysis can benefit the other in the pursuit of a more comprehensive understanding of extinction.

Behavioral and neural analysis of GABA in the acquisition, consolidation, reconsolidation, and extinction of fear memory

The current review systematically documents the role of gamma-amino-butyric acid (GABA) in different aspects of fear memory-acquisition and consolidation, reconsolidation, and extinction, and attempts to resolve apparent contradictions in the data in order to identify the function of GABA(A) receptors in fear memory. First, numerous studies have shown that pre- and post-training administration of drugs that facilitate GABAergic transmission disrupt the initial formation of fear memories, indicating a role for GABA(A) receptors, possibly within the amygdala and hippocampus, in the acquisition and consolidation of fear memories. Similarly, recent evidence indicates that these drugs are also detrimental to the restorage of fear memories after their reactivation. This suggests a role for GABA(A) receptors in the reconsolidation of fear memories, although the precise neural circuits are yet to be identified. Finally, research regarding the role of GABA in extinction has shown that GABAergic transmission is also disruptive to the formation of newly acquired extinction memories. We argue that contradictions to these patterns are the result of variations in (a) the location of drug infusion, (b) the dosage of the drug and/or (c) the time point of drug administration. The question of whether these GABA-induced memory deficits reflect deficits in retrieval is discussed. Overall, the evidence implies that the processes mediating memory stability consequent to initial fear learning, memory reactivation, and extinction training are dependent on a common mechanism of reduced GABAergic neurotransmission.

Taste-potentiated odor aversion learning in rats with lesions of the insular cortex

The current study assessed the influence of excitotoxic lesions of the insular cortex (IC) on taste-potentiated odor aversion (TPOA) learning. Water-deprived rats initially received a single odor-toxicosis or odor/taste-toxicosis pairing and were subsequently tested, in separate trials, with the odor and the taste stimulus. Indicating TPOA, neurologically intact rats conditioned with the odor/taste compound stimulus acquired significantly stronger odor aversions than normal rats conditioned with the odor stimulus. IC lesions disrupted TPOA, conditioned taste aversion and taste neophobia. The finding that taste did not potentiate odor aversion learning in the IC-lesioned rats provides support for the "within-compound association" analysis but is inconsistent with the "sensory-and-gate" account of TPOA learning.

Timing of omitted events: an analysis of temporal control of inhibitory behavior

This paper reviews research designed to investigate the temporal control of inhibitory responding using rats as subjects. One area of investigation has focused on the role of temporal variables in conditioned inhibition produced using Pavlov's [Pavlov, I.P., 1927. Conditioned Reflexes. Oxford University Press, London, 430 pp.] procedure. These studies have found that evidence of conditioned inhibition obtained by negative summation testing is strongest when the conditioned inhibitor signals the omission of the unconditioned stimulus (US) at the same temporal location as a transfer excitor signals presentation of the US [e.g., Barnet, R.C., Miller, R.R., 1996. Temporal encoding as a determinant of inhibitory control. Learn. Motiv. 27, 73-91]. Similarly, retardation of acquisition of behavioral control by a previously inhibitory conditioned stimulus (CS) is maximal when the inhibitory CS is paired with the US at the same temporal location as the inhibitor had previously signaled US omission [Burger, D., Denniston, J.C., Miller, R.R., 2001. Temporal coding in condition inhibition: retardation tests. Anim. Learn. Behav. 29, 281-290]. Other lines of research designed to assess the associative structure of temporal control of inhibition [e.g., Denniston, J.C., Blaisdell, A.P., Miller, R.R., 2004. Temporal control in conditioned inhibition: analysis of associative structure of inhibition. J. Exp. Psychol. Anim. Behav. Process. 30, 190-202] are reviewed, as is the assessment of temporal control of inhibition produced through extinction [Denniston, J.C., Miller, R.R., 2003. The role of temporal variables in inhibition produced through extinction. Learn. Behav. 31, 35-48]. These collective observations are discussed in terms of the temporal coding hypothesis [Matzel, L.D., Held, F.P., Miller, R.R., 1988. Reexamination of simultaneous and backward conditioning: Implications for contiguity theory. Learn. Motiv. 19, 317-344].

Classical fear conditioning in the anxiety disorders: a meta-analysis

Fear conditioning represents the process by which a neutral stimulus comes to evoke fear following its repeated pairing with an aversive stimulus. Although fear conditioning has long been considered a central pathogenic mechanism in anxiety disorders, studies employing lab-based conditioning paradigms provide inconsistent support for this idea. A quantitative review of 20 such studies, representing fear-learning scores for 453 anxiety patients and 455 healthy controls, was conducted to verify the aggregated result of this literature and to assess the moderating influences of study characteristics. Results point to modest increases in both acquisition of fear learning and conditioned responding during extinction among anxiety patients. Importantly, these patient-control differences are not apparent when looking at discrimination studies alone and primarily emerge from studies employing simple, single-cue paradigms where only danger cues are presented and no inhibition of fear to safety cues is required.

Effects of an extinguished CS on competition with another CS

Three experiments were conducted using a conditioned taste aversion procedure with rats to examine the effect of nonreinforced presentations of a conditioned stimulus (CS) on its ability to compete with a target stimulus for manifest conditioned responding. Two CSs (A and B) were presented in a serial compound and then paired with the unconditioned stimulus. CS A was first paired with the US and then presented without the US (i.e., extinction) prior to reinforced presentation of the AB compound. Experiment 1 showed that A was poor at competing with B for conditioned responding when given conditioning and extinction prior to reinforcement of AB relative to a group that received both A and B for the first time during compound conditioning. That is, an extinguished A stimulus allowed greater manifest acquisition to B. Experiment 2 found that extinction treatment produced a poor CR to the pretrained and extinguished CS itself following compound conditioning. Experiment 3 found that interposing a retention interval after extinction of A and prior to compound conditioning enhanced A's ability to compete with B. The results of these experiments are discussed with regard to different theories of extinction and associative competition.

The role of temporal variables in inhibition produced through extinction

In two experiments with rats as subjects, the temporal characteristics of inhibition produced through extinction were investigated. Each experiment established two independent signals for unconditioned stimulus presentation, one trace and one delay. Following initial training, either the trace or the delay conditioned stimulus (CS) was massively extinguished. In Experiment 1, a summation test established that an extinguished delay CS (but not a neutral CS) passed a summation test with a delay, but not with a trace, transfer excitor, and an extinguished trace CS (but not a neutral CS) passed a summation test with a trace, but not with a delay, transfer excitor. In Experiment 2, a retardation test showed retarded behavioral control by an extinguished delay CS when the CS was retrained as a delay CS, but not as a trace CS, and by an extinguished trace CS when the CS was retrained as a trace CS, but not as a delay CS. The results are discussed in terms of contemporary theories of extinction.

Savings in classical conditioning in the rabbit as a function of extended extinction

In the present experiments, savings phenomena following a limited amount of initial acquisition and extended extinction were examined. Experiments 1 and 2 compared rates of reacquisition following brief acquisition and various amounts of extinction in conditioning of the rabbit's nictitating membrane and heart rate response, respectively. Experiment 3 compared rates of acquisition to a novel stimulus (e.g., light) following brief acquisition and various amounts of extinction to another stimulus (e.g., tone). In addition, in Experiment 3 recovery of responding to the extinguished stimulus during acquisition to the novel, cross-modal stimulus was examined. Experiments 1, 2, and 3 demonstrated that with a limited number of acquisition trials (1) there was a graded reduction in the rate of reacquisition as a function of the number of extinction trials in both conditioning preparations, (2) there was a graded reduction in the rate of cross-modal acquisition as a function of the number of extinction trials, but (3), in Experiment 3, recovery of responding to the extinguished stimulus during cross-modal training of the novel stimulus appeared uniformly robust even in the face of extended extinction.

Impact of brief or extended extinction of a taste aversion on inhibitory associations: evidence from summation, retardation, and preference tests

In five conditioned taste aversion experiments with rats, summation, retardation, and preference tests were used to assess the effects of extinguishing a conditioned saccharin aversion for three or nine trials. In Experiment 1, a summation test showed that saccharin aversion extinguished over nine trials reduced the aversion to a merely conditioned flavor (vinegar), whereas three saccharin extinction trials did not subsequently influence the vinegar aversion. Experiment 2 clarified that result, with unpaired controls equated on flavor exposure prior to testing; the results with those controls suggested that the flavor extinguished for nine trials produced generalization decrement during testing. In Experiment 3, the saccharin aversion reconditioned slowly after nine extinction trials, but not after three. Those results suggested the development of latent inhibition after more than three extinction trials. Preference tests comparing saccharin consumption with a concurrently available fluid (water in Experiment 4, saline in Experiment 5) showed that the preference for saccharin was greater after nine extinction trials than after three. However, saccharin preference after nine extinction trials was not greater, as compared with that for either latent inhibition controls (Experiments 4 and 5) or a control given equated exposures to saccharin and trained to drink saline at a high rate prior to testing (Experiment 5). Concerns about whether conditioned inhibition has been demonstrated in any flavor aversion procedure are discussed. Our findings help explain both successes and failures in demonstrating post-extinction conditioned response recovery effects reported in the conditioned taste aversion literature, and they can be explained using a memory interference account.

The role of glutamate and gamma-aminobutyric acid in fear extinction: clinical implications for exposure therapy

Although much is now known about the neural basis of fear acquisition, the mechanisms of fear inhibition or suppression remain largely obscure. Fear inhibition is studied in the laboratory through the use of an extinction procedure, in which an animal (typically a rat) is exposed to nonreinforced presentations of a conditioned stimulus (CS; e.g., a light or tone) that had previously been paired with a fear-inducing unconditioned stimulus (US; e.g., a mild footshock). Over the course of such training, the conditioned fear response exhibited by the rat in the presence of the CS is reduced in amplitude and frequency. This procedure is analogous to those employed in the treatment of fear dysregulation in humans, which typically involve exposure to the feared object in the absence of any overt danger. Recent work on the neural basis of extinction indicates that the neurotransmitters gamma-aminobutyric acid (GABA) and glutamate are critically involved. Gamma-aminobutyric acid may act to inhibit brain areas involved in fear learning (e.g., the amygdala), and glutamate, acting at N-methyl-D-aspartate receptors, may play a role in the neural plasticity that permits this GABA-mediated inhibition to be exerted appropriately. These insights have significant implications for the conduct of extinction-based clinical interventions for fear disorders.

Behavioral and neural analysis of extinction

The neural mechanisms by which fear is inhibited are poorly understood at the present time. Behaviorally, a conditioned fear response may be reduced in intensity through a number of means. Among the simplest of these is extinction, a form of learning characterized by a decrease in the amplitude and frequency of a conditioned response when the conditioned stimulus that elicits it is repeatedly nonreinforced. Because clinical interventions for patients suffering from fear dysregulation seek to inhibit abnormal, presumably learned fear responses, an understanding of fear extinction is likely to inform and increase the efficacy of these forms of treatment. This review considers the behavioral, cellular, and molecular literatures on extinction and presents the most recent advances in our understanding while identifying issues that require considerable further research.

Superlatent inhibition and spontaneous recovery: differential effects of pre- and postconditioning CS-alone presentations after long delays in different contexts

In two pairs of three-stage conditioned taste aversion experiments, we examined the effects of delay interval (1 or 21 days) between the second and third stages, and of context in which the animals spent the delay (same as or different from the context of the other stages) on latent inhibition (LI) and spontaneous recovery following extinction. In the LI experiments (Experiments 1A and 1B), the first stage comprised nonreinforced presentations to saccharin or to water. In the second stage, rats were conditioned by saccharin paired with LiCl. In the extinction experiments (Experiments 2A and 2B), the order of the stages was reversed. For all experiments, Stage 3, the test stage, consisted of three presentations of saccharin alone. There was a super-LI effect in the saccharin-preexposed group that spent the 21-day delay in the different context (Experiment 1A). When the delay was spent in the same context, there was no difference in the amount of LI between the short- and long-delay groups (Experiment 1B). Conversely, there was a spontaneous recovery effect in the long-delay/same-context group (Experiment 2B), but not in the long-delay/different-context group (Experiment 2A). The pattern of results, incompatible with current explanations of delay-induced changes in memory performance, was interpreted in terms of an interaction between the delay conditions (same or different delay context), which modulate the extinction of previously acquired context-CS-nothing associations (during CS-alone presentations), and primacy effects.