Paradoxical enhancement of conditioned suppression

Basic and applied research on extinction bursts

Discontinuation of the contingency between a response and its reinforcer sometimes produces a temporary increase in the response before its rate decreases, a phenomenon called the extinction burst. Prior clinical and basic studies on the prevalence of the extinction burst provide highly disparate estimates. Existing theories on the extinction burst fail to account for the dynamic nature of this phenomenon, and the basic behavioral processes that control response bursting remain poorly understood. In this paper, we first review the basic and applied literature on the extinction burst. We then describe a recent refinement of the concatenated matching law called the temporally weighted matching law that appears to resolve the above-mentioned issues regarding the extinction burst. We present illustrative translational data based conceptually on the model. Finally, we discuss specific recommendations derived from the temporally weighted matching law regarding procedures clinicians could implement to potentially mitigate or prevent extinction bursts.

Effects of UCS Intensity and Duration of Exposure of Nonreinforced CS on Conditioned Electrodermal Responses: An Experimental Analysis of the Incubation Theory of Anxiety

Eysenck's incubation theory of fear or anxiety was examined in a human Pavlovian conditioning experiment with skin-conductance responses as the dependent variable. The conditioned stimuli (CSs) were fear-relevant slides (snakes and spiders) and the unconditioned stimuli (UCSs) were aversive tones. Different groups of subjects were presented two tone intensities during the acquisition phase and three durations of nonreinforced CS (extinction phase) in a delay differential conditioning paradigm. Resistance to extinction of conditioned skin-conductance responses (conditioned fear responses) exhibited was largest for high intensity of tone and short presentations of the nonreinforced CS (CS + presented alone). The result tends to support Eysenck's incubation theory of anxiety.

The computational nature of memory modification

Retrieving a memory can modify its influence on subsequent behavior. We develop a computational theory of memory modification, according to which modification of a memory trace occurs through classical associative learning, but which memory trace is eligible for modification depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience into statistically distinct clusters (latent causes). New memories are formed when the structure learning mechanism infers that a new latent cause underlies current sensory observations. By the same token, old memories are modified when old and new sensory observations are inferred to have been generated by the same latent cause. We derive this framework from probabilistic principles, and present a computational implementation. Simulations demonstrate that our model can reproduce the major experimental findings from studies of memory modification in the Pavlovian conditioning literature.

Determinants to trigger memory reconsolidation: The role of retrieval and updating information

Long-term memories can undergo destabilization/restabilization processes, collectively called reconsolidation. However, the parameters that trigger memory reconsolidation are poorly understood and are a matter of intense investigation. Particularly, memory retrieval is widely held as requisite to initiate reconsolidation. This assumption makes sense since only relevant cues will induce reconsolidation of a specific memory. However, recent studies show that pharmacological inhibition of retrieval does not avoid memory from undergoing reconsolidation, indicating that memory reconsolidation occurs through a process that can be dissociated from retrieval. We propose that retrieval is not a unitary process but has two dissociable components; one leading to the expression of memory and the other to reconsolidation, referred herein as executer and integrator respectively. The executer would lead to the behavioral expression of the memory. This component would be the one disrupted on the studies that show reconsolidation independence from retrieval. The integrator would deal with reconsolidation. This component of retrieval would lead to long-term memory destabilization when specific conditions are met. We think that an important number of reports are consistent with the hypothesis that reconsolidation is only initiated when updating information is acquired. We suggest that the integrator would initiate reconsolidation to integrate updating information into long-term memory.

Repeated Activation of a CS-US-Contingency Memory Results in Sustained Conditioned Responding

Individuals seem to differ in conditionability, i.e., the ease by which the contingent presentation of two stimuli will lead to a conditioned response. In contemporary learning theory, individual differences in the etiology and maintenance of anxiety disorders are, among others, explained by individual differences in temperamental variables (Mineka and Zinbarg, 2006). One such individual difference variable is how people process a learning experience when the conditioning stimuli are no longer present. Repeatedly thinking about the conditioning experience, as in worry or rumination, might prolong the initial (fear) reactions and as such, might leave certain individuals more vulnerable to developing an anxiety disorder. However, in human conditioning research, relatively little attention has been devoted to the processing of a memory trace after its initial acquisition, despite its potential influences on subsequent performance. Post-acquisition processing can be induced by mental reiteration of a conditioned stimulus-unconditioned stimulus (CS-US)-contingency. Using a human conditioned suppression paradigm, we investigated the effect of repeated activations of a CS-US-contingency memory on the level of conditioned responding at a later test. Results of three experiments showed more sustained responding to a "rehearsed" CS+ as compared to a "non-rehearsed" CS+. Moreover, the second experiment showed no effect of rehearsal when only the CS was rehearsed instead of the CS-US-contingency. The third experiment demonstrated that mental CS-US-rehearsal has the same effect regardless of whether it was cued by the CS and a verbal reference to the US or by a neutral signal, making the rehearsal "purely mental." In sum, it was demonstrated that post-acquisition activation of a CS-US-contingency memory can impact conditioned responding, underlining the importance of post-acquisition processes in conditioning. This might indicate that individuals who are more prone to mentally rehearse information condition more easily.

Memory reactivation effects independent of reconsolidation

Memory reactivation is an important process resulting from reexposure to salient training-related information whereby a memory is brought from an inactive to an active state. Reactivation is the first stage of memory retrieval but can result from the exposure to salient cues without any behavioral output. Such cue-induced reactivation, although frequently used by neuroscientists to study reconsolidation, has seldom been considered as a process in its own right and studied as such. This review presents arguments indicating that memory reactivation has two main consequences: (1) to enhance the accessibility of the target memory and (2) to make the memory malleable. Accordingly, reactivation creates a transient state during which the content of the memory is easily accessible and can be modified and/or updated. As both of these aspects can be observed shortly after memory reactivation, this review emphasizes that reconsolidation is not necessarily required for these processes and calls attention to reactivation as a factor in the dynamics of the memory.

Facets of Pavlovian and operant extinction

Research on extinction is of fundamental importance in both Pavlovian and operant approaches to the experimental analysis of learning. Although these approaches are often motivated by different empirical and theoretical questions, extinction has emerged as a research area in which common themes unite the two approaches. In this review, we focus on some common considerations in the analysis of Pavlovian and operant extinction. These include methodological challenges and interpretational issues in analyzing behavior during and after extinction. We consider the different roles that theory has played in the development of research on extinction in these preparations and conclude with some attention to applications of extinction.

The conditioning model of neurosis

The long-term persistence of neurotic symptoms, such as anxiety, poses difficult problems for any psychological theory. An attempt is made to revive the Watson-Mowrer conditioning theory and to avoid the many criticisms directed against it in the past. It is suggested that recent research has produced changes in learning theory that can be used to render this possible. In the first place, the doctrine of equipotentiality has been shown to be wrong, and some such concept as Seligman's “preparedness” is required, that is the notion that certain CS are biologically prepared to be more readily connected with anxiety responses than others. In the second place, the law of extinction has to be amended, and the law of incubation or enhancement added, according to which the exposure of the CS-only may, under certain specified conditions, have the effect of increasing the strength of the CR, rather than reducing it. The major conditions favouring incubation are (1) Pavlovian B conditioning, that is a type of conditioning in which the CR is a drive; (2) a strong UCS, and (3) short exposure of the CS-only.

Primacy effects induced by temporal or physical context shifts are attenuated by a preshift test trial

When subjects are sequentially trained with a cue (A) paired separately with two outcomes (B and C) in different phases (i.e., A-B pairings followed by A-C pairings) testing in the training context after short retention intervals often reveals recency effects (i.e., stronger influence by A-C). In contrast, testing after long retention intervals or testing in a context different from that of training sometimes reveals primacy effects (A-B). Three experiments were conducted using rats in a Pavlovian conditioned bar-press suppression preparation to ascertain whether a nonreinforced test trial in the training context soon after training can attenuate this shift to primacy. Experiment 1 demonstrated that exposure to A shortly after both phases of training, but prior to a long retention interval, can attenuate shifts from recency to primacy otherwise observed with a long retention interval. Experiment 2 showed that exposure to A in the training context can also eliminate the shift from recency to primacy otherwise produced by shifting the physical context between training and test. Experiment 3 discredited a potential account of the results of Experiments 1 and 2. The effects observed in Experiment 1 and 2 are interpreted as early testing in the training context serving to initiate rehearsal of the A-C association due to the temporal proximity of A-C training.

Reconsolidation: A brief history, a retrieval view, and some recent issues

This review briefly traces some of the history of the phenomenon of what has come to be called "reconsolidation." The early findings of retrograde amnesia for an old but reactivated memory led to several interesting but largely behaviorally oriented studies. With only a few sporadic exceptions, research in the area languished until about 2000, when several articles caught the attention of the neuroscience community and led to a number of studies examining the phenomenon at several different levels of analysis. We consider several of the current issues generated by those studies, present a retrieval based model that may account for some findings, and indicate some possible new directions on this topic.

Cognitive trauma therapy for battered women with PTSD (CTT-BW)

This article describes a second treatment-outcome study of cognitive trauma therapy for battered women with posttraumatic stress disorder (PTSD; CTT-BW). CTT-BW includes trauma history exploration: PTSD education; stress management; exposure to abuse and abuser reminders; self-monitoring of negative self-talk; cognitive therapy for guilt; and modules on self-advocacy, assertiveness, and how to identify perpetrators. One hundred twenty-five ethnically diverse women were randomly assigned to immediate or delayed CTT-BW. PTSD remitted in 87% of women who completed CTT-BW, with large reductions in depression and guilt and substantial increases in self-esteem. White and ethnic minority women benefited equally from CTT-BW. Similar treatment outcomes were obtained by male and female therapists and by therapists with different levels of education and training. Gains were maintained at 3- and 6-month follow-ups.

Resistance to extinction of conditioned electrodermal responses: a study of the incubation fear hypothesis

In the present study we examined Eysenck's incubation hypothesis of fear. Probability of skin conductance response (SCR) was analyzed for a sample of 79 undergraduate women, ranging in age from 18 to 25 years. Different groups of participants were conditioned to two levels of unconditioned stimuli (UCS) intensity and presented to three levels of unreinforced conditioned stimuli (CS) exposures (extinction phase) in a delay differential conditioning paradigm. The CSs were fear-relevant slides (snakes and spiders) and the UCSs were aversive tones. Analysis did not show a clear incubation effect; instead an increased resistance to extinction of SCR probability in association to the high-UCS and the short unreinforced CS presentation was evident. Findings support partially Eysenck's incubation theory of fear/anxiety.

Effects of UCS intensity and duration of exposure of nonreinforced CS on conditioned electrodermal responses: an experimental analysis of the incubation theory of anxiety

Eysenck's incubation theory of fear or anxiety was examined in a human Pavlovian conditioning experiment with skin-conductance responses as the dependent variable. The conditioned stimuli (CSs) were fear-relevant slides (snakes and spiders) and the unconditioned stimuli (UCSs) were aversive tones. Different groups of subjects were presented two tone intensities during the acquisition phase and three durations of nonreinforced CS (extinction phase) in a delay differential conditioning paradigm. Resistance to extinction of conditioned skin-conductance responses (conditioned fear responses) exhibited was largest for high intensity of tone and short presentations of the nonreinforced CS (CS+presented alone). The result tends to support Eysenck's incubation theory of anxiety.

A preliminary resolution of the retention of distributed vs massed response prevention in rats

This study consisted of two experiments conducted to investigate the difference in efficacy and retention of distributed response prevention when compared to massed response prevention using an animal model of avoidance learning. The purpose was to obtain an estimate of the over-all treatment time for response prevention that begins to be affected by the treatment, either distributed or massed. In Exp. 1, 50 rats were given two trials of escape learning in a one-way black-white shuttle-box. Groups received response-prevention treatment or nontreatment in 9 1-min. distributed sessions or 1 9-min. massed session. Subjects were tested using a passive-avoidance paradigm immediately following treatment, 24 hours, and 720 hours (30 days) later. Analysis showed that with an over-all response-prevention time of 9 min., response-prevention treatment was effective in reducing avoidance behavior, that the effect was retained, and that there were no differences between distributed and massed groups. These results led to Exp. II in which 50 rats were exposed to the same training procedure as in Exp. I. These groups received response-prevention treatment or nontreatment in 12 15-sec. distributed sessions or one 3-min. massed session. Analysis of passive-avoidance testing immediately following treatment, 24 hr., and 720 hr. later showed that, when the over-all response-prevention time was 3 min., only groups with distributed treatment showed reduction of avoidance behavior and retention of the treatment effects. Since past studies have produced inconsistent findings in comparing distributed vs massed delivery of response-prevention treatment these two experiments are intended to serve as a preliminary resolution of the past differing results. When the over-all treatment time is longer than 3 min., there is no delivery of treatment effect. However, with 3 min. of over-all treatment time, distributed delivery was necessary to facilitate the treatment effects. Implications for animals and humans are discussed.

Retention of massed vs distributed response-prevention treatments in rats and a revised training procedure

Two experiments were conducted to estimate the retention of response-prevention effects using massed vs distributed treatments in a model of animal avoidance-learning. In Exp. I, 120 rats were trained to avoid shock in a one-way platform avoidance apparatus. Groups received response-prevention treatment or nontreatment in a 36-min. massed session or in several sessions distributed over a four-day period. In Exp. II, 160 rats were given two trials of escape training in a one-way shuttle box. Groups received response-prevention treatment or nontreatment in a 24-min. session of massed or distributed treatments delivered in one day. Subjects in both studies were tested using a passive-avoidance paradigm immediately following treatment, 24 hours later, and 30 days later. Analysis showed that response-prevention treatments were effective in reducing avoidance behavior and there were no significant differences in retention of avoidance associated with massed vs distributed response-prevention treatments. Implications for animals and humans are discussed, and researchers are encouraged to change from a criterion training procedure to an escape procedure since the latter is a closer analogue to the human condition.

Learning and unlearning fear: a clinical and evolutionary perspective

Many fears, phobias and rituals seem to arise from prepared phylogenetic mechanisms which favor old over new evolutionary dangers and affect the rules of aversive learning which govern the acquisition of fear. Recent developments in several forms of aversive learning (sensitization, conditioning, extinction, observational learning) can improve them as paradigms of the acquisition, spread and maintenance of normal and clinical fears. The most reliable treatment for phobias and rituals is exposure, whose effects closely parallel the habituation of normal defensive responses and the extinction of conditioned fear and avoidance in animals. Habituation during exposure is usually slow and step by step, and generalizes little, but once attained tends to endure. Conditioned fear extinction and fear habituation have similar courses and may depend on similar neural processes. To be reduced, avoidance has to be prevented or the safety intervals that it heralds must be given up. Some phobias may result less from enhanced acquisition than from insufficient exposure to attain habituation. Finally, the review discusses the limits of habituation and the instability of fear extinction in relation to the long-term efficacy of exposure therapy.

Eysenck's incubation of fear hypothesis: an experimental test

The present experiment was designed to test Eysenck's hypothesis that repeated exposure to an unreinforced CS of brief duration following acquisition of a classical aversive CR may lead to a progressive increase in the strength of that CR, provided that the UCS is intense and the CR has drive-like properties. Using a between-groups design, normal human subjects were given identical classical acquisition trials, followed by extinction trials where CS duration was either 2, 8 or 16 sec. The UCS was of fixed high intensity. Dependent measures were tonic and phasic heart rate and skin conductance. No evidence of incubation was found as a function of CS duration. Nor was there any indication that CS duration differentially affected resistance to extinction. A small number of subjects showed evidence of incubation with heart rate measures during extinction. However, there was no indication that this enhancement was governed by the parameters suggested by Eysenck. UCR amplitude, which showed a positive correspondence with CS-bound activity throughout the trials, did not reliably predict incubation. Problems concerning both the definition and the demonstration of incubation are discussed.

The incubation theory of fear/anxiety: experimental investigation in a human laboratory model of Pavlovian conditioning

The aim of this work was to test Eysenck's incubation theory of fear/anxiety in human Pavlovian B conditioning of heart rate (HR) responses. The conditioned stimuli (CSs) were phobia-relevant slides (snakes and spiders) and the unconditioned stimuli (UCSs) were aversive noises. The subjects were presented with two levels of noise intensity during acquisition and three levels of nonreinforced CS presentation (CS-only) in a delay differential (CS+/CS-) conditioning paradigm (2 x 3 x 2). Consistent with the incubation theory, conditioned HR acceleratory responses were sustained (resistance to extinction) for high-noise intensity and short-presentations of CS-only subjects. During the extinction phase, HR acceleratory responses quickly extinguished in low-noise intensity groups after the first presentations of CS-only. These findings were interpreted as support for the incubation theory of phobic fear.