Occasional Reinforced Responses During Extinction Can Slow the Rate of Reacquisition of an Operant Response

Prediction error determines how memories are organized in the brain

How is new information organized in memory? According to latent state theories, this is determined by the level of surprise, or prediction error, generated by the new information: a small prediction error leads to the updating of existing memory, large prediction error leads to encoding of a new memory. We tested this idea using a protocol in which rats were first conditioned to fear a stimulus paired with shock. The stimulus was then gradually extinguished by progressively reducing the shock intensity until the stimulus was presented alone. Consistent with latent state theories, this gradual extinction protocol (small prediction errors) was better than standard extinction (large prediction errors) in producing long-term suppression of fear responses, and the benefit of gradual extinction was due to updating of the conditioning memory with information about extinction. Thus, prediction error determines how new information is organized in memory, and latent state theories adequately describe the ways in which this occurs.

Resurgence of ethanol seeking following voluntary abstinence produced by nondrug differential reinforcement of other behavior

Resurgence refers to the relapse of a target behavior following the worsening of a source of alternative reinforcement that was made available during response elimination. Most laboratory analyses of resurgence have used a combination of extinction and alternative reinforcement to reduce target behavior. In contingency-management treatments for alcohol use disorder, however, alcohol use is not placed on extinction. Instead, participants voluntarily abstain from alcohol use to access nondrug alternative reinforcers. Inasmuch, additional laboratory research on resurgence following voluntary abstinence is warranted. The present experiment evaluated resurgence of rats' ethanol seeking following voluntary abstinence produced by differential reinforcement of other behavior (DRO). Lever pressing produced ethanol reinforcers during baseline phases. During DRO phases, lever pressing continued to produce ethanol and food reinforcers were delivered according to resetting DRO schedules. Ethanol and food reinforcers were suspended during resurgence test phases to evaluate resurgence following voluntary abstinence. Lever pressing was elevated during baseline phases and occurred at near-zero rates during DRO phases. During the resurgence test phases, lever pressing increased, despite that it no longer produced ethanol. The procedure introduced here may help researchers better understand the variables that affect voluntary abstinence from ethanol seeking and resurgence following voluntary abstinence.

Infralimbic cortex plays a similar role in the punishment and extinction of instrumental behavior

Learning to stop responding is a fundamental process in instrumental learning. Animals may learn to stop responding under a variety of conditions that include punishment-where the response earns an aversive stimulus in addition to a reinforcer-and extinction-where a reinforced response now earns nothing at all. Recent research suggests that punishment and extinction may be related manifestations of a common retroactive interference process. In both paradigms, animals learn to stop performing a specific response in a specific context, suggesting direct inhibition of the response by the context. This process may depend on the infralimbic cortex (IL), which has been implicated in a variety of interference-based learning paradigms including extinction and habit learning. Despite the behavioral parallels between extinction and punishment, a corresponding role for IL in punishment has not been identified. Here we report that, in a simple arrangement where either punishment or extinction was conducted in a context that differed from the context in which the behavior was first acquired, IL inactivation reduced response suppression in the inhibitory context, but not responding when it "renewed" in the original context. In a more complex arrangement in which two responses were first trained in different contexts and then extinguished or punished in the opposite one, IL inactivation had no effect. The results advance our understanding of the effects of IL in retroactive interference and the behavioral mechanisms that can produce suppression of a response.

Memory persistence: from fundamental mechanisms to translational opportunities

Memory persistence is a double edge sword. Persistence of adaptive memories is essential for survival and even determines who we are. Neurodegenerative conditions with significant memory loss such as Alzheimer's disease, testify how defects of memory persistence have severe and irreversible effects on personality, among other symptoms. Yet, maintenance of overly strong maladaptive memories underlies highly debilitating psychiatric conditions including post-traumatic stress disorder, specific phobia, substance dependence and binge eating disorder. Here we review the neurobiological mechanisms supporting memory formation, persistence, inhibition and forgetting. We then shift the focus to how such mechanisms have been exploited to alter the persistence of laboratory-generated memories in human healthy volunteers as a proof of concept. Finally, we review the effect of behavioural and pharmacological interventions in anxiety and addiction disorder patients, highlighting key findings, gaps, and future directions for basic and translational research.

A comparison of renewal, spontaneous recovery, and reacquisition after punishment and extinction

Punishment and extinction are both effective methods of reducing instrumental responding and may involve similar learning mechanisms. To characterize the similarities and differences between them, we examined three well-established recovery or "relapse" effects -renewal, spontaneous recovery, and reacquisition - following either punishment or extinction of an instrumental response. In Experiment 1a, both punished and extinguished responses renewed to similar degrees following a context change at test (ABA renewal). In Experiment 1b, responding spontaneously recovered to similar degrees following punishment or extinction. In Experiment 2, responding was rapidly reacquired when the response was reinforced again following extinction but not following punishment, as predicted by the idea that the reinforcer delivered in reacquisition is part of the context of punishment, but not extinction. The results collectively suggest that both punishment and extinction produce similar context-dependent retroactive interference effects. More broadly, they also suggest that punished and extinguished responses may be equally likely to return following a change of context despite the intuition that punishment might provide a more extreme and effective means of suppressing behavior. To our knowledge, this is the first direct behavioral comparison of response recovery after punishment and extinction within individual experiments.

Trait anxiety is associated with hidden state inference during aversive reversal learning

Updating beliefs in changing environments can be driven by gradually adapting expectations or by relying on inferred hidden states (i.e. contexts), and changes therein. Previous work suggests that increased reliance on context could underly fear relapse phenomena that hinder clinical treatment of anxiety disorders. We test whether trait anxiety variations in a healthy population influence how much individuals rely on hidden-state inference. In a Pavlovian learning task, participants observed cues that predicted an upcoming electrical shock with repeatedly changing probability, and were asked to provide expectancy ratings on every trial. We show that trait anxiety is associated with steeper expectation switches after contingency reversals and reduced oddball learning. Furthermore, trait anxiety is related to better fit of a state inference, compared to a gradual learning, model when contingency changes are large. Our findings support previous work suggesting hidden-state inference as a mechanism behind anxiety-related to fear relapse phenomena.

Using what we know about threat reactivity models to understand mental health during the COVID-19 pandemic

The COVID-19 pandemic has been accompanied by unprecedented levels of stress and threats in a variety of domains (e.g., health, livelihood). Individual differences in threat reactivity may explain why some individuals are at elevated risk for the development or maintenance of psychopathology during the COVID-19 pandemic. This article describes several prominent models, mechanisms, and components of threat reactivity (e.g., appraisals, intolerance of uncertainty, avoidance) and discusses how they might help improve understanding of changes in psychopathology during and following the COVID-19 pandemic.

Limitations of occasional reinforced extinction to alleviate spontaneous recovery and reinstatement effects: Evidence for a trial-signalling mechanism

Fear extinction is not permanent but is instead more vulnerable than the original fear memory, as traditionally shown by the return of fear phenomena. Because of this, techniques to mitigate the return of fear are needed in the clinical treatment of related psychological conditions. One promising strategy is the occasional reinforced extinction treatment, introducing a gradual and sparse number of conditioned stimulus-unconditioned stimulus (CS-US) pairings within the extinction treatment. We present the results of three experiments in which we used a threat conditioning procedure in humans. Our main aim was to evaluate whether occasional reinforced extinction could reduce two different forms of relapse: spontaneous recovery (Experiments 1 and 2) and reinstatement (Experiment 3). Contrary to our predictions and previous literature, the results indicate that an occasional reinforcement treatment did not mitigate relapse compared with standard extinction. From a theoretical standpoint, these results are more consistent with the idea that extinction entails the acquisition of new knowledge than with the idea that there are conditions in which extinction leads to a weakening of the original fear memory. These findings also question the generality of the potential benefits of using occasional reinforced extinction in clinical settings.

Merging Our Understanding of Anxiety and Exposure: Using Inhibitory Learning to Target Anxiety Sensitivity in Exposure Therapy

Exposure-based therapies are the gold standard treatment for anxiety disorders, and recent advancements in basic and clinical research point to the need to update the implementation of exposure. Recent research has highlighted the importance of transdiagnostic factors such as anxiety sensitivity (AS), or fear of anxiety-related sensations. Elevated AS is common among all anxiety disorders and contains three dimensions, or expectancies, that can be used to guide treatment. Recently, treatments directly targeting AS have shown potential in reducing symptoms of anxiety. In addition, inhibitory learning theory (ILT) provides an alternative explanation of exposure processes based on basic learning research. ILT extends the current framework by accounting for renewal of fear, which is important given the substantial number of individuals who experience a return of symptoms following treatment. The current paper will provide an overview of ILT and discuss several ILT techniques that can be used to target AS. These two converging bodies of research hold strong potential for optimizing treatment for anxiety.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Behavioral and neural processes in counterconditioning: Past and future directions

Counterconditioning refers both to the technique and putative process by which behavior is modified through a new association with a stimulus of an opposite valence. Similar to extinction, counterconditioning is considered a form of inhibition that interferes with the expression of the originally learned response without erasing it. But whereas interest in extinction continues to rise, counterconditioning has received far less attention. Here, we provide an in-depth review of counterconditioning research and detail whether counterconditioning is any more effective than extinction at preventing relapse of the originally learned behavior. We consider the clinical implications of counterconditioning, describe recent neurobiological and neuroimaging research in this area, and consider future avenues in need of further investigation.

Re-exposure to reinforcement in context a during treatment in context b reduces ABC renewal

Previous work from our laboratory showed that intermittently re-exposing rats to reinforcement for lever pressing in a training (A) context, while eliminating lever pressing in a second (B) context, increased ABA renewal of lever pressing relative to rats that experienced only Context B during response elimination. In the current study, we replicated these procedures while assessing renewal in the presence of a novel context (i.e., ABC renewal). Unlike the findings described above, renewal was reduced in the group that experienced re-exposure to Context A during lever-press elimination relative to rats that experienced only Context B. These findings suggest that alternating between contexts associated with reinforcement and extinction during treatment reduces the probability that organisms will respond in novel contexts. These outcomes may be the result of discrimination and/or generalization processes. Moreover, this training procedure may offer a potential mitigation strategy for ABC renewal.

An alternative approach to relapse analysis: Using Monte Carlo methods and proportional rates of response

Relapse is the recovery of a previously suppressed response. Animal models have been useful in examining the mechanisms underlying relapse (e.g., reinstatement, renewal, reacquisition, resurgence). However, there are several challenges to analyzing relapse data using traditional approaches. For example, null hypothesis significance testing is commonly used to determine whether relapse has occurred. However, this method requires several a priori assumptions about the data, as well as a large sample size for between-subjects comparisons or repeated testing for within-subjects comparisons. Monte Carlo methods may represent an improved analytic technique, because these methods require no prior assumptions, permit smaller sample sizes, and can be tailored to account for all of the data from an experiment instead of some limited set. In the present study, we conducted reanalyses of three studies of relapse (Berry, Sweeney, & Odum, ; Galizio et al., ; Odum & Shahan, ) using Monte Carlo techniques to determine if relapse occurred and if there were differences in rate of response based on relevant independent variables (such as group membership or schedule of reinforcement). These reanalyses supported the previous findings. Finally, we provide general recommendations for using Monte Carlo methods in studies of relapse.

That Was Easy! Expectancy Violations During Exposure and Response Prevention for Childhood Obsessive-Compulsive Disorder

Violating expectancies during exposure therapy is proposed to promote inhibitory learning and improved treatment outcomes. Because people tend to overestimate how distressing emotionally challenging situations will be, violating expectations of distress may be an intuitive way to promote treatment outcome during exposure-based cognitive-behavioral therapy (CBT). This study evaluated overpredictions of distress during exposure tasks in 33 youth with obsessive-compulsive disorder (OCD; ages 8-17) participating in CBT. Youth with more variable prediction accuracy and a higher proportion of overpredictions experienced more rapid symptom reduction, b = -0.29, p = .002. Underpredictions were less common toward the end of therapy as youth experienced less severe OCD, b = 0.12, p= .001. Findings suggest that although youth often accurately predict the intensity of exposure, overpredictions are common as well. The frequency of these overpredictions promoted treatment outcome, supporting expectancy violations as one indicator of inhibitory learning during exposure therapy.

Building physiological toughness: Some aversive events during extinction may attenuate return of fear

BACKGROUND AND OBJECTIVES

Although exposure therapy is an effective treatment for anxiety disorders, fear sometimes returns following successful therapy. Recent literature in animal models indicates that incorporating some aversive events into extinction training may offset these return of fear effects.

METHODS

The effect of occasional reinforced extinction trials was investigated in a sample of thirty-nine participants using a fear conditioning and extinction paradigm. Participants either underwent traditional extinction procedures during which the conditional stimulus which had been paired with the unconditional stimulus (US) during acquisition training (CS+) was presented alone with no presentations of the US or partially reinforced extinction during which there were several unpredicted CS+/US pairings.

RESULTS

As measured by skin conductance responses, physiological fear responding remained elevated during extinction for participants who experienced partially reinforced extinction; however, these participants demonstrated protection from rapid reacquisition effects. Results from the subjective US-expectancy ratings did not provide evidence of protection against rapid reacquisition in the partially reinforced extinction group; however, there was evidence of protection from spontaneous recovery effects. Lastly, as measured by valence ratings, it was unclear whether partially reinforced extinction provided protection from fear recovery effects.

LIMITATIONS

Although participants who experienced partially reinforced extinction demonstrated protection from rapid reacquisition as measured by skin conductance responses, they also demonstrated significantly higher levels of physiological fear responding during extinction which made the results of the spontaneous recovery test more difficult to interpret.

CONCLUSIONS

Occasional CS-US pairings during extinction may protect against return of fear effects. Clinical implications are discussed.

Tackling maladaptive memories through reconsolidation: From neural to clinical science

Behavioral neuroscience has greatly informed how we understand the formation, persistence, and plasticity of memory. Research has demonstrated that memory reactivation can induce a labile period, during which previously consolidated memories are sensitive to change, and in need of restabilization. This process is known as reconsolidation. Such findings have advanced not only our basic understanding of memory processes, but also hint at the prospect of harnessing these insights for the development of a new generation of treatments for disorders of emotional memory. However, even in simple experimental models, the conditions for inducing memory reconsolidation are complex: memory labilization appears to result from the interplay of learning history, reactivation, and also individual differences, posing difficulties for the translation of basic experimental research into effective clinical interventions. In this paper, we review a selection of influential animal and human research on memory reconsolidation to illustrate key insights these studies afford. We then consider how these findings can inform the development of new treatment approaches, with a particular focus on the transition of memory from reactivation, to reconsolidation, to new memory formation, as well as highlighting possible limitations of experimental models. If the challenges of translational research can be overcome, and if reconsolidation-based procedures become a viable treatment option, then they would be one of the first mental health treatments to be directly derived from basic neuroscience research. This would surely be a triumph for the scientific study of mind and brain.

The role of feedback contingency in perceptual category learning

Feedback is highly contingent on behavior if it eventually becomes easy to predict, and weakly contingent on behavior if it remains difficult or impossible to predict even after learning is complete. Many studies have demonstrated that humans and nonhuman animals are highly sensitive to feedback contingency, but no known studies have examined how feedback contingency affects category learning, and current theories assign little or no importance to this variable. Two experiments examined the effects of contingency degradation on rule-based and information-integration category learning. In rule-based tasks, optimal accuracy is possible with a simple explicit rule, whereas optimal accuracy in information-integration tasks requires integrating information from 2 or more incommensurable perceptual dimensions. In both experiments, participants each learned rule-based or information-integration categories under either high or low levels of feedback contingency. The exact same stimuli were used in all 4 conditions, and optimal accuracy was identical in every condition. Learning was good in both high-contingency conditions, but most participants showed little or no evidence of learning in either low-contingency condition. Possible causes of these effects, as well as their theoretical implications, are discussed. (PsycINFO Database Record

Expanding the role of striatal cholinergic interneurons and the midbrain dopamine system in appetitive instrumental conditioning

The basal ganglia are a collection of subcortical nuclei thought to underlie a wide variety of vertebrate behavior. Although a great deal is known about the functional and physiological properties of the basal ganglia, relatively few models have been formally developed that have been tested against both behavioral and physiological data. Our previous work (Ashby FG, Crossley MJ. J Cogn Neurosci 23: 1549-1566, 2011) showed that a model grounded in the neurobiology of the basal ganglia could account for basic single-neuron recording data, as well as behavioral phenomena such as fast reacquisition that constrain models of conditioning. In this article we show that this same model accounts for a variety of appetitive instrumental conditioning phenomena, including the partial reinforcement extinction (PRE) effect, rapid and slowed reacquisition following extinction, and renewal of previously extinguished instrumental responses by environmental context cues.

Implications of learning theory for developing programs to decrease overeating

Childhood obesity is associated with medical and psychological comorbidities, and interventions targeting overeating could be pragmatic and have a significant impact on weight. Calorically dense foods are easily available, variable, and tasty which allows for effective opportunities to learn to associate behaviors and cues in the environment with food through fundamental conditioning processes, resulting in measurable psychological and physiological food cue reactivity in vulnerable children. Basic research suggests that initial learning is difficult to erase, and that it is vulnerable to a number of phenomena that will allow the original learning to re-emerge after it is suppressed or replaced. These processes may help explain why it may be difficult to change food cue reactivity and overeating over the long term. Extinction theory may be used to develop effective cue-exposure treatments to decrease food cue reactivity through inhibitory learning, although these processes are complex and require an integral understanding of the theory and individual differences. Additionally, learning theory can be used to develop other interventions that may prove to be useful. Through an integration of learning theory, basic and translational research, it may be possible to develop interventions that can decrease the urges to overeat, and improve the weight status of children.

Effects of occasional reinforced trials during extinction on the reacquisition of conditioned responses to food cues

BACKGROUND AND OBJECTIVES

Successful long-term dieting appears to be difficult, and part of its difficulty might be explained by processes related to classical appetitive conditioning. Increasing the speed of extinction of appetitive responses to food cues and decreasing the magnitude of returns of these responses could help increase the long-term effectiveness of weight loss attempts. Two extinction techniques hypothesized to slow down rapid reacquisition of conditioned appetitive responses were investigated: the provision of 1) occasional reinforced extinction trials (OR) and 2) unpaired unconditioned stimuli (USs) during extinction (UNP).

METHODS

After acquisition, participants (N = 90) received one of three extinction trainings: OR, UNP, or normal extinction (control), followed by a reacquisition phase. Their desire to eat, US expectancy, and salivation were measured. Effects of impulsivity on different phases of appetitive conditioning were also assessed.

RESULTS

It was found that both extinction techniques were successful in reducing the rate of reacquisition of US expectancies. Participants in the OR condition also demonstrated a slower extinction of US expectancies and desires to eat. However, the reacquisition of conditioned desires was not affected by either extinction technique. Impulsivity did not moderate responses during acquisition or extinction, but appeared to slow down the reacquisition of conditioned desires.

LIMITATIONS

US expectancies and eating desires were not completely extinguished, and a few differences in baseline responses caused difficulty in interpreting some of the findings.

CONCLUSIONS

It is concluded that the provision of occasional reinforced extinction trials and unpaired USs seem promising techniques to slow down reacquisition, but that additional studies are needed.

Why behavior change is difficult to sustain

Unhealthy behavior is responsible for much human disease, and a common goal of contemporary preventive medicine is therefore to encourage behavior change. However, while behavior change often seems easy in the short run, it can be difficult to sustain. This article provides a selective review of research from the basic learning and behavior laboratory that provides some insight into why. The research suggests that methods used to create behavior change (including extinction, counterconditioning, punishment, reinforcement of alternative behavior, and abstinence reinforcement) tend to inhibit, rather than erase, the original behavior. Importantly, the inhibition, and thus behavior change more generally, is often specific to the "context" in which it is learned. In support of this view, the article discusses a number of lapse and relapse phenomena that occur after behavior has been changed (renewal, spontaneous recovery, reinstatement, rapid reacquisition, and resurgence). The findings suggest that changing a behavior can be an inherently unstable and unsteady process; frequent lapses should be expected. In the long run, behavior-change therapies might benefit from paying attention to the context in which behavior change occurs.

Gradual extinction prevents the return of fear: implications for the discovery of state

Fear memories are notoriously difficult to erase, often recovering over time. The longstanding explanation for this finding is that, in extinction training, a new memory is formed that competes with the old one for expression but does not otherwise modify it. This explanation is at odds with traditional models of learning such as Rescorla-Wagner and reinforcement learning. A possible reconciliation that was recently suggested is that extinction training leads to the inference of a new state that is different from the state that was in effect in the original training. This solution, however, raises a new question: under what conditions are new states, or new memories formed? Theoretical accounts implicate persistent large prediction errors in this process. As a test of this idea, we reasoned that careful design of the reinforcement schedule during extinction training could reduce these prediction errors enough to prevent the formation of a new memory, while still decreasing reinforcement sufficiently to drive modification of the old fear memory. In two Pavlovian fear-conditioning experiments, we show that gradually reducing the frequency of aversive stimuli, rather than eliminating them abruptly, prevents the recovery of fear. This finding has important implications for theories of state discovery in reinforcement learning.

Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning

This article reviews research on the behavioral and neural mechanisms of extinction as it is represented in both Pavlovian and instrumental learning. In Pavlovian extinction, repeated presentation of a signal without its reinforcer weakens behavior evoked by the signal; in instrumental extinction, repeated occurrence of a voluntary action without its reinforcer weakens the strength of the action. In either case, contemporary research at both the behavioral and neural levels of analysis has been guided by a set of extinction principles that were first generated by research conducted at the behavioral level. The review discusses these principles and illustrates how they have informed the study of both Pavlovian and instrumental extinction. It shows that behavioral and neurobiological research efforts have been tightly linked and that their results are readily integrated. Pavlovian and instrumental extinction are also controlled by compatible behavioral and neural processes. Since many behavioral effects observed in extinction can be multiply determined, we suggest that the current close connection between behavioral-level and neural-level analyses will need to continue.

Erasing the engram: the unlearning of procedural skills

Huge amounts of money are spent every year on unlearning programs--in drug-treatment facilities, prisons, psychotherapy clinics, and schools. Yet almost all of these programs fail, since recidivism rates are high in each of these fields. Progress on this problem requires a better understanding of the mechanisms that make unlearning so difficult. Much cognitive neuroscience evidence suggests that an important component of these mechanisms also dictates success on categorization tasks that recruit procedural learning and depend on synaptic plasticity within the striatum. A biologically detailed computational model of this striatal-dependent learning is described (based on Ashby & Crossley, 2011). The model assumes that a key component of striatal-dependent learning is provided by interneurons in the striatum called the tonically active neurons (TANs), which act as a gate for the learning and expression of striatal-dependent behaviors. In their tonically active state, the TANs prevent the expression of any striatal-dependent behavior. However, they learn to pause in rewarding environments and thereby permit the learning and expression of striatal-dependent behaviors. The model predicts that when rewards are no longer contingent on behavior, the TANs cease to pause, which protects striatal learning from decay and prevents unlearning. In addition, the model predicts that when rewards are partially contingent on behavior, the TANs remain partially paused, leaving the striatum available for unlearning. The results from 3 human behavioral studies support the model predictions and suggest a novel unlearning protocol that shows promising initial signs of success.

Relapse processes after the extinction of instrumental learning: renewal, resurgence, and reacquisition

It is widely recognized that extinction (the procedure in which a Pavlovian conditioned stimulus or an instrumental action is repeatedly presented without its reinforcer) weakens behavior without erasing the original learning. Most of the experiments that support this claim have focused on several "relapse" effects that occur after Pavlovian extinction, which collectively suggest that the original learning is saved through extinction. However, although such effects do occur after instrumental extinction, they have not been explored there in as much detail. This article reviews recent research in our laboratory that has investigated three relapse effects that occur after the extinction of instrumental (operant) learning. In renewal, responding returns after extinction when the behavior is tested in a different context; in resurgence, responding recovers when a second response that has been reinforced during extinction of the first is itself put on extinction; and in rapid reacquisition, extinguished responding returns rapidly when the response is reinforced again. The results provide new insights into extinction and relapse, and are consistent with principles that have been developed to explain extinction and relapse as they occur after Pavlovian conditioning. Extinction of instrumental learning, like Pavlovian learning, involves new learning that is relatively dependent on the context for expression.

Extinction phenomena: a biologic perspective on how and why psychoanalysis works

This article presents the view that much of the success of classical psychoanalysis is centrally predicated on its biological potency; focusing not on neuropsychology, but on the biology of conditioning. The argument suggests that features of classic psychoanalytic technique - the couch, meetings several times per week with both parties present, and free association - uniquely facilitate intense transferences of various sorts, and that these in turn constitute the multiple and diverse extinction trials necessary to best approximate extinction.

Mechanisms of resurgence II: Response-contingent reinforcers can reinstate a second extinguished behavior

Three experiments with rat subjects examined resurgence of an extinguished instrumental response using the procedure introduced by Epstein (1983) with pigeons. There were three phases: (1) initial acquisition of pressing on a lever (L1) for pellet reward, (2) extinction of L1, and (3) a test session in which a second lever (L2) was inserted, briefly reinforced, and then extinguished. Experiment 1 confirmed that if pressing L2 delivered 20 pellets followed by extinction, rats would resume L1 responding in the final test. Experiment 2 compared the effects of response-contingent and non-contingent rewards delivered upon insertion of L2. Although insertion of L2 alone did not increase L1 responding, response-contingent and non-contingent rewards led to comparable increases in L1 responding. Experiment 3 found that the delivery of non-contingent pellets during extinction of L1, which would be expected to reduce the ability of pellets to set the occasion for the L1 response, also reduced the effects of both response-contingent and non-contingent rewards during the final test. The results indicate that in this method, the resurgence treatment leads to an increase in L1 pressing due to simple presentation of the pellet; delivering the reinforcer after extinction of L1 reinstates L1 responding by setting the occasion for the L1 response.

A decrease in gamma-synuclein expression within the nucleus accumbens increases cocaine intravenous self-administration in the rat

Except as a marker of cancer progression, gamma-synuclein (GSyn) had received little attention. Recent data showed however that GSyn modulates cocaine-induced locomotor effects, suggesting that it could also play a role in cocaine reinforcing effects. In the rat, siRNAs targeting GSyn expression were injected in the nucleus accumbens and cocaine reinforcing effects were evaluated by means of intravenous self-administration. A dose-response curve was followed by procedures of progressive ratio, extinction, cocaine- and cue-induced reinstatements. Decrease of GSyn expression increased self-administration over a large range of doses. This effect was associated with an increase in cocaine-induced reinstatement. The present data reveal that GSyn exert a specific negative control on cocaine-induced reinforcing and incentive effects.

Learning and the persistence of appetite: extinction and the motivation to eat and overeat

The modern world is saturated with highly palatable and highly available food, providing many opportunities to associate food with environmental cues and actions (through Pavlovian and operant or instrumental learning, respectively). Basic learning processes can often increase the tendency to approach and consume food, whereas extinction, in which Pavlovian and operant behaviors decline when the reinforcer is withheld, weakens but does not erase those tendencies. Contemporary research suggests that extinction involves an inhibitory form of new learning that appears fragile because it is highly dependent on the context for expression. These ideas are supported by the phenomena of renewal, spontaneous recovery, resurgence, reinstatement, and rapid reacquisition in appetitive learning, which together may help explain why overeating may be difficult to suppress permanently, and why appetitive behavior may seem so persistent.