Resurgence of temporal patterns of responding

A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40614-022-00361-y.

Response effort and resurgence

This study provides an initial translational examination of response effort and resurgence. Eleven typically developing adults and five adolescents with autism served as participants across two experiments. Participants received points for touching moving stimuli on a computer screen. The resurgence evaluation consisted of three phases: establishment wherein R1 was reinforced, elimination wherein R1 was placed on extinction while R2 was reinforced, and extinction wherein R1 and R2 no longer resulted in reinforcement. Rate of R1 during extinction was compared across three conditions: intermediate, easy, and difficult. Disparity in effort was created by manipulations of the size and speed of objects that moved about on a computer screen. In Experiment 2, control stimuli were added to the experimental arrangement. Across the two experiments, the magnitude of resurgence was greater when R1 was easy. In Experiment 2, both R1 and control responding were greater in the extinction phase than in the elimination phase in all conditions with all participants. The present study supports the hypothesis that response effort affects resurgence and that less effortful responses are likely to recur with greater magnitude under conditions that produce resurgence than are their more effortful counterparts.

Resurgence during transitions from variable- to fixed-interval schedules

The effects of local periods of extinction on resurgence following transitions from variable-interval (VI) to fixed-interval (FI) schedules were studied using four pigeons exposed to a within-session resurgence procedure. Each session was divided into a Training (T) Alternative-Reinforcement (AR), and Resurgence Test (RT) phase. During the T phase, key pecking was reinforced under a VI 60-s schedule on one key. In the AR phase, responses reinforced in the T phase were extinguished, while responses to a different key were reinforced under a VI 90-s schedule. Next, responding to the same key that produced reinforcers in the AR phase was reinforced according to four different RT conditions: RT phase I (FI 90 s), RT phase II (FI 180 s), RT phase III (FI 45 s), or RT phase IV (extinction). The frequency of resurgence generally was an inverse function of the rate of reinforcement in the RT phase. Resurgence occurred less often when reinforcers were delivered under the FI 45-s schedule and more often under leaner schedules in the RT phase, peaking under extinction. The results show that resurgence may occur during local periods of extinction, with larger and more consistent effects occurring when the rate of reinforcement in the RT condition is leaner than it was during the preceding AR phase.

Changes in the elimination and resurgence of alcohol-maintained behavior in rats and the effects of naltrexone

Resurgence may be a mechanism of relapse in alcohol use disorder patients upon discharge from treatment as part of an abuse-treatment-relapse cycle. Adjunctive pharmacotherapies may be a means to facilitate behavioral treatments and block resurgence. Experiments were conducted using a model of alcohol self-administration to assess the repeatability of the elimination and resurgence of alcohol-maintained behavior and the effects of naltrexone. Experiments had three phases. In Phase 1, behavior was maintained by oral alcohol under a fixed-ratio schedule. In Phase 2, behavior was extinguished via condensed milk delivery under a differential-reinforcement-of-other-behavior (DRO) schedule. In Phase 3, the DRO schedule was eliminated. In Experiment 1, this 3-phase cycle was replicated 4 times. Across replications, response rates and dose of alcohol consumed did not differ in Phase 1, alcohol-maintained behavior was eliminated more rapidly in Phase 2, and the resurgence effect was generally stable in Phase 3. In Experiment 2, naltrexone was administered in Phase 2, Phase 3, or both Phases 2 and 3, to separate groups of rats. Naltrexone facilitated the elimination of alcohol-maintained behavior in Phase 2 and, the resurgence of alcohol-maintained behavior was reduced only for those rats that received naltrexone in both phases. Together, these experiments demonstrate that the resurgence of alcohol-maintained behavior is replicable within-subjects and, further, resurgence of alcohol-maintained behavior may be a useful model to evaluate pharmacological interventions to facilitate behavioral treatments and reduce the likelihood of relapse. Results with naltrexone support the use of medication-assisted therapy approaches to reduce relapse risk in patients. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

The control response in assessing resurgence: Useful or compromised tool?

Resurgence experiments sometimes include an operandum on which a history of reinforcement has not been experimentally established. The purpose of this control operandum is to rule out a generalized increase in responding when the alternative response is extinguished as being the cause of the resurgent target response. A review of the results of experiments conducted with both nonhumans and humans in which a control operandum was included shows that control- operandum responding is more common in the latter and almost nonexistent in the former. Both the presence and absence of responding on the control operandum, however, are subject to multiple interpretations thereby rendering it a compromised tool. Alternatives to using a control operandum to rule out extinction induction as the basis for resurgence include a preresurgence test control procedure and a differential resurgence procedure.

Repeated, within-session resurgence

Resurgence is a reliable, transient effect that only occasionally is replicated more than once within a single experiment or subject. In the present experiments, within-session resurgence was generated repeatedly by dividing individual sessions into three phases (Training, Alternative-Reinforcement, and Resurgence-Test). In Experiments 1 and 2, resurgence reliably occurred in most of the 22-30 daily sessions when responding was reinforced on, respectively, fixed- and variable-interval schedules. Resurgence magnitude and duration did decrease across replications for some subjects, but not for others. To examine the utility of the procedure in studying the effects of an independent variable on resurgence, in Experiment 3 the effects of rich and lean baseline and alternative reinforcement rates on resurgence were compared. The target response was eliminated more rapidly, resurgence occurred more often, and usually was greater following rich alternative reinforcement rates. Resurgence was of greater magnitude when the baseline reinforcement rate was relatively lean compared to the alternative reinforcement rate. These experiments provide a reliable method for generating resurgence within individual sessions, instead of across multiple-session conditions, that can be repeated over many successive sessions.

An alternative approach to relapse analysis: Using Monte Carlo methods and proportional rates of response

Relapse is the recovery of a previously suppressed response. Animal models have been useful in examining the mechanisms underlying relapse (e.g., reinstatement, renewal, reacquisition, resurgence). However, there are several challenges to analyzing relapse data using traditional approaches. For example, null hypothesis significance testing is commonly used to determine whether relapse has occurred. However, this method requires several a priori assumptions about the data, as well as a large sample size for between-subjects comparisons or repeated testing for within-subjects comparisons. Monte Carlo methods may represent an improved analytic technique, because these methods require no prior assumptions, permit smaller sample sizes, and can be tailored to account for all of the data from an experiment instead of some limited set. In the present study, we conducted reanalyses of three studies of relapse (Berry, Sweeney, & Odum, ; Galizio et al., ; Odum & Shahan, ) using Monte Carlo techniques to determine if relapse occurred and if there were differences in rate of response based on relevant independent variables (such as group membership or schedule of reinforcement). These reanalyses supported the previous findings. Finally, we provide general recommendations for using Monte Carlo methods in studies of relapse.

Stimulus contributions to operant resurgence

In two experiments, pigeons were exposed to a three-phase resurgence procedure (train Response A; extinguish Response A and train Response B; extinguish Response B). In the first experiment, the stimuli associated with phases were different, resulting in a resurgence procedure combined with an ABC renewal procedure. Presenting the novel stimulus, C, during extinction of both responses in the third phase resulted in minimal resurgence. Subsequently, substituting the original training Stimulus A for Stimulus C resulted in resurgence with all pigeons. In the second experiment, resurgence with the same stimuli present in all three phases of the resurgence procedure (AAA) was compared concurrently with a resurgence procedure in which the ABC renewal procedure used in Experiment 1 was superimposed. Substantially more resurgence occurred with the AAA procedure compared to the ABC procedure. Although ABC renewal in combination with the resurgence procedure generated some resurgence, such recurrent responding was attenuated relative to that observed when the stimulus conditions were constant across phases. Combined with earlier research showing the enhancing effects of combining resurgence and ABA renewal procedures, the present results elaborate on how stimuli correlated with certain behavioral histories affect the course of operant resurgence.

Factors that encourage generalization from extinction to test reduce resurgence of an extinguished operant response

Two experiments investigated methods that reduce the resurgence of an extinguished behavior (R1) that occurs when reinforcement for an alternative behavior (R2) is discontinued. In Experiment 1, R1 was first trained and then extinguished while R2 was reinforced during a 5- or 25-session treatment phase. For half the rats, sessions in which R2 was reinforced alternated with sessions in which R2 was extinguished. Controls received the same number of treatment sessions, but R2 was never extinguished. When reinforcement for R2 was discontinued, R1 resurged in the controls. However, the alternating groups showed reduced resurgence, and the magnitude of the resurgences observed during their R2 extinction sessions decreased systematically over Phase 2. In Experiment 2, R1 was first reinforced with one outcome (O1). The rats then had two types of double-alternating treatment sessions. In one type, R1 was extinguished and R2 produced O2. In the other, R1 was unavailable and R2 produced O3. R1 resurgence was weakened when O2, but not O3, was delivered freely during testing. Together, the results suggest that methods that encourage generalization between R1 extinction and resurgence testing weaken the resurgence effect. They are not consistent with an account of resurgence proposed by Shahan and Craig (2017).

Role of the discriminative properties of the reinforcer in resurgence

In three experiments with rat subjects, we examined the effects of the discriminative effects of reinforcers that were presented during or after operant extinction. Experiments 1 and 2 examined resurgence, in which an extinguished operant response (R1) recovers when a second behavior (R2) that has been reinforced to replace it is also placed in extinction. The results of Experiment 1 suggest that the amount of R1's resurgence is a decreasing linear function of the interreinforcement interval used during the reinforcement of R2. In Experiment 2, R1 was reinforced with one outcome (O1), and R2 was then reinforced with a second outcome (O2) while R1 was extinguished. In resurgence tests, response-independent (noncontingent) presentations of O2 prevented resurgence of R1, which otherwise occurred when testing was conducted with either no reinforcers or noncontingent presentations of O1. In Experiment 3, we then examined the effects of noncontingent O1 and O2 presentations after simple extinction in either the presence or the absence of noncontingent presentations of O2. Overall, the results are consistent with a role for the discriminative properties of the reinforcer in controlling operant behavior. In resurgence, the reinforcer used during response elimination provides a distinct context that controls the inhibition of R1. The results are less consistent with an alternative view emphasizing the disrupting effects of alternative reinforcement.

Quantitative analysis of local-level resurgence

Resurgence is the recurrence of a previously reinforced and then extinguished behavior induced by the extinction of another more recently reinforced behavior. Resurgence provides insight into behavioral processes relevant to treatment relapse of a range of problem behaviors. Resurgence is typically studied across three phases: (1) reinforcement of a target response, (2) extinction of the target and concurrent reinforcement of an alternative response, and (3) extinction of the alternative response, resulting in the recurrence of target responding. Because each phase typically occurs successively and spans multiple sessions, extended time frames separate the training and resurgence of target responding. This study assessed resurgence more dynamically and throughout ongoing training in 6 pigeons. Baseline entailed 50-s trials of a free-operant psychophysical procedure, resembling Phases 1 and 2 of typical resurgence procedures. During the first 25 s, we reinforced target (left-key) responding but not alternative (right-key) responding; contingencies reversed during the second 25 s. Target and alternative responding followed the baseline reinforcement contingencies, with alternative responding replacing target responding across the 50 s. We observed resurgence of target responding during signaled and unsignaled probes that extended trial durations an additional 100 s in extinction. Furthermore, resurgence was greater and/or sooner when probes were signaled, suggesting an important role of discriminating transitions to extinction in resurgence. The data were well described by an extension of a stimulus-control model of discrimination that assumes resurgence is the result of generalization of obtained reinforcers across space and time. Therefore, the present findings introduce novel methods and quantitative analyses for assessing behavioral processes underlying resurgence.

Resurgence of time allocation

The resurgence of time allocation with pigeons was studied in three experiments. In Phase 1 of each experiment, response-independent food occurred with different probabilities in the presence of two different keylights. Each peck on the key changed its color and the food probability in effect. In Phase 2, the food probabilities associated with each keylight were reversed and, in Phase 3, food was discontinued in the presence of either keylight. The food probabilities were .25 and .75, in Experiment 1, and 0.0 and 1.0 in Experiment 2. More time was allocated to the keylight correlated with more probable food in Phases 1 and 2, and in Phase 3 resurgence of time allocation occurred for two of three pigeons in Experiment 1, and for each of four pigeons in Experiment 2. Because time had to be allocated to either of the two alternatives in Experiments 1 and 2, however, it was difficult to characterize the time allocation patterns in Phase 3 as resurgence when changeover responding approached zero. In Experiment 3 this issue was addressed by providing a third alternative uncorrelated with food such that in each phase, after 30 s in the presence of either keylight correlated with food, the third alternative always was reinstated, requiring a response to access either of the two keylights correlated with food. In this experiment, the food probabilities were similar to those in Experiment 1. Resurgence of time allocation occurred for each of three pigeons under this procedure. The results of these experiments suggest that patterns of time allocation resurge similarly to discrete responses and to spatial and temporal patterns of responding.

Resurgence of response duration in human participants

Previously reinforced responses can reappear when reinforcement is withdrawn from current responding. This is known as resurgence. Although resurgence of response topography, spacing, and patterns over time has been demonstrated, there is no evidence of resurgence of response duration. This experiment explored resurgence of response duration in humans. In Phase 1 a multiple schedule of reinforcement with two components was used. In each component a chained variable-interval 30s, variable-ratio 3 schedule was implemented. In the terminal link of the chained schedule, response durations between 0.1 and 0.5s were reinforced during one component, and between 2 and 8s in the other component. In Phase 2, response requirement during the terminal link of the chained schedule was inverted between components relative to Phase 1. In Phase 3 the chained schedule was changed to a variable-interval 30-s, extinction 30s. Resurgence of the durations trained during Phase 1 was observed. It was concluded that duration is a response dimension that reappears during extinction.

AN EVALUATION OF RESURGENCE DURING FUNCTIONAL COMMUNICATION TRAINING

Three children who displayed destructive behavior maintained by negative reinforcement received functional communication training (FCT). During FCT, the children were required to complete a demand and then to mand (touch a card attached to a microswitch, sign, or vocalize) to receive brief play breaks. Prior to and 1 to 3 times following the initiation of FCT, extinction probes were conducted to evaluate the resurgence of destructive behavior when the microswitch without the mand card was present or the microswitch and the mand card were absent to determine if different patterns of resurgence occurred when the microswitch was present or absent and, for 2 of the children, if changes in resurgence occurred at different points in treatment. Results showed that FCT led to relatively rapid reductions in destructive behavior. During all extinction sessions, resurgence of destructive behavior occurred with only minimal differences across the switch/no card and no-switch conditions.

Behavioral momentum theory fails to account for the effects of reinforcement rate on resurgence

The behavioral-momentum model of resurgence predicts reinforcer rates within a resurgence preparation should have three effects on target behavior. First, higher reinforcer rates in baseline (Phase 1) produce more persistent target behavior during extinction plus alternative reinforcement. Second, higher rate alternative reinforcement during Phase 2 generates greater disruption of target responding during extinction. Finally, higher rates of either reinforcement source should produce greater responding when alternative reinforcement is suspended in Phase 3. Recent empirical reports have produced mixed results in terms of these predictions. Thus, the present experiment further examined reinforcer-rate effects on persistence and resurgence. Rats pressed target levers for high-rate or low-rate variable-interval food during Phase 1. In Phase 2, target-lever pressing was extinguished, an alternative nose-poke became available, and nose-poking produced either high-rate variable-interval, low-rate variable-interval, or no (an extinction control) alternative reinforcement. Alternative reinforcement was suspended in Phase 3. For groups that received no alternative reinforcement, target-lever pressing was less persistent following high-rate than low-rate Phase-1 reinforcement. Target behavior was more persistent with low-rate alternative reinforcement than with high-rate alternative reinforcement or extinction alone. Finally, no differences in Phase-3 responding were observed for groups that received either high-rate or low-rate alternative reinforcement, and resurgence occurred only following high-rate alternative reinforcement. These findings are inconsistent with the momentum-based model of resurgence. We conclude this model mischaracterizes the effects of reinforcer rates on persistence and resurgence of operant behavior.

Reaparecimento de sequências com diferentes números de respostas em contextos de extinção e de variação

RESUMO O reaparecimento de uma resposta previamente extinta quando os reforços para uma resposta alternativa são descontinuados é denominado ressurgência. Foram investigados os efeitos de três variáveis sobre o reaparecimento de sequências de respostas: probabilidade da sequência (alta e baixa), contexto de teste (extinção e variação operante) e número de respostas por sequência (três e cinco). Sequências muito prováveis reapareceram mais frequentemente que sequências pouco prováveis, o reaparecimento da sequência alvo foi mais frequente no contexto de extinção do que de variação e o reaparecimento da sequência alvo variou inversamente ao número de respostas por sequência. O reaparecimento da sequência alvo, entretanto, não foi conceitualizado como ressurgência, uma vez que sua frequência foi menor que a das sequências controle.

Context change explains resurgence after the extinction of operant behavior

Extinguished operant behavior can return or "resurge" when a response that has replaced it is also extinguished. Typically studied in nonhuman animals, the resurgence effect may provide insight into relapse that is seen when reinforcement is discontinued following human contingency management (CM) and functional communication training (FCT) treatments, which both involve reinforcing alternative behaviors to reduce behavioral excess. Although the variables that affect resurgence have been studied for some time, the mechanisms through which they promote relapse are still debated. We discuss three explanations of resurgence (response prevention, an extension of behavioral momentum theory, and an account emphasizing context change) as well as studies that evaluate them. Several new findings from our laboratory concerning the effects of different temporal distributions of the reinforcer during response elimination and the effects of manipulating qualitative features of the reinforcer pose a particular challenge to the momentum-based model. Overall, the results are consistent with a contextual account of resurgence, which emphasizes that reinforcers presented during response elimination have a discriminative role controlling behavioral inhibition. Changing the "reinforcer context" at the start of testing produces relapse if the organism has not learned to suppress its responding under conditions similar to the ones that prevail during testing.

Why behavior change is difficult to sustain

Unhealthy behavior is responsible for much human disease, and a common goal of contemporary preventive medicine is therefore to encourage behavior change. However, while behavior change often seems easy in the short run, it can be difficult to sustain. This article provides a selective review of research from the basic learning and behavior laboratory that provides some insight into why. The research suggests that methods used to create behavior change (including extinction, counterconditioning, punishment, reinforcement of alternative behavior, and abstinence reinforcement) tend to inhibit, rather than erase, the original behavior. Importantly, the inhibition, and thus behavior change more generally, is often specific to the "context" in which it is learned. In support of this view, the article discusses a number of lapse and relapse phenomena that occur after behavior has been changed (renewal, spontaneous recovery, reinstatement, rapid reacquisition, and resurgence). The findings suggest that changing a behavior can be an inherently unstable and unsteady process; frequent lapses should be expected. In the long run, behavior-change therapies might benefit from paying attention to the context in which behavior change occurs.

Some Factors Modulating the Strength of Resurgence After Extinction of an Instrumental Behavior

In resurgence, an operant behavior that has undergone extinction can return ("resurge") when a second operant that has replaced it itself undergoes extinction. The phenomenon may provide insight into relapse that may occur after incentive or contingency management therapies in humans. Three experiments with rats examined the impact of several variables on the strength of the resurgence effect. In each, pressing one lever (L1) was first reinforced and then extinguished while pressing a second, alternative, lever (L2) was now reinforced. When L2 responding was then itself extinguished, L1 responses resurged. Experiment 1 found that resurgence was especially strong after an extensive amount of L1 training (12 as opposed to 4 training sessions) and after L1 was reinforced on a random ratio schedule as opposed to a variable interval schedule that was matched on reinforcement rate. Experiment 2 found that after 12 initial sessions of L1 training, 4, 12, or 36 sessions of Phase 2 each allowed substantial (and apparently equivalent) resurgence. Experiment 3 found no effect of changing the identity of the reinforcer (from grain pellet to sucrose pellet or sucrose to grain) on the amount of resurgence. The results suggest that resurgence can be robust; in the natural world, an operant behavior with an extensive reinforcement history may still resurge after extensive incentive-based therapy. The results are discussed in terms of current explanations of the resurgence effect.

Relapse processes after the extinction of instrumental learning: renewal, resurgence, and reacquisition

It is widely recognized that extinction (the procedure in which a Pavlovian conditioned stimulus or an instrumental action is repeatedly presented without its reinforcer) weakens behavior without erasing the original learning. Most of the experiments that support this claim have focused on several "relapse" effects that occur after Pavlovian extinction, which collectively suggest that the original learning is saved through extinction. However, although such effects do occur after instrumental extinction, they have not been explored there in as much detail. This article reviews recent research in our laboratory that has investigated three relapse effects that occur after the extinction of instrumental (operant) learning. In renewal, responding returns after extinction when the behavior is tested in a different context; in resurgence, responding recovers when a second response that has been reinforced during extinction of the first is itself put on extinction; and in rapid reacquisition, extinguished responding returns rapidly when the response is reinforced again. The results provide new insights into extinction and relapse, and are consistent with principles that have been developed to explain extinction and relapse as they occur after Pavlovian conditioning. Extinction of instrumental learning, like Pavlovian learning, involves new learning that is relatively dependent on the context for expression.

Reflections on Behavior Analysis and Evolutionary Biology: A Selective Review of Evolution Since Darwin—The First 150 Years. Edited by M. A. Bell, D. J. Futuyama, W. F. Eanes, & J. S. Levinton

This review focuses on parallels between the selectionist sciences of evolutionary biology and behavior analysis. In selectionism, complex phenomena are interpreted as the cumulative products of relatively simple processes acting over time—natural selection in evolutionary biology and reinforcement in behavior analysis. Because evolutionary biology is the more mature science, an examination of the factors that led to the triumph of natural selection provides clues whereby reinforcement may achieve a similar fate in the science of behavior.