Resurgence and downshifts in alternative reinforcement rate

Punishment-induced resurgence

The phenomenon of extinction-induced resurgence is well established, but there is comparatively little experimental evidence for punishment-induced resurgence. Punishment-induced resurgence can by tested by contingent shocks following the alternative response. The purpose of Experiment 1 was to test whether low-intensity shocks, that do not decrease rate of reinforcement, result in resurgence. Four rats served as subjects. Rats were exposed to three sequential conditions: (a) variable-interval (VI) 30-s food delivery for a lever press (target response); (b) VI 30-s food delivery for a nose poke (alternative response) and extinction of the lever press; (c) VI 30-s reinforcement for a nose poke with superimposed VI 60-s shock delivery. In the final condition, shocks increased gradually from 0.1 to 0.5 mA. Experiment 2 evaluated whether an abrupt introduction of a high-intensity shock would result in resurgence. Three rats served as subjects and were exposed to three sequential conditions: (a) VI 30-s food delivery for a lever press; (b) VI 30-s food delivery for a nose poke and extinction of the lever press; (c) continued VI 30-s reinforcement for a nose poke with superimposed VI 60-s 0.6 mA shock delivery. Resurgence was observed in all subjects, including in situations in which rate of responding, but not rate of reinforcement, decreased. The present study provides additional evidence for punishment-induced resurgence, but future studies are warranted to determine the extent to which punishment can produce resurgence with or without decreases in rates of reinforcement.

Synthesized alternative reinforcement and resurgence

In treatments based on differential reinforcement of alternative behavior, applied researchers and clinicians often provide multiple, qualitatively different reinforcers (i.e., synthesized reinforcement) rather than a single reinforcer (i.e., isolated reinforcement) contingent on alternative behavior. Some research shows that providing synthesized reinforcement for alternative responses within such treatments produces more rapid and complete suppression of target behavior; however, there is limited research evaluating the durability of these effects during treatment disruptions. Conceptual explanations of resurgence (e.g., resurgence as choice, context theory) suggest that treatments that include synthesized alternative reinforcement may lead to more resurgence of target behavior when alternative reinforcement is disrupted relative to treatments using isolated reinforcement. We evaluated this hypothesis within a three-phase resurgence evaluation. We exposed rats to isolated or synthesized reinforcement for alternative responding in the second phase, and we exposed rats to extinction in the third phase. Synthesized alternative reinforcement produced more rapid and complete suppression of target behavior than did isolated reinforcement in the second phase; however, exposure to extinction following synthesized reinforcement produced more resurgence. We discuss these results in terms of their implications for applied research and their support for current conceptual explanations for resurgence.

Resurgence of destructive behavior following decreases in alternative reinforcement: A prospective analysis

Basic and retrospective translational research has shown that the magnitude of resurgence is determined by the size of the decrease in alternative reinforcement, with larger decreases producing more resurgence. However, this finding has not been evaluated prospectively with a clinical population. In Experiment 1, five participants experienced a fixed progression of reinforcement schedule-thinning steps during treatment of their destructive behavior. Resurgence occurred infrequently across steps and participants, and when resurgence did occur, its clinical meaningfulness was often minimal. In Experiment 2, five new participants experienced these same schedule-thinning steps but in a counterbalanced order. Resurgence occurred most often and was generally largest with larger decreases in alternative reinforcement programmed earlier in the evaluation. Large decreases in alternative reinforcement may be more problematic clinically when they occur earlier in treatment. Whether larger transitions can be recommended in the clinic following the success of smaller ones will require additional research.

Examination of clinical variables affecting resurgence: A reanalysis of 46 applications

Despite the efficacy of behavioral interventions, resurgence of challenging behavior (e.g., aggression, self-injury) following successful treatment can still occur. Applied work has focused on identifying treatment-related variables thought to affect the occurrence and magnitude of resurgence. The current study describes the relation between several variables (i.e., phase duration, response rates in baseline and treatment, obtained rates of reinforcement, downshift in reinforcement step size) and resurgence in a retrospective consecutive controlled case series of 46 treatment applications for challenging behavior conducted in an inpatient setting. Only the downshift in reinforcement (e.g., schedule-thinning) step size was correlated with the magnitude of resurgence. These results are consistent with recent findings suggesting that treatment duration and other factors have inconsistent effects on resurgence of challenging behavior.

Resurgence and Behavioral Contrast, Compared and Contrasted

This is a review of the relation between operant response resurgence and behavioral contrast. Both are defined by rate changes in a target response as a function of environmental changes spatially or temporally distal to the location of the target response. The typical procedures for investigating these two phenomena differ in that (1) resurgence is studied using concurrent schedules and behavioral contrast predominantly with multiple schedules and (2) resurgence is assessed against an extinction baseline of the target response and behavioral contrast has been assessed under a variety of reinforcement schedules. The distinctions between concurrent and multiple schedules, however, may be ones of degree rather than kind. Research into both phenomena reveals considerable overlap in the controlling variables of the two. With certain caveats, resurgence appears to be an instance of behavioral contrast measured against an extinction baseline. Because of Point 2 above, most instances of behavioral contrast do not meet the definition of resurgence. Investigating resurgence while maintaining target responding by a schedule of reinforcement might be useful, but such a procedure would not qualify as resurgence because it violates the definition of resurgence as the return of a previously reinforced but currently extinguished response. Several implications of the similarities and differences between the two are discussed.

Abstinence as Choice: Exploring Voluntary Abstinence from Alcohol Self-Administration Using the Resurgence-as-Choice Framework

Resurgence is an increase in the rate of a previously suppressed behavior that occurs when an alternative source of reinforcement is made worse in some way. The Resurgence as Choice model offers a quantitative approach to understanding resurgence that may provide important insights into the variables that affect this form of relapse in the natural environment. Bringing this model to bear on relapse following reinforcement-based interventions for alcohol and other substance use disorders, however, may not be straightforward. Laboratory work on which the Resurgence as Choice model is based has almost exclusively focused on resurgence following extinction of target behavior, but abstinence from alcohol during intervention is often voluntary: Patients may drink alcohol and forfeit therapeutic reinforcers at any time. In this article, we first will review recent data from our group that demonstrate a method for studying resurgence following voluntary abstinence from alcohol seeking in rats. In a previous experiment, we reduced rats' alcohol-maintained lever pressing to low levels without placing it on extinction by arranging nondrug differential reinforcement of other behavior. Further, when we suspended nondrug reinforcement, resurgence of lever pressing occurred. Next, we will explore methods for modeling these outcomes using the Resurgence-as-Choice framework. We conclude that the data under consideration may not be sufficient to discriminate between candidate models of resurgence following voluntary abstinence and point to areas for future empirical and theoretical development. This work may provide a stronger bridge between preclinical and conceptual work on resurgence and clinical treatments for alcohol use disorder.

Examining resurgence in rats following expanded-operant treatments

Resurgence of previously reinforced behavior represents a challenge to otherwise successful interventions based on differential reinforcement of alternative behavior (DRA). Expanded-operant treatments seek to increase the number of functional alternative behaviors through DRA, thereby potentially mitigating resurgence. However, the few studies that have directly examined these methods as a tool for resurgence mitigation have provided limited and unclear results. Thus, the present experiments were designed to investigate the effect of expanded-operant DRA methods on resurgence of previously reinforced behavior using rat subjects. In two experiments, following a baseline phase in which a target response was trained, groups of rats experienced concurrent (i.e., five simultaneous alternative responses), serial (i.e., five sequentially available alternative responses), or single DRA interventions arranging similar rates of alternative reinforcement in order to examine potential differences in resurgence. Both experiments showed that neither serial nor concurrent DRA expanded-operant treatments reduced resurgence compared with single DRA regardless of whether stimuli associated with previously reinforced alternative responses were removed (Experiment 1) or remained present (Experiment 2) for the serial-DRA group. Further, a primacy effect in resurgence was obtained for the serial-DRA group in both experiments. Overall, these results suggest that expanded-operant treatments may not help to reduce resurgence.

Application of the evolutionary theory of behavior dynamics to severe challenging behavior

The evolutionary theory of behavior dynamics (ETBD) is a genetic algorithm that applies the Darwinian principles of evolutionary biology to model how behavior changes dynamically via selection by contingencies of reinforcement. The ETBD is a complexity theory where low-level rules of selection, reproduction, and mutation operate iteratively to animate "artificial organisms" that generate emergent outcomes. Numerous studies have demonstrated the ETBD can accurately model behavior of live animals in the laboratory, and it has been applied recently to model automatically maintained self-injury. The purpose of the current series of studies was to further extend the application of the ETBD to model additional functional classes of challenging behavior and clinical procedures. Outcomes obtained with artificial organisms generally corresponded well with outcomes observed with clinical cases sourced from consecutive controlled case series studies. Conceptual and methodological considerations on the application of the ETBD to model challenging behavior are discussed.

Modeling Behavioral Persistence with Resurgence as Choice in Context (RaC2): A Tutorial

Resurgence as Choice in Context (RaC2) is a quantitative model for evaluating the reemergence of a previously extinguished response when alternative reinforcement is worsened. Rooted in the matching law, RaC2 proposes that allocation between target and alternative responding is based on changes in the relative value of each response option over time, accounting for periods with and without alternative reinforcement. Given that practitioners and applied researchers may have limited experience with constructing quantitative models, we provide a step-by-step task analysis for building RaC2 using Microsoft Excel 2013. We also provide a few basic learning activities to help readers better understand RaC2 itself, the variables that affect the model's predictions, and the clinical implications of those predictions.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40617-023-00796-y.

Modeling and quantifying resurgence in the Evolutionary Theory of Behavior Dynamics

McDowell's Evolutionary Theory of Behavior Dynamics (ETBD) has been shown to model a wide range of live organism behavior with excellent descriptive accuracy. Recently, artificial organisms (AOs) animated by the ETBD were shown to replicate the resurgence of a target response following downshifts in the density of reinforcement for an alternative response and across repeated iterations of the traditional three-phase resurgence paradigm in a manner commensurate with nonhuman subjects. In the current investigation, we successfully replicated an additional study that used this traditional three-phase resurgence paradigm with human participants. We fitted two models based on the Resurgence as Choice (RaC) theory to the data generated by the AOs. Because the models had varying numbers of free parameters, we used an information-theoretic approach to compare the models against one another. We found that a version of the Resurgence as Choice in Context model that incorporates aspects of Davison and colleague's Contingency Discriminability Model provided the best description of the resurgence data emitted by the AOs when accounting for the models' complexity. Last, we discuss considerations when developing and testing new quantitative models of resurgence that account for the ever-growing literature of resurgence.

A quantitative analysis of resurgence following downshifts in alternative-reinforcer magnitude

Resurgence is the increase in a previously reinforced and then extinguished target response due to changes in reinforcement conditions for an alternative response, including reductions in the rate or magnitude of reinforcement for the alternative response. Research with nonhumans suggests that reductions in both alternative-reinforcer rate and magnitude produce resurgence, but the present study was the first to examine effects of downshifts in alternative-reinforcer magnitude on humans' resurgence. Moreover, it was the first to evaluate whether the quantitative framework, resurgence as choice in context (RaC² ), could account for those effects. Consistent with predictions of RaC² , resurgence of a target button press occurred with reductions in point gain for an alternative response, with greater reductions producing higher levels of resurgence. However, the model consistently underpredicted and then overpredicted resurgence during tests with low-magnitude reinforcement and extinction. Systematic deviations in model predictions of alternative responding were also evident and consistent with previous fits of RaC² to nonhuman data. Overall, our findings suggest that RaC² could be a useful quantitative theoretical framework for understanding processes contributing to resurgence in humans, but further theoretical development is needed to account for the apparent divergent effects of extinction versus downshifts in reinforcer magnitude.

Creating and Studying the Behavior of Artificial Organisms Animated by an Evolutionary Theory of Behavior Dynamics

The evolutionary theory of behavior dynamics (ETBD) is a complexity theory, which means that it is stated in the form of simple low-level rules, the repeated operation of which generates high-level outcomes that can be compared to data. The low-level rules of the theory implement Darwinian processes of selection, reproduction, and mutation. This tutorial is an introduction to the ETBD for a general audience, and illustrates how the theory is used to animate artificial organisms that can behave continuously in any experimental environment. Extensive research has shown that the theory generates behavior in artificial organisms that is indistinguishable in qualitative and quantitative detail from the behavior of live organisms in a wide variety of experimental environments. An overview and summary of this supporting evidence is provided. The theory may be understood to be computationally equivalent to the biological nervous system, which means that the algorithmic operation of the theory and the material operation of the nervous system give the same answers. The applied relevance of the theory is also discussed, including the creation of artificial organisms with various forms of psychopathology that can be used to study clinical problems and their treatment. Finally, possible future directions are discussed, such as the extension of the theory to behavior in a two-dimensional grid world.

A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40614-022-00361-y.

Further evaluation of treatment duration on the resurgence of destructive behavior

Translation of promising procedures for mitigating treatment relapse has received considerable attention recently from researchers across the basic-applied continuum. One procedure that has demonstrated mixed support involves increasing the duration of treatment as a strategy for blunting resurgence. In a recent translational study, Greer et al. (2020) failed to detect a mitigation effect of increased treatment duration on the resurgence of destructive behavior. However, design limitations may have been responsible. The present study corrected these limitations by (a) employing a sequential design to decrease the possibility of multiple-treatment interference, (b) evaluating more treatment durations, (c) arranging treatments of fixed durations, and (d) conducting treatments of more extreme duration in a different clinical sample. Despite these improvements in experimental rigor and the testing of more extreme boundary conditions, the present study also failed to detect a mitigation effect of increased treatment duration. Likely explanations are discussed.

Basic and applied research on extinction bursts

Discontinuation of the contingency between a response and its reinforcer sometimes produces a temporary increase in the response before its rate decreases, a phenomenon called the extinction burst. Prior clinical and basic studies on the prevalence of the extinction burst provide highly disparate estimates. Existing theories on the extinction burst fail to account for the dynamic nature of this phenomenon, and the basic behavioral processes that control response bursting remain poorly understood. In this paper, we first review the basic and applied literature on the extinction burst. We then describe a recent refinement of the concatenated matching law called the temporally weighted matching law that appears to resolve the above-mentioned issues regarding the extinction burst. We present illustrative translational data based conceptually on the model. Finally, we discuss specific recommendations derived from the temporally weighted matching law regarding procedures clinicians could implement to potentially mitigate or prevent extinction bursts.

A Theory of the Extinction Burst

A preliminary theory of a temporary increase in the rate of an operant response with the transition to extinction (i.e., the extinction burst) is proposed. The theory assumes reinforcers are events permitting access to some valuable activity, and that such activity can compete for allocation with the target response under some conditions (e.g., very high reinforcement rates). With the transition to extinction, elimination of this competition for allocation can produce an increase in the the target response, but the increase is transient because the value of the target response decreases with exposure to extinction. The theory provides a way to understand why the extinction burst is not ubiquitous, seems more common following very small ratio schedules, occurs for a short period of time following the transition to extinction, and may be eliminated with the availability of alternative reinforcement. It appears to provide a reasonable starting point for a theory of the extinction burst that does not necessarily require inclusion of invigorating effects of frustration, and it is closely aligned with Resurgence as Choice theory. Additional research on factors modulating reinforcement-related activities and how they affect the extinction burst could help to further evaluate the theory.

Quantifying increases in problem behavior following downshifts in reinforcement: A retrospective analysis and replication

The recurrence of a previously eliminated or reduced behavior following a downshift in alternative reinforcement is referred to as resurgence. Resurgence as Choice (RaC) is a quantitative model of behavioral persistence that posits that resurgence is governed by the same behavioral principles that underlie choice behavior. Consistent with the predictions of RaC, extant basic research with animals indicates that resurgence increases as an exponential function of the size of the downshift in alternative reinforcement. Recently, Shahan and Greer (2021) extended this finding to resurgence of problem behavior during schedule thinning following functional communication training (FCT). They found that when resurgence occurred, it increased exponentially as a function of relative decrements in reinforcer availability during schedule thinning with compound schedules of reinforcement. The purpose of the current study was to directly replicate the analytic procedures described in Shahan and Greer to examine resurgence of problem behavior during schedule thinning following FCT using two novel clinical datasets. Our results closely replicate the findings from Shahan and Greer, providing additional support for the generality of resurgence during downshifts in alternative reinforcement in clinical contexts. These results also highlight the potential applicability of RaC for modeling resurgence of problem behavior during FCT schedule thinning.

Modeling resurgence with an evolutionary theory of behavior dynamics

McDowell's (2004) Evolutionary Theory of Behavior Dynamics (ETBD) is a computational theory that has reproduced a wide variety of behavioral phenomena observed in material reality. Here, we extended the generality of the ETBD by successfully replicating laboratory studies of resurgence with live animals using artificial organisms (AOs) animated by the theory. We ran AOs on concurrent random-interval random-interval (conc RI RI) schedules of reinforcement wherein one alternative (i.e., a target behavior) was reinforced while the other alternative (i.e., an alternative behavior) was not reinforced. Then, we placed the target behavior on extinction and reinforced the alternative response, producing a shift in allocation of responding from the target behavior to the alternative response. Finally, schedule thinning of the alternative response (i.e., downshifts) resulted in resurgence of target behavior. Our findings indicated that resurgence increased as a function of the relative downshift in reinforcement rate and magnitude, replicating findings from previous studies with live animals. These results further illustrate the utility of the ETBD for generating dynamic behavioral data and serve as a proof-of-concept for a novel computational approach for studying and understanding resurgence in future studies.

Translating Quantitative Theories of Behavior into Improved Clinical Treatments for Problem Behavior

The most important advancement in the treatment of destructive behavior has been the development of the functional analysis, which is used to prescribe effective treatments like functional communication training. Although this approach can be highly effective, extinction bursts and forms of treatment relapse commonly occur when function-based treatments are implemented by caregivers in natural community settings. In recent years, researchers have increasingly applied quantitative theories of behavior like behavioral momentum theory (BMT) and the temporally weighted matching law (TWML) to understand, prevent, or mitigate extinction bursts and treatment relapse. In this paper, we describe BMT and TWML and selectively review the basic, translational, and applied research supporting and opposing each theory. Then, we describe how function-based treatments may be refined based on these theories to improve the effectiveness, generality, and durability of function-based treatments for individuals with autism spectrum and related disorders who display problem behavior.

Phase duration and resurgence

Resurgence, the recurrence of responding due to a worsening of reinforcement conditions for current behavior, is a prevalent form of treatment relapse. Resurgence as Choice in Context predicts that increasing the duration of exposure to reinforcement for target responding during Phase 1 will increase resurgence magnitude, whereas increasing the duration of exposure to reinforcement for alternative responding and extinction for target responding during Phase 2 will decrease resurgence magnitude. We conducted an experiment evaluating these predictions with human participants recruited through Amazon's Mechanical Turk platform. We varied Phase 1 and Phase 2 durations across 4 experimental groups. Resurgence as Choice in Context successfully predicted the differences in resurgence magnitude across these groups, and fitting the quantitative model to the obtained data yielded an exceptional coefficient of determination. We discuss the implications of these results for using Resurgence as Choice in Context to inform experiments with human participants and the feasibility of using human-operant preparations to evaluate resurgence.

Evaluating effects of context changes on resurgence in humans

Laboratory models of relapse provide methods for evaluating challenges to behavioral treatments with differential reinforcement of an alternative response (DRA). Resurgence occurs with the worsening of conditions of reinforcement for appropriate behavior and renewal occurs when transitioning out of a treatment context. Across five experiments, participants recruited via online crowdsourcing pressed onscreen buttons to earn points exchangeable for money and contexts sometimes changed through changes in the background image. Returning to the training context (ABA, Experiment 1) and transitioning to a novel context (ABC, Experiment 2) produced greater resurgence when removing alternative reinforcement in comparison with remaining in the treatment context (ABB). In contrast, we observed little difference in resurgence among AAA, ABB, and AAC context manipulations (Experiment 3) and ABA, ABC, and AAC context manipulations (Experiment 4). In Experiment 5, we evaluated relative contributions of the presence versus absence of context changes (ABA vs. ABB) in combination with or without the removal of alternative reinforcement. Both changing context and removing alternative reinforcement increased responding in isolation and the combination produced greater-than-additive effects. Overall, the present findings demonstrate a consistent effect of removing alternative reinforcement on relapse that, under certain conditions, can be enhanced by context change.

Destructive behavior increases as a function of reductions in alternative reinforcement during schedule thinning: A retrospective quantitative analysis

The behavioral processes determining the magnitude of the resurgence of destructive behavior during reinforcement schedule thinning have yet to be described, despite an uptick in prevalence research on the topic. As predicted by Resurgence as Choice theory, recent animal research has found that resurgence increases with the magnitude of a downshift in alternative reinforcement. Here we reanalyze the data from 2 recent prevalence studies to determine whether the size of the decrease in alternative reinforcement availability predicts the magnitude of resurgence in the clinic. Results from this retrospective analysis suggest that resurgence of destructive behavior increases significantly with decreases in the availability of alternative reinforcement. Implications for future research and translations of theoretical analyses to the clinic are discussed.