Effects of high, low, and thinning rates of alternative reinforcement on response elimination and resurgence

Synthesized alternative reinforcement and resurgence

In treatments based on differential reinforcement of alternative behavior, applied researchers and clinicians often provide multiple, qualitatively different reinforcers (i.e., synthesized reinforcement) rather than a single reinforcer (i.e., isolated reinforcement) contingent on alternative behavior. Some research shows that providing synthesized reinforcement for alternative responses within such treatments produces more rapid and complete suppression of target behavior; however, there is limited research evaluating the durability of these effects during treatment disruptions. Conceptual explanations of resurgence (e.g., resurgence as choice, context theory) suggest that treatments that include synthesized alternative reinforcement may lead to more resurgence of target behavior when alternative reinforcement is disrupted relative to treatments using isolated reinforcement. We evaluated this hypothesis within a three-phase resurgence evaluation. We exposed rats to isolated or synthesized reinforcement for alternative responding in the second phase, and we exposed rats to extinction in the third phase. Synthesized alternative reinforcement produced more rapid and complete suppression of target behavior than did isolated reinforcement in the second phase; however, exposure to extinction following synthesized reinforcement produced more resurgence. We discuss these results in terms of their implications for applied research and their support for current conceptual explanations for resurgence.

Resurgence and Behavioral Contrast, Compared and Contrasted

This is a review of the relation between operant response resurgence and behavioral contrast. Both are defined by rate changes in a target response as a function of environmental changes spatially or temporally distal to the location of the target response. The typical procedures for investigating these two phenomena differ in that (1) resurgence is studied using concurrent schedules and behavioral contrast predominantly with multiple schedules and (2) resurgence is assessed against an extinction baseline of the target response and behavioral contrast has been assessed under a variety of reinforcement schedules. The distinctions between concurrent and multiple schedules, however, may be ones of degree rather than kind. Research into both phenomena reveals considerable overlap in the controlling variables of the two. With certain caveats, resurgence appears to be an instance of behavioral contrast measured against an extinction baseline. Because of Point 2 above, most instances of behavioral contrast do not meet the definition of resurgence. Investigating resurgence while maintaining target responding by a schedule of reinforcement might be useful, but such a procedure would not qualify as resurgence because it violates the definition of resurgence as the return of a previously reinforced but currently extinguished response. Several implications of the similarities and differences between the two are discussed.

Abstinence as Choice: Exploring Voluntary Abstinence from Alcohol Self-Administration Using the Resurgence-as-Choice Framework

Resurgence is an increase in the rate of a previously suppressed behavior that occurs when an alternative source of reinforcement is made worse in some way. The Resurgence as Choice model offers a quantitative approach to understanding resurgence that may provide important insights into the variables that affect this form of relapse in the natural environment. Bringing this model to bear on relapse following reinforcement-based interventions for alcohol and other substance use disorders, however, may not be straightforward. Laboratory work on which the Resurgence as Choice model is based has almost exclusively focused on resurgence following extinction of target behavior, but abstinence from alcohol during intervention is often voluntary: Patients may drink alcohol and forfeit therapeutic reinforcers at any time. In this article, we first will review recent data from our group that demonstrate a method for studying resurgence following voluntary abstinence from alcohol seeking in rats. In a previous experiment, we reduced rats' alcohol-maintained lever pressing to low levels without placing it on extinction by arranging nondrug differential reinforcement of other behavior. Further, when we suspended nondrug reinforcement, resurgence of lever pressing occurred. Next, we will explore methods for modeling these outcomes using the Resurgence-as-Choice framework. We conclude that the data under consideration may not be sufficient to discriminate between candidate models of resurgence following voluntary abstinence and point to areas for future empirical and theoretical development. This work may provide a stronger bridge between preclinical and conceptual work on resurgence and clinical treatments for alcohol use disorder.

Resurgence of ethanol seeking following voluntary abstinence produced by nondrug differential reinforcement of other behavior

Resurgence refers to the relapse of a target behavior following the worsening of a source of alternative reinforcement that was made available during response elimination. Most laboratory analyses of resurgence have used a combination of extinction and alternative reinforcement to reduce target behavior. In contingency-management treatments for alcohol use disorder, however, alcohol use is not placed on extinction. Instead, participants voluntarily abstain from alcohol use to access nondrug alternative reinforcers. Inasmuch, additional laboratory research on resurgence following voluntary abstinence is warranted. The present experiment evaluated resurgence of rats' ethanol seeking following voluntary abstinence produced by differential reinforcement of other behavior (DRO). Lever pressing produced ethanol reinforcers during baseline phases. During DRO phases, lever pressing continued to produce ethanol and food reinforcers were delivered according to resetting DRO schedules. Ethanol and food reinforcers were suspended during resurgence test phases to evaluate resurgence following voluntary abstinence. Lever pressing was elevated during baseline phases and occurred at near-zero rates during DRO phases. During the resurgence test phases, lever pressing increased, despite that it no longer produced ethanol. The procedure introduced here may help researchers better understand the variables that affect voluntary abstinence from ethanol seeking and resurgence following voluntary abstinence.

Resurgence Following Higher or Lower Quality Alternative Reinforcement

Resurgence is a temporary increase in a previously suppressed target behavior following a worsening in reinforcement conditions. Previous studies have examined how higher rates or magnitudes of alternative reinforcement affect suppression of the target behavior and subsequent resurgence. However, there has been no investigation of the effects of higher versus lower qualities of alternative reinforcement on resurgence. Using a three-phase resurgence preparation with rats, the present experiments examined the effects of an alternative reinforcer that was of higher (Experiment 1) or lower (Experiment 2) quality than the reinforcer that had previously maintained the target behavior. The results of both experiments showed greater reductions in target behavior with a higher quality alternative reinforcer and larger increases in target responding when a higher quality alternative reinforcer was removed. Along with prior findings with higher rates and magnitudes of alternative reinforcement, these findings suggest that variations in reinforcer dimensions that increase the efficacy of alternative reinforcement also tend to increase resurgence when alternative reinforcement is removed. The results are discussed in terms of the resurgence as choice in context model and in terms of potential clinical implications.

Translational evaluation of on/off alternative reinforcement cycling

Cycling between the availability and unavailability of reinforcement for alternative responding has successfully reduced resurgence in basic laboratory evaluations, but this approach represents a marked departure from current standards of care when treating problem behavior, warranting careful translation before its use clinically. Therefore, with extinction arranged for target responding across groups in Phase 2, we evaluated the effects of cycling between the availability and unavailability of differential reinforcement of alternative behavior (DRA) using a computer-based task with adult humans recruited through Amazon MTurk. Two control groups experienced constant DRA in Phase 2, with one group experiencing a dense DRA schedule and another group experiencing a lean DRA schedule. The cycling DRA group tended to show greater reductions in target responding and improved discrimination in Phase 2 and less target responding across Phases 2 and 3 than the lean DRA and dense DRA groups. These preliminary findings suggest that on/off DRA cycling procedures may produce more desirable treatment outcomes than constant DRA without producing negative side effects; however, further research is needed to confirm these possibilities.

Examining resurgence in rats following expanded-operant treatments

Resurgence of previously reinforced behavior represents a challenge to otherwise successful interventions based on differential reinforcement of alternative behavior (DRA). Expanded-operant treatments seek to increase the number of functional alternative behaviors through DRA, thereby potentially mitigating resurgence. However, the few studies that have directly examined these methods as a tool for resurgence mitigation have provided limited and unclear results. Thus, the present experiments were designed to investigate the effect of expanded-operant DRA methods on resurgence of previously reinforced behavior using rat subjects. In two experiments, following a baseline phase in which a target response was trained, groups of rats experienced concurrent (i.e., five simultaneous alternative responses), serial (i.e., five sequentially available alternative responses), or single DRA interventions arranging similar rates of alternative reinforcement in order to examine potential differences in resurgence. Both experiments showed that neither serial nor concurrent DRA expanded-operant treatments reduced resurgence compared with single DRA regardless of whether stimuli associated with previously reinforced alternative responses were removed (Experiment 1) or remained present (Experiment 2) for the serial-DRA group. Further, a primacy effect in resurgence was obtained for the serial-DRA group in both experiments. Overall, these results suggest that expanded-operant treatments may not help to reduce resurgence.

Resurgence of destructive behavior following differential rates of alternative reinforcement

Behavioral momentum theory (BMT) suggests that resurgence of destructive behavior may be at least partly determined by the rate of alternative reinforcement, with lean schedules of reinforcement producing less resurgence than dense schedules. Findings from basic and translational studies have been mixed, and the effects of alternative reinforcement rate on resurgence remain unclear. In the current study, we conducted a within-subject evaluation of resurgence during extinction with four children following functional communication training using dense and lean (BMT-informed) schedules of alternative reinforcement. We observed no reliable differences in resurgence across the dense and lean conditions. We discuss implications of these findings in relation to future research using quantitative analyses to evaluate the relative effects of alternative reinforcement rate and other BMT-based strategies for mitigating resurgence in applied settings.

Modeling Behavioral Persistence with Resurgence as Choice in Context (RaC2): A Tutorial

Resurgence as Choice in Context (RaC2) is a quantitative model for evaluating the reemergence of a previously extinguished response when alternative reinforcement is worsened. Rooted in the matching law, RaC2 proposes that allocation between target and alternative responding is based on changes in the relative value of each response option over time, accounting for periods with and without alternative reinforcement. Given that practitioners and applied researchers may have limited experience with constructing quantitative models, we provide a step-by-step task analysis for building RaC2 using Microsoft Excel 2013. We also provide a few basic learning activities to help readers better understand RaC2 itself, the variables that affect the model's predictions, and the clinical implications of those predictions.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40617-023-00796-y.

Relapse and its mitigation: Toward behavioral inoculation

Relapse following the successful treatment of problem behavior can increase the likelihood of injury and the need for more intensive care. Current research offers some predictions of how treatment procedures may contribute to relapse, and conversely, how the risk of relapse can be mitigated. This review describes relapse-mitigation procedures with varying levels of support, the quantitative models that have influenced the research on relapse mitigation, different experimental methods for measuring relapse mitigation, and directions for future research. We propose that by viewing the implementation of relapse-mitigation procedures as a means of producing behavioral inoculation, clinicians are placed in the proactive and intentional role of exposing their client's behavior to an array of reinforcement and stimulus conditions during treatment with the goal of decreasing the detrimental impact of future treatment challenges.

A quantitative analysis of resurgence following downshifts in alternative-reinforcer magnitude

Resurgence is the increase in a previously reinforced and then extinguished target response due to changes in reinforcement conditions for an alternative response, including reductions in the rate or magnitude of reinforcement for the alternative response. Research with nonhumans suggests that reductions in both alternative-reinforcer rate and magnitude produce resurgence, but the present study was the first to examine effects of downshifts in alternative-reinforcer magnitude on humans' resurgence. Moreover, it was the first to evaluate whether the quantitative framework, resurgence as choice in context (RaC² ), could account for those effects. Consistent with predictions of RaC² , resurgence of a target button press occurred with reductions in point gain for an alternative response, with greater reductions producing higher levels of resurgence. However, the model consistently underpredicted and then overpredicted resurgence during tests with low-magnitude reinforcement and extinction. Systematic deviations in model predictions of alternative responding were also evident and consistent with previous fits of RaC² to nonhuman data. Overall, our findings suggest that RaC² could be a useful quantitative theoretical framework for understanding processes contributing to resurgence in humans, but further theoretical development is needed to account for the apparent divergent effects of extinction versus downshifts in reinforcer magnitude.

A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40614-022-00361-y.

Response effort and resurgence

This study provides an initial translational examination of response effort and resurgence. Eleven typically developing adults and five adolescents with autism served as participants across two experiments. Participants received points for touching moving stimuli on a computer screen. The resurgence evaluation consisted of three phases: establishment wherein R1 was reinforced, elimination wherein R1 was placed on extinction while R2 was reinforced, and extinction wherein R1 and R2 no longer resulted in reinforcement. Rate of R1 during extinction was compared across three conditions: intermediate, easy, and difficult. Disparity in effort was created by manipulations of the size and speed of objects that moved about on a computer screen. In Experiment 2, control stimuli were added to the experimental arrangement. Across the two experiments, the magnitude of resurgence was greater when R1 was easy. In Experiment 2, both R1 and control responding were greater in the extinction phase than in the elimination phase in all conditions with all participants. The present study supports the hypothesis that response effort affects resurgence and that less effortful responses are likely to recur with greater magnitude under conditions that produce resurgence than are their more effortful counterparts.

Further evaluation of treatment duration on the resurgence of destructive behavior

Translation of promising procedures for mitigating treatment relapse has received considerable attention recently from researchers across the basic-applied continuum. One procedure that has demonstrated mixed support involves increasing the duration of treatment as a strategy for blunting resurgence. In a recent translational study, Greer et al. (2020) failed to detect a mitigation effect of increased treatment duration on the resurgence of destructive behavior. However, design limitations may have been responsible. The present study corrected these limitations by (a) employing a sequential design to decrease the possibility of multiple-treatment interference, (b) evaluating more treatment durations, (c) arranging treatments of fixed durations, and (d) conducting treatments of more extreme duration in a different clinical sample. Despite these improvements in experimental rigor and the testing of more extreme boundary conditions, the present study also failed to detect a mitigation effect of increased treatment duration. Likely explanations are discussed.

Assessing human performance during contingency changes and extinction tests in reversal-learning tasks

Serial reversal-learning procedures are simple preparations that allow for a better understanding of how animals learn about environmental changes, including flexibly shifting responding to adapt to changing reinforcement contingencies. The present study examined serial reversal learning with humans by arranging both midsession and variable contingency reversals across two experiments. We also examined the effects of extinction by adding nonreinforced trials at the end of later sessions and provided the first evaluation of effects of win-stay/lose-shift versus counting strategies on accuracy and response latency of humans' reversal-learning performance. In each experiment, responding tracked contingency reversals, primarily with participants using either win-stay/lose-shift or counting strategies. Introducing variable reversal points in the second experiment resulted in near-exclusive win-stay/lose-shift responding among participants and eliminated counting of trials. Each experiment also revealed an immediate shift from S2 to S1 after experiencing extinction during the initial test trial, indicating resurgence of the initial response through a win-stay/lose-shift response pattern. Therefore, the present study replicates and extends prior findings of a win-stay/lose shift response pattern in situations of greater uncertainty. These findings suggest that differences in environmental certainty induce qualitatively different decision-making strategies.

Validating Human-Operant Software: A Case Example

Human-operant experiments conducted with computer software facilitate translational research by assessing the generality of basic research findings and exploring previously untested predictions about behavior in a cost-effective and efficient manner. However, previous human-operant research with computer-based tasks has included little or no description of rigorous validation procedures for the experimental apparatus (i.e., the software used in the experiment). This omission, combined with a general lack of guidance regarding how to thoroughly validate experimental software, introduces the possibility that nascent researchers may insufficiently validate their computer-based apparatus. In this paper, we provide a case example to demonstrate the rigor required to validate experimental software by describing the procedures we used to validate the apparatus reported by Smith and Greer (2021) to assess relapse via a crowdsourcing platform. The validation procedures identified several issues with early iterations of the software, demonstrating how failing to validate human-operant software can introduce confounds into similar experiments. We describe our validation procedures in detail so that others exploring similar computer-based research may have an exemplar for the rigorous testing needed to validate computer software to ensure precision and reliability in computer-based, human-operant experiments.

A Theory of the Extinction Burst

A preliminary theory of a temporary increase in the rate of an operant response with the transition to extinction (i.e., the extinction burst) is proposed. The theory assumes reinforcers are events permitting access to some valuable activity, and that such activity can compete for allocation with the target response under some conditions (e.g., very high reinforcement rates). With the transition to extinction, elimination of this competition for allocation can produce an increase in the the target response, but the increase is transient because the value of the target response decreases with exposure to extinction. The theory provides a way to understand why the extinction burst is not ubiquitous, seems more common following very small ratio schedules, occurs for a short period of time following the transition to extinction, and may be eliminated with the availability of alternative reinforcement. It appears to provide a reasonable starting point for a theory of the extinction burst that does not necessarily require inclusion of invigorating effects of frustration, and it is closely aligned with Resurgence as Choice theory. Additional research on factors modulating reinforcement-related activities and how they affect the extinction burst could help to further evaluate the theory.

Gradual Change Procedures in Behavior Analysis

A wide variety of procedures within behavior analysis use gradual change in stimuli, response requirements, reinforcement, or some combination thereof, to effectively change behavior. Such procedures include shaping, thinning, fading, and chaining. Collectively, gradual change procedures represent a conceptually systematic technology of behavior change with wide-ranging empirical support across diverse settings and contexts. However, navigating the gradual change literature can be challenging. Similar terms are used to describe functionally distinct procedures (e.g., stimulus fading, delay fading, demand fading), and distinct terms are used to describe functionally similar procedures (e.g., leaning, demand fading). I propose a taxonomy in which gradual change procedures are categorized according to the functional component of the contingency on which they act. Three broad categories are proposed: Gradual Changes in Discriminative Stimuli, Response Requirement, and Reinforcement. I provide examples of research in each category, across basic and applied settings, including terminology used by the author(s) to describe each procedure. Finally, I discuss benefits of this framework for consumers of the literature.

Resurgence Increases with Repetition

Resurgence refers to a behavioral process in which a recent response is extinguished (or reinforcement conditions worsen) and a previously extinguished response recurs. In previous research, resurgence has been reliably produced when the resurgence procedure is repeated. Changes in the degree of increase of the resurging response across iterations of the procedure have been inconsistent, however, with some studies showing increases and some showing no changes or decreases in resurgence magnitude. The present study examined the nature of resurgence across repeated iterations of the conventional resurgence procedure by exposing four pigeons to the resurgence procedure six times in succession. In the first condition of the resurgence procedure, pecks on one key (e.g., the left) were reinforced under a variable-interval (VI) 30-s schedule. In the second condition pecks on that key were extinguished, and pecks on another key (e.g., the right) were reinforced under the same schedule. In the final condition there were no programmed consequences for either response. Resurgence was observed in 21 of 24 opportunities (87.5%). Iteration-over-iteration increases in resurgence were observed in 15 of 20 opportunities (75.0%), and this increase was found to be statistically significant. These findings demonstrate that, under certain conditions, resurgence generally increases in magnitude with repeated exposure to the procedures that generate it.

The effects of large, small, and thinning magnitudes of alternative reinforcement on resurgence

Resurgence refers to an increase of a previously reinforced target behavior following the worsening of conditions for a more recently reinforced alternative behavior. There is evidence to suggest that alternative reinforcers of greater magnitude are more effective at reducing target responding but may also result in more resurgence when removed. Similar effects have been observed with high rates of alternative reinforcement. However, in clinical settings, reinforcement rate thinning is used to reduce the likelihood of resurgence associated with higher rates of alternative reinforcement. Given the clinical importance of alternative reinforcer magnitude, it is necessary to evaluate how reinforcer magnitude thinning may impact resurgence as well. Following Phase 1 in which target responding was reinforced, rats earned either large (six pellets), small (one pellet), or thinned (reduced from six pellets to one across sessions) magnitude reinforcement for alternative responding during target-response extinction in Phase 2. Then, alternative responding was placed on extinction for all groups in Phase 3. Target responding was comparably elevated at the end of Phase 2 for groups Small and Thin compared to group Large. In Phase 3, resurgence was evident only in group Large but target responding remained relatively elevated in groups Small and Thin. These results provide additional evidence of the important interplay between conditions of alternative reinforcement and the persistence and resurgence of target responding.

Phase duration and resurgence

Resurgence, the recurrence of responding due to a worsening of reinforcement conditions for current behavior, is a prevalent form of treatment relapse. Resurgence as Choice in Context predicts that increasing the duration of exposure to reinforcement for target responding during Phase 1 will increase resurgence magnitude, whereas increasing the duration of exposure to reinforcement for alternative responding and extinction for target responding during Phase 2 will decrease resurgence magnitude. We conducted an experiment evaluating these predictions with human participants recruited through Amazon's Mechanical Turk platform. We varied Phase 1 and Phase 2 durations across 4 experimental groups. Resurgence as Choice in Context successfully predicted the differences in resurgence magnitude across these groups, and fitting the quantitative model to the obtained data yielded an exceptional coefficient of determination. We discuss the implications of these results for using Resurgence as Choice in Context to inform experiments with human participants and the feasibility of using human-operant preparations to evaluate resurgence.

Resurgence during transitions from variable- to fixed-interval schedules

The effects of local periods of extinction on resurgence following transitions from variable-interval (VI) to fixed-interval (FI) schedules were studied using four pigeons exposed to a within-session resurgence procedure. Each session was divided into a Training (T) Alternative-Reinforcement (AR), and Resurgence Test (RT) phase. During the T phase, key pecking was reinforced under a VI 60-s schedule on one key. In the AR phase, responses reinforced in the T phase were extinguished, while responses to a different key were reinforced under a VI 90-s schedule. Next, responding to the same key that produced reinforcers in the AR phase was reinforced according to four different RT conditions: RT phase I (FI 90 s), RT phase II (FI 180 s), RT phase III (FI 45 s), or RT phase IV (extinction). The frequency of resurgence generally was an inverse function of the rate of reinforcement in the RT phase. Resurgence occurred less often when reinforcers were delivered under the FI 45-s schedule and more often under leaner schedules in the RT phase, peaking under extinction. The results show that resurgence may occur during local periods of extinction, with larger and more consistent effects occurring when the rate of reinforcement in the RT condition is leaner than it was during the preceding AR phase.

Applied Quantitative Analysis of Behavior: What It Is, and Why We Care-Introduction to the Special Section

Science evolves from prior approximations of its current form. Interest in changes in species over time was not a new concept when Darwin made his famous voyage to the Galapagos Islands; concern with speciation stretches back throughout the history of modern thought. Behavioral science also does and must evolve. Such change can be difficult, but it can also yield great dividends. The focus of the current special section is on a common mutation that appears to have emerged across these areas and the critical features that define an emerging research area-applied quantitative analysis of behavior (AQAB). In this introduction to the "Special Issue on Applications of Quantitative Methods," we will outline some of the common characteristics of research in this area, an exercise that will surely be outdated as the research area continues to progress. In doing so, we also describe how AQAB is relevant to theory, behavioral pharmacology, applied behavior analysis, and health behaviors. Finally, we provide a summary for the articles that appear in this special issue. The authors of these papers are all thinking outside the Skinner box, creating new tools and approaches, and testing them against relevant data. If we can keep up this evolution of methods and ideas, behavior analysis will regain its place at the head of the table!

Examining effects of training duration on humans' resurgence and variability using a novel touchscreen procedure

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence.

Evaluating Extinction, Renewal, and Resurgence of Operant Behavior in Humans with Amazon Mechanical Turk

Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace providing researchers with the opportunity to collect behavioral data from remote participants at a low cost. Recent research demonstrated reliable extinction effects, as well as renewal and resurgence of button pressing with MTurk participants. To further examine the generality of these findings, we replicated and extended these methods across six experiments arranging reinforcement and extinction of a target button press. In contrast to previous findings, we did not observe as reliable of decreases in button pressing during extinction (1) after training with VR or VI schedules of reinforcement, (2) in the presence or absence of context changes, or (3) with an added response cost for button pressing. However, we found that that a 1-point response cost for all button presses facilitated extinction to a greater extent than the absence of response cost. Nevertheless, we observed ABA renewal of button pressing when changing background contexts across phases and resurgence when extinguishing presses on an alternative button. Our findings suggest that MTurk could be a viable platform from which to ask and address questions about extinction and relapse processes, but further procedural refinements will be necessary to improve the replicability of control by experimental contingencies.

Examination of alternative-response discrimination training and resurgence in rats

Resurgence is an increase in a previously reinforced behavior following a worsening of conditions for a more recently reinforced behavior. Discrimination training is incorporated into treatment for problem behavior to prevent treatment adherence failures that may result in resurgence. There is evidence that resurgence may be reduced when a stimulus that signals alternative-response extinction is present compared with absent; however, the generality of this effect is unknown given the limited testing conditions. The goal of the present experiments was to further examine the effects of such stimuli in a reverse-translational evaluation using rats. Target responding was reinforced in baseline and then placed on extinction in the following discrimination-training phase. An alternative response was differentially reinforced in a two-component multiple schedule where one stimulus (i.e., S^D) signaled alternative-response reinforcement and the other (i.e., S^Δ) signaled extinction. Experiment 1 assessed resurgence in both the S^Δ and S^D when alternative reinforcement was removed. Experiment 2 evaluated resurgence under conditions that better approximated those used in the clinic in which the alternative-response S^Δ was present or absent. The S^Δ failed to suppress target responding during resurgence testing in both experiments. These findings suggest that the conditions under which an alternative-response S^Δ will successfully mitigate resurgence may be limited and require further research.

Resurgence and repeated within-session progressive-interval thinning of alternative reinforcement

Resurgence of a previously suppressed target behavior is common when reinforcement for a more recently reinforced alternative behavior is thinned. To better characterize such resurgence, these experiments examined repeated within-session alternative reinforcement thinning using a progressive-interval (PI) schedule with rats. In Experiment 1, a transition from a high rate of alternative reinforcement to a within-session PI schedule generated robust resurgence, but subsequent complete removal of alternative reinforcement produced no additional resurgence. Experiment 2 replicated these findings and showed similar effects with a fixed-interval (FI) schedule arranging similarly reduced session-wide rates of alternative reinforcement. Thus, the lack of additional resurgence following repeated exposure to the PI schedule was likely due to the low overall obtained rate of alternative reinforcement provided by the PI schedule, rather than to exposure to within-session reinforcement thinning per se. In both experiments, target responding increased at some point in the session during schedule thinning and continued across the rest of the session. Rats exposed to a PI schedule showed resurgence later in the session and after more cumulative alternative reinforcers than those exposed to an FI schedule. The results suggest the potential importance of further exploring how timing and change-detection mechanisms might be involved in resurgence.

Further evaluation of a nonsequential approach to studying operant renewal

Basic-laboratory assessments of renewal may inform clinical efforts to maintain reduction of severe destructive behavior when clients transition between contexts. The contextual changes arranged during standard renewal procedures, however, do not necessarily align with those that clients experience during outpatient therapy. More specifically, clients transition between clinical (associated with extinction for target behavior) and home/community (associated with reinforcement for target behavior) contexts during outpatient treatment. Standard renewal assessments do not incorporate these contextual alternations during treatment. The present experiment aimed to directly compare renewal of rats' lever pressing following a standard ("sequential") ABA renewal procedure (i.e., baseline in Context A, extinction in Context B, renewal test in Context A) and a "nonsequential" renewal assessment wherein treatment consisted of daily alternation between Context A (associated with reinforcement for lever pressing) and Context B (associated with extinction). Lever pressing renewed to a greater extent for rats in the Nonsequential group than for rats in the Sequential group, suggesting the contextual changes that clients experience during outpatient treatment for severe destructive behavior may be a variable that is important to consider in translational research on renewal. Potential implications of these findings for basic and clinical research on renewal are discussed.

An investigation of resurgence of reinforced behavioral variability in humans

The present study examined resurgence of reinforced variability in college students, who completed a 3-phase computer-based variability task. In the first phase, baseline, points were delivered for drawing rectangles that sufficiently differed from previous rectangles in terms of a target dimension (size or location, counterbalanced) but were sufficiently similar in terms of the alternative dimension. In the second phase, alternative, points were only delivered for rectangles that were sufficiently different in terms of the alternative dimension, but repetitive in terms of the target dimension. In the third phase, extinction, no points were delivered. In baseline, participants made rectangles that were highly varied in terms of the target dimension and less varied in terms of the alternative dimension, and vice versa in the alternative phase. During extinction, levels of variability increased for the target dimension, providing evidence for resurgence of reinforced variability of a specific dimension of behavior. However, levels of variability also remained high for the alternative dimension, indicating that extinction-induced response variability may also have impacted the results. Although future research is needed to explore other explanations, the results of this study replicate prior research with pigeons and provide some support for the notion of variability as an operant.

Resurgence and downshifts in alternative reinforcement rate

Resurgence refers to an increase in a previously suppressed target behavior with a relative worsening of conditions for a more recently reinforced alternative behavior. This experiment examined the relation between resurgence and the magnitude of a reduction in the rate of reinforcement for the alternative behavior. Groups of both male and female rats initially pressed a target lever for food on a variable-interval (VI) 30-s schedule. In a second phase, responding to the target lever was extinguished for all groups and pressing an alternative lever was reinforced on a VI 10-s schedule. Next, the rate of reinforcement for alternative behavior was reduced differentially across groups by arranging extinction, VI 80-s, VI 40-s, VI 20-s, or continued VI 10-s reinforcement. Target responding increased as an exponential function of the magnitude of the reduction in alternative reinforcement rates. With the exception that males appeared to show higher rates of target responding in baseline and higher rates of alternative responding in other phases, the overall pattern of responding across phases was not meaningfully different between sexes. The pattern of both target and alternative response rates across sessions and phases was well described quantitatively by the Resurgence as Choice in Context model.

Effects of response cost magnitude on resurgence of human operant behavior

Extensive research has been dedicated to the study of resurgence following extinction and differential reinforcement of alternative behavior. Less is known about the effects of punishment on resurgence. This study extended previous research by examining whether the magnitude of response cost punishment affects resurgence of human operant behavior. College students engaged in a computer task using the three-phase resurgence procedure where points were used to reinforce target (Phase 1) or alternative (Phase 2) behavior. Across three groups, Phase 2 contingencies for the target response were manipulated. In one group, only extinction was implemented. In the other two groups, response cost was also implemented. Response cost was equal to or double the number of points that could be gained for alternative responding. Resurgence was similar in Phase 3 across the three groups, demonstrating that neither the addition nor the magnitude of punishment differentially affected response recovery under these conditions. Future research should examine other parameters of punishment (e.g., delay, schedule) and how these variables interact with different parameters of alternative reinforcement to increase our understanding of the conditions under which resurgence may be exacerbated or minimized.

Resurgence following differential reinforcement of alternative behavior implemented with and without extinction

In the clinic, differential reinforcement of alternative behavior (DRA) often involves programming extinction for destructive behavior while reinforcing an alternative form of communication (e.g., a functional communication response); however, implementing extinction can be unsafe or impractical under some circumstances. Quantitative theories of resurgence (i.e., Behavioral Momentum Theory and Resurgence as Choice) predict differences in the efficacy of treatments that do and do not involve extinction of target responding when reinforcement conditions maintaining alternative responding worsen. We tested these predictions by examining resurgence following two DRA conditions in which we equated rates of reinforcement. In DRA without extinction, target and alternative behavior produced reinforcement. In DRA with extinction plus noncontingent reinforcement, only alternative behavior produced reinforcement. We conducted this study in a reverse-translation sequence, first with participants who engaged in destructive behavior (Experiment 1) and then in a laboratory setting with rats (Experiment 2). Across both experiments, we observed proportionally lower levels of target responding during and following the DRA condition that arranged extinction for the target response. However, levels of resurgence were similar following both arrangements.

Cues Associated with Alternative Reinforcement During Extinction Can Attenuate Resurgence of an Extinguished Instrumental Response

In resurgence, a target behavior (R1) is acquired in an initial phase and extinguished in a second phase while an R2 behavior is reinforced. When R2 is extinguished, R1 behavior can return or resurge. Two experiments tested the effectiveness of a potential retrieval cue associated with extinction in attenuating resurgence. Experiment 1 established that a 2-s cue paired with outcome delivery in Phase 2 can attenuate resurgence when presented during testing. This effect depended on the cue being associated with the outcome, and it occurred if the cue was delivered contingently or noncontingently on responding during testing. Pairing the cue with reinforcement might be necessary to maintain attention to it during Phase 2. Experiment 2 demonstrated that the cue must be experienced in sessions that also include R1 extinction and that it does not reduce resurgence through a conditioned reinforcement mechanism. The results suggest that previously neutral stimuli can attenuate resurgence if they are first paired with alternative reinforcement and presented in sessions in which R1 is extinguished. They build on existing literature that suggests enhancing generalization between extinction and testing reduces resurgence. The results may have implications for reducing relapse following interventions in humans such as contingency management (CM), in which participants can earn vouchers contingent upon drug abstinence. A cue associated with CM might help reduce this relapse.

The control response in assessing resurgence: Useful or compromised tool?

Resurgence experiments sometimes include an operandum on which a history of reinforcement has not been experimentally established. The purpose of this control operandum is to rule out a generalized increase in responding when the alternative response is extinguished as being the cause of the resurgent target response. A review of the results of experiments conducted with both nonhumans and humans in which a control operandum was included shows that control- operandum responding is more common in the latter and almost nonexistent in the former. Both the presence and absence of responding on the control operandum, however, are subject to multiple interpretations thereby rendering it a compromised tool. Alternatives to using a control operandum to rule out extinction induction as the basis for resurgence include a preresurgence test control procedure and a differential resurgence procedure.

Resurgence as Choice: Implications for promoting durable behavior change

Resurgence is an increase in a previously suppressed behavior resulting from a worsening in reinforcement conditions for current behavior. Resurgence is often observed following successful treatment of problem behavior with differential reinforcement when reinforcement for an alternative behavior is subsequently omitted or reduced. The efficacy of differential reinforcement has long been conceptualized in terms of quantitative models of choice between concurrent operants (i.e., the matching law). Here, we provide an overview of a novel quantitative model of resurgence called Resurgence as Choice (RaC), which suggests that resurgence results from these same basic choice processes. We review the failures of the only other quantitative model of resurgence (i.e., Behavioral Momentum Theory) and discuss its shortcomings with respect to the limited range of circumstances about which it makes predictions in applied settings. Finally, we describe how RaC overcomes these shortcomings and discuss implications of the model for promoting durable behavior change.

Resurgence in humans: Reducing relapse by increasing generalization between treatment and testing

Resurgence is the increase in performance of an extinguished instrumental (operant) response that accompanies the extinction of a response that has been reinforced to replace it. Resurgence may involve processes that are relevant for understanding relapse in applied and clinical settings. While resurgence is known to be a robust phenomenon in human operant extinction, the processes that control it remain unclear. Here we asked whether human resurgence is controlled by processes that are similar to those that have been identified in animals by asking whether two methods that reduce resurgence in animals also reduce it in humans. Participants first learned to make an operant response (R1) for a tangible food reinforcer (O1). In a second phase (Phase 2), R1 was extinguished while a second response (R2) was introduced and reinforced with a virtual monetary reward (USD $0.10 coins; O2). In a test phase, extinction was then introduced for R2 and resurgence of R1 was assessed. In Experiment 1, resurgence that occurred after the treatment just described was attenuated if there had been periodic exposure to R2 extinction during the treatment phase (Phase 2). In Experiment 2, resurgence was prevented when O2, but not O1, was presented noncontingently during the test. The results are among the first to suggest a mechanism underlying resurgence in humans, namely, renewal caused by contextual change. They also provide initial evidence to suggest that resurgence may be the result of common processes in animals and humans. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Resurgence of a target behavior suppressed by a combination of punishment and alternative reinforcement

Differential-reinforcement-based treatments involving extinction of target problem behavior and reinforcement of an alternative behavior are highly effective. However, extinction of problem behavior is sometimes difficult or contraindicated in clinical settings. In such cases, punishment instead of extinction may be used in combination with alternative reinforcement. Although it is well documented that omitting alternative reinforcement can produce recurrence (i.e., resurgence) of behavior previously suppressed by extinction plus alternative reinforcement, it remains unclear if resurgence similarly occurs for behavior previously suppressed by punishment plus alternative reinforcement. The present experiment examined this question with rats. In Phase 1, a target behavior (lever pressing) was reinforced with food pellets. In Phase 2, the target behavior continued to be reinforced, but it also produced mild foot shock and an alternative behavior (nose poking) also produced food. Finally, all consequences were removed and resurgence of target behavior occurred. Resurgence did not occur for another group that similarly received punishment of target behavior in Phase 2 but not alternative reinforcement. These results indicate that resurgence was a product of the history of exposure to and then removal of alternative reinforcement and that the removal of punishment alone did not produce resurgence of target behavior.

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.

Baseline reinforcement rate and resurgence of destructive behavior

Concepts from behavioral momentum theory, along with some empirical findings, suggest that the rate of baseline reinforcement may contribute to the relapse of severe destructive behavior. With seven children who engaged in destructive behavior, we tested this hypothesis in the context of functional communication training by comparing the effects of different baseline reinforcement rates on resurgence during a treatment challenge (i.e., extinction). We observed convincing resurgence of destructive behavior in four of seven participants, and we observed more resurgence in the condition associated with high-rate baseline reinforcement (i.e., variable-interval 2 s in Experiment 1 or fixed-ratio 1 in Experiment 2) compared to a low-rate baseline reinforcement condition. We discuss the implications of these results relative to schedules of reinforcement in the treatment of destructive behavior and strategies to mitigate resurgence in clinical settings.

Assessing the repeatability of resurgence in humans: Implications for the use of within-subject designs

Resurgence refers to the recurrence of a previously reinforced response following the worsening of reinforcement conditions (e.g., extinction) for an alternative response. Because of the implications for treatment relapse, researchers have become particularly interested in mitigating resurgence of human behavior. Some studies have employed reversal designs and varied parameters across replications (e.g., ABCADC) to compare effects of second-phase variables. Although resurgence is generally repeatable within and between subjects, the extent to which similar levels of resurgence occur across replications is less clear. To assess the repeatability of resurgence, we conducted a secondary analysis of 62 human-operant data sets using ABCABC reversal designs from two laboratories in the United States. We found significant reductions in the magnitude of resurgence during the second exposure to extinction relative to the first exposure when all other phase variables were held constant. These results suggest that researchers should exercise caution when using within-subject, across-phase replications to compare resurgence between variable manipulations with human participants.

Resurgence when challenging alternative behavior with progressive ratios in children and pigeons

Resurgence is defined as the recurrence of a previously reinforced and then extinguished target response when reducing or eliminating a more recently reinforced alternative response. In experiments with children and pigeons, we evaluated patterns of resurgence across and within sessions through decreases in reinforcer availability by challenging alternative responding with extinction and progressive-ratio schedules. In Phase 1, we reinforced only target responding. In Phase 2, we extinguished target responding while reinforcing an alternative response. Finally, Phase 3 assessed resurgence by (a) extinguishing alternative responding versus (b) introducing a progressive-ratio schedule of reinforcement for alternative responding. In both children and pigeons, resurgence of target responding occurred in both conditions but generally was greater when assessed during extinction than with progressive ratios. Importantly, within-session patterns of resurgence did not differ between testing with progressive ratios and extinction. Resurgence with progressive ratios tended to be greater with longer durations between reinforcers but we observed similar findings with only simulated reinforcers during extinction testing. Therefore, the present investigation reveals that the events contributing to instances of resurgence remain to be understood, and presents an approach from which to examine variables influencing within-session patterns of resurgence.