Behavioral momentum theory fails to account for the effects of reinforcement rate on resurgence

A parametric manipulation and meta-analysis of target-response punishment on resurgence

Resurgence can be defined as increases in previously reinforced and subsequently extinguished target responding when conditions for an alternative response worsen. Worsening of alternative conditions, such as extinction, has been linked to relapse of clinically relevant behavior. Preclinical researchers have evaluated whether punishing target responses while differentially reinforcing an alternative response could reduce resurgence when conditions are worsened with extinction, with mixed results. In the present investigation, we systematically replicated this line of research with human participants recruited via crowdsourcing, using response cost as punishment. During Phase 1, we reinforced target responses with 100 points per delivery, exchangeable for money. During Phase 2, we reinforced alternative responses, discontinued point reinforcement for target responses, and parametrically manipulated across groups the magnitude of point loss (1, 100, 320, or 1,000 points) contingent on target responses. During Phase 3, we tested for resurgence by extinguishing target and alternative responses. Added punishment systematically decreased target responding during Phase 2 but did not influence resurgence during Phase 3. With a meta-analysis, we compared our findings with existing research examining a range of punishers and species. The results of the meta-analysis comport with the present findings, suggesting that the inclusion of punishment reduces target responding during DRA but, overall, has no systematic effects on resurgence.

Resurgence mitigation across extended extinction following four and eight cycles of on/off alternative reinforcement

Resurgence is an increase in an extinguished operant response resulting from a worsening of conditions (e.g., extinction) for a more recently reinforced alternative behavior. Previous research has shown that exposure to cycles of alternative reinforcement available versus unavailable (i.e., on/off alternative reinforcement) across sessions can reduce subsequent resurgence. Most previous assessments of the procedure have examined target operant responding during only single-session resurgence tests, and it remains unclear if exposure to relatively few cycles of on/off alternative reinforcement can maintain low rates of target behavior across extended exposure to extinction. This experiment with rats examined the effects of 4 or 8 cycles of on/off alternative reinforcement on subsequent resurgence during a 10-session extinction test. The results show that exposure to 4 cycles of on/off alternative reinforcement is as effective as 8 cycles in producing low rates of target behavior during treatment and across extended extinction. This result is consistent with extant theories of resurgence and suggests that on/off alternative reinforcement could have translational utility following relatively few cycles of exposure.

Punishment-induced resurgence

The phenomenon of extinction-induced resurgence is well established, but there is comparatively little experimental evidence for punishment-induced resurgence. Punishment-induced resurgence can by tested by contingent shocks following the alternative response. The purpose of Experiment 1 was to test whether low-intensity shocks, that do not decrease rate of reinforcement, result in resurgence. Four rats served as subjects. Rats were exposed to three sequential conditions: (a) variable-interval (VI) 30-s food delivery for a lever press (target response); (b) VI 30-s food delivery for a nose poke (alternative response) and extinction of the lever press; (c) VI 30-s reinforcement for a nose poke with superimposed VI 60-s shock delivery. In the final condition, shocks increased gradually from 0.1 to 0.5 mA. Experiment 2 evaluated whether an abrupt introduction of a high-intensity shock would result in resurgence. Three rats served as subjects and were exposed to three sequential conditions: (a) VI 30-s food delivery for a lever press; (b) VI 30-s food delivery for a nose poke and extinction of the lever press; (c) continued VI 30-s reinforcement for a nose poke with superimposed VI 60-s 0.6 mA shock delivery. Resurgence was observed in all subjects, including in situations in which rate of responding, but not rate of reinforcement, decreased. The present study provides additional evidence for punishment-induced resurgence, but future studies are warranted to determine the extent to which punishment can produce resurgence with or without decreases in rates of reinforcement.

Synthesized alternative reinforcement and resurgence

In treatments based on differential reinforcement of alternative behavior, applied researchers and clinicians often provide multiple, qualitatively different reinforcers (i.e., synthesized reinforcement) rather than a single reinforcer (i.e., isolated reinforcement) contingent on alternative behavior. Some research shows that providing synthesized reinforcement for alternative responses within such treatments produces more rapid and complete suppression of target behavior; however, there is limited research evaluating the durability of these effects during treatment disruptions. Conceptual explanations of resurgence (e.g., resurgence as choice, context theory) suggest that treatments that include synthesized alternative reinforcement may lead to more resurgence of target behavior when alternative reinforcement is disrupted relative to treatments using isolated reinforcement. We evaluated this hypothesis within a three-phase resurgence evaluation. We exposed rats to isolated or synthesized reinforcement for alternative responding in the second phase, and we exposed rats to extinction in the third phase. Synthesized alternative reinforcement produced more rapid and complete suppression of target behavior than did isolated reinforcement in the second phase; however, exposure to extinction following synthesized reinforcement produced more resurgence. We discuss these results in terms of their implications for applied research and their support for current conceptual explanations for resurgence.

Abstinence as Choice: Exploring Voluntary Abstinence from Alcohol Self-Administration Using the Resurgence-as-Choice Framework

Resurgence is an increase in the rate of a previously suppressed behavior that occurs when an alternative source of reinforcement is made worse in some way. The Resurgence as Choice model offers a quantitative approach to understanding resurgence that may provide important insights into the variables that affect this form of relapse in the natural environment. Bringing this model to bear on relapse following reinforcement-based interventions for alcohol and other substance use disorders, however, may not be straightforward. Laboratory work on which the Resurgence as Choice model is based has almost exclusively focused on resurgence following extinction of target behavior, but abstinence from alcohol during intervention is often voluntary: Patients may drink alcohol and forfeit therapeutic reinforcers at any time. In this article, we first will review recent data from our group that demonstrate a method for studying resurgence following voluntary abstinence from alcohol seeking in rats. In a previous experiment, we reduced rats' alcohol-maintained lever pressing to low levels without placing it on extinction by arranging nondrug differential reinforcement of other behavior. Further, when we suspended nondrug reinforcement, resurgence of lever pressing occurred. Next, we will explore methods for modeling these outcomes using the Resurgence-as-Choice framework. We conclude that the data under consideration may not be sufficient to discriminate between candidate models of resurgence following voluntary abstinence and point to areas for future empirical and theoretical development. This work may provide a stronger bridge between preclinical and conceptual work on resurgence and clinical treatments for alcohol use disorder.

Resurgence of ethanol seeking following voluntary abstinence produced by nondrug differential reinforcement of other behavior

Resurgence refers to the relapse of a target behavior following the worsening of a source of alternative reinforcement that was made available during response elimination. Most laboratory analyses of resurgence have used a combination of extinction and alternative reinforcement to reduce target behavior. In contingency-management treatments for alcohol use disorder, however, alcohol use is not placed on extinction. Instead, participants voluntarily abstain from alcohol use to access nondrug alternative reinforcers. Inasmuch, additional laboratory research on resurgence following voluntary abstinence is warranted. The present experiment evaluated resurgence of rats' ethanol seeking following voluntary abstinence produced by differential reinforcement of other behavior (DRO). Lever pressing produced ethanol reinforcers during baseline phases. During DRO phases, lever pressing continued to produce ethanol and food reinforcers were delivered according to resetting DRO schedules. Ethanol and food reinforcers were suspended during resurgence test phases to evaluate resurgence following voluntary abstinence. Lever pressing was elevated during baseline phases and occurred at near-zero rates during DRO phases. During the resurgence test phases, lever pressing increased, despite that it no longer produced ethanol. The procedure introduced here may help researchers better understand the variables that affect voluntary abstinence from ethanol seeking and resurgence following voluntary abstinence.

Updated Recommendations for Reinforcement Schedule Thinning following Functional Communication Training

Schedule thinning is a necessary treatment procedure following the acquisition of a communication response during functional communication training. In this article, we update and extend the Hagopian et al. Behavior Analysis in Practice, 4, 4-16, (2011) review and recommendations on schedule-thinning procedures following functional communication training. Since their publication, substantial research has been published on the efficacy, efficiency, and social validity of schedule-thinning methods. We provide updated recommendations for schedule thinning based on contemporary literature that has been published since 2011, as well as discuss key areas for future research.

Resurgence Following Higher or Lower Quality Alternative Reinforcement

Resurgence is a temporary increase in a previously suppressed target behavior following a worsening in reinforcement conditions. Previous studies have examined how higher rates or magnitudes of alternative reinforcement affect suppression of the target behavior and subsequent resurgence. However, there has been no investigation of the effects of higher versus lower qualities of alternative reinforcement on resurgence. Using a three-phase resurgence preparation with rats, the present experiments examined the effects of an alternative reinforcer that was of higher (Experiment 1) or lower (Experiment 2) quality than the reinforcer that had previously maintained the target behavior. The results of both experiments showed greater reductions in target behavior with a higher quality alternative reinforcer and larger increases in target responding when a higher quality alternative reinforcer was removed. Along with prior findings with higher rates and magnitudes of alternative reinforcement, these findings suggest that variations in reinforcer dimensions that increase the efficacy of alternative reinforcement also tend to increase resurgence when alternative reinforcement is removed. The results are discussed in terms of the resurgence as choice in context model and in terms of potential clinical implications.

Translational evaluation of on/off alternative reinforcement cycling

Cycling between the availability and unavailability of reinforcement for alternative responding has successfully reduced resurgence in basic laboratory evaluations, but this approach represents a marked departure from current standards of care when treating problem behavior, warranting careful translation before its use clinically. Therefore, with extinction arranged for target responding across groups in Phase 2, we evaluated the effects of cycling between the availability and unavailability of differential reinforcement of alternative behavior (DRA) using a computer-based task with adult humans recruited through Amazon MTurk. Two control groups experienced constant DRA in Phase 2, with one group experiencing a dense DRA schedule and another group experiencing a lean DRA schedule. The cycling DRA group tended to show greater reductions in target responding and improved discrimination in Phase 2 and less target responding across Phases 2 and 3 than the lean DRA and dense DRA groups. These preliminary findings suggest that on/off DRA cycling procedures may produce more desirable treatment outcomes than constant DRA without producing negative side effects; however, further research is needed to confirm these possibilities.

Resistance to change, of behavior and of theory

The persistence of operant behavior when disrupted tends to be positively related to how often reinforcers were delivered in the past. Behavioral momentum theory describes this finding as the outcome of Pavlovian processes. That is, the relation between discriminative stimuli and reinforcers that were delivered in their presence strengthens behavior, thereby making it more likely to persist. If only the story were that simple. A growing number of findings challenge the basic tenets of behavioral momentum theory. Some even call into question whether Pavlovian relations contribute to persistence in the first place. In this paper, I will review behavioral momentum theory and some of the data that have been problematic for the theory. I will argue that despite these very real challenges, the theory provides important utility not only to basic analyses of response persistence but also to clinical interventions directed at long-term reductions in problem behavior. It, for example, has set the stage for the development of alternative conceptual analyses of resistance to change, two of which will be highlighted for readers. Moreover, behavioral momentum theory may tell us something important about the reasons it continues to have an influence on the field, despite the challenging data that deter it.

Examining resurgence in rats following expanded-operant treatments

Resurgence of previously reinforced behavior represents a challenge to otherwise successful interventions based on differential reinforcement of alternative behavior (DRA). Expanded-operant treatments seek to increase the number of functional alternative behaviors through DRA, thereby potentially mitigating resurgence. However, the few studies that have directly examined these methods as a tool for resurgence mitigation have provided limited and unclear results. Thus, the present experiments were designed to investigate the effect of expanded-operant DRA methods on resurgence of previously reinforced behavior using rat subjects. In two experiments, following a baseline phase in which a target response was trained, groups of rats experienced concurrent (i.e., five simultaneous alternative responses), serial (i.e., five sequentially available alternative responses), or single DRA interventions arranging similar rates of alternative reinforcement in order to examine potential differences in resurgence. Both experiments showed that neither serial nor concurrent DRA expanded-operant treatments reduced resurgence compared with single DRA regardless of whether stimuli associated with previously reinforced alternative responses were removed (Experiment 1) or remained present (Experiment 2) for the serial-DRA group. Further, a primacy effect in resurgence was obtained for the serial-DRA group in both experiments. Overall, these results suggest that expanded-operant treatments may not help to reduce resurgence.

Resurgence of destructive behavior following differential rates of alternative reinforcement

Behavioral momentum theory (BMT) suggests that resurgence of destructive behavior may be at least partly determined by the rate of alternative reinforcement, with lean schedules of reinforcement producing less resurgence than dense schedules. Findings from basic and translational studies have been mixed, and the effects of alternative reinforcement rate on resurgence remain unclear. In the current study, we conducted a within-subject evaluation of resurgence during extinction with four children following functional communication training using dense and lean (BMT-informed) schedules of alternative reinforcement. We observed no reliable differences in resurgence across the dense and lean conditions. We discuss implications of these findings in relation to future research using quantitative analyses to evaluate the relative effects of alternative reinforcement rate and other BMT-based strategies for mitigating resurgence in applied settings.

Modeling Behavioral Persistence with Resurgence as Choice in Context (RaC2): A Tutorial

Resurgence as Choice in Context (RaC2) is a quantitative model for evaluating the reemergence of a previously extinguished response when alternative reinforcement is worsened. Rooted in the matching law, RaC2 proposes that allocation between target and alternative responding is based on changes in the relative value of each response option over time, accounting for periods with and without alternative reinforcement. Given that practitioners and applied researchers may have limited experience with constructing quantitative models, we provide a step-by-step task analysis for building RaC2 using Microsoft Excel 2013. We also provide a few basic learning activities to help readers better understand RaC2 itself, the variables that affect the model's predictions, and the clinical implications of those predictions.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40617-023-00796-y.

Relapse and its mitigation: Toward behavioral inoculation

Relapse following the successful treatment of problem behavior can increase the likelihood of injury and the need for more intensive care. Current research offers some predictions of how treatment procedures may contribute to relapse, and conversely, how the risk of relapse can be mitigated. This review describes relapse-mitigation procedures with varying levels of support, the quantitative models that have influenced the research on relapse mitigation, different experimental methods for measuring relapse mitigation, and directions for future research. We propose that by viewing the implementation of relapse-mitigation procedures as a means of producing behavioral inoculation, clinicians are placed in the proactive and intentional role of exposing their client's behavior to an array of reinforcement and stimulus conditions during treatment with the goal of decreasing the detrimental impact of future treatment challenges.

Operant ABA renewal during dense and lean schedules of differential reinforcement

Renewal is a type of relapse that occurs due to a change in context. Previous research has demonstrated that renewal of target responding may occur despite the availability of differential reinforcement for an alternative response (DRA). Nevertheless, the current literature on renewal presents mixed findings regarding the effects of dense and lean schedules of DRA on the magnitude of renewal. We used a translational approach with undergraduate college students and a task on a touchscreen tablet device to study the effects of dense and lean schedules of DRA during repeated renewal tests. All participants experienced two, three-phase ABA renewal arrangements. In the dense and lean renewal arrangements, we differentially reinforced alternative behavior in Context B and the renewal test in Context A on a VI 3-s or a VI 12-s schedule, respectively. Overall, we observed renewal in 31/36 (86%) renewal tests regardless of the density of reinforcement for the alternative response. Furthermore, the results showed that although renewal occurred in both arrangements, we found slightly higher magnitudes of renewal during DRA with lean schedules of reinforcement relative to dense schedules. We discuss the implications of these findings as they relate to the treatment of problem behavior.

A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40614-022-00361-y.

Response effort and resurgence

This study provides an initial translational examination of response effort and resurgence. Eleven typically developing adults and five adolescents with autism served as participants across two experiments. Participants received points for touching moving stimuli on a computer screen. The resurgence evaluation consisted of three phases: establishment wherein R1 was reinforced, elimination wherein R1 was placed on extinction while R2 was reinforced, and extinction wherein R1 and R2 no longer resulted in reinforcement. Rate of R1 during extinction was compared across three conditions: intermediate, easy, and difficult. Disparity in effort was created by manipulations of the size and speed of objects that moved about on a computer screen. In Experiment 2, control stimuli were added to the experimental arrangement. Across the two experiments, the magnitude of resurgence was greater when R1 was easy. In Experiment 2, both R1 and control responding were greater in the extinction phase than in the elimination phase in all conditions with all participants. The present study supports the hypothesis that response effort affects resurgence and that less effortful responses are likely to recur with greater magnitude under conditions that produce resurgence than are their more effortful counterparts.

Nondrug reinforcers contingent on alternative behavior or abstinence increase resistance to extinction and reinstatement of ethanol-maintained behavior

The effects of delivering nondrug alternative reinforcement on resistance to extinction and reinstatement of rats' ethanol-maintained lever pressing were evaluated in two experiments. In both, rats self-administered ethanol by lever pressing in a two-component multiple schedule during baseline. In the Rich component, alternative food reinforcement was made available for performing an alternative response (Experiment 1) or according to a differential-reinforcement-of-other-behavior schedule for lever pressing (Experiment 2). In the Lean component, only ethanol was available. Moreover, the frequency of alternative reinforcement was manipulated across conditions in Experiment 1. Following baseline, lever pressing was extinguished in both components by suspending ethanol reinforcement, and alternative food reinforcers were discontinued. Finally, to test for reinstatement, ethanol reinforcers were delivered independently of lever pressing in both components. In both experiments, proportion-of-baseline response rates were higher during extinction and reinstatement testing in the Rich component than in the Lean component (although differentiation was not observed at the lowest frequency of alternative reinforcement in Experiment 1). Thus, alternative nondrug reinforcers increased resistance to extinction and reinstatement of rats' ethanol-maintained lever pressing, even when those reinforcers were delivered contingently on an alternative response or on abstinence from lever pressing.

A Theory of the Extinction Burst

A preliminary theory of a temporary increase in the rate of an operant response with the transition to extinction (i.e., the extinction burst) is proposed. The theory assumes reinforcers are events permitting access to some valuable activity, and that such activity can compete for allocation with the target response under some conditions (e.g., very high reinforcement rates). With the transition to extinction, elimination of this competition for allocation can produce an increase in the the target response, but the increase is transient because the value of the target response decreases with exposure to extinction. The theory provides a way to understand why the extinction burst is not ubiquitous, seems more common following very small ratio schedules, occurs for a short period of time following the transition to extinction, and may be eliminated with the availability of alternative reinforcement. It appears to provide a reasonable starting point for a theory of the extinction burst that does not necessarily require inclusion of invigorating effects of frustration, and it is closely aligned with Resurgence as Choice theory. Additional research on factors modulating reinforcement-related activities and how they affect the extinction burst could help to further evaluate the theory.

Modeling resurgence with an evolutionary theory of behavior dynamics

McDowell's (2004) Evolutionary Theory of Behavior Dynamics (ETBD) is a computational theory that has reproduced a wide variety of behavioral phenomena observed in material reality. Here, we extended the generality of the ETBD by successfully replicating laboratory studies of resurgence with live animals using artificial organisms (AOs) animated by the theory. We ran AOs on concurrent random-interval random-interval (conc RI RI) schedules of reinforcement wherein one alternative (i.e., a target behavior) was reinforced while the other alternative (i.e., an alternative behavior) was not reinforced. Then, we placed the target behavior on extinction and reinforced the alternative response, producing a shift in allocation of responding from the target behavior to the alternative response. Finally, schedule thinning of the alternative response (i.e., downshifts) resulted in resurgence of target behavior. Our findings indicated that resurgence increased as a function of the relative downshift in reinforcement rate and magnitude, replicating findings from previous studies with live animals. These results further illustrate the utility of the ETBD for generating dynamic behavioral data and serve as a proof-of-concept for a novel computational approach for studying and understanding resurgence in future studies.

Translating Quantitative Theories of Behavior into Improved Clinical Treatments for Problem Behavior

The most important advancement in the treatment of destructive behavior has been the development of the functional analysis, which is used to prescribe effective treatments like functional communication training. Although this approach can be highly effective, extinction bursts and forms of treatment relapse commonly occur when function-based treatments are implemented by caregivers in natural community settings. In recent years, researchers have increasingly applied quantitative theories of behavior like behavioral momentum theory (BMT) and the temporally weighted matching law (TWML) to understand, prevent, or mitigate extinction bursts and treatment relapse. In this paper, we describe BMT and TWML and selectively review the basic, translational, and applied research supporting and opposing each theory. Then, we describe how function-based treatments may be refined based on these theories to improve the effectiveness, generality, and durability of function-based treatments for individuals with autism spectrum and related disorders who display problem behavior.

Resurgence Increases with Repetition

Resurgence refers to a behavioral process in which a recent response is extinguished (or reinforcement conditions worsen) and a previously extinguished response recurs. In previous research, resurgence has been reliably produced when the resurgence procedure is repeated. Changes in the degree of increase of the resurging response across iterations of the procedure have been inconsistent, however, with some studies showing increases and some showing no changes or decreases in resurgence magnitude. The present study examined the nature of resurgence across repeated iterations of the conventional resurgence procedure by exposing four pigeons to the resurgence procedure six times in succession. In the first condition of the resurgence procedure, pecks on one key (e.g., the left) were reinforced under a variable-interval (VI) 30-s schedule. In the second condition pecks on that key were extinguished, and pecks on another key (e.g., the right) were reinforced under the same schedule. In the final condition there were no programmed consequences for either response. Resurgence was observed in 21 of 24 opportunities (87.5%). Iteration-over-iteration increases in resurgence were observed in 15 of 20 opportunities (75.0%), and this increase was found to be statistically significant. These findings demonstrate that, under certain conditions, resurgence generally increases in magnitude with repeated exposure to the procedures that generate it.

The effects of large, small, and thinning magnitudes of alternative reinforcement on resurgence

Resurgence refers to an increase of a previously reinforced target behavior following the worsening of conditions for a more recently reinforced alternative behavior. There is evidence to suggest that alternative reinforcers of greater magnitude are more effective at reducing target responding but may also result in more resurgence when removed. Similar effects have been observed with high rates of alternative reinforcement. However, in clinical settings, reinforcement rate thinning is used to reduce the likelihood of resurgence associated with higher rates of alternative reinforcement. Given the clinical importance of alternative reinforcer magnitude, it is necessary to evaluate how reinforcer magnitude thinning may impact resurgence as well. Following Phase 1 in which target responding was reinforced, rats earned either large (six pellets), small (one pellet), or thinned (reduced from six pellets to one across sessions) magnitude reinforcement for alternative responding during target-response extinction in Phase 2. Then, alternative responding was placed on extinction for all groups in Phase 3. Target responding was comparably elevated at the end of Phase 2 for groups Small and Thin compared to group Large. In Phase 3, resurgence was evident only in group Large but target responding remained relatively elevated in groups Small and Thin. These results provide additional evidence of the important interplay between conditions of alternative reinforcement and the persistence and resurgence of target responding.

Phase duration and resurgence

Resurgence, the recurrence of responding due to a worsening of reinforcement conditions for current behavior, is a prevalent form of treatment relapse. Resurgence as Choice in Context predicts that increasing the duration of exposure to reinforcement for target responding during Phase 1 will increase resurgence magnitude, whereas increasing the duration of exposure to reinforcement for alternative responding and extinction for target responding during Phase 2 will decrease resurgence magnitude. We conducted an experiment evaluating these predictions with human participants recruited through Amazon's Mechanical Turk platform. We varied Phase 1 and Phase 2 durations across 4 experimental groups. Resurgence as Choice in Context successfully predicted the differences in resurgence magnitude across these groups, and fitting the quantitative model to the obtained data yielded an exceptional coefficient of determination. We discuss the implications of these results for using Resurgence as Choice in Context to inform experiments with human participants and the feasibility of using human-operant preparations to evaluate resurgence.

Examining effects of training duration on humans' resurgence and variability using a novel touchscreen procedure

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence.

The extinction burst: Impact of reinforcement time and level of analysis on measured prevalence

Despite widespread belief in the extinction burst as a common occurrence, relatively little empirical work has focused directly on the phenomenon. In order to provide additional data on the topic, we report reanalyses of published extinction-control groups from our laboratory following training with a variety of schedules and reinforcers. In addition, two prospective experiments were conducted in which rats responded for food on FR 5 or FR 1 schedules prior to a within-session transition to extinction. The results of these reanalyses and experiments suggest that the obtained prevalence of the extinction burst was considerably greater when response rates in the first minute of the transition to extinction were considered as compared to when session-wide response rates were considered. In addition, when reinforcement time was included in baseline response-rate calculations, the obtained prevalence of the extinction burst was higher than when reinforcement time was omitted. These findings highlight the importance of measurement and definitional issues in the obtained prevalence of the extinction burst. Further, a closer alignment of such issues across basic and applied research would be desirable in terms of the development of future theories describing the processes giving rise to the extinction burst.

Evaluating Extinction, Renewal, and Resurgence of Operant Behavior in Humans with Amazon Mechanical Turk

Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace providing researchers with the opportunity to collect behavioral data from remote participants at a low cost. Recent research demonstrated reliable extinction effects, as well as renewal and resurgence of button pressing with MTurk participants. To further examine the generality of these findings, we replicated and extended these methods across six experiments arranging reinforcement and extinction of a target button press. In contrast to previous findings, we did not observe as reliable of decreases in button pressing during extinction (1) after training with VR or VI schedules of reinforcement, (2) in the presence or absence of context changes, or (3) with an added response cost for button pressing. However, we found that that a 1-point response cost for all button presses facilitated extinction to a greater extent than the absence of response cost. Nevertheless, we observed ABA renewal of button pressing when changing background contexts across phases and resurgence when extinguishing presses on an alternative button. Our findings suggest that MTurk could be a viable platform from which to ask and address questions about extinction and relapse processes, but further procedural refinements will be necessary to improve the replicability of control by experimental contingencies.

Resistance to extinction versus extinction as discrimination

The hypothesis that response strength might be measured by persistence of responding in the face of extinction was discredited in the 1960s because experiments showed that responding persists longer following intermittent reinforcers than following continuous reinforcers. Instead, researchers proposed that the longer persistence following intermittent reinforcers arises because intermittent reinforcement more closely resembles extinction-a discrimination theory. Attention to resistance to extinction revived because one observation seemed to support the persistence hypothesis: Following training on a multiple schedule with unequal components, responding usually persisted longer in the formerly richer component than in the formerly lean component. This observation represents an anomaly, however, because results with single schedules and concurrent schedules contradict it. We suggest that the difference in results arises because the multiple-schedule procedure, while including extensive training on stimulus discrimination, includes no training on discrimination between food available and food unavailable, whereas comparable single- and concurrent-schedule procedures include such training with repeated extinction. In Experiment 1, we replicated the original result, and in Experiment 2 showed that when the multiple-schedule procedure includes training on food/no-food discrimination, extinction following multiple schedules contradicts behavioral momentum theory and agrees with the discrimination theory and research with single and concurrent schedules.

Examination of alternative-response discrimination training and resurgence in rats

Resurgence is an increase in a previously reinforced behavior following a worsening of conditions for a more recently reinforced behavior. Discrimination training is incorporated into treatment for problem behavior to prevent treatment adherence failures that may result in resurgence. There is evidence that resurgence may be reduced when a stimulus that signals alternative-response extinction is present compared with absent; however, the generality of this effect is unknown given the limited testing conditions. The goal of the present experiments was to further examine the effects of such stimuli in a reverse-translational evaluation using rats. Target responding was reinforced in baseline and then placed on extinction in the following discrimination-training phase. An alternative response was differentially reinforced in a two-component multiple schedule where one stimulus (i.e., S^D) signaled alternative-response reinforcement and the other (i.e., S^Δ) signaled extinction. Experiment 1 assessed resurgence in both the S^Δ and S^D when alternative reinforcement was removed. Experiment 2 evaluated resurgence under conditions that better approximated those used in the clinic in which the alternative-response S^Δ was present or absent. The S^Δ failed to suppress target responding during resurgence testing in both experiments. These findings suggest that the conditions under which an alternative-response S^Δ will successfully mitigate resurgence may be limited and require further research.

Sustaining behavior reduction by transitioning the topography of the functional communication response

When a functional communication response (FCR) can be reliably occasioned, destructive behavior tends to be lower. However, the form of FCR may affect the durability of functional communication training, as missing FCR materials may promote resurgence. Experiment 1 demonstrated that resurgence of target responding was lower when a vocal FCR remained available but was placed on extinction compared to when a card-based FCR was unavailable. Experiment 2 replicated the finding that initiating treatment with a card FCR produced less target responding than when initiating treatment with a vocal FCR. We then evaluated a set of procedures for transitioning the card FCR to the previously unlearned vocal FCR. These findings suggest benefits of training different types of FCRs at different stages of treatment and provide a preliminary set of procedures for transitioning between FCR topographies while occasioning minimal target responding.

Resurgence and repeated within-session progressive-interval thinning of alternative reinforcement

Resurgence of a previously suppressed target behavior is common when reinforcement for a more recently reinforced alternative behavior is thinned. To better characterize such resurgence, these experiments examined repeated within-session alternative reinforcement thinning using a progressive-interval (PI) schedule with rats. In Experiment 1, a transition from a high rate of alternative reinforcement to a within-session PI schedule generated robust resurgence, but subsequent complete removal of alternative reinforcement produced no additional resurgence. Experiment 2 replicated these findings and showed similar effects with a fixed-interval (FI) schedule arranging similarly reduced session-wide rates of alternative reinforcement. Thus, the lack of additional resurgence following repeated exposure to the PI schedule was likely due to the low overall obtained rate of alternative reinforcement provided by the PI schedule, rather than to exposure to within-session reinforcement thinning per se. In both experiments, target responding increased at some point in the session during schedule thinning and continued across the rest of the session. Rats exposed to a PI schedule showed resurgence later in the session and after more cumulative alternative reinforcers than those exposed to an FI schedule. The results suggest the potential importance of further exploring how timing and change-detection mechanisms might be involved in resurgence.

Further evaluation of a nonsequential approach to studying operant renewal

Basic-laboratory assessments of renewal may inform clinical efforts to maintain reduction of severe destructive behavior when clients transition between contexts. The contextual changes arranged during standard renewal procedures, however, do not necessarily align with those that clients experience during outpatient therapy. More specifically, clients transition between clinical (associated with extinction for target behavior) and home/community (associated with reinforcement for target behavior) contexts during outpatient treatment. Standard renewal assessments do not incorporate these contextual alternations during treatment. The present experiment aimed to directly compare renewal of rats' lever pressing following a standard ("sequential") ABA renewal procedure (i.e., baseline in Context A, extinction in Context B, renewal test in Context A) and a "nonsequential" renewal assessment wherein treatment consisted of daily alternation between Context A (associated with reinforcement for lever pressing) and Context B (associated with extinction). Lever pressing renewed to a greater extent for rats in the Nonsequential group than for rats in the Sequential group, suggesting the contextual changes that clients experience during outpatient treatment for severe destructive behavior may be a variable that is important to consider in translational research on renewal. Potential implications of these findings for basic and clinical research on renewal are discussed.

On the "Strength" of Behavior

The place of the concept of response strength in a natural science of behavior has been the subject of much debate. This article reconsiders the concept of response strength for reasons linked to the foundations of a natural science of behavior. The notion of response strength is implicit in many radical behaviorists' work. Palmer (2009) makes it explicit by applying the response strength concept to three levels: (1) overt behavior, (2) covert behavior, and (3) latent or potential behavior. We argue that the concept of response strength is superfluous in general, and an explication of the notion of giving causal status to nonobservable events like latent behavior or response strength is harmful to a scientific endeavor. Interpreting EEG recordings as indicators of changes in response strength runs the risk of reducing behavior to underlying mechanisms, regardless of whether such suggestions are accompanied by behavioral observations. Many radical behaviorists understand behavior as a discrete unit, inviting conceptual mistakes reflected in the notion of response strength. A molar view is suggested as an alternative that accounts for the temporally extended nature of behavior and avoids the perils of a response-strength based approach.

Resurgence and downshifts in alternative reinforcement rate

Resurgence refers to an increase in a previously suppressed target behavior with a relative worsening of conditions for a more recently reinforced alternative behavior. This experiment examined the relation between resurgence and the magnitude of a reduction in the rate of reinforcement for the alternative behavior. Groups of both male and female rats initially pressed a target lever for food on a variable-interval (VI) 30-s schedule. In a second phase, responding to the target lever was extinguished for all groups and pressing an alternative lever was reinforced on a VI 10-s schedule. Next, the rate of reinforcement for alternative behavior was reduced differentially across groups by arranging extinction, VI 80-s, VI 40-s, VI 20-s, or continued VI 10-s reinforcement. Target responding increased as an exponential function of the magnitude of the reduction in alternative reinforcement rates. With the exception that males appeared to show higher rates of target responding in baseline and higher rates of alternative responding in other phases, the overall pattern of responding across phases was not meaningfully different between sexes. The pattern of both target and alternative response rates across sessions and phases was well described quantitatively by the Resurgence as Choice in Context model.

Effects of response cost magnitude on resurgence of human operant behavior

Extensive research has been dedicated to the study of resurgence following extinction and differential reinforcement of alternative behavior. Less is known about the effects of punishment on resurgence. This study extended previous research by examining whether the magnitude of response cost punishment affects resurgence of human operant behavior. College students engaged in a computer task using the three-phase resurgence procedure where points were used to reinforce target (Phase 1) or alternative (Phase 2) behavior. Across three groups, Phase 2 contingencies for the target response were manipulated. In one group, only extinction was implemented. In the other two groups, response cost was also implemented. Response cost was equal to or double the number of points that could be gained for alternative responding. Resurgence was similar in Phase 3 across the three groups, demonstrating that neither the addition nor the magnitude of punishment differentially affected response recovery under these conditions. Future research should examine other parameters of punishment (e.g., delay, schedule) and how these variables interact with different parameters of alternative reinforcement to increase our understanding of the conditions under which resurgence may be exacerbated or minimized.

Changes in the elimination and resurgence of alcohol-maintained behavior in rats and the effects of naltrexone

Resurgence may be a mechanism of relapse in alcohol use disorder patients upon discharge from treatment as part of an abuse-treatment-relapse cycle. Adjunctive pharmacotherapies may be a means to facilitate behavioral treatments and block resurgence. Experiments were conducted using a model of alcohol self-administration to assess the repeatability of the elimination and resurgence of alcohol-maintained behavior and the effects of naltrexone. Experiments had three phases. In Phase 1, behavior was maintained by oral alcohol under a fixed-ratio schedule. In Phase 2, behavior was extinguished via condensed milk delivery under a differential-reinforcement-of-other-behavior (DRO) schedule. In Phase 3, the DRO schedule was eliminated. In Experiment 1, this 3-phase cycle was replicated 4 times. Across replications, response rates and dose of alcohol consumed did not differ in Phase 1, alcohol-maintained behavior was eliminated more rapidly in Phase 2, and the resurgence effect was generally stable in Phase 3. In Experiment 2, naltrexone was administered in Phase 2, Phase 3, or both Phases 2 and 3, to separate groups of rats. Naltrexone facilitated the elimination of alcohol-maintained behavior in Phase 2 and, the resurgence of alcohol-maintained behavior was reduced only for those rats that received naltrexone in both phases. Together, these experiments demonstrate that the resurgence of alcohol-maintained behavior is replicable within-subjects and, further, resurgence of alcohol-maintained behavior may be a useful model to evaluate pharmacological interventions to facilitate behavioral treatments and reduce the likelihood of relapse. Results with naltrexone support the use of medication-assisted therapy approaches to reduce relapse risk in patients. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Re-exposure to reinforcement in context a during treatment in context b reduces ABC renewal

Previous work from our laboratory showed that intermittently re-exposing rats to reinforcement for lever pressing in a training (A) context, while eliminating lever pressing in a second (B) context, increased ABA renewal of lever pressing relative to rats that experienced only Context B during response elimination. In the current study, we replicated these procedures while assessing renewal in the presence of a novel context (i.e., ABC renewal). Unlike the findings described above, renewal was reduced in the group that experienced re-exposure to Context A during lever-press elimination relative to rats that experienced only Context B. These findings suggest that alternating between contexts associated with reinforcement and extinction during treatment reduces the probability that organisms will respond in novel contexts. These outcomes may be the result of discrimination and/or generalization processes. Moreover, this training procedure may offer a potential mitigation strategy for ABC renewal.

Resurgence as Choice in Context: Treatment duration and on/off alternative reinforcement

Resurgence as Choice (RaC) is a quantitative theory suggesting that an increase in an extinguished target behavior with subsequent extinction of an alternative behavior (i.e., resurgence) is governed by the same processes as choice more generally. We present data from an experiment with rats examining a range of treatment durations with alternative reinforcement plus extinction and demonstrate that increases in treatment duration produce small but reliable decreases in resurgence. Although RaC predicted the relation between target responding and treatment duration, the model failed in other respects. First, contrary to predictions, the present experiment also replicated previous findings that exposure to cycling on/off alternative reinforcement reduces resurgence. Second, RaC did a poor job simultaneously accounting for target and alternative behaviors across conditions. We present a revised model incorporating a role for more local signaling effects of reinforcer deliveries or their absence on response allocation. Such signaling effects are suggested to impact response allocation above and beyond the values of the target and alternative behaviors as longer-term repositories of experience. The new model provides an excellent account of the data and can be viewed as an integration of RaC and a quantitative approximation of some aspects of Context Theory.

Behavioral momentum and resistance to extinction across repeated extinction tests

The present experiments assessed whether resistance to extinction of pigeons' key pecking decreased across repeated extinction tests. An additional impetus for this research was to determine how the quantitative framework provided by behavioral momentum theory might be used to describe any such changes across tests. Pigeons pecked keys in two-component multiple schedules (one component associated with a higher reinforcer rate and the other with a lower rate) in which baseline and extinction conditions alternated. In Experiment 1, baseline and extinction conditions alternated every session, and, in Experiment 2, these conditions lasted for 10 and 7 sessions, respectively. Resistance to extinction decreased across successive extinction conditions in both experiments. Fits of the behavioral-momentum based model of extinction to the data returned uncertain results in Experiment 1 but implicated both generalization decrement and response-reinforcer contingency termination as the possible mechanisms responsible for behavior change in Experiment 2. Thus, these data suggest that experimental manipulations that affect discrimination of changes in reinforcement contingencies may influence resistance to extinction by modulating the disruptive impacts of removing reinforcers from the experimental context and of suspending response-reinforcer contingencies.