Punishment of an alternative behavior generates resurgence of a previously extinguished target behavior

Punishment-induced resurgence

The phenomenon of extinction-induced resurgence is well established, but there is comparatively little experimental evidence for punishment-induced resurgence. Punishment-induced resurgence can by tested by contingent shocks following the alternative response. The purpose of Experiment 1 was to test whether low-intensity shocks, that do not decrease rate of reinforcement, result in resurgence. Four rats served as subjects. Rats were exposed to three sequential conditions: (a) variable-interval (VI) 30-s food delivery for a lever press (target response); (b) VI 30-s food delivery for a nose poke (alternative response) and extinction of the lever press; (c) VI 30-s reinforcement for a nose poke with superimposed VI 60-s shock delivery. In the final condition, shocks increased gradually from 0.1 to 0.5 mA. Experiment 2 evaluated whether an abrupt introduction of a high-intensity shock would result in resurgence. Three rats served as subjects and were exposed to three sequential conditions: (a) VI 30-s food delivery for a lever press; (b) VI 30-s food delivery for a nose poke and extinction of the lever press; (c) continued VI 30-s reinforcement for a nose poke with superimposed VI 60-s 0.6 mA shock delivery. Resurgence was observed in all subjects, including in situations in which rate of responding, but not rate of reinforcement, decreased. The present study provides additional evidence for punishment-induced resurgence, but future studies are warranted to determine the extent to which punishment can produce resurgence with or without decreases in rates of reinforcement.

Resurgence and Behavioral Contrast, Compared and Contrasted

This is a review of the relation between operant response resurgence and behavioral contrast. Both are defined by rate changes in a target response as a function of environmental changes spatially or temporally distal to the location of the target response. The typical procedures for investigating these two phenomena differ in that (1) resurgence is studied using concurrent schedules and behavioral contrast predominantly with multiple schedules and (2) resurgence is assessed against an extinction baseline of the target response and behavioral contrast has been assessed under a variety of reinforcement schedules. The distinctions between concurrent and multiple schedules, however, may be ones of degree rather than kind. Research into both phenomena reveals considerable overlap in the controlling variables of the two. With certain caveats, resurgence appears to be an instance of behavioral contrast measured against an extinction baseline. Because of Point 2 above, most instances of behavioral contrast do not meet the definition of resurgence. Investigating resurgence while maintaining target responding by a schedule of reinforcement might be useful, but such a procedure would not qualify as resurgence because it violates the definition of resurgence as the return of a previously reinforced but currently extinguished response. Several implications of the similarities and differences between the two are discussed.

Examining resurgence in rats following expanded-operant treatments

Resurgence of previously reinforced behavior represents a challenge to otherwise successful interventions based on differential reinforcement of alternative behavior (DRA). Expanded-operant treatments seek to increase the number of functional alternative behaviors through DRA, thereby potentially mitigating resurgence. However, the few studies that have directly examined these methods as a tool for resurgence mitigation have provided limited and unclear results. Thus, the present experiments were designed to investigate the effect of expanded-operant DRA methods on resurgence of previously reinforced behavior using rat subjects. In two experiments, following a baseline phase in which a target response was trained, groups of rats experienced concurrent (i.e., five simultaneous alternative responses), serial (i.e., five sequentially available alternative responses), or single DRA interventions arranging similar rates of alternative reinforcement in order to examine potential differences in resurgence. Both experiments showed that neither serial nor concurrent DRA expanded-operant treatments reduced resurgence compared with single DRA regardless of whether stimuli associated with previously reinforced alternative responses were removed (Experiment 1) or remained present (Experiment 2) for the serial-DRA group. Further, a primacy effect in resurgence was obtained for the serial-DRA group in both experiments. Overall, these results suggest that expanded-operant treatments may not help to reduce resurgence.

A quantitative analysis of resurgence following downshifts in alternative-reinforcer magnitude

Resurgence is the increase in a previously reinforced and then extinguished target response due to changes in reinforcement conditions for an alternative response, including reductions in the rate or magnitude of reinforcement for the alternative response. Research with nonhumans suggests that reductions in both alternative-reinforcer rate and magnitude produce resurgence, but the present study was the first to examine effects of downshifts in alternative-reinforcer magnitude on humans' resurgence. Moreover, it was the first to evaluate whether the quantitative framework, resurgence as choice in context (RaC² ), could account for those effects. Consistent with predictions of RaC² , resurgence of a target button press occurred with reductions in point gain for an alternative response, with greater reductions producing higher levels of resurgence. However, the model consistently underpredicted and then overpredicted resurgence during tests with low-magnitude reinforcement and extinction. Systematic deviations in model predictions of alternative responding were also evident and consistent with previous fits of RaC² to nonhuman data. Overall, our findings suggest that RaC² could be a useful quantitative theoretical framework for understanding processes contributing to resurgence in humans, but further theoretical development is needed to account for the apparent divergent effects of extinction versus downshifts in reinforcer magnitude.

A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40614-022-00361-y.

Response effort and resurgence

This study provides an initial translational examination of response effort and resurgence. Eleven typically developing adults and five adolescents with autism served as participants across two experiments. Participants received points for touching moving stimuli on a computer screen. The resurgence evaluation consisted of three phases: establishment wherein R1 was reinforced, elimination wherein R1 was placed on extinction while R2 was reinforced, and extinction wherein R1 and R2 no longer resulted in reinforcement. Rate of R1 during extinction was compared across three conditions: intermediate, easy, and difficult. Disparity in effort was created by manipulations of the size and speed of objects that moved about on a computer screen. In Experiment 2, control stimuli were added to the experimental arrangement. Across the two experiments, the magnitude of resurgence was greater when R1 was easy. In Experiment 2, both R1 and control responding were greater in the extinction phase than in the elimination phase in all conditions with all participants. The present study supports the hypothesis that response effort affects resurgence and that less effortful responses are likely to recur with greater magnitude under conditions that produce resurgence than are their more effortful counterparts.

Effects of repeated exposure to escalating versus constant punishment intensity on response allocation

The present experiment investigated the effects of 1) repeated exposures to escalating punishment intensities and 2) repeated exposure to punishment after periods of vacation on response allocation between punished and unpunished responding in three groups of rats. The first group (intensity + vacation) experienced repeated exposures to escalating punishment intensities after a period of vacation (i.e., return to baseline) from punishment. The second group (intensity-only) experienced repeated exposures to escalating punishment intensities without vacation from punishment. The third group (vacation-only) experienced repeated exposures to a constant punishment intensity after a period of vacation from punishment. Results showed that superimposition of punishment on one of two concurrently available responses decreased allocation toward the punished response and increased allocation toward the unpunished response. Furthermore, greater changes in allocation were observed with the introduction of a moderate constant intensity than with the introduction of a low intensity that increased across sessions. Reexposure to punishment had different effects between the groups. Although there was evidence that high shock intensities can enhance the efficacy of lower intensities to shift allocation away from the punished response and toward the unpunished response, there was little evidence of changes in response allocation with reintroduction of punishment after a period of vacation.

Modeling resurgence with an evolutionary theory of behavior dynamics

McDowell's (2004) Evolutionary Theory of Behavior Dynamics (ETBD) is a computational theory that has reproduced a wide variety of behavioral phenomena observed in material reality. Here, we extended the generality of the ETBD by successfully replicating laboratory studies of resurgence with live animals using artificial organisms (AOs) animated by the theory. We ran AOs on concurrent random-interval random-interval (conc RI RI) schedules of reinforcement wherein one alternative (i.e., a target behavior) was reinforced while the other alternative (i.e., an alternative behavior) was not reinforced. Then, we placed the target behavior on extinction and reinforced the alternative response, producing a shift in allocation of responding from the target behavior to the alternative response. Finally, schedule thinning of the alternative response (i.e., downshifts) resulted in resurgence of target behavior. Our findings indicated that resurgence increased as a function of the relative downshift in reinforcement rate and magnitude, replicating findings from previous studies with live animals. These results further illustrate the utility of the ETBD for generating dynamic behavioral data and serve as a proof-of-concept for a novel computational approach for studying and understanding resurgence in future studies.

Relapse during the treatment of pediatric feeding disorders

Resurgence and renewal are treatment-relapse phenomena in which previously extinguished behavior returns after the conditions for an alternative response worsen or the context changes, respectively. Recently, researchers have evaluated the prevalence of resurgence and renewal when treating destructive behavior with functional communication training. However, resurgence of inappropriate mealtime behavior has yet to be evaluated; perhaps because treatments involve qualitatively different resurgence opportunities (e.g., increased bite-presentation rate). We evaluated the prevalence of resurgence and renewal of inappropriate mealtime behavior across 22 and 25 applications of extinction-based treatments, respectively. Resurgence occurred in 41% (9/22) of applications, most often following presentation-rate increases. Renewal occurred in 52% (13/25) of applications, most often following feeder changes from therapist to caregiver. We discuss these findings in terms of their ability to inform relapse-mitigation strategies for resurgence and renewal of inappropriate mealtime behavior.

Destructive behavior increases as a function of reductions in alternative reinforcement during schedule thinning: A retrospective quantitative analysis

The behavioral processes determining the magnitude of the resurgence of destructive behavior during reinforcement schedule thinning have yet to be described, despite an uptick in prevalence research on the topic. As predicted by Resurgence as Choice theory, recent animal research has found that resurgence increases with the magnitude of a downshift in alternative reinforcement. Here we reanalyze the data from 2 recent prevalence studies to determine whether the size of the decrease in alternative reinforcement availability predicts the magnitude of resurgence in the clinic. Results from this retrospective analysis suggest that resurgence of destructive behavior increases significantly with decreases in the availability of alternative reinforcement. Implications for future research and translations of theoretical analyses to the clinic are discussed.

Effects of response cost magnitude on resurgence of human operant behavior

Extensive research has been dedicated to the study of resurgence following extinction and differential reinforcement of alternative behavior. Less is known about the effects of punishment on resurgence. This study extended previous research by examining whether the magnitude of response cost punishment affects resurgence of human operant behavior. College students engaged in a computer task using the three-phase resurgence procedure where points were used to reinforce target (Phase 1) or alternative (Phase 2) behavior. Across three groups, Phase 2 contingencies for the target response were manipulated. In one group, only extinction was implemented. In the other two groups, response cost was also implemented. Response cost was equal to or double the number of points that could be gained for alternative responding. Resurgence was similar in Phase 3 across the three groups, demonstrating that neither the addition nor the magnitude of punishment differentially affected response recovery under these conditions. Future research should examine other parameters of punishment (e.g., delay, schedule) and how these variables interact with different parameters of alternative reinforcement to increase our understanding of the conditions under which resurgence may be exacerbated or minimized.

Resurgence of punishment-suppressed cocaine seeking in rats

Alternative reinforcement-based treatments are among the most effective for reducing substance abuse. However, relapse often occurs when alternative reinforcement ends. Relapse following the loss of alternative reinforcement is called resurgence. An animal model has been used to study basic factors that may ultimately reduce resurgence but uses drug unavailability (i.e., extinction) to reduce drug seeking. In humans, drug abstinence is thought to be a product of aversive consequences associated with drug use rather than extinction. This discrepancy is important because the environmental and neurobiological factors involved in relapse may differ between punished and extinguished behavior. Experiment 1 evaluated resurgence of previously punished cocaine seeking. In Phase 1, rats earned cocaine for pressing levers. In Phase 2, cocaine remained available, but lever pressing also produced mild foot shocks while an alternative response produced food pellets for 1 group but not for another group. In Phase 3, alternative reinforcement and punishment were removed and resurgence of cocaine seeking occurred only in rats previously exposed to alternative reinforcement. In Experiment 2, resurgence was evaluated similarly, except that consequences of cocaine seeking (i.e., punishment and cocaine) remained available during Phase 3. Resurgence did not occur in either group during Experiment 2. The animal models of resurgence developed herein could increase translational utility and improve examination of the environmental and neurobiological factors underlying resurgence of drug seeking. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The control response in assessing resurgence: Useful or compromised tool?

Resurgence experiments sometimes include an operandum on which a history of reinforcement has not been experimentally established. The purpose of this control operandum is to rule out a generalized increase in responding when the alternative response is extinguished as being the cause of the resurgent target response. A review of the results of experiments conducted with both nonhumans and humans in which a control operandum was included shows that control- operandum responding is more common in the latter and almost nonexistent in the former. Both the presence and absence of responding on the control operandum, however, are subject to multiple interpretations thereby rendering it a compromised tool. Alternatives to using a control operandum to rule out extinction induction as the basis for resurgence include a preresurgence test control procedure and a differential resurgence procedure.

Resurgence as Choice: Implications for promoting durable behavior change

Resurgence is an increase in a previously suppressed behavior resulting from a worsening in reinforcement conditions for current behavior. Resurgence is often observed following successful treatment of problem behavior with differential reinforcement when reinforcement for an alternative behavior is subsequently omitted or reduced. The efficacy of differential reinforcement has long been conceptualized in terms of quantitative models of choice between concurrent operants (i.e., the matching law). Here, we provide an overview of a novel quantitative model of resurgence called Resurgence as Choice (RaC), which suggests that resurgence results from these same basic choice processes. We review the failures of the only other quantitative model of resurgence (i.e., Behavioral Momentum Theory) and discuss its shortcomings with respect to the limited range of circumstances about which it makes predictions in applied settings. Finally, we describe how RaC overcomes these shortcomings and discuss implications of the model for promoting durable behavior change.

Resurgence of a target behavior suppressed by a combination of punishment and alternative reinforcement

Differential-reinforcement-based treatments involving extinction of target problem behavior and reinforcement of an alternative behavior are highly effective. However, extinction of problem behavior is sometimes difficult or contraindicated in clinical settings. In such cases, punishment instead of extinction may be used in combination with alternative reinforcement. Although it is well documented that omitting alternative reinforcement can produce recurrence (i.e., resurgence) of behavior previously suppressed by extinction plus alternative reinforcement, it remains unclear if resurgence similarly occurs for behavior previously suppressed by punishment plus alternative reinforcement. The present experiment examined this question with rats. In Phase 1, a target behavior (lever pressing) was reinforced with food pellets. In Phase 2, the target behavior continued to be reinforced, but it also produced mild foot shock and an alternative behavior (nose poking) also produced food. Finally, all consequences were removed and resurgence of target behavior occurred. Resurgence did not occur for another group that similarly received punishment of target behavior in Phase 2 but not alternative reinforcement. These results indicate that resurgence was a product of the history of exposure to and then removal of alternative reinforcement and that the removal of punishment alone did not produce resurgence of target behavior.

An alternative approach to relapse analysis: Using Monte Carlo methods and proportional rates of response

Relapse is the recovery of a previously suppressed response. Animal models have been useful in examining the mechanisms underlying relapse (e.g., reinstatement, renewal, reacquisition, resurgence). However, there are several challenges to analyzing relapse data using traditional approaches. For example, null hypothesis significance testing is commonly used to determine whether relapse has occurred. However, this method requires several a priori assumptions about the data, as well as a large sample size for between-subjects comparisons or repeated testing for within-subjects comparisons. Monte Carlo methods may represent an improved analytic technique, because these methods require no prior assumptions, permit smaller sample sizes, and can be tailored to account for all of the data from an experiment instead of some limited set. In the present study, we conducted reanalyses of three studies of relapse (Berry, Sweeney, & Odum, ; Galizio et al., ; Odum & Shahan, ) using Monte Carlo techniques to determine if relapse occurred and if there were differences in rate of response based on relevant independent variables (such as group membership or schedule of reinforcement). These reanalyses supported the previous findings. Finally, we provide general recommendations for using Monte Carlo methods in studies of relapse.