The recurrence of negatively reinforced responding of humans

A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40614-022-00361-y.

Early-extinction effects on a force response of humans

Humans were used to investigate changes in response force occurring soon after reinforcement was eliminated. In Experiment 1, in a 300-s baseline phase, 10 participants received a point for holding down a pressure sensor set to operate at a force equal to 85% of the maximum force the participants exerted during a pretest. Following this, during a 600-s extinction phase, criterion responses had no consequence. In Experiment 2, 6 participants worked on the same task, but (a) points were exchangeable for money and (b) after extinction, the reinforcement baseline phase was reinstated. In Experiment 3, 6 participants completed the same task as in Experiment 2, but the required minimum force was 60% of the maximum force exerted during the pretest. In each experiment, increases in response force relative to the mean and peak force exerted during the last 100 s of baseline were observed in most participants when force responses were aggregated into short sample intervals, but less so with longer ones. The increases, however, were not systematic across or within participants, questioning the generality of and the criteria for demonstrating an extinction burst.

A review of the behavioral effects of response force: Perspectives on measurement and functions

Response force is a fundamental dimension of behavior. Yet, little is known about its functional significance for learning. The present review examines the behavioral effects of force across several domains. Along the way, advantages of different measurement strategies that have been used to study force are evaluated. The behavioral functions of force are also considered in light of two commonly expressed notions about behavior. First, the Law of Least Effort predicts that animals and humans will act in ways that minimize the costs of behaving. Second, it is widely held that work requirements and effortful responding are aversive. A review of the literature, especially regarding behavioral adaptations to force, is consistent with the Law of Least Effort on many points. Empirical data are less clear on the aversive properties of force requirements. For much of the literature, there is little in coherent findings. Many disagreements and inconsistencies pertain to measurement strategies that fail to record the full range of response variants. Consistent support for aversive functions of force requirements have been obtained only when studied as a negative reinforcer.

Renewal of fear and avoidance in humans to escalating threat: Implications for translational research on anxiety disorders

Exposure-based treatment for threat avoidance in anxiety disorders often results in fear renewal. However, little is known about renewal of avoidance. This multimodal laboratory-based treatment study used an ABA renewal design and an approach-avoidance (AP-AV) task to examine renewal of fear/threat and avoidance in twenty adults. In Context A, 9 visual cues paired with increases in probabilistic money loss (escalating threats) produced increases in ratings of feeling threatened and loss expectancies and skin-conductance responses (SCR). During the AP-AV task, a monetary reinforcer was available concurrently with threats. Approach produced the reinforcer or probabilistic loss, while avoidance prevented loss and forfeited reinforcement. Escalating threat produced increasing avoidance and ratings. In Context B with Pavlovian extinction, threats signaled no money loss and SCR declined. During the AP-AV task, avoidance and ratings also declined. In a return to Context A with Pavlovian threat extinction in effect during the AP-AV task, renewal was observed. Escalating threat was associated with increasing ratings and avoidance in most participants. SCR did not show renewal. These are the first translational findings to highlight renewal of avoidance in humans. Further research should identify individual difference variables and altered neural mechanisms that may confer increased risk of avoidance renewal.

Relapse of anxiety-related fear and avoidance: Conceptual analysis of treatment with acceptance and commitment therapy

Excessive fear and avoidance in relatively safe situations can lead to a narrowing of one's behavioral repertoire and less engagement with valued aspects of living. Ultimately, these processes can reach clinical levels, as seen in anxiety, trauma, and obsessive-compulsive disorders. Research on the basic behavioral processes underlying successful treatment with exposure therapy is growing, yet little is known about the mechanisms contributing to clinical relapse. Until recently, these mechanisms have largely been conceptualized in terms of Pavlovian return of fear, with relatively little research into operant processes. In the current paper, we briefly review translational research in anxiety disorders and the connections between fear and avoidance, focusing on recent work in the acquisition, extinction, and relapse of avoidance behavior and the generalization of this learning through arbitrary symbolic relations. We then introduce one possible treatment approach to mitigating clinical relapse, acceptance and commitment therapy (ACT), and provide a conceptual analysis for why ACT may be especially well-situated to address this issue. Finally, we end with potential directions for future research on treatment and relapse of anxiety disorders.

Operant renewal of desirable behavior in a simulated workplace: A translational model

Organizational settings are replete with changing stimulus contexts and contingencies, which makes relapse a particularly relevant framework for understanding the ways in which controlling stimuli influence employee responding. The purpose of the current study was to develop a translational model to assess renewal of desirable behavior in a simulated workplace with neurotypical adults. Experiment 1 assessed renewal of desirable behavior using a computerized check processing task. Experiment 2 extended the findings and the translational utility of the experimental arrangement to implementation of a behavior-analytic teaching procedure. Results across both experiments demonstrated renewal of desirable behavior. Overall, the current methodology and findings extend the human operant literature on renewal and demonstrate a translational model that brings together operant renewal and organizational behavior management.

Context affects resurgence of negatively reinforced human behavior

The effects of context on the resurgence of negatively reinforced (escape) responding was studied in an experiment with undergraduate students in which resurgence and renewal procedures were combined. Across conditions, in baseline (BL), key-pressing produced 3-s timeouts from pressing a force cell on a variable-ratio schedule of reinforcement; in the Alternative-Reinforcement and Test phases, a differential-reinforcement-of-other-behavior schedule and extinction were in effect, respectively. Conditions differed according to the context (the computer-screen color) in effect in each phase: ABA vs. ABB (with each letter representing a context; order of exposure to conditions was counterbalanced across participants). For each of six participants, independent of (a) order of exposure to conditions, (b) slight differences in BL reinforcement, and (c) differences in BL key-pressing rates, resurgence of greater magnitude occurred in the ABA than in the ABB condition. These results replicate and extend to contingencies of negative reinforcement previous findings with nonhumans and humans showing that context modulates the magnitude of resurgence.

A review of investigations of operant renewal with human participants: Implications for theory and practice

Operant renewal is the recurrence of a previously eliminated target behavior as a function of changing stimulus contexts. Renewal as a model of treatment relapse in humans suggests that a change in stimulus conditions or context is sufficient to produce relapse of a previously eliminated maladaptive behavior. The extent to which general findings from operant renewal studies involving nonhuman animal subjects are supported by relapse studies involving human participants is unknown. We conducted a systematic review of studies demonstrating or mitigating operant renewal in human participants in peer-reviewed studies found in PsycINFO, ERIC, PubMed, and Scopus between 1980 and 2019. We identified 12 studies involving 61 participants and 93 cases of operant renewal. We coded descriptive data on participant and study characteristics and calculated summary statistics. Results indicated that the renewal effect was a robust phenomenon, supported by demonstrations in both clinical and human-laboratory studies, and across a variety of variables and experimental preparations. However, there were relatively few studies involving human participants that attempted to reduce or eliminate renewal of clinically meaningful behavior. We discuss variables relevant for studying renewal in socially meaningful contexts, practical limitations of observing the renewal effect in real-world settings, implications for theoretical models of renewal, and identify barriers to methodology unique to human participants. We provide directions for future research related to implementing and translating nonhuman animal studies of renewal to applied settings.

Resurgence in humans: Reducing relapse by increasing generalization between treatment and testing

Resurgence is the increase in performance of an extinguished instrumental (operant) response that accompanies the extinction of a response that has been reinforced to replace it. Resurgence may involve processes that are relevant for understanding relapse in applied and clinical settings. While resurgence is known to be a robust phenomenon in human operant extinction, the processes that control it remain unclear. Here we asked whether human resurgence is controlled by processes that are similar to those that have been identified in animals by asking whether two methods that reduce resurgence in animals also reduce it in humans. Participants first learned to make an operant response (R1) for a tangible food reinforcer (O1). In a second phase (Phase 2), R1 was extinguished while a second response (R2) was introduced and reinforced with a virtual monetary reward (USD $0.10 coins; O2). In a test phase, extinction was then introduced for R2 and resurgence of R1 was assessed. In Experiment 1, resurgence that occurred after the treatment just described was attenuated if there had been periodic exposure to R2 extinction during the treatment phase (Phase 2). In Experiment 2, resurgence was prevented when O2, but not O1, was presented noncontingently during the test. The results are among the first to suggest a mechanism underlying resurgence in humans, namely, renewal caused by contextual change. They also provide initial evidence to suggest that resurgence may be the result of common processes in animals and humans. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Effects of differential rates of alternative reinforcement on resurgence of human behavior

Despite the success of exposure-based psychotherapies in anxiety treatment, relapse remains problematic. Resurgence, the return of previously eliminated behavior following the elimination of an alternative source of reinforcement, is a promising model of operant relapse. Nonhuman resurgence research has shown that higher rates of alternative reinforcement result in faster, more comprehensive suppression of target behavior, but also in greater resurgence when alternative reinforcement is eliminated. This study investigated rich and lean rates of alternative reinforcement on response suppression and resurgence in typically developing humans. In Phase 1, three groups (Rich, n = 18; Lean, n = 18; Control, n = 10) acquired the target response. In Phase 2, target responding was extinguished and alternative reinforcement delivered on RI 1 s, RI 3 s, and extinction schedules, respectively. Resurgence was assessed during Phase 3 under extinction conditions for all groups. Target responding was suppressed most thoroughly in Rich and partially in Lean. Target responding resurged in the Rich and Lean groups, but not in the Control group. Between groups, resurgence was more pronounced in the Rich group than the Lean and Control groups. Clinical implications of these findings, including care on the part of clinicians when identifying alternative sources of reinforcement, are discussed.

Reaparecimento de sequências com diferentes números de respostas em contextos de extinção e de variação

RESUMO O reaparecimento de uma resposta previamente extinta quando os reforços para uma resposta alternativa são descontinuados é denominado ressurgência. Foram investigados os efeitos de três variáveis sobre o reaparecimento de sequências de respostas: probabilidade da sequência (alta e baixa), contexto de teste (extinção e variação operante) e número de respostas por sequência (três e cinco). Sequências muito prováveis reapareceram mais frequentemente que sequências pouco prováveis, o reaparecimento da sequência alvo foi mais frequente no contexto de extinção do que de variação e o reaparecimento da sequência alvo variou inversamente ao número de respostas por sequência. O reaparecimento da sequência alvo, entretanto, não foi conceitualizado como ressurgência, uma vez que sua frequência foi menor que a das sequências controle.