1
|
Podlesnik CA, Ritchey CM, Waits J, Gilroy SP. A Comprehensive Systematic Review of Procedures and Analyses Used in Basic and Preclinical Studies of Resurgence, 1970-2020. Perspect Behav Sci 2023; 46:137-184. [PMID: 37006602 PMCID: PMC10050505 DOI: 10.1007/s40614-022-00361-y] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/12/2022] [Indexed: 11/24/2022] Open
Abstract
Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature. Supplementary Information The online version contains supplementary material available at 10.1007/s40614-022-00361-y.
Collapse
Affiliation(s)
- Christopher A. Podlesnik
- Department of Psychology, University of Florida, 114 Psychology Building, 945 Center Drive, Gainesville, FL 32611-2250 USA
| | | | - Jo Waits
- Louisiana State University, Baton Rouge, LA USA
| | | |
Collapse
|
2
|
Haney SD, Greer BD, Mitteer DR, Randall KR. Relapse during the treatment of pediatric feeding disorders. J Appl Behav Anal 2022; 55:704-726. [PMID: 35318658 PMCID: PMC10091143 DOI: 10.1002/jaba.913] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 07/16/2021] [Accepted: 01/25/2022] [Indexed: 01/05/2023]
Abstract
Resurgence and renewal are treatment-relapse phenomena in which previously extinguished behavior returns after the conditions for an alternative response worsen or the context changes, respectively. Recently, researchers have evaluated the prevalence of resurgence and renewal when treating destructive behavior with functional communication training. However, resurgence of inappropriate mealtime behavior has yet to be evaluated; perhaps because treatments involve qualitatively different resurgence opportunities (e.g., increased bite-presentation rate). We evaluated the prevalence of resurgence and renewal of inappropriate mealtime behavior across 22 and 25 applications of extinction-based treatments, respectively. Resurgence occurred in 41% (9/22) of applications, most often following presentation-rate increases. Renewal occurred in 52% (13/25) of applications, most often following feeder changes from therapist to caregiver. We discuss these findings in terms of their ability to inform relapse-mitigation strategies for resurgence and renewal of inappropriate mealtime behavior.
Collapse
Affiliation(s)
| | - Brian D Greer
- Children's Specialized Hospital-Rutgers University Center for Autism Research, Education, and Services (CSH-RUCARES).,Rutgers Robert Wood Johnson Medical School
| | - Daniel R Mitteer
- Children's Specialized Hospital-Rutgers University Center for Autism Research, Education, and Services (CSH-RUCARES).,Rutgers Robert Wood Johnson Medical School
| | | |
Collapse
|
3
|
Ritchey CM, Kuroda T, Podlesnik CA. Evaluating effects of context changes on resurgence in humans. Behav Processes 2021; 194:104563. [PMID: 34871750 DOI: 10.1016/j.beproc.2021.104563] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 11/23/2021] [Accepted: 12/01/2021] [Indexed: 12/29/2022]
Abstract
Laboratory models of relapse provide methods for evaluating challenges to behavioral treatments with differential reinforcement of an alternative response (DRA). Resurgence occurs with the worsening of conditions of reinforcement for appropriate behavior and renewal occurs when transitioning out of a treatment context. Across five experiments, participants recruited via online crowdsourcing pressed onscreen buttons to earn points exchangeable for money and contexts sometimes changed through changes in the background image. Returning to the training context (ABA, Experiment 1) and transitioning to a novel context (ABC, Experiment 2) produced greater resurgence when removing alternative reinforcement in comparison with remaining in the treatment context (ABB). In contrast, we observed little difference in resurgence among AAA, ABB, and AAC context manipulations (Experiment 3) and ABA, ABC, and AAC context manipulations (Experiment 4). In Experiment 5, we evaluated relative contributions of the presence versus absence of context changes (ABA vs. ABB) in combination with or without the removal of alternative reinforcement. Both changing context and removing alternative reinforcement increased responding in isolation and the combination produced greater-than-additive effects. Overall, the present findings demonstrate a consistent effect of removing alternative reinforcement on relapse that, under certain conditions, can be enhanced by context change.
Collapse
|
4
|
Bernal-Gamboa R, Mason TA, Nieto J, Gámez AM. An Analysis of Extinction-Cue Features in the Reduction of Operant Behavior Relapse. PSYCHOLOGICAL RECORD 2021. [DOI: 10.1007/s40732-021-00472-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
5
|
Bouton ME, Maren S, McNally GP. BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING. Physiol Rev 2021; 101:611-681. [PMID: 32970967 PMCID: PMC8428921 DOI: 10.1152/physrev.00016.2020] [Citation(s) in RCA: 151] [Impact Index Per Article: 50.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.
Collapse
Affiliation(s)
- Mark E Bouton
- Department of Psychological Science, University of Vermont, Burlington, Vermont
| | - Stephen Maren
- Department of Psychological and Brain Sciences and Institute for Neuroscience, Texas A&M University, College Station, Texas
| | - Gavan P McNally
- School of Psychology, University of New South Wales, Sydney, Australia
| |
Collapse
|
6
|
Examination of alternative-response discrimination training and resurgence in rats. Learn Behav 2021; 49:379-396. [PMID: 33772464 DOI: 10.3758/s13420-021-00470-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/28/2021] [Indexed: 11/08/2022]
Abstract
Resurgence is an increase in a previously reinforced behavior following a worsening of conditions for a more recently reinforced behavior. Discrimination training is incorporated into treatment for problem behavior to prevent treatment adherence failures that may result in resurgence. There is evidence that resurgence may be reduced when a stimulus that signals alternative-response extinction is present compared with absent; however, the generality of this effect is unknown given the limited testing conditions. The goal of the present experiments was to further examine the effects of such stimuli in a reverse-translational evaluation using rats. Target responding was reinforced in baseline and then placed on extinction in the following discrimination-training phase. An alternative response was differentially reinforced in a two-component multiple schedule where one stimulus (i.e., SD) signaled alternative-response reinforcement and the other (i.e., SΔ) signaled extinction. Experiment 1 assessed resurgence in both the SΔ and SD when alternative reinforcement was removed. Experiment 2 evaluated resurgence under conditions that better approximated those used in the clinic in which the alternative-response SΔ was present or absent. The SΔ failed to suppress target responding during resurgence testing in both experiments. These findings suggest that the conditions under which an alternative-response SΔ will successfully mitigate resurgence may be limited and require further research.
Collapse
|
7
|
Lay BPP, Khoo SYS. Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology. NEUROANATOMY AND BEHAVIOUR 2021. [DOI: 10.35430/nab.2021.e18] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.
Collapse
Affiliation(s)
- Belinda Po Pyn Lay
- Center for Studies in Behavioral Neurobiology/Groupe de Recherche en Neurobiologie Comportementale, Department of Psychology, Concordia University, Montreal, Canada
| | - Shaun Yon-Seng Khoo
- Department of Pharmacology and Physiology, Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada
| |
Collapse
|
8
|
Shvarts S, Jimenez‐Gomez C, Bai JYH, Thomas RR, Oskam JJ, Podlesnik CA. Examining stimuli paired with alternative reinforcement to mitigate resurgence in children diagnosed with autism spectrum disorder and pigeons. J Exp Anal Behav 2019; 113:214-231. [DOI: 10.1002/jeab.575] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2019] [Revised: 11/22/2019] [Accepted: 11/26/2019] [Indexed: 01/26/2023]
Affiliation(s)
- Samuel Shvarts
- Florida Institute of Technology and The Scott Center for Autism Treatment
| | | | | | - Rachel R. Thomas
- Florida Institute of Technology and The Scott Center for Autism Treatment
| | - James J Oskam
- Florida Institute of Technology and The Scott Center for Autism Treatment
| | | |
Collapse
|
9
|
Gámez AM, Bernal-Gamboa R. The reoccurrence of voluntary behavior in humans is reduced by retrieval cues from extinction. Acta Psychol (Amst) 2019; 200:102945. [PMID: 31665622 DOI: 10.1016/j.actpsy.2019.102945] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2019] [Revised: 09/24/2019] [Accepted: 09/30/2019] [Indexed: 12/29/2022] Open
Abstract
Changes in the temporal as well as the physical context produces the reappearance of extinguished behaviors. Furthermore, combining both kinds of contextual stimuli often causes greater levels of recovery. The current experiment explored the impact of extinction reminders on spontaneous recovery, renewal, and a combination of both effects using an instrumental learning task with humans. All participants learned to shoot at enemies in a videogame. Then, throughout extinction, the instrumental response was eliminated. We found a return of the extinguished behavior by introducing a retention interval of 48 h, by changing the physical background and by testing participants in a spatiotemporal context different from the extinction context. However, we also found that the presentation of a stimulus directly associated with extinction attenuates all three forms of operant reoccurrence. These results are consistent with the perspective that emphasizes that context plays a key role in response-recovery phenomena. Moreover, our findings may be promissory for therapeutic strategies involving relapse treatment.
Collapse
Affiliation(s)
- A Matías Gámez
- Universidad de Jaén, Spain; Universidad de Cádiz, Spain.
| | | |
Collapse
|
10
|
Bouton ME. Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control. Psychopharmacology (Berl) 2019; 236:7-19. [PMID: 30350221 PMCID: PMC6374202 DOI: 10.1007/s00213-018-5076-4] [Citation(s) in RCA: 68] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Accepted: 10/10/2018] [Indexed: 12/16/2022]
Abstract
This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.
Collapse
|