Noncontingent reinforcement: effects of satiation versus choice responding

Basic and applied research on extinction bursts

Discontinuation of the contingency between a response and its reinforcer sometimes produces a temporary increase in the response before its rate decreases, a phenomenon called the extinction burst. Prior clinical and basic studies on the prevalence of the extinction burst provide highly disparate estimates. Existing theories on the extinction burst fail to account for the dynamic nature of this phenomenon, and the basic behavioral processes that control response bursting remain poorly understood. In this paper, we first review the basic and applied literature on the extinction burst. We then describe a recent refinement of the concatenated matching law called the temporally weighted matching law that appears to resolve the above-mentioned issues regarding the extinction burst. We present illustrative translational data based conceptually on the model. Finally, we discuss specific recommendations derived from the temporally weighted matching law regarding procedures clinicians could implement to potentially mitigate or prevent extinction bursts.

Bridging the gap between laboratory and applied research on response-independent schedules

In 1948, Skinner described the behavior of pigeons under response-independent schedules as "superstitious," and proposed that the responses were reinforced by contiguous, adventitious food deliveries. Subsequently, response-independent schedules have been of interest to both basic and applied researchers, first to understand the mechanisms involved, and later, as "noncontingent reinforcement" (NCR) to reduce undesirable behavior. However, the potential superstitious effects produced by these schedules have been challenged, with some researchers arguing that antecedent variables play a significant role. This paper examines the evidence for adventitious reinforcement from both laboratory and applied research, the results of which suggest that antecedent, nonoperant functions may be important in fully understanding the effects of NCR. We propose an applied-basic research synthesis, in which attention to potential nonoperant functions could provide a more complete understanding of response-independent schedules. We conclude with a summary of the applied implications of the nonoperant functions of NCR schedules.

A Theory of the Extinction Burst

A preliminary theory of a temporary increase in the rate of an operant response with the transition to extinction (i.e., the extinction burst) is proposed. The theory assumes reinforcers are events permitting access to some valuable activity, and that such activity can compete for allocation with the target response under some conditions (e.g., very high reinforcement rates). With the transition to extinction, elimination of this competition for allocation can produce an increase in the the target response, but the increase is transient because the value of the target response decreases with exposure to extinction. The theory provides a way to understand why the extinction burst is not ubiquitous, seems more common following very small ratio schedules, occurs for a short period of time following the transition to extinction, and may be eliminated with the availability of alternative reinforcement. It appears to provide a reasonable starting point for a theory of the extinction burst that does not necessarily require inclusion of invigorating effects of frustration, and it is closely aligned with Resurgence as Choice theory. Additional research on factors modulating reinforcement-related activities and how they affect the extinction burst could help to further evaluate the theory.

The extinction burst: Impact of reinforcement time and level of analysis on measured prevalence

Despite widespread belief in the extinction burst as a common occurrence, relatively little empirical work has focused directly on the phenomenon. In order to provide additional data on the topic, we report reanalyses of published extinction-control groups from our laboratory following training with a variety of schedules and reinforcers. In addition, two prospective experiments were conducted in which rats responded for food on FR 5 or FR 1 schedules prior to a within-session transition to extinction. The results of these reanalyses and experiments suggest that the obtained prevalence of the extinction burst was considerably greater when response rates in the first minute of the transition to extinction were considered as compared to when session-wide response rates were considered. In addition, when reinforcement time was included in baseline response-rate calculations, the obtained prevalence of the extinction burst was higher than when reinforcement time was omitted. These findings highlight the importance of measurement and definitional issues in the obtained prevalence of the extinction burst. Further, a closer alignment of such issues across basic and applied research would be desirable in terms of the development of future theories describing the processes giving rise to the extinction burst.

Noncontingent reinforcement: Arbitrary versus maintaining reinforcers for escape-maintained problem behavior

Noncontingent reinforcement (NCR) involves the delivery of maintaining reinforcers on a time-dependent schedule and often includes extinction. However, arbitrary reinforcers may be equally efficacious during NCR without extinction for treating escape-maintained problem behavior. The purpose of this study was to extend previous research on NCR by evaluating the relative efficacy of NCR without extinction and comparing maintaining versus arbitrary reinforcers for 4 individuals with escape-maintained problem behavior. Two different NCR conditions, NCR using the maintaining reinforcer (escape) and NCR using an arbitrary reinforcer (an edible), were evaluated using multielement and reversal designs. Treatment effects varied across participants. Results for 2 participants showed a reduction in problem behavior during NCR without extinction with both the arbitrary and maintaining reinforcers. For 1 participant, results showed a reduction in problem behavior with both the arbitrary and maintaining reinforcers only when extinction was added to NCR. For the 4th participant, the maintaining reinforcer was effective during NCR without extinction, but the arbitrary reinforcer was ineffective.

Treatment Burst Data Points and Single Case Design Studies: A Bayesian N-of-1 Analysis for Estimating Treatment Effect Size

Single-case experimental designs (SCED) evaluate treatment effects for each participant, but it is difficult to aggregate and quantify treatment effects across SCED participants receiving the same type of treatment. We applied Bayesian analytic procedures to SCED data aggregated across participants that have previously only been applied to large-N and group design studies of treatment effect sizes. For the current study, we defined transient elevated treatment data points as (1) above the range of the last five baseline sessions during the first three sessions of treatment (i.e., extinction burst); (2) within or above the range of baseline after the first three treatment sessions (i.e., recurrence burst); or (3) thinning phase data points above the last three prethinning treatment data points (i.e., thinning burst). Results indicated that the treatment effect sizes remained large regardless of controlling for transient elevated treatment data points. Finally, we examined the effects of reinforcer schedule thinning on estimates of treatment effect size. Results indicated a moderate negative impact of schedule thinning on treatment effect size with a 16% decrease in effect size. Recommendations for research and practice are provided, and the utility of using Bayesian analysis in single-case experimental designs is discussed.

Assessing preferences for positive and negative reinforcement during treatment of destructive behavior with functional communication training

Results of prior studies (e.g. [J. Appl. Behav. Anal. 32 (1999) 285]) showing that participants chose alternative behavior (compliance) over escape-reinforced destructive behavior when this latter response produced escape and the former response produced positive reinforcement may have been due to (a) the value of the positive reinforcer overriding the value of the negative reinforcer or (b) the presence of the positive reinforcer altering the value of the negative reinforcer (i.e., lessening the aversiveness of the demands). In this investigation we evaluated the relative contributions of these alternative mechanisms with two girls with autism. We compared the relative effects of positive and negative reinforcement using equivalent communication responses under both a restricted-choice condition (in which participants could choose positive or negative reinforcement, but not both) and an unrestricted-choice condition (in which participants could choose one or both reinforcers). Both participants often chose positive over negative reinforcement in the restricted-choice condition. However, in the unrestricted-choice condition (in which participants could choose one or both reinforcers), one participant consistently chose both reinforcers by the end of the analysis whereas the other primarily chose only positive reinforcement. Results suggested that for one participant the value of the positive reinforcer overrode the value of the negative reinforcer, whereas for the other participant, the presence of the positive reinforcer in the demand context lessened the aversiveness of the demands.

Noncontingent reinforcement, alternative reinforcement, and the matching law: a laboratory demonstration

Basic researchers, but not most applied researchers, have assumed that the behavior-decelerating effects of noncontingent reinforcement result at least partly from adventitious reinforcement of competing behaviors. The literature contains only sketchy evidence of these effects because few noncontingent reinforcement studies measure alternative behaviors. A laboratory model is presented in which concurrent schedules of contingent reinforcement were used to establish a "target" and an "alternative" behavior. Imposing noncontingent reinforcement decreased target behavior rates and increased alternative behavior rates, outcomes that were well described by the standard quantitative account of alternative reinforcement, the generalized matching law. These results suggest that adventitious reinforcement of alternative behaviors can occur during noncontingent reinforcement interventions, although the range of conditions under which this occurs remains to be determined in future studies. As an adjunct to applied studies, laboratory models permit easy measurement of alternative behaviors and parametric manipulations needed to answer many research questions.

A review of "noncontingent" reinforcement as treatment for the aberrant behavior of individuals with developmental disabilities

The term noncontingent reinforcement (NCR) refers to the delivery of an aberrant behavior's known reinforcer on a response-independent basis. The typical result is a decrease in responding from baseline (i.e., reinforcement) levels. NCR has become one of the most reported function-based treatments for aberrant behavior in the recent literature. The purpose of this review is to briefly discuss the history of the procedure and summarize the findings from the treatment research literature. The review is organized into the following sections: (a) basic research on NCR, (b) NCR as a control procedure, (c) NCR as a function-based treatment, (d) considerations in the programming of NCR schedules, (e) behavior-change mechanisms underlying NCR effects, and (t) directions for future research.

Effects of noncontingent reinforcement on problem behavior and stimulus engagement: the role of satiation, extinction, and alternative reinforcement

This study examined the effects of noncontingent reinforcement (NCR) with and without extinction on problem behavior and stimulus engagement (consumption of reinforcement) of 4 participants. Reductions in problem behavior using NCR have frequently been attributed to both satiation of the reinforcer and extinction. In the current study, aspects of the NCR treatment effects were difficult to explain based solely on either a satiation or an extinction account. Specifically, it was found that stimulus engagement remained high throughout the NCR treatment analysis, and that problem behavior was reduced to near-zero levels during NCR without extinction. The implications of these findings are discussed with respect to the satiation and extinction hypotheses frequently described in the applied literature. Findings from basic studies examining the effects of response-independent schedules are presented, and are used as the basis for a matching theory account of NCR-related effects. It is proposed that reductions in problem behavior observed during NCR interventions may be a function of the availability of alternative sources of reinforcement.