On the effects of noncontingent delivery of differing magnitudes of reinforcement

A Theory of the Extinction Burst

A preliminary theory of a temporary increase in the rate of an operant response with the transition to extinction (i.e., the extinction burst) is proposed. The theory assumes reinforcers are events permitting access to some valuable activity, and that such activity can compete for allocation with the target response under some conditions (e.g., very high reinforcement rates). With the transition to extinction, elimination of this competition for allocation can produce an increase in the the target response, but the increase is transient because the value of the target response decreases with exposure to extinction. The theory provides a way to understand why the extinction burst is not ubiquitous, seems more common following very small ratio schedules, occurs for a short period of time following the transition to extinction, and may be eliminated with the availability of alternative reinforcement. It appears to provide a reasonable starting point for a theory of the extinction burst that does not necessarily require inclusion of invigorating effects of frustration, and it is closely aligned with Resurgence as Choice theory. Additional research on factors modulating reinforcement-related activities and how they affect the extinction burst could help to further evaluate the theory.

The extinction burst: Impact of reinforcement time and level of analysis on measured prevalence

Despite widespread belief in the extinction burst as a common occurrence, relatively little empirical work has focused directly on the phenomenon. In order to provide additional data on the topic, we report reanalyses of published extinction-control groups from our laboratory following training with a variety of schedules and reinforcers. In addition, two prospective experiments were conducted in which rats responded for food on FR 5 or FR 1 schedules prior to a within-session transition to extinction. The results of these reanalyses and experiments suggest that the obtained prevalence of the extinction burst was considerably greater when response rates in the first minute of the transition to extinction were considered as compared to when session-wide response rates were considered. In addition, when reinforcement time was included in baseline response-rate calculations, the obtained prevalence of the extinction burst was higher than when reinforcement time was omitted. These findings highlight the importance of measurement and definitional issues in the obtained prevalence of the extinction burst. Further, a closer alignment of such issues across basic and applied research would be desirable in terms of the development of future theories describing the processes giving rise to the extinction burst.

Behavior Momentum Theory and Humans: A Review of the Literature

Behavioral Momentum Theory (BMT) is often described as analogous to Newton's (1687) laws of motion. That is to say, similar to an object in motion continuing in motion unless acted upon by a force, responses occurring in a static environment will continue to occur at the same rate, unless presented with a disruptor (Nevin, Tota, Torquato, & Shull, Journal of the Experimental Analysis of Behavior, 53, 359-379, 1990). When evaluating response rates through a behavioral momentum framework, responding continuing after a change in reinforcer conditions is said to persist. Previous research conducted with nonhuman animals indicates greater response persistence following conditions with either higher reinforcer rates or higher reinforcer magnitudes (Nevin, Journal of the Experimental Analysis of Behavior, 21(3), 389-408, 1974; Nevin et al., Journal of the Experimental Analysis of Behavior, 53, 359-379, 1990). Although BMT's implications extend across human and nonhuman species, this literature review attempts to provide practitioners and researchers information regarding response persistence across various conditions with human participants.

An Evaluation of the Effects of Varying Magnitudes of Reinforcement on Variable Responding Exhibited by Individuals With Autism

Interventions aimed at increasing communicative response variability hold particular importance for individuals with autism spectrum disorders (ASD). Several procedures have been demonstrated in the applied and translational literature to increase response variability. However, little is known about the relationship between reinforcer magnitude and response variability. In the basic literature, Doughty, Giorno, and Miller evaluated the effects of reinforcer magnitude on behavioral variability by manipulating reinforcer magnitude across alternating relative frequency threshold contingencies, with results suggesting that larger reinforcers induced repetitive responding. The purpose of this study was to translate Doughty et al.'s findings to evaluate the relative effects of different magnitudes of reinforcement on communicative response variability in children with ASD. A Lag 1 schedule of reinforcement was in place during each condition within an alternating treatments design. Magnitudes of reinforcement contingent on variable communicative responding were manipulated across the two conditions. Inconsistent with basic findings, the results showed higher levels of variable communicative responding associated with the larger magnitude of reinforcement. These outcomes may have potential implications for interventions aimed at increasing response variability in individuals with ASD, as well as future research in this area.

Evaluating the effects of discriminability on behavioral persistence during and following time-based reinforcement

With four children with autism we evaluated a refinement to time-based reinforcement designed to reduce response persistence when we simultaneously introduced time-based reinforcement and extinction. We further evaluated whether this refinement mitigated response recurrence when all reinforcer deliveries ceased during an extinction-only disruptor phase. The refinement involved increasing the saliency of the contingency change from contingent reinforcement (during baseline) to time-based reinforcement by delivering different colored reinforcers during time-based reinforcement. Behavioral momentum theory predicts that increasing the discriminability of the change from variable-interval to variable-time reinforcement should lead to faster reductions in responding. We present data on four participants, three of whom displayed response patterns consistent with the predictions of behavioral momentum theory during time-based reinforcement. However, the participants showed more varied patterns of recurrent behavior during extinction. We discuss these results within a translational research framework focusing on strategies used to mitigate treatment relapse for severe destructive behavior, as time-based reinforcement is one of the most commonly prescribed interventions for destructive behavior displayed by individuals with intellectual and developmental disabilities.

Noncontingent reinforcement of disruptive behaviors in personal care home settings

The purpose of this case study was to examine the potential of using noncontingent reinforcement (NCR) to reduce the frequency of disruptive behaviors of three elderly persons in personal care home (PCH) settings. Assessment indicated that participants were engaging in the disruptive behaviors to obtain social attention from PCH staff. Social attention, up to 1 min of staff making eye contact with the participant and directing positive verbal statements toward the participant, was given on a fixed time interval (from morning through early evening) beginning every 20 min and fading to every 30 min. Results indicate that NCR reduced the frequency of the disruptive behaviors.

A systematic examination of different parameters of presession exposure to tangible stimuli that maintain problem behavior

We examined the effects of three different presession conditions on tangibly maintained problem behavior for 2 students with autism, using individual-participant multielement designs. First, an analogue functional analysis demonstrated that problem behavior was maintained by access to tangible items. Next, topographies of item rejection were identified. Finally, students were exposed to (a) brief access, (b) no access, and (c) satiation to the tangible items prior to tangible sessions. The results demonstrated high levels of problem behavior following the brief-access and no-access presession conditions and low levels of problem behavior following the satiation condition. The findings are discussed in the context of how satiation might best be defined for these sorts of evaluations.

Applied implications of reinforcement history effects

Although the influence of reinforcement history is a theoretical focus of behavior analysis, the specific behavioral effects of reinforcement history have received relatively little attention in applied research and practice. We examined the potential effects of reinforcement history by reviewing nonhuman, human operant, and applied research and interpreted the findings in relation to possible applied significance. The focus is on reinforcement history effects in the context of reinforcement schedules commonly used either to strengthen behavior (e.g., interval schedules) or commonly used to decrease behavior (e.g., extinction).

The effects of signaling stimulus presentation during noncontingent reinforcement

The effects of signaling the return of items or attention during treatment with noncontingent reinforcement were examined. First, functional analyses showed that the problem behavior exhibited by 2 teenagers with developmental disabilities was sensitive to social positive reinforcement. Next, delivery of the stimulus that maintained problem behavior on a fixed-time (FT) schedule was compared to a condition in which the removal of the stimulus during the same FT schedule was immediately preceded by a statement indicating that the stimulus would be returned and the initiation of a digital timer. Results show that the FT schedule reduced problem behavior, and the addition of an informative statement and a timer further decreased problem behavior.

Noncontingent reinforcement, alternative reinforcement, and the matching law: a laboratory demonstration

Basic researchers, but not most applied researchers, have assumed that the behavior-decelerating effects of noncontingent reinforcement result at least partly from adventitious reinforcement of competing behaviors. The literature contains only sketchy evidence of these effects because few noncontingent reinforcement studies measure alternative behaviors. A laboratory model is presented in which concurrent schedules of contingent reinforcement were used to establish a "target" and an "alternative" behavior. Imposing noncontingent reinforcement decreased target behavior rates and increased alternative behavior rates, outcomes that were well described by the standard quantitative account of alternative reinforcement, the generalized matching law. These results suggest that adventitious reinforcement of alternative behaviors can occur during noncontingent reinforcement interventions, although the range of conditions under which this occurs remains to be determined in future studies. As an adjunct to applied studies, laboratory models permit easy measurement of alternative behaviors and parametric manipulations needed to answer many research questions.

Effects of reinforcer consumption and magnitude on response rates during noncontingent reinforcement

Results of previous research on the effects of noncontingent reinforcement (NCR) have been inconsistent when magnitude of reinforcement was manipulated. We attempted to clarify the influence of NCR magnitude by including additional controls. In Study 1, we examined the effects of reinforcer consumption time by comparing the same magnitude of NCR when session time was and was not corrected to account for reinforcer consumption. Lower response rates were observed when session time was not corrected, indicating that reinforcer consumption can suppress response rates. In Study 2, we first selected varying reinforcer magnitudes (small, medium, and large) on the basis of corrected response rates observed during a contingent reinforcement condition and then compared the effects of these magnitudes during NCR. One participant exhibited lower response rates when large-magnitude reinforcers were delivered; the other ceased responding altogether even when small-magnitude reinforcers were delivered. We also compared the effects of the same NCR magnitude (medium) during 10-min and 30-min sessions. Lower response rates were observed during 30-min sessions, indicating that the number of reinforcers consumed across a session can have the same effect as the number consumed per reinforcer delivery. These findings indicate that, even when response rate is corrected to account for reinforcer consumption, larger magnitudes of NCR (defined on either a per-delivery or per-session basis) result in lower response rates than do smaller magnitudes.

Effects of alternative reinforcement on human behavior: the source does matter

Competing theories regarding the effects of delivering periodic response-independent reinforcement (more accurately, response-independent points exchanged for money) on a baseline rate of behavior were evaluated in human subjects. Contiguity theory holds that these events decrease target responding because incompatible behavior is adventitiously strengthened when the point deliveries follow target behavior closely in time. Matching theory holds that response-independent points, like any other alternative reinforcer, should reduce target responding. On this view, temporal contiguity between target responding and response-independent point delivery is unimportant. In our experiment, four different responses (moving a joystick in four different directions) were reinforced with points exchangeable for money according to four independent variable-interval schedules. Different schedules of point delivery were then superimposed on these baselines. When all superimposed point deliveries occurred immediately after one of the four responses (the target response), time allocated to target responding increased. When the superimposed point deliveries could be delivered at any time, time allocated to target responding declined and other behavior increased. When superimposed points could never immediately follow target responses, time allocated to target responding decreased further and other behavior or pausing predominated. The findings underscore the contribution of temporal contiguity in the effects of response-independent deliveries of food, money, points, etc.

The effects of magnitude and quality of reinforcement on choice responding during play activities

Three boys with autism participated in a study of the effects of magnitude and quality of reinforcement on choice responding. Two concurrent response alternatives were arranged: (a) to play in an area where a peer or sibling was located, or (b) to play in an area where there was no peer or sibling. During one condition, the magnitude (i.e., duration of access to toys) or quality (level of preference) of reinforcement provided for both responses was equal. During the other condition, the magnitude or quality of reinforcement was relatively greater for choosing the play area where the peer or sibling was located than the area where the peer or sibling was not located. Results showed that after repeated exposure to the unequal magnitude or quality condition, the participant increasingly allocated his responses to the play area where the peer or sibling was located. For 2 participants, this pattern of responding was maintained in the subsequent equal magnitude or quality condition. Overall, the analysis suggests that the dimensions of magnitude and quality of reinforcement can be arranged to influence choice responding in favor of playing near a peer or sibling rather than playing alone.

Using fixed-time schedules to maintain behavior: a preliminary investigation

The purpose of this study was to evaluate the potential of fixed-time (FT) schedules to maintain behavior. Two children who had been diagnosed with autism were taught a functional task. Subsequently, three different FT schedules (i.e., yoked, thin, dense) were compared to determine their capacity to maintain task responding. Results suggested that FT schedules may be used to maintain previously acquired behavior.

Fixed-time schedule effects as a function of baseline reinforcement rate

Using an arbitrary response, we evaluated fixed-time (FT) schedules that were either similar or dissimilar to a baseline (response-dependent) reinforcement schedule and extinction. Results suggested that both FT schedules and extinction resulted in decreased responding. However, FT schedules were more effective in reducing response rates if the FT reinforcer rate was dissimilar to baseline reinforcer rates. Possible reasons for this difference were evaluated with data analysis methods designed to identify adventitious response-reinforcer relations.

Habit reversal as a treatment for chronic skin picking in typically developing adult male siblings

In this study, habit reversal was evaluated as a treatment for skin picking in typically developing adult male siblings using a nonconcurrent multiple baseline across participants design. Results showed socially valid decreases in reported picking as a result of treatment.

A review of "noncontingent" reinforcement as treatment for the aberrant behavior of individuals with developmental disabilities

The term noncontingent reinforcement (NCR) refers to the delivery of an aberrant behavior's known reinforcer on a response-independent basis. The typical result is a decrease in responding from baseline (i.e., reinforcement) levels. NCR has become one of the most reported function-based treatments for aberrant behavior in the recent literature. The purpose of this review is to briefly discuss the history of the procedure and summarize the findings from the treatment research literature. The review is organized into the following sections: (a) basic research on NCR, (b) NCR as a control procedure, (c) NCR as a function-based treatment, (d) considerations in the programming of NCR schedules, (e) behavior-change mechanisms underlying NCR effects, and (t) directions for future research.

A method for identifying satiation versus extinction effects under noncontingent reinforcement schedules

We evaluated one method for determining whether response suppression under noncontingent reinforcement (NCR) is a function of satiation or extinction. Three individuals with developmental disabilities who engaged in self-injurious behavior (SIB) or aggression participated. Results of functional analyses indicated that their problem behavior was maintained by social-positive reinforcement. NCR procedures, individualized for each participant, were implemented in a multiple baseline across subjects design and were associated with decreases in all participants' problem behavior. Identification of the mechanism by which NCR produced these effects was based on examination of cumulative records showing response patterns during and immediately following each NCR session. Satiation during NCR should lead to a temporary increase in responding during the post-NCR (extinction) period due to a transition from the availability to the unavailability of reinforcement (satiation to deprivation). Alternatively, extinction during NCR should reveal no increase in responding during the extinction period because the contingency for the problem behavior would remain unchanged and the transition from satiation to deprivation conditions would be irrelevant. Results suggested that the operative mechanisms of NCR were idiosyncratic across the 3 participants and appeared to change during treatment for 1 of the participants.

Competition between noncontingent and contingent reinforcement schedules during response acquisition

We examined the extent to which noncontingent reinforcement (NCR), when used as treatment to reduce problem behavior, might interfere with differential reinforcement contingencies designed to strengthen alternative behavior. After conducting a functional analysis to identify the reinforcers maintaining 2 participants' self-injurious behavior (SIB), we delivered those reinforcers under dense NCR schedules. We delivered the same reinforcers concurrently under differential-reinforcement-of-alternative-behavior (DRA) contingencies in an attempt to strengthen replacement behaviors (mands). Results showed that the NCR plus DRA intervention was associated with a decrease in SIB but little or no increase in appropriate mands. In a subsequent phase, when the NCR schedule was thinned while the DRA schedule remained unchanged, SIB remained low and mands increased. These results suggest that dense NCR schedules may alter establishing operations that result in not only suppression of problem behavior but also interference with the acquisition of appropriate behavior. Thus, the strengthening of socially appropriate behaviors as replacements for problem behavior during NCR interventions might best be achieved if the NCR schedule is first thinned.

Noncontingent reinforcement: effects of satiation versus choice responding

Recent research findings suggest that the initial reductive effects of noncontingent reinforcement (NCR) schedules on destructive behavior result from the establishing effects of an antecedent stimulus (i.e., the availability of "free" reinforcement) rather than extinction. A number of authors have suggested that these antecedent effects result primarily from reinforcer satiation, but an alternative hypothesis is that the individual attempts to access contingent reinforcement primarily when noncontingent reinforcement is unavailable, but chooses not to access contingent reinforcement when noncontingent reinforcement is available. If the satiation hypothesis is more accurate, then the reductive effects of NCR should increase over the course of a session, especially for denser schedules of NCR, and should occur during both NCR delivery and the NCR inter-reinforcement interval (NCR IRI). If the choice hypothesis is more accurate, then the reductive effects of NCR should be relatively constant over the course of a session for both denser and leaner schedules of NCR and should occur almost exclusively during the NCR interval (rather than the NCR IRI). To evaluate these hypotheses, we examined within-session trends of destructive behavior with denser and leaner schedules of NCR (without extinction), and also measured responding in the NCR interval separate from responding in the NCR IRI. Reductions in destructive behavior were mostly due to the participants choosing not to access contingent reinforcement when NCR was being delivered and only minimally due to reinforcer satiation.

Further evaluation of reinforcer magnitude effects in noncontingent schedules

We closely replicated the procedures of a previous study that showed a positive relationship between reinforcer magnitude and the response-rate-reducing effects of noncontingent schedules (NCS). NCS reduced response rates, as expected, but the NCS-magnitude effect was not reproduced, illuminating possible weaknesses of current arbitrary-response procedures and suggesting avenues for future research.