Competition between noncontingent and contingent reinforcement schedules during response acquisition

Reinforcer value moderates response magnitude and persistence during extinction: A randomized trial

Extinction bursts, or temporary increases in rates and intensities of behavior during extinction, can preclude the inclusion of extinction in intervention packages meant to suppress severe challenging behavior. To identify underlying behavioral mechanisms responsible for response persistence and bursting, 69 adults with developmental disabilities completed a low-stakes translational investigation employing a 2 × 2 factorial, crossed, and randomized matched blocks design, with batched randomization logic. In each of the four test groups, we made distinct antecedent manipulations with two value parameters commonly studied through behavioral economics (i.e., demand intensity, Pmax) and evaluated the extent to which each of these manipulations influenced target responding during extinction. Although we found statistically significant differences attributable to both parameters, variations in reinforcer consumption relative to demand intensity were most influential across all dependent variables. This outcome implicates consumption relative to demand intensity as both a mitigating and exacerbating preextinction factor that influences the prevalence of adverse collateral extinction effects (e.g., bursts).

Approaches for Treating Multiply Controlled Problem Behavior

A portion of problem behavior is maintained by multiple reinforcement contingencies. Treating multiply controlled problem behavior may be more complex than treating problem behavior maintained by a single contingency. Several approaches for addressing multiply controlled problem behavior have been described in the literature. The purpose of this review is to provide practitioners with an overview of function-based approaches for addressing multiply controlled problem behavior. In particular, we present guidelines for functional analysis and treatment. We also describe strengths and limitations of published treatment approaches and discuss strategies for mitigating these limitations. Finally, we describe areas for future research.

Relative preference for distinct reinforcers maintaining destructive behavior

The literature offers few recommendations for sequencing exposure to treatment conditions with individuals with multiply maintained destructive behavior. Identifying relative preference for the functional reinforcers maintaining destructive behavior may be one means of guiding that decision. The present study presents a preliminary attempt at developing a robust relative preference and reinforcer assessment for individuals with multiply maintained destructive behavior. Guided and free-choice trials were implemented in which participants chose between two multiple-schedule arrangements, each of which programmed signaled periods of isolated reinforcer availability and unavailability. Consistent participant choice and responding during free-choice trials was then used to thin the corresponding schedule of reinforcement. The results demonstrated a strong preference for one of the two functional reinforcers for all four participants, yet preferences differed across participants and were not well predicted by responding in prior analyses.

Multiple Schedules Facilitate Rapid Noncontingent Reinforcement Schedule Thinning

We evaluated a noncontingent reinforcement treatment that included initial brief exposures to signaled alternation of availability and nonavailability of reinforcement, followed by rapid schedule thinning. Results confirmed findings from previous research (typically with differential reinforcement schedules) that establishing stimulus control across multiple treatment components facilitated schedule thinning. We discuss both the clinical utility of this procedure and the utility of stimulus control for making interventions more practical for clinicians.

Sustaining behavior reduction by transitioning the topography of the functional communication response

When a functional communication response (FCR) can be reliably occasioned, destructive behavior tends to be lower. However, the form of FCR may affect the durability of functional communication training, as missing FCR materials may promote resurgence. Experiment 1 demonstrated that resurgence of target responding was lower when a vocal FCR remained available but was placed on extinction compared to when a card-based FCR was unavailable. Experiment 2 replicated the finding that initiating treatment with a card FCR produced less target responding than when initiating treatment with a vocal FCR. We then evaluated a set of procedures for transitioning the card FCR to the previously unlearned vocal FCR. These findings suggest benefits of training different types of FCRs at different stages of treatment and provide a preliminary set of procedures for transitioning between FCR topographies while occasioning minimal target responding.

Does teaching an omnibus mand preclude the development of specifying mands?

When problem behavior is controlled by a synthesized reinforcement contingency, a simple omnibus mand that yields access to all reinforcers simultaneously has been shown to effectively replace problem behavior. The question arises as to whether teaching an omnibus mand will preclude the acquisition of specifying mands for each of the combined reinforcers. In this study, after 3 students diagnosed with autism acquired an omnibus mand ("My way, please") that yielded all identified reinforcers simultaneously, specifying mands (e.g., "All done," "May I have my toys?" "Play with me") were taught to yield each individual reinforcer (e.g., escape, tangibles, attention). Problem behavior was immediately eliminated for all children, and the omnibus mand was acquired quickly. Teaching an omnibus mand did not preclude acquisition of specifying mands for any learner and instead allowed for the acquisition of specifying mands once problem behavior had been effectively reduced.

The effects of the non-contingent presentation of safety signals on the elimination of safety behaviors: An experimental comparison between individuals with low and high obsessive-compulsive profiles

BACKGROUND AND OBJECTIVES

Safety behaviors, defined as engagement in avoidance within safe environments, are a key symptom of obsessive-compulsive and related disorders. They may interfere with daily functioning and as such their emission should be reduced. The purpose of the current study is to investigate the effects of the non-contingent presentation of safety signals (cues produced by safety behaviors) on reducing safety behaviors in participants self-reporting low and high OCD profiles.

METHODS

In total, 32 participants were asked to play a game to gain points and avoid their loss. After having developed avoidance behavior, evidenced by maintaining all of their earned points, they were exposed to safe environments where no point loss was programmed. In Test 1, safety cues (blue bar) were produced contingent on performing safety behaviors. In Test 2, safety cues were presented continuously without any response requirement.

RESULTS

Findings demonstrated that high OCD group displayed higher rates of safety behaviors than low OCD group. However, exposure to the non-contingent presentation of safety signals eliminated their emission in both groups.

LIMITATIONS

Future studies need to evaluate the effects of different non-contingent schedules on the suppression of safety behaviors.

CONCLUSIONS

These findings contribute to the literature by demonstrating that non-contingent introduction of safety signals eliminated safety behaviors completely, even in high OCD participants, who performed safety behavior at higher rates. Such a treatment protocol may ameliorate exposure therapy in which response prevention constitutes a key element and is generally associated with increased drop-out rates.

A comparison of resetting and nonresetting contingencies in progressive-duration schedules

We compared two progressive schedules of reinforcement in which rats received access to sweetened condensed milk for depressing and holding down a response lever. Duration requirements increased after each reinforcer delivery in a manner similar to progressive-ratio schedules. Under one schedule, any response duration less than that required for reinforcement had no programmed consequences. Under the second schedule, the cumulative duration of all responses could meet the reinforcement criteria. Breaking points were consistently higher when all lever presses, regardless of duration, contributed to meeting the reinforcer requirements. Breaking points under both schedules increased when food deprivation was long enough to result in body-weight reductions, but the sensitivity of the schedules to brief periods of food deprivation was inconsistent. Under both schedules, food deprivation produced an increase in shorter durations, thus reducing the efficiency of responding.

Noncontingent reinforcement without extinction plus differential reinforcement of alternative behavior during treatment of problem behavior

The effects of noncontingent reinforcement (NCR) without extinction during treatment of problem behavior maintained by social positive reinforcement were evaluated for five individuals diagnosed with autism spectrum disorder. A continuous NCR schedule was gradually thinned to a fixed-time 5-min schedule. If problem behavior increased during NCR schedule thinning, a continuous NCR schedule was reinstated and NCR schedule thinning was repeated with differential reinforcement of alternative behavior (DRA) included. Results showed an immediate decrease in all participants' problem behavior during continuous NCR, and problem behavior maintained at low levels during NCR schedule thinning for three participants. Problem behavior increased and maintained at higher rates during NCR schedule thinning for two other participants; however, the addition of DRA to the intervention resulted in decreased problem behavior and increased mands.

Teaching a Child With ASD to Approach Communication Partners and Use a Speech-Generating Device Across Settings: Clinic, School, and Home

Individuals with autism spectrum disorder (ASD) often have difficulty generalizing newly acquired communication skills to different contexts. In this study, a multiple baseline across settings (clinic, school, and home) design was used to determine whether an 8-year-old boy with ASD could learn to approach communication partners to request preferred items using an iPad®-based speech-generating device (SGD). Results indicated that the participant learned to approach communication partners to request across all settings. Acquisition of this skill was fastest at school and slowest in the clinic. The participant’s learning generalized to a novel room within the same setting, and he was also able to retrieve the SGD prior to approaching the communication partner without additional teaching. Results suggest that individuals with ASD may benefit from being systematically taught to use an SGD across different settings and communication partners.

Modeling the effects of sensory reinforcers on behavioral persistence with alternative reinforcement

Problem behavior often has sensory consequences that cannot be separated from the target response, even if external, social reinforcers are removed during treatment. Because sensory reinforcers that accompany socially mediated problem behavior may contribute to persistence and relapse, research must develop analog sensory reinforcers that can be experimentally manipulated. In this research, we devised analogs to sensory reinforcers in order to control for their presence and determine how sensory reinforcers may impact treatment efficacy. Experiments 1 and 2 compared the efficacy of differential reinforcement of alternative behavior (DRA) versus noncontingent reinforcement (NCR) with and without analog sensory reinforcers in a multiple schedule. Experiment 1 measured the persistence of key pecking in pigeons, whereas Experiment 2 measured the persistence of touchscreen responses in children with intellectual and developmental disabilities. Across both experiments, the presence of analog sensory reinforcers increased the levels, persistence, and variability of responding relative to when analog sensory reinforcers were absent. Also in both experiments, target responding was less persistent under conditions of DRA compared to NCR regardless of the presence or absence of analog sensory reinforcers.

The association between self-injurious behaviors and autism spectrum disorders

A key area of concern in children with autism spectrum disorders (ASDs) are self-injurious behaviors (SIBs). These are behaviors that an individual engages in that may cause physical harm, such as head banging, or self-biting. SIBs are more common in children with ASD than those who are typically developing or have other neurodevelopmental disabilities. Therefore, it is important that clinicians who work with children with ASD have a solid understanding of SIB. The purpose of this paper is to review the research on the epidemiology of SIB in children with ASD, factors that predict the presence of SIB in this population, and the empirically supported behavioral treatments available.

Noncontingent reinforcement: a further examination of schedule effects during treatment

We conducted 2 studies to determine whether dense and thin NCR schedules exert different influences over behavior and whether these influences change as dense schedules are thinned. In Study 1, we observed that thin as well as dense NCR schedules effectively decreased problem behavior exhibited by 3 individuals. In Study 2, we compared the effects of 2 NCR schedules in multielement designs, one with and the other without an extinction (EXT) component, while both schedules were thinned. Problem behavior remained low as the NCR schedule with EXT was thinned, but either (a) did not decrease initially or (b) subsequently increased as the NCR schedule without EXT was thinned. These results suggest that dense schedules of NCR decrease behavior by altering its motivating operation but that extinction occurs as the NCR schedule is thinned. The benefits and limitations of using dense or thin NCR schedules are discussed.

The effects of fixed-time reinforcement schedules on functional response classes: a translational study

Research on functional response classes has applied significance because less severe forms of problem behavior have been found to co-occur with more severe forms. In addition, the most severe forms of problem behavior are sometimes targeted for intervention without monitoring other less severe forms. In such cases, it is unknown whether and how untreated forms of problem behavior covary with the targeted behaviors. The present study employed a translational procedure (with button presses as the target behavior) to investigate response covariation under noncontingent reinforcement with typically developing preschoolers. The results indicated that noncontingent reinforcement was generally effective in decreasing all response class members when only one member was targeted.

Function-based treatments for escape-maintained problem behavior: a treatment-selection model for practicing behavior analysts

Escape from instructional activities is a common maintaining variable for problem behavior and a number of effective treatments have been developed for this function. Each of these treatments has characteristics that make them optimal for certain environments and clients, but less optimal for others. We summarize the most commonly researched function-based treatments for escape-maintained behavior, describe the contexts for which they are most appropriate, and provide a clinical model for selecting treatments based on client characteristics and the constraints of the therapeutic environment.

Extended Analysis of Empirical Citations with Skinner's Verbal Behavior: 1984-2004

The present paper comments on and extends the citation analysis of verbal operant publications based on Skinner's Verbal Behavior (1957) by Dymond, O'Hora, Whelan, and O'Donovan (2006). Variations in population parameters were evaluated for only those studies that Dymond et al. categorized as empirical. Preliminary results indicate that the majority of empirical research in the area of verbal behavior has been conducted with the younger developmentally disabled population and has focused on verbal operants from the introductory chapters of Skinner's book. It is clear that Verbal Behavior has influenced empirical research over the past 50 years. We believe, however, that there are many underdeveloped research areas originating from Verbal Behavior that have not yet been addressed. Suggestions for extended areas of research are provided.

Reinforcement schedule thinning following functional communication training: review and recommendations

This paper extends the Tiger, Hanley, and Bruzek (2008) review of functional communication training (FCT) by reviewing the published literature on reinforcement schedule thinning following FCT. As noted by Tiger et al. and others, schedule thinning may be necessary when the newly acquired communication response occurs excessively, to the extent that reinforcing it consistently is not practical in the natural environment. We provide a review of this literature including a discussion of each of the more commonly used schedule arrangements used for this purpose, outcomes obtained, a description of methods for progressing toward the terminal schedule, and a description of supplemental treatment components aimed at maintaining low levels of problem behavior during schedule thinning. Recommendations for schedule thinning are then provided. Finally, conceptual issues related to the reemergence of problem behavior during schedule thinning and areas for future research are discussed.

A review of empirical support for differential reinforcement of alternative behavior

Differential reinforcement of alternative behavior (DRA) is one of the most common behavior analytic interventions used to decrease unwanted behavior. We reviewed the DRA literature from the past 30 years to identify the aspects that are thoroughly researched and those that would benefit from further emphasis. We found and coded 116 empirical studies that used DRA, later grouping them into categories that met APA Division 12 Task Force criteria. We found that DRA has been successful at reducing behaviors on a continuum from relatively minor problems like prelinguistic communication to life-threatening failure to thrive. DRA with and without extinction is well established for treating destructive behavior of those with developmental disabilities, and to combat food refusal.

Empirical Applications of Skinner's Analysis of Verbal Behavior with Humans

In Verbal Behavior,Skinner (1957) provided a conceptual framework and taxonomy for the controlling variables of language that defined independent verbal operants by their functional relations to antecedents and consequences (rather than by topography or meaning). Although professional interest in this area has recently increased within the behavior analytic community, Skinner's conceptual framework may not yet have fully impacted the experimental literature. This quantitative review of the literature examined the studies on verbal behavior that were empirical in nature, concerned with human verbal behavior, and addressed at least one verbal operant (e.g., mand, tact, echoic, autoclitic, and/or intraverbal behavior) within the experiment. The results of this review suggest that a growing body of research exists to support many of the tenets of Skinner's conceptualization and taxonomy but many areas of verbal behavior research have yet to be addressed. Continued research in this area is crucial for the development and implementation of effective verbal behavior interventions for people with disabilities.

Citation Analysis of Skinner's Verbal Behavior: 1984-2004

The present study undertook an updated citation analysis of Skinner's (1957)Verbal Behavior. All articles that cited Verbal Behavior between 1984 and 2004 were recorded and content analyzed into one of five categories; four empirical and one nonempirical. Of the empirical categories, studies that employed a verbal operant from Skinner's analysis were assigned to either basic, applied, or observational categories. Empirical studies that did not employ a verbal operant were categorized as other-empirical. The total number of citations remained stable across the review period and averaged just over 52 per year. Of these, 80% were from nonempirical articles, 13.7% were from other-empirical articles, 4% were from applied articles, 1.4% were from basic articles, and 0.9% were from observational articles. An "obliteration" analysis was also conducted to identify articles that employed Skinner's verbal operant terms but did not cite Verbal Behavior. This analysis identified 44 additional articles, suggesting that a degree of obliteration had occurred in the half century since the publication of Verbal Behavior. In particular, the analysis suggests that the verbal operant of manding has sufficient presence in the applied empirical literature to render citation of Verbal Behavior redundant. Overall, Verbal Behavior continues to make an important contribution to the psychological literature.

The effects of fixed-time and contingent schedules of negative reinforcement on compliance and aberrant behavior

Prior research has suggested that fixed-time (FT) schedules of reinforcement do not necessarily preclude the acquisition of appropriate behavior (e.g., mands) when combined with differential reinforcement (DRA). These studies also note that dense FT schedules are more likely to interfere with DRA packages than lean FT schedules. In the current investigation, we examined whether similar findings would occur with FT schedules of negative reinforcement. Schedule analyses were conducted with two participants following functional analyses that identified escape from task demands as the maintaining variable for problem behavior. Differential negative reinforcement of alternative behavior (DNRA) was implemented first to establish behavioral control (decreased problem behavior and increased compliance). Breaks (negative reinforcement) were then concurrently delivered on a FT basis under either dense (at a greater rate than that obtained during DNRA alone) or lean (at a lower rate than that obtained during DNRA) reinforcement schedules. In general, results showed that FT escape did not preclude compliance when the FT schedule was lean, but treatment gains were significantly disrupted when dense FT schedules were superimposed.

On the relative contributions of noncontingent reinforcement and escape extinction in the treatment of food refusal

In the current investigation, we evaluated the relative effects of noncontingent reinforcement (NCR), escape extinction, and a combination of NCR and escape extinction as treatment for the feeding problems exhibited by 4 children. For each participant, consumption increased only when escape extinction was implemented, independent of whether NCR was present or absent. These results were consistent with prior research suggesting that positive reinforcement alone is insufficient for increasing consumption, and that escape extinction often is necessary to increase and maintain food acceptance. However, NCR appeared to decrease inappropriate behavior for some participants.

Motivating operations and terms to describe them: some further refinements

Over the past decade, behavior analysts have increasingly used the term establishing operation (EO) to refer to environmental events that influence the behavioral effects of operant consequences. Nonetheless, some elements of current terminology regarding EOs may interfere with applied behavior analysts' efforts to predict, control, describe, and understand behavior. The present paper (a) describes how the current conceptualization of the EO is in need of revision, (b) suggests alternative terms, including the generic term motivating operation (MO), and (c) provides examples of MOs and their behavioral effects using articles from the applied behavior analysis literature.

Motivating operations and terms to describe them: some further refinements

Over the past decade, behavior analysts have increasingly used the term establishing operation (EO) to refer to environmental events that influence the behavioral effects of operant consequences. Nonetheless, some elements of current terminology regarding EOs may interfere with applied behavior analysts' efforts to predict, control, describe, and understand behavior. The present paper (a) describes how the current conceptualization of the EO is in need of revision, (b) suggests alternative terms, including the generic term motivating operation (MO), and (c) provides examples of MOs and their behavioral effects using articles from the applied behavior analysis literature.

Carryover effects of free reinforcement on children's work completion

Patterns of behavior that persist during transition to a new set of contingencies are referred to as reinforcement history or carryover effects. The authors examined the carryover effects of a fixed-time (FT) schedule of free reinforcement on children's work completion and accuracy. Two female students with learning disabilities participated. During an initial concurrent-choice condition, both children completed more difficult problems reinforced on a richer schedule than easy problems reinforced on a leaner schedule. Exposure to an FT schedule was alternated with subsequent choice conditions in an ABABA design to examine potential carryover effects. During FT conditions, the children completed both types of problems with more errors. During subsequent choice conditions, errors were high initially but decreased, and both children completed easy problems for the first few sessions despite their leaner reinforcement schedule. The potential for detrimental effects of free reinforcement on children's work completion is discussed.

A review of "noncontingent" reinforcement as treatment for the aberrant behavior of individuals with developmental disabilities

The term noncontingent reinforcement (NCR) refers to the delivery of an aberrant behavior's known reinforcer on a response-independent basis. The typical result is a decrease in responding from baseline (i.e., reinforcement) levels. NCR has become one of the most reported function-based treatments for aberrant behavior in the recent literature. The purpose of this review is to briefly discuss the history of the procedure and summarize the findings from the treatment research literature. The review is organized into the following sections: (a) basic research on NCR, (b) NCR as a control procedure, (c) NCR as a function-based treatment, (d) considerations in the programming of NCR schedules, (e) behavior-change mechanisms underlying NCR effects, and (t) directions for future research.

A method for identifying satiation versus extinction effects under noncontingent reinforcement schedules

We evaluated one method for determining whether response suppression under noncontingent reinforcement (NCR) is a function of satiation or extinction. Three individuals with developmental disabilities who engaged in self-injurious behavior (SIB) or aggression participated. Results of functional analyses indicated that their problem behavior was maintained by social-positive reinforcement. NCR procedures, individualized for each participant, were implemented in a multiple baseline across subjects design and were associated with decreases in all participants' problem behavior. Identification of the mechanism by which NCR produced these effects was based on examination of cumulative records showing response patterns during and immediately following each NCR session. Satiation during NCR should lead to a temporary increase in responding during the post-NCR (extinction) period due to a transition from the availability to the unavailability of reinforcement (satiation to deprivation). Alternatively, extinction during NCR should reveal no increase in responding during the extinction period because the contingency for the problem behavior would remain unchanged and the transition from satiation to deprivation conditions would be irrelevant. Results suggested that the operative mechanisms of NCR were idiosyncratic across the 3 participants and appeared to change during treatment for 1 of the participants.

Relative influences of establishing operations and reinforcement contingencies on self-injurious behavior during functional analyses

In the typical functional analysis in which the antecedent and consequent events associated with problem behavior are manipulated, the control condition involves elimination of both the relevant establishing operation (EO) and its associated contingency through a schedule of noncontingent reinforcement (usually fixed-time [FT] 30 s). In some functional analyses, however, antecedent events are manipulated in the absence of differential consequences, and a common test condition in such analyses also involves the delivery of reinforcement on an FT 30-s schedule. Thus, the same schedule of reinforcement (FT 30 s) is not considered to be an EO in the former type of analysis but is considered to be an EO in the latter. We examined the relative influences of EOs and reinforcement contingencies on problem behavior by exposing 6 individuals who engaged in self-injurious behavior (SIB) to four combinations of functional analysis conditions: EO present/contingency present, EO absent/contingency present, EO present/contingency absent, and EO absent/contingency absent. Results indicated that the only condition in which high rates of SIB were observed consistently was one in which the EO and the reinforcement contingency were both present. Implications of these results for the design of functional analysis test and control conditions are discussed.

Variable-time reinforcement schedules in the treatment of socially maintained problem behavior

Noncontingent reinforcement (NCR) consists of delivering a reinforcer on a time-based schedule, independent of responding. Studies evaluating the effectiveness of NCR as treatment for problem behavior have used fixed-time (FT) schedules of reinforcement. In this study, the efficacy of NCR with variable-time (VT) schedules was evaluated by comparing the effects of VT and FT reinforcement schedules with 2 individuals who engaged in problem behavior maintained by positive reinforcement. Both FT and VT schedules were effective in reducing problem behavior. These findings suggest that VT schedules can be used to treat problem behavior maintained by social consequences.

A comparison of procedures for programming noncontingent reinforcement schedules

We compared two methods for programming and thinning noncontingent reinforcement (NCR) schedules during the treatment of self-injurious behavior (SIB). The participants were 3 individuals who had been diagnosed with mental retardation. Results of functional analyses indicated that all participants' SIB was maintained by positive reinforcement (i.e., access to attention or food). Following baseline, the effects of two NCR schedule-thinning procedures were compared in multielement designs. One schedule (fixed increment) was initially set at fixed-time 10-s reinforcer deliveries and was also thinned according to fixed-time intervals. The other schedule (adjusting IRT) was initially determined by participants' baseline interresponse times (IRTs) for SIB and was thinned based on IRTs observed during subsequent treatment sessions. Results indicated that both schedules were effective in initially reducing SIB and in maintaining response suppression as the schedules were thinned.