A review of reinforcement control procedures

Evaluation of schedule thinning following treatment for aggression maintained by access to higher level restrictive and repetitive behavior

One of the diagnostic characteristics of individuals with autism spectrum disorders includes engaging in restricted and repetitive behavior. Research has shown that individuals will often display problem behavior when access to restricted and repetitive behavior is blocked. The purpose of the current study was to evaluate the use of functional communication training and schedule thinning to treat aggression displayed by three children diagnosed with autism spectrum disorders when higher level restrictive and repetitive behavior was blocked. Further, we assessed whether all steps in a schedule-thinning sequence were necessary as well as extended the practicality of these procedures by removing the continuous signal during the delay to reinforcement. The results indicated that functional communication with schedule thinning reduced aggression related to blocking access to engaging in higher level restrictive and repetitive behavior for all participants.

Bridging the gap between laboratory and applied research on response-independent schedules

In 1948, Skinner described the behavior of pigeons under response-independent schedules as "superstitious," and proposed that the responses were reinforced by contiguous, adventitious food deliveries. Subsequently, response-independent schedules have been of interest to both basic and applied researchers, first to understand the mechanisms involved, and later, as "noncontingent reinforcement" (NCR) to reduce undesirable behavior. However, the potential superstitious effects produced by these schedules have been challenged, with some researchers arguing that antecedent variables play a significant role. This paper examines the evidence for adventitious reinforcement from both laboratory and applied research, the results of which suggest that antecedent, nonoperant functions may be important in fully understanding the effects of NCR. We propose an applied-basic research synthesis, in which attention to potential nonoperant functions could provide a more complete understanding of response-independent schedules. We conclude with a summary of the applied implications of the nonoperant functions of NCR schedules.

Effects of repeated exposure to escalating versus constant punishment intensity on response allocation

The present experiment investigated the effects of 1) repeated exposures to escalating punishment intensities and 2) repeated exposure to punishment after periods of vacation on response allocation between punished and unpunished responding in three groups of rats. The first group (intensity + vacation) experienced repeated exposures to escalating punishment intensities after a period of vacation (i.e., return to baseline) from punishment. The second group (intensity-only) experienced repeated exposures to escalating punishment intensities without vacation from punishment. The third group (vacation-only) experienced repeated exposures to a constant punishment intensity after a period of vacation from punishment. Results showed that superimposition of punishment on one of two concurrently available responses decreased allocation toward the punished response and increased allocation toward the unpunished response. Furthermore, greater changes in allocation were observed with the introduction of a moderate constant intensity than with the introduction of a low intensity that increased across sessions. Reexposure to punishment had different effects between the groups. Although there was evidence that high shock intensities can enhance the efficacy of lower intensities to shift allocation away from the punished response and toward the unpunished response, there was little evidence of changes in response allocation with reintroduction of punishment after a period of vacation.

Noncontingent reinforcement: Arbitrary versus maintaining reinforcers for escape-maintained problem behavior

Noncontingent reinforcement (NCR) involves the delivery of maintaining reinforcers on a time-dependent schedule and often includes extinction. However, arbitrary reinforcers may be equally efficacious during NCR without extinction for treating escape-maintained problem behavior. The purpose of this study was to extend previous research on NCR by evaluating the relative efficacy of NCR without extinction and comparing maintaining versus arbitrary reinforcers for 4 individuals with escape-maintained problem behavior. Two different NCR conditions, NCR using the maintaining reinforcer (escape) and NCR using an arbitrary reinforcer (an edible), were evaluated using multielement and reversal designs. Treatment effects varied across participants. Results for 2 participants showed a reduction in problem behavior during NCR without extinction with both the arbitrary and maintaining reinforcers. For 1 participant, results showed a reduction in problem behavior with both the arbitrary and maintaining reinforcers only when extinction was added to NCR. For the 4th participant, the maintaining reinforcer was effective during NCR without extinction, but the arbitrary reinforcer was ineffective.

Independent Contingency and Token Economy at Recess to Reduce Aggression

School-wide behavior problems can vary significantly from structured to unstructured settings. Often problem behaviors can spike during unstructured times such as lunch and recess and the use of Tier 1 positive behavior interventions and supports (PBIS) can be used to reduce student behavior problems in these settings. Using a token economy as an independent group contingency, this study aimed to reduce student aggression in an elementary school during lunch/recess periods of the day. Students had the opportunity to earn school “dollars” during recess for demonstrating prosocial behaviors in which they were told could be exchanged for incentives at a student store (backup reinforcers). Across all grade levels, student levels of aggression were reduced between 50 and 100% from baseline levels in a 3-month period. However, as effect sizes indicated, only some intervention groups showed significant reduction of aggression. Despite the limitation of access to backup reinforcers, we theorized that the effectiveness of the present intervention was due to socially mediated contingencies among student group members as a result of receiving dollars.

Punishment and its putative fallout: A reappraisal

In his book Coercion and Its Fallout Murray Sidman argued against the use of punishment based on concerns about its shortcomings and side effects. Among his concerns were the temporary nature of response suppression produced by punishment, the dangers of conditioned punishment, increases in escape and avoidance responses, punishment-induced aggression, and the development of countercontrol. This paper revisits Sidman's arguments about these putative shortcomings and side effects by examining the available data. Although Sidman's concerns are reasonable and should be considered when using any form of behavioral control, there appears to be a lack of strong empirical support for the notion that these potential problems with punishment are necessarily ubiquitous, long-lasting, or specific to punishment. We describe the need for additional research on punishment in general, and especially on its putative shortcomings and side effects. We also suggest the need for more effective formal theories of punishment that provide a principled account of how, why, and when lasting effects of punishment and its potential side effects might be expected to occur or not. In addition to being necessary for a complete account of behavior, such data and theories might contribute to improved interventions for problems of human concern.

Training Petting Zoo Sheep to Act Like Petting Zoo Sheep: An Empirical Evaluation of Response-Independent Schedules and Shaping with Negative Reinforcement

Simple Summary

The present study examines the use of response-independent food schedules (food delivered independent of what an animal is doing) and negative reinforcement in the form of a trainer removing themselves from the presence of an animal to effectively train approach and contact behaviors in petting zoo sheep. All sheep had previously been reported to avoid/escape the presence of zoo staff and caretakers, as well as refuse to eat in the presence of any persons. In Experiment 1, we were able to effectively use response-independent schedules to produce both approach and contact behaviors in a Hampshire sheep. In Experiment 2, a Jacob sheep was trained for approach/contact via a shaping procedure that initially rewarded approach behaviors by removing the presence of the trainer (negative reinforcement), and was later switched to rewarding responses directly with food (positive reinforcement) once the sheep began to regularly eat in the trainer’s presence. The results are discussed with respect to how both procedures are effective in examining the applied approach/avoidance behaviors with zoo animals, as well as the greater ethical considerations involved in using negative vs. positive reinforcement to train animals.

Abstract

Shaping through differential reinforcement of successive approximations to a target response has been a cornerstone procedure for the training of novel behavior. However, much of how it has traditionally been implemented occurs through informal observation, rather than any direct, systematic measurement. In the present study, we examine the use of response-independent food schedules and shaping for increasing approach and contact behaviors in petting zoo sheep. In Experiment 1, a fixed-time (FT) 15 s food schedule was used to effectively increase approach and contact behaviors in one sheep. In Experiment 2, negative reinforcement in the form of removal of the presence of a trainer was made contingent on the successful completion of approximations within a shaping procedure and later switched to food rewards. A changing-criterion design was used to empirically examine the effects of the shaping procedure during each step of the program. The result is one of the first studies to demonstrate the utility of using negative reinforcement within a shaping procedure to successfully intervene on approach/avoidance behaviors in an applied animal setting.

On the Standardization of the Functional Analysis

The functional analysis procedures described in the seminal Iwata et al. (1982/1994) study are prominent in the applied behavior analytic literature, having been replicated hundreds of times over the past 30 years (Beavers, Iwata, & Lerman, 2013; Hanley, McCord, Iwata, 2003). However, the extent to which particular components of this functional analysis model have become more or less prominent over time is not clear from these literature reviews. We therefore conducted a review of the functional analysis literature between the years of 1965 and 2016 to determine the trends in the usage of particular components over time and to determine if the published literature reflects a standardization of the manner in which functional analyses of problem behavior are conducted. Furthermore, we discuss whether or not this standardization of a functional analysis model is currently necessary.

An evaluation of differential reinforcement with stimulus fading as an intervention for medical compliance

Individuals with autism spectrum disorder (ASD) often exhibit noncompliance during medical exams. One intervention used to address this concern is differential reinforcement. Although differential reinforcement includes extinction, it may not be feasible or safe to implement extinction during medical exams. In the current study, we evaluated differential reinforcement without extinction and differential reinforcement without extinction plus stimulus fading, for increasing compliance during routine medical exams exhibited by 4 individuals with ASD. An indirect assessment identified problematic medical procedures, and a functional analysis showed that participants' disruptive behavior was maintained by escape from medical tasks. Differential reinforcement without extinction was insufficient in increasing medical compliance with 3 of 4 participants. The addition of a modified stimulus fading procedure that involved gradually introducing smaller components of problematic exam steps was effective in increasing medical compliance with all exam steps.

Efficiency in functional analysis of problem behavior: A quantitative and qualitative review

Originating in the mid-1960s, functional analysis (FA) has become the gold standard method for understanding the environmental variables that come to shape and maintain problematic behaviors such as aggression, self-injury, and property destruction. Over the decades, a number of studies have refined FA methods, attempting to improve the overall efficiency of the analysis through experimental design and procedural modifications. In the present review, we used ongoing visual-inspection criteria and basic probability theory to compare and analyze levels of efficiency across FA types. The multielement design and synthesized contingency analyses were about equally efficient with respect to the mean number of sessions conducted per function tested, and the trial-based and synthesized contingency analyses were the 2 most efficient with respect to the mean duration per function tested. We discuss the implications of these findings in the broader context of efficiency and provide recommendations for maximizing efficiency during an FA. We also discuss other qualitative procedural details that may influence the overall efficiency of an FA.

Reinforcement effects in anticipatory smooth eye movements

When predictive information about target motion is available, anticipatory smooth pursuit eye movements (aSPEM) are consistently generated before target appearance, thereby reducing the typical sensorimotor delay between target motion onset and foveation. By manipulating the probability for target motion direction, we were able to bias the direction and mean velocity of aSPEM. This suggests that motion-direction expectancy has a strong effect on the initiation of anticipatory movements. To further understand the nature of anticipatory smooth eye movements, we investigated different effects of reinforcement on aSPEM. In a first experiment, the reinforcement was contingent to a particular anticipatory behavior. A monetary reward was associated to a criterion-matching anticipatory velocity as estimated online during the gap before target motion onset. Our results showed a small but significant effect of behavior-contingent monetary reward on aSPEM. In a second experiment, the proportion of rewarded trials was manipulated across motion directions (right vs. left) independently from participants' behavior. Our results indicate that a bias in expected reward does not systematically affect anticipatory eye movements. Overall, these findings strengthen the notion that anticipatory eye movements can be considered as an operant behavior (similar to visually guided ones), whereas the expectancy for a noncontingent reward cannot efficiently bias them.

Response duration is sensitive to both immediate and delayed reinforcement

We investigated the duration of lever pressing by rats when the delivery of appetitive reinforcers was contingent upon response duration. In the first experiment, response durations increased when duration requirements were imposed, and they decreased when duration requirements were removed. This effect occurred whether reinforcers were immediate or delayed by 8 s. In order to maintain the integrity of the delay intervals, reinforcer delivery was dependent upon both lever depression and release. In a second experiment, lever depression only and a response duration of at least 4 s were required for reinforcer delivery. Compared to immediate reinforcement conditions, delayed reinforcers increased both variability and the length of the maximum response durations. In a third experiment, immediate reinforcers were delivered contingent upon lever depression and release under a variety of duration requirements. Median lever-press durations tracked the contingencies rapidly. Across all three experiments, rats emitted numerous response durations that were too short to satisfy the reinforcer requirements, and bimodal distributions similar to those produced by differential reinforcement of low rate schedules were evident for most rats. In many aspects, response duration responds to reinforcement parameters in a fashion similar to rate of discrete responding, but an examination of this continuous dimension of behavior may provide additional information about environment-behavior relationships.

Placebo Groups in Research on the Effectiveness of ABA Therapeutic Techniques

Behavior analysts have shown that a single-subject experimental design (SSED) is a useful tool for identifying the effectiveness of specific therapeutic techniques, whereas researchers outside applied behavior analysis (ABA) maintain that randomized placebo-controlled trials (RPCT) provide the most definite test of efficacy. In this paper the possible benefits that could result from supporting SSED studies by placebo control groups are discussed. However, the use of placebo groups in psychotherapy research arouses considerable controversy and many researchers argue against it. The main aim of this paper is to clarify theoretical and methodological problems associated with using placebo groups in psychotherapy research and to demonstrate that these problems can be solved if the assumptions on which they are based are reformulated. The article also discusses ethical issues about the use of placebo groups in research on the effectiveness of psychotherapy.

Identifying and Resolving End of Session Cues in Substance Detection Canine Training

When training and working a substance detection canine, a trained final response should be performed immediately upon recognition of odor (Generally, a 1–3 s window is preferred within our detection practices). Typical canine training places much emphasis on planning and setting up training scenarios to achieve specific objectives but not much consideration is given to how to end a training session. When the canine fails to maintain criteria, trainers are left trying to determine the cause of poor performance. One consideration often overlooked is a phenomenon called End of Session Cueing that may exist in detection training whereby a previously trained canine no longer responds to odor because it has taken on aversive association. This may be due to several factors associated with motivation. The sequence of events at the end of a session can be as equally important to maintain motivation for the task of scent detection in future sessions. This paper will identify and examine multiple factors associated with “End of Session Cues” in working dogs, how they may be responsible for poor final response performance and discuss potential strategies to address them.

Token reinforcement: Translational research and application

The present paper provides an integrative review of research on token reinforcement systems, organized in relation to basic behavioral functions and economic variables. This type of functional taxonomy provides a useful way to organize the literature, bringing order to a wide range of findings across species and settings, and revealing gaps in the research and areas especially ripe for analysis and application. Unlike standard translational research, based on a unidirectional model in which the analysis moves from laboratory to the applied realm, work in the area of token systems is best served by a bidirectional interplay between laboratory and applied research, where applied questions inspire research on basic mechanisms. When based on and contributing to an analysis, applied research on token economies can be on the leading edge of theoretical advances, helping set the scientific research agenda.

EEG-Neurofeedback as a Tool to Modulate Cognition and Behavior: A Review Tutorial

Neurofeedback is attracting renewed interest as a method to self-regulate one’s own brain activity to directly alter the underlying neural mechanisms of cognition and behavior. It not only promises new avenues as a method for cognitive enhancement in healthy subjects, but also as a therapeutic tool. In the current article, we present a review tutorial discussing key aspects relevant to the development of electroencephalography (EEG) neurofeedback studies. In addition, the putative mechanisms underlying neurofeedback learning are considered. We highlight both aspects relevant for the practical application of neurofeedback as well as rather theoretical considerations related to the development of new generation protocols. Important characteristics regarding the set-up of a neurofeedback protocol are outlined in a step-by-step way. All these practical and theoretical considerations are illustrated based on a protocol and results of a frontal-midline theta up-regulation training for the improvement of executive functions. Not least, assessment criteria for the validation of neurofeedback studies as well as general guidelines for the evaluation of training efficacy are discussed.

Functional analysis and treatment of problem behavior exhibited by children with fragile X syndrome

The efficacy of function-based interventions for the treatment of severe problem behavior exhibited by individuals with intellectual and developmental disabilities (IDD) is well established. However, few studies have reported on behavioral interventions in fragile X syndrome (FXS) specifically. The present study is a consecutive case-series analysis that reports on functional analysis and treatment of problem behavior of nine children with FXS. Assessment findings were consistent with previous research indicating that among individuals with FXS, problem behavior is more commonly maintained by escape from demands and access to tangible items, relative to the broader population of individuals with IDD. Functional analysis-based behavioral interventions resulted in a mean reduction in problem behavior of 95.2% across the nine participants. Additionally, generalization of treatment effects from controlled clinical settings to home, school, and community was demonstrated. The current findings suggest that function-based behavioral interventions shown to be effective with the broader population of individuals with IDD are also effective for individuals with FXS. Our results in combination with those of previous studies describing functional analysis outcomes provide additional evidence for a unique functional behavioral phenotype for severe problem behavior in individuals with FXS. Implications of study findings for early intervention and prevention of problem behavior in children with FXS are discussed.

Thirty years of research on the functional analysis of problem behavior

Hanley, Iwata, and McCord (2003) reviewed studies published through 2000 on the functional analysis (FA) of problem behavior. We update that review for 2001 through 2012, including 158 more recent studies that reported data from 445 FAs. Combined with data obtained from Hanley et al., 435 FA studies, with line graphs for 981 FAs, have been published since 1961. We comment on recent trends in FA research and introduce the studies in the 2013 special issue of the Journal of Applied Behavior Analysis.

The Effects of Contingent Caregiver Imitation of Infant Vocalizations: a Comparison of Multiple Caregivers

The present study replicated and extended the Pelaez et al. (Journal of Applied Behavior Analysis 44:33-40, 2011) study, which examined the reinforcing effects of mothers' contingent imitation of their infants' vocalizations. Three infants aged 7-12 months who could vocalize sounds but not words participated with two caregivers for each infant (i.e., triads). During the intervention phase, the caregivers were asked to immediately imitate all vocalizations emitted by the child for a 3-min period. During the yoked control phase, the caregivers listened to an audio recording from the preceding condition and provided vocalizations non-contingently on the infants' responses. The procedures yielded different results across participants; one infant emitted a higher frequency of vocalizations during the contingent imitation phases over the control phases, and the other two infants showed higher rates of responding during the control phases. However, all infants emitted more imitative return vocalizations during contingent reinforcement conditions compared with the yoked control condition.

Functional assessment of problem behavior: dispelling myths, overcoming implementation obstacles, and developing new lore

Hundreds of studies have shown the efficacy of treatments for problem behavior based on an understanding of its function. Assertions regarding the legitimacy of different types of functional assessment vary substantially across published articles, and best practices regarding the functional assessment process are sometimes difficult to cull from the empirical literature or from published discussions of the behavioral assessment process. A number of myths regarding the functional assessment process, which appear to be pervasive within different behavior-analytic research and practice communities, will be reviewed in the context of an attempt to develop new lore regarding the functional assessment process. Frequently described obstacles to implementing a critical aspect of the functional assessment process, the functional analysis, will be reviewed in the context of solutions for overcoming them. Finally, the aspects of the functional assessment process that should be exported to others versus those features that should remain the sole technological property of behavior analysts will be discussed.

Reinforcement of vocalizations through contingent vocal imitation

Maternal vocal imitation of infant vocalizations is highly prevalent during face-to-face interactions of infants and their caregivers. Although maternal vocal imitation has been associated with later verbal development, its potentially reinforcing effect on infant vocalizations has not been explored experimentally. This study examined the reinforcing effect of maternal vocal imitation of infant vocalizations using a reversal probe BAB design. Eleven 3- to 8-month-old infants at high risk for developmental delays experienced contingent maternal vocal imitation during reinforcement conditions. Differential reinforcement of other behavior served as the control condition. The behavior of 10 infants showed evidence of a reinforcement effect. Results indicated that vocal imitations can serve to reinforce early infant vocalizations.

Assessment of the relative effects of attention and escape on noncompliance

The current study presents a method for assessing the relative effects of attention and escape on noncompliance in preschoolers. Attention and escape conditions were alternated in a multielement design, and a contingency reversal procedure, in which one test condition served as a control for the other, was used to demonstrate control. For all 3 participants, noncompliance was maintained, at least in part, by social attention. Functional analyses of noncompliance such as the one described here may be valuable for developing function-based treatments.

Do children prefer contingencies? An evaluation of the efficacy of and preference for contingent versus noncontingent social reinforcement during play

Discovering whether children prefer reinforcement via a contingency or independent of their behavior is important considering the ubiquity of these programmed schedules of reinforcement. The current study evaluated the efficacy of and preference for social interaction within differential reinforcement of alternative behavior (DRA) and noncontingent reinforcement (NCR) schedules with typically developing children. Results showed that 7 of the 8 children preferred the DRA schedule; 1 child was indifferent. We also demonstrated a high degree of procedural fidelity, which suggested that preference is influenced by the presence of a contingency under which reinforcement can be obtained. These findings are discussed in terms of (a) the selection of reinforcement schedules in practice, (b) variables that influence children's preferences for contexts, and (c) the selection of experimental control procedures when evaluating the effects of reinforcement.

Análise funcional de comportamentos verbais inapropriados de um esquizofrênico

O presente estudo registrou as verbalizações inapropriadas de um esquizofrênico adulto e do sexo masculino. Os comportamentos verbais inapropriados foram observados durante breves períodos de exposição a quatro condições: atenção, atenção não contingente, demanda e sozinho. Os resultados indicaram que as condições afetaram os comportamentos verbais inapropriados diferentemente. Esses resultados são discutidos em termos das suas implicações para as avaliações funcionais antes de intervenções psicológicas.

Differential effects of daily snack food intake on the reinforcing value of food in obese and nonobese women

BACKGROUND

Food reinforcement, ie, motivation to obtain food, is associated with energy intake and obesity. Finding ways to decrease the reinforcing value of unhealthy foods may help with adherence to diets and maintenance of weight loss. Our previous study in nonobese adults showed that daily consumption of the same snack food (food consumed apart from meals) for 14 d significantly decreased its reinforcing value.

OBJECTIVES

The aims of this study were to replicate and extend these findings to obese individuals and to examine the effects of different portion sizes of snack foods on food reinforcement.

DESIGN

Food reinforcement and liking were tested in 31 obese and 27 nonobese women at baseline and after 2 wk of daily consumption of 0, 100, or 300 kcal/d of the same snack food.

RESULTS

We found a significant interaction of phase, portion size, and body mass index on the pattern of operant responding for food. Obese women had a significant increase in food reinforcement after consuming the 300-kcal portion of food for 2 wk, whereas nonobese women had the opposite response. No significant differences were found on the reinforcing value with the 0- and 100-kcal portion-size conditions. Women in the 300-kcal group (obese and nonobese) reported a significant decrease in snack food liking from baseline to after daily intake.

CONCLUSIONS

These findings suggest that obese and nonobese women respond differently to the daily intake of a snack food and that this may not be a viable mechanism for reducing food reinforcement in obese women. This trial was registered at www.clinicaltrials.gov as NCT00837694.

Applied implications of reinforcement history effects

Although the influence of reinforcement history is a theoretical focus of behavior analysis, the specific behavioral effects of reinforcement history have received relatively little attention in applied research and practice. We examined the potential effects of reinforcement history by reviewing nonhuman, human operant, and applied research and interpreted the findings in relation to possible applied significance. The focus is on reinforcement history effects in the context of reinforcement schedules commonly used either to strengthen behavior (e.g., interval schedules) or commonly used to decrease behavior (e.g., extinction).

Response-reinforcer relations and resistance to change

Behavioral momentum theory suggests that the relation between a response and a reinforcer (i.e., response-reinforcer relation) governs response rates and the relation between a stimulus and a reinforcer (i.e., stimulus-reinforcer relation) governs resistance to change. The present experiments compared the effects degrading response-reinforcer relations with response-independent or delayed reinforcers on resistance to change in conditions with equal stimulus-reinforcer relations. In Experiment 1, pigeons responded on equal variable-interval schedules of immediate reinforcement in three components of a multiple schedule. Additional response-independent reinforcers were available in one component and additional delayed reinforcers were available in another component. The results showed that resistance to disruption was greater in the components with added reinforcers than without them (i.e., better stimulus-reinforcer relations), but did not differ for the components with added response-independent and delayed reinforcement. In Experiment 2, a component presenting immediate reinforcement alternated with either a component that arranged equal rates of reinforcement with a proportion of those reinforcers being response independent or a component with a proportion of the reinforcers being delayed. Results showed that resistance to disruption tended to be either similar across components or slightly lower when response-reinforcer relations were degraded with either response-independent or delayed reinforcers. These findings suggest that degrading response-reinforcer relations can impact resistance to change, but that impact does not depend on the specific method and is small relative to the effects of the stimulus-reinforcer relation.