Concurrent reinforcement schedules for problem behavior and appropriate behavior: experimental applications of the matching law

Evaluation of resurgence following differential reinforcement of alternative behavior with and without extinction in a human operant model

One of the most common treatments for severe challenging behavior involves placing the challenging behavior on extinction and differentially reinforcing an alternative response (DRA). However, extinction is not always feasible and may be unsafe or impractical to implement in some circumstances. Thus, implementing a DRA without extinction intervention may be necessary for some cases. Currently, the extent to which DRA without extinction produces durable treatment outcomes, particularly as it relates to the resurgence of challenging behavior, is unclear. The present study investigated resurgence following DRA with and without extinction using a three-phase resurgence evaluation in a translational human operant model with college students as participants. All participants demonstrated resurgence across both experimental groups. Although there were no statistically significant differences in the prevalence, magnitude, or persistence of resurgence between groups, levels of resurgence magnitude were relatively higher in the DRA-without-extinction group than in the DRA-with-extinction group. Clinical implications of these findings and directions for future human operant investigations of resurgence are discussed.

Updated Recommendations for Reinforcement Schedule Thinning following Functional Communication Training

Schedule thinning is a necessary treatment procedure following the acquisition of a communication response during functional communication training. In this article, we update and extend the Hagopian et al. Behavior Analysis in Practice, 4, 4-16, (2011) review and recommendations on schedule-thinning procedures following functional communication training. Since their publication, substantial research has been published on the efficacy, efficiency, and social validity of schedule-thinning methods. We provide updated recommendations for schedule thinning based on contemporary literature that has been published since 2011, as well as discuss key areas for future research.

Relapse and its mitigation: Toward behavioral inoculation

Relapse following the successful treatment of problem behavior can increase the likelihood of injury and the need for more intensive care. Current research offers some predictions of how treatment procedures may contribute to relapse, and conversely, how the risk of relapse can be mitigated. This review describes relapse-mitigation procedures with varying levels of support, the quantitative models that have influenced the research on relapse mitigation, different experimental methods for measuring relapse mitigation, and directions for future research. We propose that by viewing the implementation of relapse-mitigation procedures as a means of producing behavioral inoculation, clinicians are placed in the proactive and intentional role of exposing their client's behavior to an array of reinforcement and stimulus conditions during treatment with the goal of decreasing the detrimental impact of future treatment challenges.

Basic and applied research on extinction bursts

Discontinuation of the contingency between a response and its reinforcer sometimes produces a temporary increase in the response before its rate decreases, a phenomenon called the extinction burst. Prior clinical and basic studies on the prevalence of the extinction burst provide highly disparate estimates. Existing theories on the extinction burst fail to account for the dynamic nature of this phenomenon, and the basic behavioral processes that control response bursting remain poorly understood. In this paper, we first review the basic and applied literature on the extinction burst. We then describe a recent refinement of the concatenated matching law called the temporally weighted matching law that appears to resolve the above-mentioned issues regarding the extinction burst. We present illustrative translational data based conceptually on the model. Finally, we discuss specific recommendations derived from the temporally weighted matching law regarding procedures clinicians could implement to potentially mitigate or prevent extinction bursts.

The matching law provides a quantitative description of social time allocation in children with autism

Recent research has developed and evaluated assessments of sociability in which time allocation near or away from an adult who initiates social interactions is used to characterize the participant as social, indifferent, or avoidant of social interaction. Though these qualitative outcomes have been useful, no studies have evaluated methods of obtaining more quantitative measures of sociability. The matching law has been demonstrated to describe a wide range of human behavior and may also be useful in describing social time allocation. We adapted the matching law and assessment of sociability procedures with the aim of providing a more precise, quantitative measure of sociability. We fitted the matching equation to the social time allocation data of 8 children with autism spectrum disorder. The equation was effective in quantifying sociability, accounted for a large proportion of variance in participants' behavior, did so equally well for participants who were social and avoidant, and provided a more sensitive measure relative to those used in previous research. The implications of this methodology, its potential utility, and directions for future research are discussed.

Toward a Quantification of Anhedonia: Unified Matching Law and Signal Detection for Clinical Assessment and Drug Development

Anhedonia, the loss of pleasure from previously rewarding activities, is a core symptom of several neuropsychiatric conditions, including major depressive disorder (MDD). Despite its transdiagnostic relevance, no effective therapeutics exist to treat anhedonia. This is due, in part, to inconsistent assays across clinical populations and laboratory animals, which hamper treatment development. To bridge this gap, recent work has capitalized on two long-standing research domains dedicated to quantifying responsivity to antecedents and consequences across species: the generalized matching law and signal detection theory. This review traces the integration of these quantitative frameworks, which yielded two empirically derived metrics: response bias (log b) and task discriminability (log d). These metrics serve as primary dependent variables in the Probabilistic Reward Task (PRT). In this computerized task, subjects make visual discriminations and probabilistic contingencies are arranged such that correct responses to one alternative are rewarded more often (rich) than correct responses to the other (lean). Under these conditions, healthy participants consistently develop a response bias in favor of the rich alternative, whereas participants with MDD exhibit blunted biases, which correlate with current and predict future anhedonia. Given the correspondence between anhedonic phenotypes and response bias, the PRT has been reverse-translated for rodents and nonhuman primates. Orderly log b and log d values have been observed across diverse clinical populations and laboratory animals. In addition, pharmacological challenges have produced similar outcomes across species. Taken together, this quantitative framework offers a highly translational approach to assaying reward responsiveness to accelerate treatment development for neuropsychiatric disorders involving anhedonia.

Teaching Individuals with Autism Problem-Solving Skills for Resolving Social Conflicts

Resolving social conflicts is a complex skill that involves consideration of the group when selecting conflict solutions. Individuals with autism spectrum disorder (ASD) often have difficulty resolving social conflicts, yet this skill is important for successful social interaction, maintenance of relationships, and functional integration into society. This study used a nonconcurrent multiple baseline across participants design to assess the efficacy of a problem-solving training and generalization of problem solving to naturally occurring untrained social conflicts. Three male participants with ASD were taught to use a worksheet as a problem-solving tool using multiple exemplar training, error correction, rules, and reinforcement. The results showed that using the worksheet was successful in bringing about a solution to social conflicts occurring in the natural environment. In addition, the results showed that participants resolved untrained social conflicts in the absence of the worksheet during natural environment probe sessions.

How individuals make choices explains addiction's distinctive, non-eliminable features

In keeping with the goals of this Special Issue, this paper poses the following questions: What are addiction's non-eliminable features and can they be explained by one or more general principles? I have added the qualifier "distinctive" to these goals, as in "distinctive non-eliminable features." The result is a highly heterogeneous list, which includes features of addiction's natural history, such as its high remission rates, its unique idioms (e.g., "kicking the habit"), and its patented interventions, such as Alcoholics Anonymous. I show that each of these distinctive features reflects how individuals make choices. In particular, they reflect the competing claims of two basic choice processes: global maximizing of the sort assumed in introductory economics textbooks and Herrnstein's matching law, which has empirical rather than theoretical roots. These are basic choice processes, which apply to all decision making, not just drugs and not just addicts. Nevertheless, they can result in addiction when one of the options has the capacity to undermine the value of competing interests and undermine global maximizing. Conversely, the analyses also show that the two basic choice processes combine so as to predict that addiction is a semi-stable state that is biased to resolve in favor of remission. These predictions are supported by the high rates of addiction, by the high rates of remission from addiction, and by the fact that remission is often unassisted or "spontaneous." The analyses fail to support the idea that pathological psychological processes lead to addiction. Rather they show that addiction emerges from the interactions of normal choice processes and the behaviorally toxic effects of drugs.

Is increased sensitivity to punishment a common characteristic of attention deficit/hyperactivity disorder? An experimental study of response allocation in Japanese children

Research on motivational processes in attention deficit/hyperactivity disorder (ADHD) focuses on reward. Studies with punishment are limited and findings mixed. This study evaluated the effects of punishment on response allocation in Japanese children with and without ADHD. Thirty-four children meeting DSM-IV criteria for ADHD and 59 typically developing control-group children completed an operant task in which they choose between playing two simultaneously available games. Reward was arranged symmetrically across the games under concurrent variable interval schedules. Asymmetric punishment schedules were superimposed with responses on one game punished four times as often as responses on the other. Children with ADHD showed greater behavioral sensitivity to punishment than controls. They allocated significantly more responses to the less frequently punished alternative and were more likely to play this game on consecutive trials and responded more slowly to the more punished game. Control group children allocated their responses evenly across games. Punishment exerted greater control over the behavior of Japanese children with ADHD than controls, similar to findings with children from Western countries, suggesting this is a common characteristic of the disorder. The behavior of typically developing Japanese children, while demonstrating awareness of punishment, was not controlled by the frequency of its occurrence.

Evidence for increased behavioral control by punishment in children with attention-deficit hyperactivity disorder

BACKGROUND

The behavioral sensitivity of children with ADHD to punishment has received limited theoretical and experimental attention. This study evaluated the effects of punishment on the response allocation of children with ADHD and typically developing children.

METHOD

Two hundred and ten children, 145 diagnosed with ADHD, completed an operant task in which they chose between playing two simultaneously available games. Reward was arranged symmetrically across the games under concurrent variable interval schedules. Asymmetric punishment schedules were superimposed; responses on one game were punished four times as often as responses on the other.

RESULTS

Both groups allocated more of their responses to the less frequently punished alternative. Response bias increased significantly in the ADHD group during later trials, resulting in missed reward trials and reduced earnings.

CONCLUSIONS

Punishment exerted greater control over the response allocation of children with ADHD with increased time on task. Children with ADHD appear more sensitive to the cumulative effects of punishment than typically developing children.

Case Studies of Technology-aided Interventions to Promote Hand Reaching and Standing or Basic Ambulation in Persons with Multiple Disabilities

Motor impairments such as lack of standing and/or independent ambulation are common among persons with multiple disabilities. These two studies assessed technology-aided programs for persons with those impairments. Specifically, Study I assessed a program to teach two non-ambulatory adults to hand reach a stimulation-linked object by standing up. Study II assessed a program to teach a child and a man to ambulate while holding a rail or following a corridor wall. Standing increased from below 15% to about or over 80% of the session duration in Study I. The participants of Study II managed to complete brief ambulation trials independent of guidance. These performance achievements were discussed in relation to the technology-aided programs employed in the studies and the programs' applicability in daily contexts.

Choice in transition: Replication and extension to preschool children in a naturalistic setting

This study replicated previous basic research into the dynamics of choice and extended this analysis to children's behavior in a naturalistic setting. Two preschoolers with disabilities were observed interacting with their teachers at baseline and during an experimental analysis involving four pairs of concurrent variable-interval schedules of adult attention implemented by an experimenter. Each child was exposed to four experimental phases in which the relative reinforcer rates for on- and off-task behavior were 10:1, 1:1, 1:10, and reversed back to 10:1. The 10:1 phase was designed to mimic the same schedules and types of adult attention observed at baseline. We used the generalized matching equation to model steady-state behavior at the end of the transition phases and to evaluate changes in sensitivity at various points throughout the phases. Choice in transition was evaluated by plotting log behavior ratios by session, cumulated time on- and off-task and cumulated attention for on- and off-task behavior by session, and interreinforcer behavior ratios following different sequences of the first four reinforcer deliveries. The generalized matching equation accounted for a large proportion of variance in steady-state responding, sensitivity values increased steadily throughout the phases, patterns of choice in transition were similar to those reported in basic research, and interreinforcer preference generally shifted toward the just-reinforced alternative. These findings are consistent with previous basic research and support the generality of the dynamics of choice to children's on- and off-task behavior reinforced by adult attention.

Persons with multiple disabilities engage in stimulus choice and postural control with the support of a technology-aided program

Technology-aided programs have been reported to help persons with disabilities develop adaptive responding and control problem behavior/posture. This study assessed one such program in which choice of stimulus events was used as adaptive responding for three adults with multiple disabilities. A computer system presented the participants stimulus samples. For each sample, they could perform a choice response (gaining access to the related stimulus whose length they could extend) or abstain from responding (making the system proceed to the next sample). Once choice responding had strengthened, the program also targeted the participants' problem posture (i.e., head and trunk forward bending). The stimulus exposure gained with a choice response was interrupted if the problem posture occurred. All three participants successfully (a) managed choice responses and access to preferred stimuli and (b) gained postural control (i.e., reducing the problem posture to very low levels). The practical implications of those results are discussed.

Microswitch-aided programs to support physical exercise or adequate ambulation in persons with multiple disabilities

Three microswitch-aided programs were assessed in three single-case studies to enhance physical exercise or ambulation in participants with multiple disabilities. Study I was aimed at helping a woman who tended to have the head bending forward and the arms down to exercise a combination of appropriate head and arms movements. Study II was aimed at promoting ambulation continuity with a man who tended to have ambulation breaks. Study III was aimed at promoting ambulation with appropriate foot position in a girl who usually showed toe walking. The experimental designs of the studies consisted of a multiple probe across responses (Study I), an ABAB sequence (Study II), and an ABABB(1) sequence (Study III). The last phase of each study was followed by a post-intervention check. The microswitches monitored the target responses selected for the participants and triggered a computer system to provide preferred stimuli contingent on those responses during the intervention phases of the studies. Data showed that the programs were effective with each of the participants who learned to exercise head and arms movements, increased ambulation continuity, and acquired high levels of appropriate foot position during ambulation, respectively. The positive performance levels were retained during the post-intervention checks. The discussion focused on (a) the potential of technology-aided programs for persons with multiple disabilities and (b) the need of replication studies to extend the evidence available in the area.

The matching law: a tutorial for practitioners

The application of the matching law has historically been limited to use as a quantitative measurement tool in the experimental analysis of behavior to describe temporally extended patterns of behavior-environment relations. In recent years, however, applications of the matching law have been translated to clinical settings and populations to gain a better understanding of how naturally-occurring events affect socially important behaviors. This tutorial provides a brief background of the conceptual foundations of matching, an overview of the various matching equations that have been used in research, and a description of how to interpret the data derived from these equations in the context of numerous examples of matching analyses conducted with socially important behavior. An appendix of resources is provided to direct readers to primary sources, as well as useful articles and books on the topic.

Translational research in behavior analysis: historical traditions and imperative for the future

"Pure basic" science can become detached from the natural world that it is supposed to explain. "Pure applied" work can become detached from fundamental processes that shape the world it is supposed to improve. Neither demands the intellectual support of a broad scholarly community or the material support of society. Translational research can do better by seeking innovation in theory or practice through the synthesis of basic and applied questions, literatures, and methods. Although translational thinking has always occurred in behavior analysis, progress often has been constrained by a functional separation of basic and applied communities. A review of translational traditions in behavior analysis suggests that innovation is most likely when individuals with basic and applied expertise collaborate. Such innovation may have to accelerate for behavior analysis to be taken seriously as a general-purpose science of behavior. We discuss the need for better coordination between the basic and applied sectors, and argue that such coordination compromises neither while benefiting both.