Noncontingent reinforcement, alternative reinforcement, and the matching law: a laboratory demonstration

Treatments for undefined log ratios in matching analyses

A challenge in carrying out matching analyses is to deal with undefined log ratios. If any reinforcer or response rate equals zero, the logarithm of the ratio is undefined: data are unsuitable for analyses. There have been some tentative solutions, but they had not been thoroughly investigated. The purpose of this article is to assess the adequacy of five treatments: omit undefined ratios, use full information maximum likelihood, replace undefined ratios by the mean divided by 100, replace them by a constant 1/10, and add the constant .50 to ratios. Based on simulations, the treatments are compared on their estimations of variance accounted for, sensitivity, and bias. The results show that full information maximum likelihood and omiting undefined ratios had the best overall performance, with negligibly biased and more accurate estimates than mean divided by 100, constant 1/10, and constant .50. The study suggests that mean divided by 100, constant 1/10, and constant .50 should be avoided and recommends full information maximum likelihood to deal with undefined log ratios in matching analyses.

Varying reinforcer dimensions during differential reinforcement without extinction: A translational model

Procedural arrangements of differential reinforcement of alternative behavior without extinction often involve presenting the same reinforcers for problem behavior and appropriate behavior, which is typically ineffective at reducing problem behavior and increasing an alternative response. However, manipulating reinforcement dimensions such that the contingencies favor the alternative response may improve treatment outcomes when using differential reinforcement of alternative behavior without extinction by increasing appropriate behavior and reducing problem behavior. We conducted this translational study with 32 college students completing a button-pressing task on a computer program in which they could engage in analogs to problem behavior and appropriate behavior. The effects of manipulating magnitude, immediacy, quality, and a combination of all three dimensions for the alternative response were evaluated. Overall, all dimension manipulations reduced the analog to problem behavior, with the largest reductions observed during the quality probe and the probe with all dimensions combined. These results support the notion that differential reinforcement of alternative behavior without extinction can be an effective form of treatment.

Bridging the gap between laboratory and applied research on response-independent schedules

In 1948, Skinner described the behavior of pigeons under response-independent schedules as "superstitious," and proposed that the responses were reinforced by contiguous, adventitious food deliveries. Subsequently, response-independent schedules have been of interest to both basic and applied researchers, first to understand the mechanisms involved, and later, as "noncontingent reinforcement" (NCR) to reduce undesirable behavior. However, the potential superstitious effects produced by these schedules have been challenged, with some researchers arguing that antecedent variables play a significant role. This paper examines the evidence for adventitious reinforcement from both laboratory and applied research, the results of which suggest that antecedent, nonoperant functions may be important in fully understanding the effects of NCR. We propose an applied-basic research synthesis, in which attention to potential nonoperant functions could provide a more complete understanding of response-independent schedules. We conclude with a summary of the applied implications of the nonoperant functions of NCR schedules.

Toward a Quantification of Anhedonia: Unified Matching Law and Signal Detection for Clinical Assessment and Drug Development

Anhedonia, the loss of pleasure from previously rewarding activities, is a core symptom of several neuropsychiatric conditions, including major depressive disorder (MDD). Despite its transdiagnostic relevance, no effective therapeutics exist to treat anhedonia. This is due, in part, to inconsistent assays across clinical populations and laboratory animals, which hamper treatment development. To bridge this gap, recent work has capitalized on two long-standing research domains dedicated to quantifying responsivity to antecedents and consequences across species: the generalized matching law and signal detection theory. This review traces the integration of these quantitative frameworks, which yielded two empirically derived metrics: response bias (log b) and task discriminability (log d). These metrics serve as primary dependent variables in the Probabilistic Reward Task (PRT). In this computerized task, subjects make visual discriminations and probabilistic contingencies are arranged such that correct responses to one alternative are rewarded more often (rich) than correct responses to the other (lean). Under these conditions, healthy participants consistently develop a response bias in favor of the rich alternative, whereas participants with MDD exhibit blunted biases, which correlate with current and predict future anhedonia. Given the correspondence between anhedonic phenotypes and response bias, the PRT has been reverse-translated for rodents and nonhuman primates. Orderly log b and log d values have been observed across diverse clinical populations and laboratory animals. In addition, pharmacological challenges have produced similar outcomes across species. Taken together, this quantitative framework offers a highly translational approach to assaying reward responsiveness to accelerate treatment development for neuropsychiatric disorders involving anhedonia.

Using Principles from Applied Behaviour Analysis to Address an Undesired Behaviour: Functional Analysis and Treatment of Jumping Up in Companion Dogs

The aim of this study was to investigate the feasibility and effectiveness of procedures successfully used in human related applied behaviour analysis practices to the field of clinical animal behaviour. Experiment 1 involved functional analyses to identify the reinforcement contingencies maintaining jumping up behaviour in five dogs. Experiment 2 comprised teaching dog owners a noncontingent reinforcement intervention (i.e., time-based reinforcement) via behavioural skills training. Single-case experimental methods were implemented in both experiments. The results of Experiment 1 showed that access to a tangible (dogs D01, D02, D03, and D04) and owner attention (dog D05) were reliably maintaining the jumping up behaviour. Experiment 2 demonstrated that noncontingent reinforcement effectively reduced jumping in three out of four dogs (Tau -0.59, CI 90% [-1-0.15], p = 0.026, Tau -1, CI 90% [-1--0.55], p = 0.0003, and Tau -0.32, CI 90% [-0.76-0.11], p = 0.22 for dyads D01, D02, and D05, respectively), and that behavioural skills training was successful in teaching owners to perform a dog training intervention with high fidelity. Although the results are promising, more canine-related research into functional analysis and noncontingent reinforcement, as well as implementation of behavioural skills training with animal caregivers, is needed.

Application of the matching law to Mixed Martial Arts

In the contemporary behavior-analytic literature, athletic performance (e.g.,choice of shot or movement) across multiple team sports has been found to correspond with predictions of the generalized matching equation. However, the research in this area has focused primarily on team sports. In the current study the Generalized Matching Equation (GME) was applied to Mixed Martial Arts (MMA) performance by examining strike selection as a function of landing significant strikes among fighters from various weight classes in the Ultimate Fighting Championship. The results suggest that the GME is a good descriptor of strike selection in MMA, an individual sport that is dynamic and fast paced where responding results in immediate feedback from an opponent.

Comparison of components of the Good Behavior Game in a preschool classroom

The Good Behavior Game (GBG) is an effective intervention package for decreasing disruptive behavior in various populations and environments. There is, however, limited research evaluating the GBG with preschoolers. Furthermore, few studies have evaluated the effects of components of the GBG, and of those that have, most have done so only after exposure to the GBG package. We evaluated the effects (a) of the GBG on disruptive behavior of preschoolers during group instruction and (b) the major components of the GBG before and after implementation of the GBG package (c) at both the group and individual level. Results suggest that the GBG package was necessary for decreasing disruptive behavior. However, after exposure to the GBG, a response-independent contingency was effective for maintaining low levels of disruptive behavior at both the group and individual level.

Choice behavior of pigeons (Columba livia), college students, and preschool children (Homo sapiens) in the Monty Hall dilemma

In the Monty Hall dilemma, an individual chooses between three options, only one of which will deliver a prize. After the initial choice, one of the nonchosen options is revealed as a losing option, and the individual can choose to stay with the original choice or switch to the other remaining option. Previous studies have found that most adults stay with their initial choice, although the chances of winning are 2/3 for switching and 1/3 for staying. Pigeons, college students, and preschool children were given many trials on this task to examine how their choices might change with experience. The college students began to switch on a majority of trials much sooner than the pigeons, contrary to the findings by Herbranson and Schroeder (2010) that pigeons perform better than people on this task. In all three groups, some individuals approximated the optimal strategy of switching on every trial, but most did not. Many of the preschoolers immediately showed a pattern of always switching or always staying and continued this pattern throughout the experiment. In a condition where the probability of winning was 90% after a switch, all college students and all but one pigeon learned to switch on nearly every trial. The results suggest that one main impediment to learning the optimal strategy in the Monty Hall task, even after repeated trials, is the difficulty in discriminating the different reinforcement probabilities for switching versus staying.

Translational research in behavior analysis: historical traditions and imperative for the future

"Pure basic" science can become detached from the natural world that it is supposed to explain. "Pure applied" work can become detached from fundamental processes that shape the world it is supposed to improve. Neither demands the intellectual support of a broad scholarly community or the material support of society. Translational research can do better by seeking innovation in theory or practice through the synthesis of basic and applied questions, literatures, and methods. Although translational thinking has always occurred in behavior analysis, progress often has been constrained by a functional separation of basic and applied communities. A review of translational traditions in behavior analysis suggests that innovation is most likely when individuals with basic and applied expertise collaborate. Such innovation may have to accelerate for behavior analysis to be taken seriously as a general-purpose science of behavior. We discuss the need for better coordination between the basic and applied sectors, and argue that such coordination compromises neither while benefiting both.

Teaching brain-behavior relations economically with stimulus equivalence technology

Instructional interventions based on stimulus equivalence provide learners with the opportunity to acquire skills that are not directly taught, thereby improving the efficiency of instructional efforts. The present report describes a study in which equivalence-based instruction was used to teach college students facts regarding brain anatomy and function. The instruction involved creating two classes of stimuli that students understood as being related. Because the two classes shared a common member, they spontaneously merged, thereby increasing the yield of emergent relations. Overall, students mastered more than twice as many facts as were explicitly taught, thus demonstrating the potential of equivalence-based instruction to reduce the amount of student investment that is required to master advanced academic topics.

What are we doing when we translate from quantitative models?

Although quantitative analysis (in which behavior principles are defined in terms of equations) has become common in basic behavior analysis, translational efforts often examine everyday events through the lens of narrative versions of laboratory-derived principles. This approach to translation, although useful, is incomplete because equations may convey concepts that are difficult to capture in words. To support this point, we provide a nontechnical introduction to selected aspects of quantitative analysis; consider some issues that translational investigators (and, potentially, practitioners) confront when attempting to translate from quantitative models; and discuss examples of relevant translational studies. We conclude that, where behavior-science translation is concerned, the quantitative features of quantitative models cannot be ignored without sacrificing conceptual precision, scientific and practical insights, and the capacity of the basic and applied wings of behavior analysis to communicate effectively.

Molar functional relations and clinical behavior analysis: implications for assessment and treatment

The experimental analysis of behavior has identified several molar functional relations that are highly relevant to clinical behavior analysis. These include matching, discounting, momentum, and variability. Matching provides a broader analysis of how multiple sources of reinforcement influence how individuals choose to allocate their time and offers an empirical rationale for reducing problem behavior by increasing adaptive behavior. Discounting highlights the functional relations that affect self-control. Momentum specifies the variables responsible for persistence in challenging situations. Variability characterizes a functional dimension of behavior that is essential for learning and problem solving. These concepts have important implications for clinical practice and research. A selective review of these concepts is presented, and their implications for assessment and treatment are discussed with two goals: to inform basic scientists about the relevance of their work and to invite clinical behavior analysts to broaden the conceptual basis for their work.

A microswitch-cluster program to foster adaptive responses and head control in students with multiple disabilities: replication and validation assessment

A program relying on microswitch clusters (i.e., combinations of microswitches) and preferred stimuli was recently developed to foster adaptive responses and head control in persons with multiple disabilities. In the last version of this program, preferred stimuli (a) are scheduled for adaptive responses occurring in combination with head control (i.e., head upright) and (b) last through the scheduled time only if head control is maintained for that time. The first of the present two studies was aimed at replicating this program with three new participants with multiple disabilities adding to the three reported by Lancioni et al. [Lancioni, G. E., Singh, N. N., O'Reilly, M. F., Sigafoos, J., Didden, R., Oliva, D., et al. (2007). Fostering adaptive responses and head control in students with multiple disabilities through a microswitch-based program: Follow-up assessment and program revision. Research in Developmental Disabilities, 28, 187-196]. The second of the two studies served to carry out an expert validation of the program's effects on head control and general physical condition with the three participants of Study I as well as the three participants involved in the Lancioni et al. study mentioned above. The expert raters were 72 new physiotherapists and 72 experienced physiotherapists. The results of Study I supported previous data and indicated that the program was effective in helping the participants increase the frequency of adaptive responses in combination with head control and the length of such control. The results of Study II showed that the raters found the effects of the new program more positive than those of other intervention conditions and also considered such program a useful complement to formal motor rehabilitation programs.

Sequential effects: Superstition or rational behavior?

In a variety of behavioral tasks, subjects exhibit an automatic and apparently suboptimal sequential effect: they respond more rapidly and accurately to a stimulus if it reinforces a local pattern in stimulus history, such as a string of repetitions or alternations, compared to when it violates such a pattern. This is often the case even if the local trends arise by chance in the context of a randomized design, such that stimulus history has no real predictive power. In this work, we use a normative Bayesian framework to examine the hypothesis that such idiosyncrasies may reflect the inadvertent engagement of mechanisms critical for adapting to a changing environment. We show that prior belief in non-stationarity can induce experimentally observed sequential effects in an otherwise Bayes-optimal algorithm. The Bayesian algorithm is shown to be well approximated by linear-exponential filtering of past observations, a feature also apparent in the behavioral data. We derive an explicit relationship between the parameters and computations of the exact Bayesian algorithm and those of the approximate linear-exponential filter. Since the latter is equivalent to a leaky-integration process, a commonly used model of neuronal dynamics underlying perceptual decision-making and trial-to-trial dependencies, our model provides a principled account of why such dynamics are useful. We also show that parameter-tuning of the leaky-integration process is possible, using stochastic gradient descent based only on the noisy binary inputs. This is a proof of concept that not only can neurons implement near-optimal prediction based on standard neuronal dynamics, but that they can also learn to tune the processing parameters without explicitly representing probabilities.

The efficacy of noncontingent escape for decreasing children's disruptive behavior during restorative dental treatment

We evaluated the effectiveness of a dentist-implemented behavioral intervention in which brief escape from dental treatment was provided on a regular basis, independent of the child's behavior. Within a multiple baseline design across subjects, 5 children, ages 4 to 7 years, were provided with temporary escape from dental treatment on a fixed-time schedule. The intervals were signaled by an electronic timer worn by the dentist. Clinically significant reductions were observed in physically disruptive behavior across all 5 children with the introduction of noncontingent escape, and verbally disruptive behavior was markedly reduced in 4 of the 5 children. In addition, the dental staff s use of physical restraint was reduced to near zero across all 5 children. The research extends the literature in both clinical dentistry and in applied behavior analysis by demonstrating that a dentist can easily and effectively implement noncontingent reinforcement to produce clinically significant and socially important changes in children's health behavior.

Testing response-stimulus equivalence relations using differential responses as a sample

This study tested the notion that an equivalence relation may include a response when differential responses are paired with stimuli presented during training. Eight normal adults learned three kinds of computer mouse movements as differential response topographies (R1, R2, and R3). Next, in matching-to-sample training, one of the response topographies was used to select a comparison stimulus B (B1, B2, or B3) conditionally upon presentation of sample stimulus A (A1, A2, or A3), and to select stimulus D (D1, D2, or D3) conditionally upon presentation of stimulus C (C1, C2, or C3). After two sample-comparison-response relations (ABR and CDR) were established, 18 sample-comparison relations were tested (BA, DC, RA, RB, RC, RD, AC, CA, AD, DA, BC, CB, BD, DB, AA, BB, CC, and DD). In the RA, RB, RC, and RD tests, the differential responses (R1, R2, and R3) were used as sample stimuli. All subjects made class-consistent comparison selections in the tests. This study provides evidence that responses may become members of an equivalence class.