Motivating operations and stimulus control

Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.

Theory of reinforcement schedules

The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the "contingencies of reinforcement." Mathematical models of each of these principles comprised mathematical principles of reinforcement (MPR; Killeen, 1994). Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm-up, extinction, sign tracking, pausing, and sequential control in progressive-ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted.

Grounding applied animal behavior practices in the experimental analysis of behavior

Some of the earliest applications outside the laboratory of principles derived from the experimental analysis of behavior (EAB), such as the pioneering work of Keller and Marian Breland, involved animals. This translational tradition continues to the present as EAB-related behavior principles are applied with increasing frequency to behavior management and training practices with animals in nonlaboratory settings. Such translations, and those populations to which they are applied, benefit from a rigorous experimental analysis of practices that are promulgated in popular outlets. These translations both affirm the generality of those principles and serve as goads for laboratory and field research that can further articulate extant principles, develop new ones, and refine methods of application and assessment. This review considered several areas of basic EAB research and contemporary applied animal behavior (AAB) practices in relation to one another: (1) response establishment and maintenance, (2) response reduction and elimination, (3) chaining and conditioned reinforcement, and (4) discriminative stimulus control. Within each topic, a selection of processes and procedures in both EAB and AAB work were reviewed in relation to one another.

Willingness to produce disadvantageous outcomes in cooperative tasks is modulated by recent experience

Cooperative behavior represents a situation in which individuals sometimes act in a way that produces a gain to another at a cost to themselves. This may be explained by a history of repeated interactions with others in which such behavior has resulted in reciprocal cooperation from others. Sometimes, even with reciprocal cooperation, gains and costs are unbalanced between partners. In this case, there is evidence that people may present an aversion to both disadvantageous and advantageous distributions of gains. In other words, they may act in such a way as to ensure an equal outcome among all group members. Aversion to inequity that benefits oneself (advantageous inequity (AI) aversion) may be more dependent on social and cultural cues than aversion to inequity that benefits others (disadvantageous inequity (DI) aversion). Using both between-subjects (Experiment 1) and within-subjects (Experiment 2) manipulations, the influence of recent experience with AI on participants' willingness to produce DI was explored within the context of a two-player card game. In initial game phases, the percentage of trials in which the participant experienced AI was manipulated. In subsequent game phases, participants had the opportunity to produce DI to themselves. The results from both experiments suggest that aversion to DI is reduced by recent experience with AI. This procedure allows social influences on DI to be tested, which may be important for providing a psychological explanation of cultural differences in aversion to DI.

Referent-Based Instruction to Strengthen the Verbal Behavior of Early Learners with Autism and Related Language Disorders

The current study evaluated the use of precision teaching to address the verbal behavior deficits of children with autism and other language disorders. From 2013 to 2018, a high-research-activity doctoral university in the south-central United States operated a free clinic that provided applied behavior anlaysis services to early learners in the local community. Participants received referent-based verbal behavior instruction to strengthen their functional language skills by systematically transferring stimulus control across 4 primary verbal operants: mands, echoics, tacts, and sequelics. Referent-based instruction is premised on the notion that proportionate levels of strength among these 4 operants provide the relational flexibility of naturalistic speaking observed in typical language development. This article details the language gains made by 49 participants who received 13 weeks of intervention for 90 min a day, 4 days a week. Relative strengths and weaknesses were identified in the verbal repertoire of each participant, and individualized fluency aims were subsequently developed. Results of pretest and posttest comparisons show that there was a large effect size within the verbal behavior gains of participants who received precision teaching. Implications for implementing referent-based instruction, as well as future areas of research, are discussed.

What Can We Learn by Treating Perspective Taking as Problem Solving?

Perspective taking has been studied extensively using a wide variety of experimental tasks. The theoretical constructs that are used to develop these tasks and interpret the results obtained from them, most notably theory of mind (ToM), have conceptual shortcomings from a behavior-analytic perspective. The behavioral approach to conceptualizing and studying this class of behavior is parsimonious and pragmatic, but the body of relevant research is currently small. The prominent relational frame theory (RFT) approach to derived perspective taking asserts that "deictic framing" is a core component of this class of behavior, but this proposal also appears to be conceptually problematic. We suggest that in many cases perspective taking is problem solving; when successful, both classes of behavior involve the emission of context-appropriate precurrent behavior that facilitates the appropriate response (i.e., the "solution"). Conceptualizing perspective taking in this way appears to have many advantages, which we explore herein.

Underlying Principles of a Covid-19 Behavioral Vaccine for a Sustainable Cultural Change

Until pharmacological measures are effective at containing the COVID-19 outbreak, adopting protective behaviors is paramount. In this work, we aim at informing interventions to limit the spread of the contagion and prepare against any future outbreaks by developing a behavioral framework to interpret and prescribe both the individual and large-scale uptake of non-pharmaceutical measures. First, we analyze the barriers and facilitators to adherence to protective behaviors according to a three-term contingency by exploring potential gaps in terms of setting stimuli, motivating operations, delayed consequences, and positive or negative consequences. We explore their roles in the likelihood of individual compliance to protective behaviors, taking physical distancing as an example of functional analysis. Second, we interpret contagion control as the cumulative effect of large-scale adherence to protective behaviors. We explore the interrelations between societal problems caused or amplified by similar behaviors presented by many individuals and the coordination of agents or agencies aiming at promoting large-scale behavioral change. Then, we highlight the potential of developing a behavioral vaccine, and practical steps for applying it to promote sustainable cultural change that may protect against health, social, and economic losses in future outbreaks.

Motivating Operations and Negative Reinforcement

The motivating operations concept has improved the precision of our approach to analyzing behavior; it serves as a framework for classifying events that alter the reinforcing and punishing effectiveness of other events. Nevertheless, some aspects of the concept are seriously flawed, thereby limiting its utility. We contend in this article that the emphasis it places on the onset of some stimuli (putative motivating operations) making their offset a reinforcer in the absence of a learning history (i.e., in the case of unconditioned motivating operations), or because of such a history (i.e., in the case of reflexive conditioned motivating operations), is of no value in predicting or controlling behavior. It is unfortunate that this pseudo-analysis has been widely accepted, which has drawn attention away from actual motivating operations that are relevant to negative reinforcement, and led to conceptually flawed explanations of challenging human behaviors that are escape-maintained. When used appropriately, the motivating operations concept can help to clarify the conditions under which a stimulus change (in particular, stimulus termination) will function as a negative reinforcer. From both a theoretical and a practical perspective, rethinking the application of the motivating operations concept to negative reinforcement is advantageous. Herein, we explore the implications of doing so with the aim of encouraging relevant research and improving the practice of applied behavior analysis.

Collaborative Research Project: Developing and Testing a Robot-Assisted Intervention for Children With Autism

The present work is a collaborative research aimed at testing the effectiveness of the robot-assisted intervention administered in real clinical settings by real educators. Social robots dedicated to assisting persons with autism spectrum disorder (ASD) are rarely used in clinics. In a collaborative effort to bridge the gap between innovation in research and clinical practice, a team of engineers, clinicians and researchers working in the field of psychology developed and tested a robot-assisted educational intervention for children with low-functioning ASD (N = 20) A total of 14 lessons targeting requesting and turn-taking were elaborated, based on the Pivotal Training Method and principles of Applied Analysis of Behavior. Results showed that sensory rewards provided by the robot elicited more positive reactions than verbal praises from humans. The robot was of greatest benefit to children with a low level of disability. The educators were quite enthusiastic about children's progress in learning basic psychosocial skills from interactions with the robot. The robot nonetheless failed to act as a social mediator, as more prosocial behaviors were observed in the control condition, where instead of interacting with the robot children played with a ball. We discuss how to program robots to the distinct needs of individuals with ASD, how to harness robots' likability in order to enhance social skill learning, and how to arrive at a consensus about the standards of excellence that need to be met in interdisciplinary co-creation research. Our intuition is that robotic assistance, obviously judged as to be positive by educators, may contribute to the dissemination of innovative evidence-based practice for individuals with ASD.

Changes in the elimination and resurgence of alcohol-maintained behavior in rats and the effects of naltrexone

Resurgence may be a mechanism of relapse in alcohol use disorder patients upon discharge from treatment as part of an abuse-treatment-relapse cycle. Adjunctive pharmacotherapies may be a means to facilitate behavioral treatments and block resurgence. Experiments were conducted using a model of alcohol self-administration to assess the repeatability of the elimination and resurgence of alcohol-maintained behavior and the effects of naltrexone. Experiments had three phases. In Phase 1, behavior was maintained by oral alcohol under a fixed-ratio schedule. In Phase 2, behavior was extinguished via condensed milk delivery under a differential-reinforcement-of-other-behavior (DRO) schedule. In Phase 3, the DRO schedule was eliminated. In Experiment 1, this 3-phase cycle was replicated 4 times. Across replications, response rates and dose of alcohol consumed did not differ in Phase 1, alcohol-maintained behavior was eliminated more rapidly in Phase 2, and the resurgence effect was generally stable in Phase 3. In Experiment 2, naltrexone was administered in Phase 2, Phase 3, or both Phases 2 and 3, to separate groups of rats. Naltrexone facilitated the elimination of alcohol-maintained behavior in Phase 2 and, the resurgence of alcohol-maintained behavior was reduced only for those rats that received naltrexone in both phases. Together, these experiments demonstrate that the resurgence of alcohol-maintained behavior is replicable within-subjects and, further, resurgence of alcohol-maintained behavior may be a useful model to evaluate pharmacological interventions to facilitate behavioral treatments and reduce the likelihood of relapse. Results with naltrexone support the use of medication-assisted therapy approaches to reduce relapse risk in patients. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Motivating Operations and Discriminative Stimuli: Distinguishable but Interactive Variables

The motivating operations concept has been of considerable interest and practical value to behavior analysts, including practitioners. Nonetheless, the concept has generated substantial controversy and has significant limitations. To address some of these limitations, we suggest that it would be wise to redefine motivating operations, to deemphasize the importance that has historically been placed on subtypes of conditioned motivating operations, to emphasize how motivating operations and discriminative stimuli interact, and to further examine the kinds of environmental changes that alter the reinforcing value of particular kinds of stimuli. These suggestions are detailed elsewhere and summarized in this article.