ABA Finding Its Heart During a Pandemic: An Exploration in Social Validity

A systematic review of social-validity assessments in the Journal of Applied Behavior Analysis: 2010-2020

We conducted a systematic review of studies published in the Journal of Applied Behavior Analysis between 2010 and 2020 to identify reports of social validity. A total of 160 studies (17.60%) published during this time included a measure of social validity. For each study, we extracted data on (a) the dimensions of social validity, (b) the methods used for collecting social-validity data, (c) the respondents, and (d) when social-validity data were collected. Most social-validity assessments measured the acceptability of intervention procedures and outcomes, with fewer evaluating goals. The most common method for collecting social validity data was Likert-type rating scales, followed by non-Likert-type questionnaires. In most studies, the direct recipients of the intervention provided feedback on social validity. Social-validity assessment data were often collected at the conclusion of the study. We provide examples of social-validity measurement methods, discuss their strengths and limitations, and provide recommendations for improving the future collection and reporting of social-validity data.

How Can Qualitative Methods Be Applied to Behavior Analytic Research: A Discussion and Suggestions for Implementation

Behavior analysts in research and clinical practice are interested in an ever-expanding array of topics. They are compelled to explore the social validity of the interventions they propose and the findings they generate. As the field moves in these important directions, qualitative methods are becoming increasingly relevant. Representing a departure from small-n design favored by behavior analysts, qualitative approaches provide analysts a unique set of tools to answer questions that prioritize voice, experience, and understandings in context. Despite recognition of the value of qualitative approaches in other disciplines, application of qualitative methods in behavior analysis remains limited. One likely explanation is that behavior analysts are not yet fluent in applying qualitative approaches within their clinical and research investigations. To address this issue, exploration of qualitative research approaches in behavior analytic literature is needed, alongside practical advice for analysts who are interested in using qualitative methods. This article briefly outlines qualitative literature which pertains to behavior analysts wanting to incorporate qualitative methods into their inquiries. Attention is primarily drawn to the need for coherence in designing and implementing a robust qualitative study that aligns with the behavior analyst's aims and perspective on knowing. A set of guiding questions are provided to orient behavior analysts to considerations in qualitative research and outline how analysts can conceptualize a strong qualitative study. This article aims to support increased application of qualitative methods by behavior analysts, where these methods best address the function of the behavior analytic investigation.

A Meta-Analysis of Treatment for Self-Injurious Behavior in Children and Adolescents With Intellectual and Developmental Disabilities

Self-injurious behavior (SIB) among children and youth with developmental disabilities has not diminished in prevalence despite the availability of effective interventions, and the impact on quality of life for people and their families is devastating. The current meta-analysis reviews SIB intervention research between 2011 and 2021 using single-case experimental designs with children and youth up to 21 years old and provides a quantitative synthesis of data from high-quality studies including moderator analyses to determine effects of participant and study characteristics on intervention outcomes. Encouraging findings include a high level of effectiveness across studies in the decrease of SIB (Tau-U = -0.90) and increase of positive behavior (Tau-U = 0.73), as well as an increase in studies (relative to prior reviews) reporting intervention fidelity, generalization, maintenance, and social validity. However, our findings shed limited light on potential moderating variables in the development of interventions for children and youth who exhibit SIB. Of the potential moderators of intervention effects, only implementer (researcher/therapist vs. parent/caregiver) and setting (clinic vs. home) were significantly associated with improved outcomes. We discuss the need for more robust involvement of natural communities of implementers in SIB intervention research to better equip them to effectively and sustainably meet the needs of people they care for. We also discuss the importance of creating systems enabling broad access for children with SIB to effective interventions in service of reducing burden for people, families, and society over time.

Social Validity in Behavioral Research: A Selective Review

Through the application of behavioral principles, behavior analysts seek to produce socially meaningful behavior change, defined as alterations in behavior that yield important outcomes immediately beneficial for the direct consumers of interventions and key stakeholders. Behavioral practitioners and researchers often engage in assessment and reporting of the meaningfulness of behavior change using social validity assessments. These assessments ensure that target behaviors are appropriately selected, intervention procedures are acceptable, and satisfactory outcomes are produced. The purpose of this review is to identify the current state of social validity within behavioral literature. We reviewed eight peer-reviewed journals between 2010 and 2020. We found that 47% of the intervention studies reviewed included a social validity assessment. Social validity assessment across journals has increased over time, with a significant rise from 2019 to 2020. Implications of these findings and suggestions for future work are discussed.

Rethinking the Place of Qualitative Methods in Behavior Analysis

Single-case design research is pervasive and dominant in the field of behavior analysis (BA). It allows for effective application of behavior change technologies in a wide variety of real-world settings. However, as the field has grown, behavioral scholars have suggested incorporating other methods into the investigator’s toolbox to supplement single-case design. To date, the call to expand beyond using only variations of single-case design as the standard for behavior analytic research has gone largely unheard. Given the need for behavior analytic work to be more closely aligned with consumer and stakeholder needs and priorities, along with a proliferation of practitioners and researchers in the field, now is the time to consider the benefits of qualitative research methods for behavior analysts. In particular, in areas of social validity and in exploring diverse applied topics, qualitative methods may help the field of behavior analysis to achieve greater success with documenting the outcomes from behavior change interventions. The present article explores areas where behavior analysis may benefit from utilizing qualitative methods, namely social validity and breadth of topics for study, and provides examples of the value of qualitative research from other fields. A brief outline of qualitative research is provided alongside consideration of the seven dimensions of applied behavior analysis. In situations where single-case design does not offer behavior analysts sufficient methodological opportunity, qualitative research methods could form a powerful addition to the field of behavior analysis.

A Bibliometric Study on the Social Validity of Telepractice in Autism Spectrum Disorder

The field of telepractice is generating increasing interest in recent years. In recent years, early childhood services have used resources such as support for interventions in families with children with autism spectrum disorder. Due to this situation, the social validity of such resources has emerged in this sector, receiving individual attention from academics and practitioners. However, a further deepening of such analyses is needed. Therefore, the main objective of this work is to analyze papers published in the Web of Science on social validity and telepractice in autism spectrum disorders. Bibliometric analysis allows us to discover the current state of a research field, to identify the main authors, articles, and topics, and to propose future lines of research to develop it further. Articles published between 2000 and 2021 were analyzed quantitatively, and by co-occurrence of words and authors. Subsequently, through bibliographic linking, the articles were grouped into different clusters. Five central themes were found, with social skills and the effectiveness of intervention programs being the most developed areas of research. Furthermore, studies focusing on evidence-based practices are necessary for the development of this research field. Thus, the analysis of social validity in the field of telepractice in children with autism spectrum disorders is a developing field within the early childhood sector.

Maintaining Effective Supervision Systems for Trainees Pursuing a Behavior Analyst Certification Board Certification During the COVID-19 Pandemic

Behavior analysts acting as supervisors of individuals pursuing Behavior Analyst Certification Board certification are tasked with designing effective and ethical supervision and training systems. Behavior analyst supervisors and their trainees may face challenges fulfilling their responsibilities in the midst of barriers that include competing contingencies, transitions, and interruptions. In this article, we review potential obstacles faced by supervisors in designing effective supervision through site closures and transitions to telepractice as a result of the COVID-19 pandemic. We explore related potential barriers faced by trainees serving clients through public school settings, as well as through insurance-funded agencies in the United States. We review some practical solutions and offer tools for supervisors and trainees to consider at this time. We present a template for trainees to help them develop a personalized applied behavior analysis fieldwork plan for their supervision, a client/family needs assessment, and a corresponding trainee needs assessment to assist with adaptations to supervision and service delivery in an individualized manner.

The Effect of COVID-19 on Education

COVID-19 has changed education for learners of all ages. Preliminary data project educational losses at many levels and verify the increased anxiety and depression associated with the changes, but there are not yet data on long-term outcomes. Guidance from oversight organizations regarding the safety and efficacy of new delivery modalities for education have been quickly forged. It is no surprise that the socioeconomic gaps and gaps for special learners have widened. The medical profession and other professions that teach by incrementally graduated internships are also severely affected and have had to make drastic changes.

Culturally Relevant Pedagogy and Applied Behavior Analysis: Addressing Educational Disparities in PK-12 Schools

The purpose of this article is to describe the theory of culturally relevant pedagogy (CRP) and its application to PK-12 education for behavior analysts working in schools. CRP is an educational framework that asserts that successful teachers of African American students help their students gain three repertoires: (1) sociopolitical awareness, (2) cultural competence, and (3) academic excellence. The CRP framework was designed to counter the effects that racial bias has on the academic and disciplinary experiences of some students of color. This article suggests that applied behavior analysis and CRP, when used together, may strengthen educators' efforts to reduce the effects of racism that some students of color experience. The authors first explain the tenets of CRP based on the work of Ladson-Billings (1995a, 1995b). Next, points of convergence between ABA and CRP are described. Finally, the authors offer recommendations for behavior analysts to consider when applying CRP in schools through the provision of examples of strategies and tactics derived from the behavioral literature that align with the CRP framework. The framework presented in this article has implications for behavior analysts interested in applying culturally relevant practices to their work as educators.