1
|
Kanazawa R, Jessel J, Park M, Fienup D, Dowdy A. A comparison of parental attention and preferred items during tummy time: A consecutive controlled case series evaluation. J Appl Behav Anal 2024; 57:341-357. [PMID: 38305497 DOI: 10.1002/jaba.1061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 01/16/2024] [Indexed: 02/03/2024]
Abstract
Tummy time is an activity for infants to practice their early motor skills. Although most pediatricians recommend tummy time, parents may avoid the procedures due to indices of infant discomfort during this period. This consecutive controlled case series evaluation compared the effects of preferred items selected from a preference assessment with those of parental attention on head evaluation and negative vocalizations during tummy time. In addition, we directly evaluated parental choice by inviting parents to select which tummy time treatment they wanted to implement. We found that both preferred items and parental attention effectively increased head elevation and decreased negative vocalizations during tummy time; however, parents tended to prefer the treatment that included the preferred item.
Collapse
Affiliation(s)
- Rika Kanazawa
- Department of Psychology, Queens College, City University of New York, Queens, NY, USA
| | - Joshua Jessel
- Department of Psychology, Queens College, City University of New York, Queens, NY, USA
| | - Minjung Park
- Department of Psychology, Queens College, City University of New York, Queens, NY, USA
| | - Daniel Fienup
- Health and Behavior Studies, Teachers College, Columbia University, New York, NY, USA
| | - Art Dowdy
- College of Education and Human Development, Temple University, Philadelphia, PA, USA
| |
Collapse
|
2
|
Cengher M, LeBlanc LA. Reviewing manuscripts for behavior-analytic journals: A primer. J Appl Behav Anal 2024; 57:71-85. [PMID: 37947502 DOI: 10.1002/jaba.1034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 10/13/2023] [Indexed: 11/12/2023]
Abstract
The peer-review component of the editorial process is designed to facilitate quality control, legitimize scientific research, and self-regulate scientific communities. Even though serving as a reviewer undoubtedly has direct and indirect benefits, the peer-review system and the methods of teaching scholars to conduct reviews are nascent and relatively underdeveloped. This article describes the peer-review process and provides recommendations for writing reviews for scientific journals. The recommendations were developed based on the expertise and preferences of editors in chief and associate editors for behavior-analytic journals (Cengher & LeBlanc, 2024), and they include honoring your responsibility, knowing your audience, being constructive and kind, and carefully evaluating the merits of the study or review. These guidelines may serve as a primer for scholars who want to conduct reviews for scientific journals in behavior analysis.
Collapse
Affiliation(s)
- Mirela Cengher
- Department of Psychology, University of Maryland, Baltimore County, Baltimore, MD, USA
| | | |
Collapse
|
3
|
Chen LT, Chen YK, Yang TR, Chiang YS, Hsieh CY, Cheng C, Ding QW, Wu PJ, Peng CYJ. Examining the normality assumption of a design-comparable effect size in single-case designs. Behav Res Methods 2024; 56:379-405. [PMID: 36650402 DOI: 10.3758/s13428-022-02035-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/22/2022] [Indexed: 01/18/2023]
Abstract
What Works Clearinghouse (WWC, 2022) recommends a design-comparable effect size (D-CES; i.e., gAB) to gauge an intervention in single-case experimental design (SCED) studies, or to synthesize findings in meta-analysis. So far, no research has examined gAB's performance under non-normal distributions. This study expanded Pustejovsky et al. (2014) to investigate the impact of data distributions, number of cases (m), number of measurements (N), within-case reliability or intra-class correlation (ρ), ratio of variance components (λ), and autocorrelation (ϕ) on gAB in multiple-baseline (MB) design. The performance of gAB was assessed by relative bias (RB), relative bias of variance (RBV), MSE, and coverage rate of 95% CIs (CR). Findings revealed that gAB was unbiased even under non-normal distributions. gAB's variance was generally overestimated, and its 95% CI was over-covered, especially when distributions were normal or nearly normal combined with small m and N. Large imprecision of gAB occurred when m was small and ρ was large. According to the ANOVA results, data distributions contributed to approximately 49% of variance in RB and 25% of variance in both RBV and CR. m and ρ each contributed to 34% of variance in MSE. We recommend gAB for MB studies and meta-analysis with N ≥ 16 and when either (1) data distributions are normal or nearly normal, m = 6, and ρ = 0.6 or 0.8, or (2) data distributions are mildly or moderately non-normal, m ≥ 4, and ρ = 0.2, 0.4, or 0.6. The paper concludes with a discussion of gAB's applicability and design-comparability, and sound reporting practices of ES indices.
Collapse
Affiliation(s)
- Li-Ting Chen
- Department of Educational Studies, University of Nevada, Reno, Reno, NV, USA.
| | - Yi-Kai Chen
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Tong-Rong Yang
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Yu-Shan Chiang
- Department of Curriculum & Instruction, Indiana University Bloomington, Bloomington, IN, USA
| | - Cheng-Yu Hsieh
- Department of Psychology, National Taiwan University, Taipei, Taiwan
- Department of Psychology, Royal Holloway, University of London, Egham, UK
| | - Che Cheng
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Qi-Wen Ding
- Institute of Sociology, Academia Sinica, Taipei, Taiwan
| | - Po-Ju Wu
- Department of Counseling and Educational Psychology, Indiana University Bloomington, Bloomington, IN, USA
| | - Chao-Ying Joanne Peng
- Department of Psychology, National Taiwan University, Taipei, Taiwan
- Department of Counseling and Educational Psychology, Indiana University Bloomington, Bloomington, IN, USA
| |
Collapse
|
4
|
Mullins LE, Scott V, Cox AD. Training programme for community service providers who support adults with intellectual disabilities: A systematic quantitative literature review of single-case research. JOURNAL OF APPLIED RESEARCH IN INTELLECTUAL DISABILITIES 2023; 36:1191-1205. [PMID: 37632395 DOI: 10.1111/jar.13152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Revised: 07/24/2023] [Accepted: 08/09/2023] [Indexed: 08/28/2023]
Abstract
BACKGROUND Research on training direct support professionals to address challenging behaviour exhibited by adults with intellectual disabilities is essential in generating effective training approaches for this sector. This systematic review's objective was to evaluate the effects of training types and whether specific training delivery components influenced outcomes. METHODS Following PRISMA (2020) guidelines, 16 single-case design studies were included that directly evaluated behaviour change of service providers training for adults with intellectual disabilities in community settings. Study quality was assessed using Horner et al. (Exceptional Children, 2005, 71(2), 165-180) criteria. The database searched included Academic Search Complete, CINAHL, Embase, ERIC, Psych Info, and Web of Science. RESULTS Descriptive analysis of effect size outcomes suggested that all training types were associated with improved outcomes. Further, in situ training was associated with improved service provider performance. Interestingly, feedback was associated with poorer service provider performance. CONCLUSIONS We provide possible explanations for this surprising outcome and propose future research.
Collapse
Affiliation(s)
- Laura E Mullins
- Department of Applied Disability Studies, Brock University, Saint Catharines, Canada
| | - Victoria Scott
- Department of Applied Disability Studies, Brock University, Saint Catharines, Canada
| | - Alison D Cox
- Department of Applied Disability Studies, Brock University, Saint Catharines, Canada
| |
Collapse
|
5
|
Virues-Ortega J, Pérez-Bustamante Pereira A, Martin N, Moeyaert M, Krause PA, Tarifa-Rodriguez A, Trujillo C, Sivaraman M. Reducing face touching through haptic feedback: A treatment evaluation against fomite-mediated self-infection. J Appl Behav Anal 2023. [PMID: 37179496 DOI: 10.1002/jaba.996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 04/23/2023] [Indexed: 05/15/2023]
Abstract
Fomite-mediated self-infection via face touching is an understudied transmission pathway for infectious diseases. We evaluated the effect of computer-mediated vibrotactile cues (presented through experimental bracelets located on one or both hands of the participant) on the frequency of face touching among eight healthy adults in the community. We conducted a treatment evaluation totaling over 25,000 min of video observation. The treatment was evaluated through a multiple-treatment design and hierarchical linear modeling. The one-bracelet intervention did not produce significantly lower levels of face touching across both hands, whereas the two-bracelet intervention did result in significantly lower face touching. The effect increased over repeated presentations of the two-bracelet intervention, with the second implementation producing, on average, 31 fewer face-touching percentual points relative to baseline levels. Dependent on the dynamics of fomite-mediated self-infection via face touching, treatment effects could be of public health significance. The implications for research and practice are discussed.
Collapse
Affiliation(s)
| | - Agustín Pérez-Bustamante Pereira
- School of Psychology, The University of Auckland, New Zealand
- Servicio de Psiquiatría, Hospital Universitario Ramón y Cajal, Madrid, Spain
| | - Neil Martin
- Behavior Analyst Certification Board, Littleton, Colorado, USA
| | | | - Peter A Krause
- Department of Psychology, California State University, Channel Islands
| | | | | | | |
Collapse
|
6
|
Tanious R, Manolov R. Violin plots as visual tools in the meta-analysis of Single-Case Experimental Designs. METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES 2022. [DOI: 10.5964/meth.9209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Despite the existence of sophisticated statistical methods, systematic reviews regularly indicate that single-case experimental designs (SCEDs) are predominantly analyzed through visual tools. For the quantitative aggregation of results, different meta-analytical techniques are available, but specific visual tools for the meta-analysis of SCEDs are lacking. The present article therefore describes the use of violin plots as visual tools to represent the raw data. We first describe the underlying rationale of violin plots and their main characteristics. We then show how the violin plots can complement the statistics obtained in a quantitative meta-analysis. The main advantages of violin plots as visual tools in meta-analysis are (a) that they preserve information about the raw data from each study, (b) that they have the ability to visually represent data from different designs in one graph, and (c) that they enable the comparison of score distributions from different experimental phases from different studies.
Collapse
|
7
|
Costello MS, Bagley RF, Fernández Bustamante L, Deochand N. Quantification of behavioral data with effect sizes and statistical significance tests. J Appl Behav Anal 2022; 55:1068-1082. [PMID: 35758067 DOI: 10.1002/jaba.938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 05/20/2022] [Indexed: 11/07/2022]
Abstract
This article describes the use of statistical significance tests and distance-based effect sizes with behavioral data from single case experimental designs (SCEDs). Such data often are interpreted only with visual analysis. However, a growing movement in the field is to quantify results to improve decision-making and communication across studies and sciences. The goal of the present study was to assess the agreement between visual analysis and various statistical tests. We recruited visual analysts to judge 160 pairwise data sets from published articles and compared these analyses to significance tests and effect sizes. One-tailed significance testing of Tau z and the percentage of pairwise differences in the predicted direction (PWD) generally agreed with each other, and complemented the effect sizes of Ratio of Distances (RD) and g. Visual analysis was somewhat unreliable and should be combined with statistical complements to maximize decision accuracy.
Collapse
|
8
|
Aydin O, Tanious R. Performance criteria-based effect size (PCES) measurement of single-case experimental designs: A real-world data study. J Appl Behav Anal 2022; 55:891-918. [PMID: 35593661 DOI: 10.1002/jaba.928] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 04/06/2022] [Indexed: 12/20/2022]
Abstract
Visual analysis and nonoverlap-based effect sizes are predominantly used in analyzing single case experimental designs (SCEDs). Although they are popular analytical methods for SCEDs, they have certain limitations. In this study, a new effect size calculation model for SCEDs, named performance criteria-based effect size (PCES), is proposed considering the limitations of 4 nonoverlap-based effect size measures, widely accepted in the literature and that blend well with visual analysis. In the field test of PCES, actual data from published studies were utilized, and the relations between PCES, visual analysis, and the 4 nonoverlap-based methods were examined. In determining the data to be used in the field test, 1,052 tiers (AB phases) were identified from 6 journals. The results revealed a weak or moderate relation between PCES and nonoverlap-based methods due to its focus on performance criteria. Although PCES has some weaknesses, it promises to eliminate the causes that may create issues in nonoverlap-based methods, using quantitative data to determine socially important changes in behavior and to complement visual analysis.
Collapse
|
9
|
Falligant JM, Chin MD, Kurtz PF. Renewal and resurgence of severe problem behavior in an intensive outpatient setting: Prevalence, magnitude, and implications for practice. BEHAVIORAL INTERVENTIONS 2022. [DOI: 10.1002/bin.1878] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Affiliation(s)
- John M. Falligant
- Department of Behavioral Psychology Kennedy Krieger Institute Baltimore Maryland USA
- Department of Psychiatry and Behavioral Sciences Johns Hopkins University School of Medicine Baltimore Maryland USA
| | - Michelle D. Chin
- Department of Behavioral Psychology Kennedy Krieger Institute Baltimore Maryland USA
| | - Patricia F. Kurtz
- Department of Behavioral Psychology Kennedy Krieger Institute Baltimore Maryland USA
- Department of Psychiatry and Behavioral Sciences Johns Hopkins University School of Medicine Baltimore Maryland USA
| |
Collapse
|
10
|
Dowdy A, Jessel J, Saini V, Peltier C. Structured visual analysis of single-case experimental design data: Developments and technological advancements. J Appl Behav Anal 2021; 55:451-462. [PMID: 34962646 DOI: 10.1002/jaba.899] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Revised: 11/22/2021] [Accepted: 11/22/2021] [Indexed: 11/05/2022]
Abstract
Visual analysis is the primary method used to interpret single-case experimental design (SCED) data in applied behavior analysis. Research shows that agreement between visual analysts can be suboptimal at times. To address the inconsistent interpretations of SCED data, recent structured visual-analysis technological advancements have been developed. To assess the extent to which structured visual analysis is used to guide or supplement applied behavior analysts' interpretation of SCED graphs, a systematic review between the years of 2015 to 2020 in the Journal of Applied Behavior Analysis was conducted. Findings showed that despite recent efforts to develop structured visual-analysis tools and criteria, these methods are rarely used to analyze SCED data. An overview of structured visual-analysis tools is shared, their utility is delineated, common characteristics are brought to light, and future directions for both research and their clinical use are highlighted.
Collapse
Affiliation(s)
- Art Dowdy
- Department of Teaching and Learning, Temple University
| | | | - Valdeep Saini
- Department of Applied Disability Studies, Brock University
| | - Corey Peltier
- Department of Educational Psychology, University of Oklahoma
| |
Collapse
|
11
|
Muharib R, Dowdy A, Rajaraman A, Jessel J. Contingency-based delay to reinforcement following functional communication training for autistic individuals: A multilevel meta-analysis. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2021; 26:761-781. [PMID: 34961394 DOI: 10.1177/13623613211065540] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
LAY ABSTRACT Functional communication training, an intervention for challenging behavior rooted in principles of applied behavior analysis, has copious empirical support dating back to the mid-1980s for autistic individuals. Recently, there has been a concerted effort to thin reinforcement delivery during functional communication training using contingency-based delays that, in turn, are designed to enhance practicality and feasibility while not compromising efficacy. In this synthesis, we meta-analyzed the literature base with the goal of investigating both combined and across type effectiveness of contingency-based delays. We also aimed to investigate moderating variables that might impact intervention outcomes. Findings showed that contingency-based delays were effective for individuals with an autism spectrum disorder diagnosis and most effective when the delay incorporated some form of positive reinforcement. In addition, differential reinforcement of alternative-based delays was overall more effective when compared to differential reinforcement of other behavior-based delays. Noteworthy moderating variables found to impact contingency-based delay efficacy included the intervention dosage and the topography of behavior. We discuss these findings and highlight directions where additional empirical research is warranted to improve our understanding about contingency-based delays for individuals diagnosed with autism spectrum disorder.
Collapse
|
12
|
Meta-Analytic Methods to Detect Publication Bias in Behavior Science Research. Perspect Behav Sci 2021; 45:37-52. [DOI: 10.1007/s40614-021-00303-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/02/2021] [Indexed: 01/01/2023] Open
|
13
|
Dowdy A, Peltier C, Tincani M, Schneider WJ, Hantula DA, Travers JC. Meta-analyses and effect sizes in applied behavior analysis: A review and discussion. J Appl Behav Anal 2021; 54:1317-1340. [PMID: 34219222 DOI: 10.1002/jaba.862] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 06/01/2021] [Accepted: 06/02/2021] [Indexed: 12/28/2022]
Abstract
For more than four decades, researchers have used meta-analyses to synthesize data from multiple experimental studies often to draw conclusions that are not supported by individual studies. More recently, single-case experimental design (SCED) researchers have adopted meta-analysis techniques to answer research questions with data gleaned from SCED experiments. Meta-analyses enable researchers to answer questions regarding intervention efficacy, generality, and condition boundaries. Here we discuss meta-analysis techniques, the rationale for their adaptation with SCED studies, and current indices used to quantify the effect of SCED data in applied behavior analysis.
Collapse
Affiliation(s)
- Art Dowdy
- Department of Teaching and Learning, Temple University
| | - Corey Peltier
- Department of Educational Psychology, University of Oklahoma
| | - Matt Tincani
- Department of Teaching and Learning, Temple University
| | - W Joel Schneider
- Department of Psychological Studies in Education, Temple University
| | | | | |
Collapse
|