Registered reports and replications: An ongoing Journal of School Psychology initiative

Recent psychological research suggests that many published studies cannot be replicated (e.g., Open Science Collaboration, 2015). The inability to replicate results suggests that there are influences and biases in the publication process that encourage publication of unusual-rather than representative-results, and that also discourage independent replication of published studies. A brief discussion of the ways in which publication bias and professional incentives may distort the research literature in school psychology is contrasted against the importance of replications and preregistration of research (i.e., registered reports) as self-correcting mechanisms for research in school psychology. The limitations of current practices, coupled with the importance of registered reports and replications as self-correcting mechanisms, provide the context for this ongoing initiative in the Journal of School Psychology. Processes for manuscript submission, review, and publication are presented to encourage researchers to preregister studies and submit replications for publication.

An Examination of Measurement Procedures and Characteristics of Baseline Outcome Data in Single-Case Research

There has been growing interest in using statistical methods to analyze data and estimate effect size indices from studies that use single-case designs (SCDs), as a complement to traditional visual inspection methods. The validity of a statistical method rests on whether its assumptions are plausible representations of the process by which the data were collected, yet there is evidence that some assumptions-particularly regarding normality of error distributions-may be inappropriate for single-case data. To develop more appropriate modeling assumptions and statistical methods, researchers must attend to the features of real SCD data. In this study, we examine several features of SCDs with behavioral outcome measures in order to inform development of statistical methods. Drawing on a corpus of over 300 studies, including approximately 1,800 cases, from seven systematic reviews that cover a range of interventions and outcome constructs, we report the distribution of study designs, distribution of outcome measurement procedures, and features of baseline outcome data distributions for the most common types of measurements used in single-case research. We discuss implications for the development of more realistic assumptions regarding outcome distributions in SCD studies, as well as the design of Monte Carlo simulation studies evaluating the performance of statistical analysis techniques for SCD data.

Single-case intervention research design standards: Additional proposed upgrades and future directions

Single-case intervention research design standards have evolved considerably over the past decade. These standards serve the dual role of assisting in single-case design (SCD) intervention research methodology and as guidelines for literature syntheses within a particular research domain. In a recent article (Kratochwill et al., 2021), we argued for a need to clarify key features of these standards. In this article we offer additional recommendations for SCD research and synthesis standards that have been either underdeveloped or missing in the conduct of research and in literature syntheses. Our recommendations are organized into three categories: expanding design standards, expanding evidence standards, and expanding the applications and consistency of SCDs. The recommendations we advance are for consideration for future standards, research design training, and they are especially important to guide the reporting of SCD intervention investigations as they enter the literature-synthesis phase of evidence-based practice initiatives.

As we coach, so shall we consult: A perspective on coaching research in education

In taking stock of educational coaching research, I consider the extant literature and content of four articles comprising a special issue of the Journal of School Psychology (viz., Glover et al., 2022; Pas et al., 2022; Pianta et al., 2022; Reddy et al., 2022). Before reviewing these specific articles, the thesis offered for the broader field is that without the solid foundation afforded by the school consultation literature, the science of educational coaching would not be as advanced as it is today. Following a description of each study and comparisons between/among them, I consider unique and shared aspects of consultation and educational coaching. The article concludes with four proposed directions for future coaching research based on prior consultation research: (a) documenting coaching procedural integrity and intervention fidelity/integrity to an equal degree, (b) changing teacher behavior utilizing social influence/behavior change frameworks, (c) incorporating greater use of technology (i.e., telecoaching), and (d) moving toward the concept of prescriptive coaching.

The quality and effectiveness of Social-Emotional Learning (SEL) intervention studies in Korea: A meta-analysis

Social-emotional learning (SEL) is an educational model for improving social-emotional competences of all students and a long-term education program connecting school, home, and community. Although there has been active research to establish evidence-based practice (EBP) of SEL programs worldwide, the quality of SEL intervention studies which is an integral part of evaluating EBP was rarely investigated. In addition, prior meta-analytic studies focused only on the effectiveness of SEL programs conducted in Western society. In this sense, in order to contribute to establishing EBP of SEL programs, the current research sought to analyze both quality and effectiveness of SEL intervention studies conducted in Korea where SEL has been investigated and applied in classroom since 2010. To conduct this study, we selected 22 peer-reviewed articles (about 23 SEL programs) and analyzed their quality by Evidence-Based Intervention (EBI) indicators and calculated effect sizes using a meta-analysis. The results of the quality analysis revealed that SEL intervention studies had some limitations with a statistical analysis, use of measurement, a control group design, intervention fidelity, and external validity. The global effect size of SEL programs was 0.27, and the results from the effect size analyses by controlling variables showed that group compositions, the number of sessions, and session length were accountable for the variability of effect sizes. Based on these findings, we discussed the directions for future research and practice on the EBP of SEL programs that can be appreciated by researchers worldwide.

Examining School Psychologists’ Attitudes Toward Standardized Assessment Tools

Despite a call for evidence-based practice in school psychology, limited research on the topic of evidence-based assessment exists. To begin to address this gap in the research, a modified version of Jenson–Doss and Hawley’s (2010) Attitudes Toward Standardized Assessment (ASA) scale was administered to 371 U.S. school psychologists. Examination of the modified ASA’s factor structure suggested that a bifactor model with a single overall domain and three sub-domains was the most parsimonious. Indices of dimensionality indicated that the overall score may be the best indicator of school psychologist’s perceptions of standardized assessment. Additionally, school psychologists’ reported favorable attitudes of standardized assessment compared to clinical judgment alone. Limitations and implications for future research are discussed.

Eficácia Docente e Dificuldades Emocionais/Comportamentais Infantis: Resultados do Programa FAVA

Resumo Este estudo quase-experimental avaliou os resultados do programa FAcilitando o conVívio com Alunos - FAVA, destinado a professores do ensino fundamental I, visando a promoção da eficácia docente e a redução de problemas emocionais/comportamentais infantis, aferidos pela Escala de Avaliação das Crenças de Eficácia do Professor e pelo Questionário de Capacidades e Dificuldades, respectivamente. O FAVA contemplou a psicoeducação sobre o modelo cognitivo, o desenvolvimento socioemocional e a modificação de comportamentos. Comparação entre os grupos experimentais (GE1, que recebeu intervenção completa, e GE2, sem o modelo cognitivo) e o grupo de comparação evidenciou a promoção da eficácia pessoal docente (GE2) e a redução da percepção das dificuldades emocionais/comportamentais infantis (GE1). Ressalta-se a contribuição do modelo cognitivo e da aprendizagem socioemocional em intervenções com professores.

Single-case design standards: An update and proposed upgrades

In this paper, we provide a critique focused on the What Works Clearinghouse (WWC) Standards for Single-Case Research Design (Standards 4.1). Specifically, we (a) recommend the use of visual-analysis to verify a single-case intervention study's design standards and to examine the study's operational issues, (b) identify limitations of the design-comparable effect-size measure and discuss related statistical matters, (c) review the applicability and practicality of Standards 4.1 to single-case designs (SCDs), and (d) recommend inclusion of content pertaining to diversity, equity, and inclusion in future standards. Within the historical context of the WWC Pilot Standards for Single-Case Design (1.0), we suggest that Standards 4.1 may best serve as standards for meta-analyses of SCDs but will need to make clear distinctions among the various types of SCD studies that are included in any research synthesis. In this regard, we argue for transparency in SCD studies that meet design standards and those that do not meet design standards in any meta-analysis emanating from the WWC. The intent of these recommendations is to advance the science of SCD research both in research synthesis and in promoting evidence-based practices.

Researching the Effectiveness of Tree of Life: an Imbeleko Approach to Counseling Refugee Youth

With the growing worldwide refugee crisis, there is a need for evidence-based interventions that specifically deal with the consequences of cumulative trauma-exposure in refugee youth. Refugee children have unique service needs and differ from their non-refugee peers in terms of sociocultural trauma, language, culture, and educational barriers. This article explains the complexities associated with understanding refugee youth and presents a proposal for studying the possible benefits of Tree of Life therapy. At the present time, Tree of Life therapy has no evidence-base because the published studies of Tree of Life with refugee and/or immigrant youth have sample sizes of one, six, eight, and twenty-nine. As a culturally-grounded, strength-based group counseling approach, Tree of Life therapy addresses traumatic experiences, recognizes participants' cultural differences, highlights individual skills, and aids in instilling both confidence and hope for the future. Ncazelo Ncube, the co-founder and main developer of Tree of Life, describes this therapy as a collective narrative practice that considers cultural beliefs and values (2006, 2010, 2018, 2019). The proposed research design is to study the effectiveness of the Tree of Life in Canada, the United States, the United Kingdom, and South Africa. The research plan is to use pragmatic, group-randomized controlled trials in the "real world" settings of schools and agencies in each of the four countries. In addition, the article describes the development of the Roots and Wings Questionnaire for Children and Youth, a culturally relevant, child-friendly questionnaire. The Tree of Life is a readily available therapy with great potential for helping traumatized refugee youth as well as other trauma-impacted young people worldwide.

The Absence of Evidence-Based Practices (EBPs) in the Treatment of Sexual Abusers: Recommendations for Moving Toward the Use of a True EBP Model

Despite a continued evolution of the field of sexual abuser treatment toward a distinct professional discipline with clinicians using an increasing variety of treatment approaches, there is no consensus regarding the strength of our various clinical interventions as evidence-based practices (EBPs). This article provides a brief history of the development and goals of EBPs in medicine and mental health, and a review of the earnest efforts of researchers within the field to establish treatment approaches with sexual abusers as evidence-based. An appraisal of the current status of EBP's with sexual abusers is provided. Although there have been improvements in the methodological quality of treatment outcome research with sexual abusers, divergent opinions about treatment effectiveness remain, and the field has not yet agreed on a system or set of criteria for what constitutes "evidence." We contend that clinical practice has been influenced as much, or more, by new paradigms that are intuitively meaningful and perceived as needed than it has by what has been determined to be scientifically efficacious. This trend and other processes in our field that seem to be slowing the development of EBPs with sexual abusers are discussed. Recommendations for conducting evidence-based reviews and moving the field of sexual abuser treatment toward the use of a true EBP model are provided.

The consecutive controlled case series: Design, data-analytics, and reporting methods supporting the study of generality

Single-case experimental designs (SCEDs) have proven invaluable in research and practice because they are optimal for asking many experimental questions relevant to the analysis of behavior. The consecutive controlled case series (CCCS) is a type of study in which a SCED is employed in a series of consecutively encountered cases that undergo a common procedure or share a common characteristic. Additional design elements, data-analytic, and reporting methods enable researchers to ask experimental questions relevant to the study of generality of procedures and processes. The current paper discusses the CCCS methodologies, including the retrospective, prospective, and randomized CCCS. These methodologies can be applied to examine the generality of clinical procedures (including their general efficacy, the limits of their generality, and variables that may mediate generality); study the epidemiology and phenomenology of clinical problems; and compare the efficacy of 2 clinical procedures within a randomized controlled trial combining SCEDs with randomized group designs.

DELINEAMENTOS INTRASSUJEITOS NA AVALIAÇÃO DE PRÁTICAS PSICOEDUCACIONAIS BASEADAS EM EVIDÊNCIA

Em diversos países, a educação baseada em evidências (EBE) ocupa um papel central na tomada de decisões acerca dos processos e procedimentos educacionais. No Brasil, a EBE ainda não é muito difundida na educação, mas dado o aumento gradual de publicações e organizações relacionadas a esta temática e dada a sua importância no cenário educacional internacional, é esperado que esta prática passe a ser mais discutida no país, especialmente pelos profissionais que trabalham na interseção entre a psicologia e a educação. Tendo por base o processo de tomada de decisão da EBE, mais especificamente, a necessidade de avaliação sistemática das intervenções educacionais e, tendo como corpo teórico-conceitual a análise do comportamento, os objetivos deste artigo são (a) apresentar como as formas de avaliação diagnóstica e formativa propostas pela análise do comportamento se relacionam a formas tradicionais de implementar avaliações de práticas psicoeducacionais e (b) demonstrar a importância dos delineamentos intrassujeitos como forma de avaliação e monitoramento de intervenções psicoeducacionais na busca por decisões que levem à EBE a partir da literatura da área. As análises realizadas neste manuscrito permitem a conclusão de que delineamentos intrassujeitos podem ser utilizados como avaliações na prática educacional como produtores de evidência.

Working on Womanhood (WOW): A participatory formative evaluation of a community-developed intervention

The well-documented disparities in availability, accessibility, and quality of behavioral health services suggest the need for innovative programs to address the needs of ethnic minority youth. The current study aimed to conduct a participatory, formative evaluation of "Working on Womanhood" (WOW), a community-developed, multifaceted, school-based intervention serving primarily ethnic minority girls living in underserved urban communities. Specifically, the current study aimed to examine the feasibility, acceptability, and initial promise of WOW using community-based participatory research (CBPR) and represented the third phase of a community-academic partnership. Qualitative and quantitative data were collected from 960 WOW participants in 21 urban public schools, as well as WOW counselors, parents, and school staff over the course of one academic year. Results demonstrated evidence of acceptability of WOW and noteworthy improvements for WOW participants in targeted outcomes, including mental health, emotion regulation, and academic engagement. Findings also indicated several challenges to implementation feasibility and acceptability, including screening and enrollment processes and curriculum length. Additionally, we discuss how, consistent with participatory and formative research, findings were used by program implementers to inform program improvements, including modifications to screening processes, timelines, curriculum, and trainings - all in preparation for a rigorous effectiveness evaluation.

Racial/ethnic measurement invariance of the School Success Profile (SSP)'s future orientation scale

Future orientation (FO) has received increasing attention for its positive effects on adolescent well-being and successful transition to adulthood. Although numerous measures of FO exist, most are not developmentally appropriate for diverse populations of adolescents, do not assess all theoretical components of FO, and/or were not developed for administration in schools. Additionally, the invariance of existing measures across racial/ethnic groups has not been examined using appropriately rigorous procedures. Using data from 2575 students in grades 6-9, this study examined the psychometric quality and measurement invariance of the FO scale on the School Success Profile (SSP) across African American (34.8%), Latino (27.0%), and European American (38.1%) subsamples. A one-factor model fit the data well in all three groups. Analyses identified only a small number of noninvariant parameters, supporting the conclusion that the scale has partial measurement invariance across the three groups. On average, African Americans had significantly higher levels of FO than the other two groups; mean scores for Latinos and European Americans were lower and statistically equivalent to each other. Construct validity of the SSP FO scale was also supported by findings of medium-sized relationships of FO scores to scores on five other constructs: low grades, school engagement, parent educational support, psychological distress, and school behavior. Multiple group tests of the magnitude and direction of the validity relationships indicated statistical equivalence across the three groups. Results support the use of the SSP FO scale by school psychologists to assess FO and to evaluate the effects of interventions targeting FO as a promoter of well-being and school success.

Methodological standards in single-case experimental design: Raising the bar

Single-case experimental designs (SCEDs), or small-n experimental research, are frequently implemented to assess approaches to improving outcomes for people with disabilities, particularly those with low-incidence disabilities, such as some developmental disabilities. SCED has become increasingly accepted as a research design. As this literature base is needed to determine what interventions are evidence-based practices, the acceptance of SCED has resulted in increased critiques with regard to methodological quality. Recent trends include recommendations from a number of expert scholars and institutions. The purpose of this article is to summarize the recent history of methodological quality considerations, synthesize the recommendations found in the SCED literature, and provide recommendations to researchers designing SCEDs with regard to essential and aspirational standards for methodological quality. Conclusions include imploring SCED to increase the quality of their experiments, with particular consideration regarding the applied nature of SCED research to be published in Research in Developmental Disabilities and beyond.

Behavioral Interventions for Inappropriate Sexual Behavior in Individuals With Developmental Disabilities and Acquired Brain Injury: A Review

Inappropriate sexual behavior (ISB) is a common, but understudied, issue for individuals diagnosed with developmental disabilities (DD), intellectual disability (ID), and/or acquired brain injuries (ABI). We conducted a systematic review to identify, analyze, and synthesize published behavior-analytic approaches to intervention for ISB in DD, ID, or ABI populations. Twenty-three studies employing single-subject research methodology were identified and evaluated using quality indicators described by Horner et al. (2005) . Results of our analysis suggest insufficient evidence exists to consider any specific response-suppression technique an overarching treatment for decreasing ISB using the Horner et al. criteria. However, broadly speaking, behavior analytic approaches have been highly effective. Practitioners should consider function-based intervention and draw from studies identified as having strong supporting evidence.

Evaluating Tau-U With Oral Reading Fluency Data and the Impact of Measurement Error

Recently, researchers have argued that using quantitative effect sizes in single-case design (SCD) research may facilitate the identification evidence-based practices. Indices to quantify nonoverlap are among the most common methods for quantifying treatment effects in SCD research. Tau-U represents a family of effect size indices that were developed to address criticisms of previously developed measures of nonoverlap. However, more research is necessary to determine the extent to which Tau-U successfully addresses proposed limitations of other nonoverlap methods. This study evaluated Tau-U effect sizes, derived from multiple-baseline designs, where researchers used curriculum-based measures of reading (CBM-R) to measure reading fluency. Specifically, we evaluated the distribution of the summary Tau-U statistic when applied to a large set of CBM-R data and assessed how the variability inherent in CBM-R data may influence the obtained Tau-U values. Findings suggest that the summary Tau-U statistic may be susceptible to ceiling effects. Moreover, the results provide initial evidence that error inherent in CBM-R scores may have a small but meaningful influence on the obtained effect sizes. Implications and recommendations for research and practice are discussed.

A systematic review and evaluation of procedures for the induction of speech among persons with developmental disabilities

OBJECTIVE

Deficits in vocal speech are common among those with developmental disabilities. This review examines interventions for teaching speech to individuals who presented as nonspeaking, or with low levels of vocalizations at baseline, and assesses evidence-based practice in this area.

METHODS

Systematic searches identified 78 studies suitable for inclusion. These studies were evaluated in terms of (a) participants, (b) intervention, (c) intervention setting, (d) intervention agent, (e) treatment efficacy, (f) generalization and maintenance of treatment effects, and (g) research rigor.

RESULTS

A variety of interventions, primarily behavioral, intended to induce vocal speech were delivered to participants with developmental disabilities aged between six months and 57 years. Treatment efficacy was variable (PND M = 52.9%; range 0%-100%); however, results indicated that behavioral interventions constituted evidence-based practice. Non-behavioral strategies were shown to have received insufficient research evaluation to date.

CONCLUSION

Results indicate that a number of procedures can induce speech among individuals with developmental disabilities.

Establishing Theoretical Stability and Treatment Integrity for Motivational Interviewing

BACKGROUND

There is increasing evidence claiming the effectiveness of motivational interviewing (MI) in promoting behavioural change. However, ongoing changes to MI theory and practice have implications for its transferability, accessibility and for the validity of previous findings. Lack of practice consistency may make its effectiveness difficult to evaluate.

AIMS

This paper explores the complexity of MI and issues in the development of evidence-based practice in delivery, before describing issues related to practitioner application.

METHOD

Theoretical and practice developments over the last 30 years are reviewed under the headings theory, practice and efficacy. Specifically, developments across the three editions of the core MI texts are examined.

RESULTS

Findings from the literature suggest a lack of theoretical stability and practice integrity, with recent fundamental changes to the underpinning structure of MI. Issues relating to the transferability and acquisition of MI skills, consistency of delivery and mechanisms underlying change are discussed.

CONCLUSIONS

The authors call for greater theoretical stability, more transparency over how developments are based on theoretical principles and empirical outcomes, and clearer guidance about how this informs practice development and delivery of MI.

Measurement equivalence: A non-technical primer on categorical multi-group confirmatory factor analysis in school psychology

Evidence-based interventions (EBIs) have become a central component of school psychology research and practice, but EBIs are dependent upon the availability and use of evidence-based assessments (EBAs) with diverse student populations. Multi-group confirmatory factor analysis (MG-CFA) is an analytical tool that can be used to examine the validity and measurement equivalence/invariance of scores across diverse groups. The objective of this article is to provide a conceptual and procedural overview of categorical MG-CFA, as well as an illustrated example based on data from the Social and Academic Behavior Risk Screener (SABRS) - a tool designed for use in school-based interventions. This article serves as a non-technical primer on the topic of MG-CFA with ordinal (rating scale) data and does so through the framework of examining equivalence of measures used for EBIs within multi-tiered models - an understudied topic. To go along with the illustrated example, we have provided supplementary files that include sample data, Mplus input code, and an annotated guide for understanding the input code (http://dx.doi.org/10.1016/j.jsp.2016.11.002). Data needed to reproduce analyses in this article are available as supplemental materials (online only) in the Appendix of this article.

The Emergence and Possible Futures of Response To Intervention

Response to intervention (RTI) has emerged as a promising, but possibly vulnerable, alter native to the current model of identification and eligibility assessment in special education. Nested within a simple and compelling struc ture for RTI are many questions and chal lenges that make its future as "policy" at-risk unless these issues can be satisfactorily resolved. As it stands, RTI is likely to improve many decisions about educational interven tions, especially when combined with universal screening procedures. In a full RTI implemen tation, potential benefits may include (a) increased achievement schoolwide, because struggling children are identified proactively and immediate help is provided to determine whether or not more intensive help is needed, as well as (b) a coherent and flexible system of services. Whereas many of the components of RTI are well established, RTI needs further operationalization, development, standardiza tion, and field-testing. All first- and second- grade children ( N = 182 children; 364 poten tial reading or math cases) at an elementary school were screened using four measures (curriculum-based measurement, Brigance subtests, state reading test, and teacher identi fication). Decision rules were applied to the screening data to select those children who were at-risk academically. Each of these chil dren ( n = 101 reading and math cases) partici pated in an individual curriculum-based assess ment (CBA) in reading or math. Of these cases, 32 met criteria to participate in individ ual intervention (16 math and 16 reading interventions). Standard protocol intervention was implemented for 5 to 9 intervention ses sions or until children met intervention suc cess criteria. All second-grade children were administered the Iowa Test of Basic Skills. Data were generated to examine various criteria for judging intervention responsiveness and to raise empirical questions about the reliability and accuracy with which decisions could be made under an RTI model.

Listening to Participants

Studying the social validity of consultation research could lead to research results being more widely used among practitioners, improving the validity of consultation research, and furthering social justice. The following qualitative study investigates school psychologists' and teachers' perceptions of school-based consultation in four elementary schools. The findings are organized into two interrelated themes: the impact of the research on the participants and the impact of the participants and their surrounds on the data collection. Soliciting participants' reactions to studies could advance our knowledge considerably, thereby leading to more sophisticated future studies that could make research results more useful to practitioners and, ultimately, improve outcomes for students.

Programming generality into a performance feedback writing intervention: A randomized controlled trial

Substantial numbers of students in the United States are performing below grade-level expectations in core academic areas, and these deficits are most pronounced in the area of writing. Although performance feedback procedures have been shown to produce promising short-term improvements in elementary-aged students' writing skills, evidence of maintenance and generalization of these intervention effects is limited. The purpose of this study was to examine the immediate, generalized, and sustained effects of incorporating multiple exemplar training into the performance feedback procedures of a writing intervention using a randomized controlled trial (RCT). Results indicated that although the addition of multiple exemplar training did not improve students' writing performance on measures of stimulus and response generalization, it did result in greater maintenance of intervention effects in comparison to students who received performance feedback without generality programming and students who engaged in weekly writing practice alone.

Educational interventions for children with ASD: A systematic literature review 2008–2013

Systematic literature reviews can play a key role in underpinning evidence-based practice. To date, large-scale reviews of interventions for individuals with Autism Spectrum Disorder (ASD) have focused primarily on research quality. To assist practitioners, the current review adopted a broader framework which allowed for greater consideration of educational utility. Between July and August 2013, 20 databases were searched, alongside web searches and hand searches, to identify ASD intervention studies published between 2008 and 2013. This search yielded 6,232 articles and the subsequent screening and evaluation process identified 85 best evidence studies. Studies were grouped into categories and individual interventions were assessed and classified as providing most; moderate; some; or a small amount of evidence. Interventions with most evidence tended to focus on younger children and core difficulties associated with ASD. Emerging trends, such as increasing evidence for technology-based interventions and peer-mediated interventions, were identified. An encouraging finding for practitioners is that in 59% of the studies, interventions were undertaken with or by school staff. Implications for school psychology practice as well as factors to consider when selecting educational interventions are discussed.

Evaluating the impact of feedback on elementary aged students' fluency growth in written expression: a randomized controlled trial

The purpose of this randomized controlled trial was to evaluate elementary-aged students' writing fluency growth in response to (a) instructional practices, (b) sex differences, and (c) student's initial level of writing fluency. Third-grade students (n=133) in three urban elementary schools were randomly assigned to either an individualized performance feedback condition (n=46), a practice-only condition (i.e., weekly writing practice; n=39), or an instructional control condition (n=48) for 8weeks. Findings included support for use of performance feedback as an instructional component in general education classrooms (Hedges' g=0.66), whereas simple practice with curriculum-based measurement in written expression did not produce growth significantly greater than standard instructional practices. The hypothesis that girls write significantly more than boys was supported. However, girls and boys did not differ in their rate of growth. Finally, students' initial risk status in writing fluency did not differentially predict growth in writing fluency over the course of the study. Implications for incorporating feedback as a basic component of intervention in writing are discussed.

Interaction of participant characteristics and type of AAC with individuals with ASD: a meta-analysis

Individuals with autism spectrum disorders (ASD) and complex communication needs often rely on augmentative and alternative communication (AAC) as a means of functional communication. This meta-analysis investigated how individual characteristics moderate effectiveness of three types of aided AAC: the Picture Exchange Communication System (PECS), speech-generating devices (SGDs), and other picture-based AAC. Effectiveness was measured via the Improvement Rate Difference. Results indicated that AAC has small to moderate effects on speech outcomes, and that SGDs appear to be most effective when considering any outcome measure with individuals with ASD without comorbid intellectual/developmental disorders (IDD). PECS appears to be most effective when considering any outcome measure with individuals with ASD and IDD. SGDs and PECS were the most effective type of AAC for preschoolers, when aggregating across outcome measures. No difference was found between systems for elementary-aged and older individuals.

Moderation of effects of AAC based on setting and types of aided AAC on outcome variables: an aggregate study of single-case research with individuals with ASD

OBJECTIVE

The purpose of this meta-analysis was to evaluate the potential moderating effects of intervention setting and type of aided augmentative and alternative communication (AAC) on outcome variables for students with autism spectrum disorders.

METHODS

Improvement rate difference, an effect size measure, was used to calculate aggregate effects across 35 single-case research studies.

RESULTS

Results indicated that the largest effects for aided AAC were observed in general education settings. With respect to communication outcomes, both speech generating devices (SGDs) and the Picture Exchange Communication System (PECS) were associated with larger effects than other picture-based systems. With respect to challenging behaviour outcomes, SGDs produced larger effects than PECS.

CONCLUSION

This aggregate study highlights the importance of considering intervention setting, choice of AAC system and target outcomes when designing and planning an aided AAC intervention.

Statistical Analyses of Single-Case Designs

Single-case-design researchers rarely used statistics in the past, but that is changing. In this article, I review the rapidly developing state of statistical analyses for single-case designs, including effect sizes, multilevel models, and Bayesian analyses. No analysis meets all the desiderata for an optimal single-case-design analysis, but this may be remedied in the near future. Single-case-design researchers will have incentives to use these analyses as they become more user-friendly and beneficial.

What is evidence-based behavior analysis?

Although applied behavior analysts often say they engage in evidence-based practice, they express differing views on what constitutes "evidence" and "practice." This article describes a practice as a service offered by a provider to help solve a problem presented by a consumer. Solving most problems (e.g., increasing or decreasing a behavior and maintaining this change) requires multiple intervention procedures (i.e., a package). Single-subject studies are invaluable in investigating individual procedures, but researchers still need to integrate the procedures into a package. The package must be standardized enough for independent providers to replicate yet flexible enough to allow individualization; intervention manuals are the primary technology for achieving this balance. To test whether the package is effective in solving consumers' problems, researchers must evaluate outcomes of the package as a whole, usually in group studies such as randomized controlled trials. From this perspective, establishing an evidence-based practice involves more than analyzing the effects of discrete intervention procedures on behavior; it requires synthesizing information so as to offer thorough solutions to problems. Recognizing the need for synthesis offers behavior analysts many promising opportunities to build on their existing research to increase the quality and quantity of evidence-based practices.