It's Messy but Real: A Pilot Study of the Implementation a Social Engagement Intervention for Children with Autism in Schools

Short report: Examining race, ethnicity, sex, and gender among autistic youth and their educators who participated in school-based research

LAY ABSTRACT

Schools are the main provider of behavioral health services in the United States (US). Conducting research in schools may help increase access for autistic youth, but there is limited research about who participates in school-based autism research. The researchers examined data spanning 14 years of participation in school-based autism research. All data were collected in the US. Researchers found that in this sample, more than half of the youth identified as racial/ethnic minoritized (REM) youth. However, demographics of sampled youth were significantly different than expected, based on publicly available school-based population demographics. More youth identified as White non-Hispanic than would be expected in those schools. Majority of the sampled educators also identified as White non-Hispanic. High percentages of autistic REM youth suggest school-based autism research may be an effective way of providing services to more diverse populations. However, sampled schools were also not representative of a US national sample, with sampled schools having fewer White non-Hispanic youth than would be expected from US national statistics. Complexity around representation of schools sampled and demographics of service environments suggests a need for more research.

In an Imperfect World: Barriers and Facilitators to Educators' Evidence-Based Practice Use for Elementary-Aged Autistic Students in Inclusive Settings

Educators' use of evidence-based practices (EBP) provides positive outcomes for autistic students in multiple areas of learning (e.g., peer interactions and academic skills) and may promote access and participation in general educational settings. However, many teachers report limited use of EBPs for their autistic students, with inconsistent fidelity. This study sought to understand barriers and facilitators educators identify to implementing EBPs with autistic students in general education classrooms. To understand educators' perspectives and experiences, we conducted a qualitative study with 81 educators who serve elementary-aged autistic students in one state. In response to interview questions based on the Consolidated Framework for Implementation Research framework, educators reported on multiple factors, including the general education environment, access to resources, training in EBPs, and professional collaboration. Implications for practice, training, and research are discussed. Specifically, we address educators' need for increased training and the availability of educator resources.

Developing a typology of network alteration strategies for implementation: a scoping review and iterative synthesis

BACKGROUND

Social networks transmit knowledge, influence, and resources. These relationships among patients, professionals, and organizations can shape how innovations are disseminated, adopted, implemented, and sustained. Network alteration interventions-interventions that change or rewire social networks-have the potential to be used as implementation strategies. Yet, the types, mechanisms, and effectiveness of these interventions for implementation are unclear. This scoping review and iterative synthesis identified and described network alteration strategies that could be tested for implementation.

METHODS

We used forward and backward citation tracking of influential articles on network interventions, bibliometric searches, and hand searches of peer-reviewed social network journals. At least two team members screened article titles/abstracts to identify studies that met inclusion criteria: empirical studies of an intervention, the intervention was designed to alter some element of a social network, and changes in social network metrics were measured at two or more time points. During full-text reviews, information about the network interventions, actors, ties, and main findings was extracted. Reporting was informed by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA). To develop our typology, we synthesized these results using an iterative team-based and consensus-building process.

RESULTS

Fifty-three articles met the inclusion criteria. The interventions described were conducted in healthcare systems or behavioral health systems (34%), communities (26.4%), and schools (22.6%). The majority included records describing interventions designed to alter social support, information-sharing, or friendship networks (65%) among individual actors (84.9%), or to increase ties. Eight strategies emerged. Three strategies targeted the general context: (1) change the environment, (2) create groups, and (3) change the composition. Four strategies targeted individual actors: change (4) motivations, (5) skills for networking, (6) knowledge of one's social network, and (7) prominence/roles. One strategy (8) targeted specific ties within the network (targeting a particular pair-wise relationship or changing the nature of an existing tie).

CONCLUSION

The network alteration strategies in this typology provide further operational specificity for how implementation strategies target relationships. Advancing these strategies will require greater theoretical specification, the development of strategies that target professionals and organizations, and studies that examine the impact on implementation outcomes.

Targeting the school environment to enable participation: A scoping review

BACKGROUND

Children with special educational needs experience limited levels of participation at school; their participation is influenced by the physical and social environment. Interventions that have been applied in school environments are described in the literature.

AIMS

To illustrate the main features of interventions targeting school environments to support participation of children with special educational needs in mainstream education.

MATERIALS AND METHODS

A scoping review using a qualitative, thematic analysis was conducted in May 2021.

RESULTS

We included a total of 20 articles. We found that intervention features contributed to children's participation and targeted social and physical school environments. The majority of the intervention features focussed on applying supportive teaching methods to enable individual children's participation. A small number of interventions described a systemic holistic approach that involved changes to the school environment. In these interventions, different professionals such as occupational therapists collaborated with teachers to adapt the school environment.

CONCLUSIONS AND SIGNIFICANCE

A shift from individual child-focussed to environment-focussed approaches that target all children's participation could impact classroom setup and teachers' roles. Occupational therapists' expertise in matching school environments and task requirements with individual children's needs could be valuable in their collaboration with schools to support this transition.

Concordance of multiple informant assessment of school-based social skills intervention and association with child outcomes: Results from a randomized trial

Background

Fidelity, or the degree to which an intervention is implemented as designed, is essential for effective implementation. There has been a growing emphasis on assessing fidelity of evidence-based practices for autistic children in schools. Fidelity measurement should be multidimensional and focus on core intervention components and assess their link with program outcomes. This study evaluated the relation between intervention fidelity ratings from multiple sources, tested the relation between fidelity ratings and child outcomes, and determined the relations between core intervention components and child outcomes in a study of an evidence-based psychosocial intervention designed to promote inclusion of autistic children at school, Remaking Recess.

Method

This study extends from a larger randomized controlled trial examining the effect of implementation support on Remaking Recess fidelity and child outcomes. Schools were randomized to receive the intervention or the intervention plus implementation support. Observers, intervention coaches, and school personnel completed fidelity measures to rate completion and quality of intervention delivery. A measure of peer engagement served as the child outcome. Pearson correlation coefficients were calculated to determine concordance between raters. Two sets of hierarchical linear models were conducted using fidelity indices as predictors of peer engagement.

Results

Coach- and self-rated completion and quality scores, observer- and self-rated quality scores, and observer- and coach-rated quality fidelity scores were significantly correlated. Higher observer-rated completion and quality fidelity scores were predictors of higher peer engagement scores. No single intervention component emerged as a significant predictor of peer engagement.

Conclusions

This study demonstrates the importance of using a multidimensional approach for measuring fidelity, testing the link between fidelity and child outcomes, and examining how core intervention components may be associated with child outcomes. Future research should clarify how to improve multi-informant reports to provide "good enough" ratings of fidelity that provide meaningful information about outcomes in community settings.

Plain Language Summary

Fidelity is defined as how closely an intervention is administered in the way the creators intended. Fidelity is important because it allows researchers to determine what exactly is leading to changes. In recent years, there has been an interest in examining fidelity of interventions for autistic children who receive services in school. This study looked at the relationship between fidelity ratings from multiple individuals, the relationship between fidelity and child outcomes, and the relationship between individual intervention component and child changes in a study of Remaking Recess, an intervention for autistic children at school. Schools were randomly selected to receive the intervention only or the intervention plus implementation support from the research team. Observers, intervention coaches, and individuals delivering the intervention themselves completed fidelity measures. Child engagement with peers was measured before and after the intervention. Several measures of self-, coach-, and observer-report fidelity were associated with each other. Higher observer-reported fidelity was associated with higher child peer engagement scores. No single intervention step was linked to child peer engagement and both treatment groups had similar outcomes in terms of fidelity. This study shows the importance of having multiple raters assess different parts of intervention fidelity, looking at the link between fidelity and child outcomes, and seeing how individual intervention steps may be related to outcomes. Future research should aim to find out which types of fidelity ratings are "good enough" to lead to positive changes following treatment so that those aspects can be used and targeted in the future.

Using Novel Implementation Tools for Evidence-based Intervention Delivery (UNITED) across public service systems for three evidence-based autism interventions in under-resourced communities: study protocol

BACKGROUND

There are a growing number of evidence-based interventions (EBIs) for autistic individuals, but few are successfully implemented with fidelity in under-resourced communities and with families from traditionally disenfranchised groups. Implementation science offers tools to increase EBI use in communities, but most implementation strategies are designed specific to a single EBI. It is not feasible to develop a new implementation strategy each time a new EBI is introduced in the community. Therefore, to test the effectiveness and generalizability of implementation strategies we are developing and testing a multifaceted implementation strategy with three EBIs concurrently. The goal of this protocol paper is to describe the randomized field trial of an implementation strategy for use across autism EBIs, diverse settings and participants, with the goal of increasing rapid uptake of effective practices to reach our most vulnerable children.

METHODS

We developed a multifaceted implementation strategy called Using Novel Implementation Tools for Evidence-based intervention Delivery (UNITED) to facilitate the implementation and sustainment of three EBIs in under-resourced settings. We will compare fidelity to, and effectiveness of, each intervention [Mind the Gap (MTG), Remaking Recess (RR), Self-Determined Learning Model of Instruction (SDLMI)] with and without UNITED in a randomized field trial. Randomization will be stratified using a minimization allocation method. We will train community practitioners using remote delivery of modules specific to the intervention, and active coaching via Zoom for at least 6 sessions and up to 12 as dictated by each EBI. Our primary outcome is fidelity to each EBI, and our secondary outcome is at the child or family level (family empowerment for MTG, child peer social engagement for RR, and adolescent self-determination for SDLMI, respectively). We will measure progress through the implementation phases using the Stages of Implementation Completion and cost-effectiveness of UNITED.

DISCUSSION

The results of this study will provide rigorous data on the effectiveness and generalizability of one relatively light-touch implementation strategy in increasing use of autism EBIs and associated outcomes in diverse under resourced public service settings for underrepresented autistic youth.

TRIAL REGISTRATION

Mind the Gap: Clinicaltrials.gov Identifier:  NCT04972825 (Date registered July 22, 2021); Remaking Recess: Clinicaltrials.gov Identifier:  NCT04972838 (Date registered July 22, 2021); Self-Determined Learning Model of Instruction: Clinicaltrials.gov Identifier:  NCT04972851 (Date registered July 22, 2021).

Exploring the Influence of Object Similarity and Desirability on Children's Ownership Identification and Preferences in Autism and Typical Development

This study investigated how ownership identification accuracy and object preferences in children with autism spectrum disorder (ASD) are influenced by visual distinctiveness and relative desirability. Unlike typically developing (TD) children matched on receptive language (M age equivalents: 58.8-59.9 months), children with ASD had difficulty identifying another person's property when object discriminability was low and identifying their own relatively undesirable objects. Children with ASD identified novel objects designated to them with no greater accuracy than objects designated to others, and associating objects with the self did not bias their preferences. We propose that, due to differences in development of the psychological self, ownership does not increase the attentional or preferential salience of objects for children with ASD.

A Systematic Review of Play-Based Interventions Targeting the Social Communication Skills of Children with Autism Spectrum Disorder in Educational Contexts

Children with autism spectrum disorder (ASD) experience social communication difficulties which can be compounded by increased social demands and expectations of the school environment. Play offers a unique context for social communication development in educational settings. This systematic review aimed to synthesize play-based interventions for the social communication skills of children with ASD in educational contexts and identified nine studies. Overall, studies in this review provided a promising evidence base for supporting social communication skills through play in education for children with ASD. The review also highlighted gaps in research on play-based interventions for the social communication skills of children with ASD within naturalistic educational settings.

Individual- and group-level network-building interventions to address social isolation and loneliness: A scoping review with implications for COVID19

PURPOSE

Worldwide mandates for social distancing and home-quarantine have contributed to loneliness and social isolation. We conducted a systematic scoping review to identify network-building interventions that address loneliness and isolation, describe their components and impact on network structure, and consider their application in the wake of COVID19.

METHODS

We performed forward and backward citation tracking of three seminal publications on network interventions and Bibliographic search of Web of Science and SCOPUS. We developed data charting tables and extracted and synthesized the characteristics of included studies, using an iteratively updating form.

FINDINGS

From 3390 retrieved titles and abstracts, we included 8 studies. These interventions focused on building networks at either individual- or group-levels. Key elements that were incorporated in the interventions at varying degrees included (a) creating opportunities to build networks; (b) improving social skills; (c) assessing network diagnostics (i.e. using network data or information to inform network strategies); (d) promoting engagement with influential actors; and (e) a process for goal-setting and feedback. The effect of interventions on network structures, or the moderating effect of structure on the intervention effectiveness was rarely assessed.

CONCLUSIONS

As many natural face-to-face opportunities for social connection are limited due to COVID19, groups already at risk for social isolation and loneliness are disproportionately impacted. Network-building interventions include multiple components that address both the structure of individuals' networks, and their skills and motivation for activating them. These intervention elements could be adapted for delivery via online platforms, and implemented by trained facilitators or novice volunteers, although more rigorous testing is needed.

Play-based interventions to support social and communication development in autistic children aged 2-8 years: A scoping review

BACKGROUND AND AIMS

Play is used by practitioners from across disciplinary backgrounds as a natural and enjoyable context for providing intervention and support in early childhood. In the case of autism interventions, many therapies are based on the association between social play and the development of social skills, language development, and communication skills, as these are often particular areas of challenge for autistic children. However, play is a wide-ranging concept and the extant literature on play-based interventions is large and heterogeneous. This means it is challenging for practitioners and families to navigate the evidence base and make choices about differing intervention strategies. This review aims to provide a comprehensive map of the research on this topic and to develop a conceptual framework to inform clinical decision-making.

METHODS

An initial stakeholder consultation confirmed the relevance of the topic to practitioners and autistic people. A scoping review methodology (preregistered) was used to identify relevant literature. We systematically searched seven databases to find peer-reviewed primary intervention studies of play-based approaches targeting language, social and communication outcomes for autistic children aged 2-8 years. We then summarised the literature using narrative synthesis and Evidence Gap Maps (EGMs). The literature was summarised according to a range of characteristics, including study design, population characteristics, agent of intervention and outcomes measured, among others. These summaries were then used to develop a framework for some key considerations for practitioners appraising play-based approaches.

RESULTS

388 studies met inclusion criteria. Approximately 21% of studies were RCTs, and over 50% had ≤10 participants. Over 45% of studies reported multiple relevant outcomes, with social play skills being the most common single intervention target. Girls and minority background groups are under-represented. A range of intervention types were identified, and some high-level categorisations are proposed.Main contribution: On the basis of the evidence synthesis we suggest important dimensions for appraisal of play-based interventions, including the role of play within an intervention (as a context, a key developmental mechanism, or a component of a larger approach), the underpinning philosophy (e.g. behaviourist or developmental), and the role of the practitioner (providing parent feedback, 1:1 intervention, group facilitation).

CONCLUSIONS

The wide range of approaches uncovered by this review is a testament to the wonderful diversity inherent to both play and autism. However, research could usefully focus on consolidating the evidence base for existing approaches, rather than aiming for further diversification. Implications: The conceptual framework proposed in this review can help practitioners appraise the literature and aid their advice to families when making shared intervention decisions.

Does the learning environment 'make the grade'? A systematic review of accommodations for children on the autism spectrum in mainstream school

BACKGROUND

The 2030 Agenda for Sustainable Development adapted by the United Nations envisions inclusive and equitable quality education. While there is a growing body of research on interventions designed to help children on the autism spectrum adapt to the school environment, accommodations to children needs have been given less attention.

OBJECTIVE

To synthesize the literature on accommodations in the learning environment for children on the autism spectrum (ages 5-19 years) in mainstream school, with a specific focus on the effects on functioning, educational outcomes and well-being.

METHODS

A systematic search was conducted. The study selection and data extraction were performed by two independent reviewers. Eligible studies were assessed according to the What Works Clearinghouse (WWC) standards.

RESULTS

The search yielded 6102 citations. Only 37 eligible studies were identified, of which 14 met the WWC standards. This inconclusive and heterogeneous body of research tentatively suggest that accommodations in the pedagogical and psychosocial leaning environment can improve performance and function in school.

CONCLUSION AND SIGNIFICANCE

Accommodations in the learning environment is a promising but understudied approach. Creative research and innovation will be needed to support policy makers and school personnel in their quest to ensure inclusive and equitable education.

Individual and organizational characteristics predicting intervention use for children with autism in schools

LAY ABSTRACT

Several interventions or treatment programs have been shown through research to improve social outcomes for children with autism, but they often are not used in schools. This study examined individual (school personnel) and organizational (school level) factors associated with the use of a research-informed social engagement intervention, Remaking Recess, for children with autism in elementary schools. A total of 28 school personnel from 12 schools in 5 districts in the northeastern United States participated. Schools were randomly assigned to (1) training in Remaking Recess only or (2) training in Remaking Recess with implementation support (tailored strategies to remove barriers to increase use of Remaking Recess). School personnel rated their attitudes about research-informed interventions, organizational readiness (school's readiness to use a research-informed intervention), and fidelity or the degree to which an intervention is used as it was originally designed. Observers rated school personnel's fidelity at baseline (pre-intervention training) and exit (post-intervention training). The results suggest that self-rated fidelity was lower when staff perceived the use of Remaking Recess was required; however, observer-rated fidelity was lower when staff rated Remaking Recess as appealing. In addition, self-rated fidelity was higher when there was a sufficient number of staff, positive individual growth, and organizational adaptability. The results also indicated higher observer-rated fidelity when staff perceived positive influence over their coworkers. The results suggest that both individual (attitudes) and organizational (influence, staffing, growth, adaptability) characteristics may affect implementation success in schools. A collaborative decision-making approach for evidence-based practice use is recommended.