The limits of evidence and the implications of context: considerations when implementing pathways to intervention for children with language disorders

Core outcomes for speech-language services in Ontario schools: a group concept mapping study and guiding framework

BACKGROUND

Establishing the most important outcomes for school-based speech-language therapy is essential to guide future research and program evaluation for these services. Many health disciplines have developed core outcomes sets (COS) for this purpose. A COS encompasses the most important outcomes for particular health services as identified by appropriate interested parties. These interested parties usually represent health care providers and those with the health condition. In this paper, we report the development of a guiding framework for a COS for speech-language therapy services in schools in a Canadian context.

METHODS

Using a group concept mapping method, we identified the outcomes for inclusion in the COS guiding framework through the elicited opinions of key interested parties: speech-language therapists, teachers, and family members of children with speech, language, and communication needs. We extracted 103 statements (potential outcomes) from a previous data set of interview transcripts. We then asked participants to sort the statements into conceptually similar groups, which were aggregated and transformed into a cluster map using multidimensional scaling followed by hierarchical cluster analysis. Participants also rated each statement on 5-point scales for importance and feasibility. We calculated mean ratings for individual statements and for all statements in a cluster, for all participants and for participant groups separately.

RESULTS

We identified seven core outcomes for school-based speech-language services in Ontario, Canada. These included: classroom-based services, a holistic approach, support for teachers, care coordination, accessible services, family supports, and student success. All outcomes were rated highly for importance. Feasibility ratings were consistently below importance ratings. All participant groups concurred that a holistic approach was the most important outcome and accessible services was the least feasible outcome to achieve.

CONCLUSIONS

The seven outcomes identified in this study are recommended to guide the development of a full COS to direct future research and program evaluation for school-based speech-language services. These outcomes have not been widely included in previous research and should be incorporated into future research alongside specific intervention outcomes. Data for some outcomes may be available from non-traditional sources such as administrative data sets. Consequently, their use for program evaluations should be accompanied by appropriate institutional support to allow speech-language therapists to make meaningful use of appropriate outcomes data.

Exploring the valued outcomes of school-based speech-language therapy services: a sequential iterative design

Background

Achieving outcomes that community members value is essential to high-quality, family-centred care. These valued outcomes should inform the production and interpretation of research evidence. To date, outcomes included in studies of service delivery models for speech-language services in schools have been narrowly defined, and do not match the outcomes suggested as important by families, teachers, and children. The most important outcomes of school-based, speech-languages services have not been directly and systematically investigated. We aimed to address this gap by asking school community members what outcomes were most relevant to evaluating and improving the delivery of speech-language services in schools.

Methods

A sequential, iterative mixed-method study was conducted using interviews with 14 family members, educators, and speech-language therapists that asked what outcomes or impacts of school-based services they considered most important or valuable. Summative content analysis was used to analyse the data. Structural topic modelling between rounds of qualitative analysis was used to describe both the quality and the quantity of the interview content. School community members' perspectives were compared through estimation of topic proportions within interviews from each member group and through qualitative comparison.

Results

Structural topic modelling diagnostics and qualitative interpretation of topic output suggested a six-topic solution. This solution was estimated successfully and yielded the following topics: (1) meeting all needs appropriately, (2) teamwork and collaboration, (3) building capacities, (4) supporting individual student needs in context, (5) coordinating care, and finally (6) supporting core educational goals. Families focused on school-based services meeting all needs appropriately and coordinating care, while educators highlighted supporting individual student needs in context. By contrast, speech-language therapists emphasized building capacities and supporting core educational goals. All school community members agreed that current assessment tools and outcome measures were inadequate to capture the most important impacts of school-based services.

Conclusions

Outcomes identified by school community members as important or valuable were broad, and included individual student outcomes, interpersonal outcomes, and systems-level outcomes. Although these outcomes were discussed by all member groups, each group focused on different outcomes in the interviews, suggesting differences in the prioritization of outcomes. We recommend building consensus regarding the most important outcomes for school-based speech-language services, as well as the prioritization of outcomes for measure development.

A classroom intervention targeting working memory, attention and language skills: a cluster randomised feasibility trial

Background

International debate around the best models of speech and language therapy provision for children with language disorders has highlighted the need for research into classroom-based approaches and intervention dosage. Working memory (WM) is a cognitive skill linked to attention and language. ‘Recall to Enhance Children’s Attention, Language and Learning’ (RECALL) is a novel, 6-week, classroom-based intervention delivered by health professionals (HPs) and teachers. It is designed to target WM and enhance attention and language skills in 4–5 year olds.

Methods

A cluster randomised feasibility trial was conducted to investigate aspects of the feasibility of a definitive trial to evaluate RECALL: (i) recruitment and sampling procedures; (ii) compliance and fidelity; (iii) the acceptability of RECALL to HPs and teachers; (iv) the appropriateness of the outcome measures. Six classes of 4–5 year olds participated: two received RECALL, two received an existing intervention targeting attention skills (not underpinned by WM theory), and two received education as usual (no intervention). Ten children in each class (n = 60) were sampled to assess the appropriateness of the outcome measures. Classroom observations were conducted to measure fidelity and semi-structured interviews with HPs, and teachers explored the acceptability of RECALL.

Results

The recruitment targets were met, and all six schools completed the trial, but the sampling procedures require modification. Compliance was good (95% of RECALL sessions were delivered), but fidelity to the intervention protocol varied between 76% and 45% across the two schools. This was influenced by large class sizes, child factors, and facilitator factors, e.g., their understanding of the theory underpinning the intervention. The lack of fidelity reduced the dose (number of practice items) accessed by individual children, particularly those most at risk. There were mixed findings regarding the acceptability of RECALL and the appropriateness of the outcome measures.

Conclusions

The trial protocol could be easily scaled-up in a future definitive trial, with an amended sampling procedure. RECALL should be repackaged as a small group intervention to enhance the fidelity of its delivery and its acceptability to HPs and teachers. This study highlights the need for thorough training for professionals who deliver classroom-based interventions for children with language disorders.

Trial registration

ISRCTN13633886. Registered on 7 September 2018

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-021-00771-w.