Reliability of Scoring Telehealth Speech Sound Assessments Administered in Real-World Scenarios

Reliability and Feasibility of Administering a Child Language Assessment via Telehealth

PURPOSE

Despite the speed with which telehealth use advanced during the COVID-19 pandemic, evidence is needed to support the remote delivery of standardized assessments. This study investigated the reliability and feasibility of administering a standardized language assessment administered in real-world telehealth scenarios compared to in-person administration.

METHOD

A total of 100 children between the ages of 3 and 12 years were administered one of three versions of the Clinical Evaluation of Language Fundamentals (CELF). Children were administered the CELF by the same licensed speech-language pathologists (SLPs) in person and using telehealth, with the order counterbalanced. Means for Core Language standard scores were compared between conditions and among devices. Descriptive statistics summarized the behavior and technology disruptions during administration as well as the results of parent and SLP telehealth perception surveys.

RESULTS

In-person and telehealth mean scores on all three versions of the CELF revealed no systematic differences of one condition under- or overestimating another. The incidence of child behavior disruptions was similar for both test administration conditions. Adaptations compensated for the rare technology disruptions. Despite no significant language score and behavior differences between testing conditions, parents reported they continued to prefer in-person assessments. SLP participants viewed telehealth overall positively but identified conditions in which they continued to prefer in-person delivery.

CONCLUSIONS

This study provides evidence of minimal or no differences in scores and behavioral or technological disruptions between remote and in-person administration of the CELF core language assessments. SLP and parent participants' attitudes toward remote delivery of standardized tests appear to be evolving in a positive direction compared to previous studies.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.25292752.

Traditional and Visual-Acoustic Biofeedback Treatment via Telepractice for Residual Speech Sound Disorders Affecting /ɹ/: Pilot study

Purpose

This study aimed to examine the feasibility of telepractice delivery of a treatment package including visual-acoustic biofeedback and motor-based treatment for residual speech sound disorder affecting /ɹ/ in school-age children. The overall study used a single-case randomization design; however, this preliminary report will simply quantify changes in accuracy before and after completion of the treatment package. The present analysis did not differentiate between the relative contributions of biofeedback and motor-based treatments.

Method

Seven children aged 9-14 received speech therapy for /ɹ/ distortions via telepractice. The study design consisted of three phases: baseline (four sessions), treatment (20 sessions), and post-treatment (three sessions). Treatment included two sessions weekly for a duration of 10 weeks. The participants received one motor-based/non-biofeedback session and one visual-acoustic biofeedback session per week. The order of treatment within each week was randomly determined prior to the start of therapy. Overall progress was assessed using untrained listeners' ratings of word probes administered in the baseline and posttreatment phases.

Results

Findings revealed that six of the seven participants showed a clinically significant response to the overall treatment package, although the magnitude of individual responses varied across speech contexts (consonantal and vocalic) and participants.

Conclusion

The present results suggest that a treatment combining visual-acoustic biofeedback and motor-based treatment for residual /ɹ/ errors treatment can be effectively delivered via telepractice. Considerations for technology setup and treatment protocols are provided.

Recast Therapy for Treating Syntax in Bilingual Children With Developmental Language Disorder: A Feasibility and Early Efficacy Study Examining the Role of Language of Intervention on Outcomes

PURPOSE

The purpose of this study is to examine the feasibility of the delivery of complex syntax recast therapy via telepractice to Spanish-English bilingual children and provide preliminary evidence of the efficacy of this approach.

METHOD

Fifteen bilingual children with developmental language disorders were stratified based on language proficiency and randomized to one of three treatment conditions: Spanish only (n = 5), English only (n = 6), or Spanish + English (n = 4). Using a within-subject design, we hypothesized that we could document treatment efficacy based on change in the treated structure in the absence of change in an untreated comparison structure. All 15 children completed ~16 hr of treatment via telepractice and participated in pre- and posttesting of their production of conditional adverbs (treated structure) and subject relative clauses (untreated structure) carried out by a masked assessor.

RESULTS

Analyses included all participants. Treatment fidelity was high, and participant attendance was remarkable, indicating feasibility. Regarding efficacy, recast therapy led to group-level gains on treated syntactic structures that exceeded those observed for the untreated comparison structure. For the 11 children who received therapy in only one language, approximately equal gains were observed in both the treated and untreated languages for conditional adverbials.

CONCLUSIONS

Preliminary evidence suggests that for highly overlapping structures like conditional adverbials, recast therapy is effective and leads to change in both of the child's languages. Larger studies are required to understand how language of administration and proficiency may affect outcomes.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.23739996.

Virtual Post-Intervention Speech and Language Assessment of Toddler and Preschool Participants in Babble Boot Camp

PURPOSE

Babble Boot Camp (BBC) is a parent-implemented telepractice intervention for infants at risk for speech and language disorders. BBC uses a teach-model-coach-review approach, delivered through weekly 15-min virtual meetings with a speech-language pathologist. We discuss accommodations needed for successful virtual follow-up test administration and preliminary assessment outcomes for children with classic galactosemia (CG) and controls at age 2.5 years.

METHOD

This clinical trial included 54 participants, 16 children with CG receiving BBC speech-language intervention from infancy, age 2 years, five children receiving sensorimotor intervention from infancy and changing to speech-language intervention at 15 months until 2 years of age, seven controls with CG, and 26 typically developing controls. The participants' language and articulation were assessed via telehealth at age 2.5 years.

RESULTS

The Preschool Language Scale-Fifth Edition (PLS-5) was successfully administered with specific parent instruction and manipulatives assembled from the child's home. The GFTA-3 was successfully administered to all but three children who did not complete this assessment due to limited expressive vocabularies. Referrals for continued speech therapy based on PLS-5 and GFTA-3 scores were made for 16% of children who received BBC intervention from infancy as compared to 40% and 57% of children who began BBC at 15 months of age or did not receive BBC intervention, respectively.

CONCLUSIONS

With extended time and accommodations from the standardized administration guidelines, virtual assessment of speech and language was possible. However, given the inherent challenges of testing very young children virtually, in-person assessment is recommended, when possible, for outcome measurements.

Is Articulation Assessment via Synchronous Telepractice as Reliable as In-Person Assessment?

PURPOSE

This study aimed to determine whether articulation assessment via telepractice is as reliable as in-person assessment.

METHOD

Thirty-four children aged 4-11 years with speech sound disorder (SSD) participated in the study. The Articulation Subtest (SET) of the Turkish Articulation and Phonology Test (SST) was used to assess the children's articulation skills. The study's procedures comprised two stages. First, in the Baseline Pilot Stage, five speech-language pathologists (SLPs; four graduate SLPs and one SLP with a PhD degree) conducted in-person assessments on seven children, and their agreement was examined (α for five SLPs = .950; p < .0001). In the Main Assessment Stage, four SLPs assessed 27 children synchronously on four separate days through either online (two SLPs) or in-person (the other two SLPs) clinician roles, which changed daily. Online evaluators did not use microphones and headphones to avoid any advantage. The agreement among the four raters was examined by calculating the intraclass correlation coefficient.

RESULTS

The results revealed an excellent level of agreement regarding overall assessment between online and in-person clinicians (p < .0001). All articulation manners were acceptable, good, or excellent. However, some sounds' (α < .7 for /d/, /ɣ/, /b/; α < .8 for /p/, /ʃ/, /t/, /l/, /v/) reliability levels were relatively low compared with others.

CONCLUSIONS

There may be certain restrictiveness regarding discriminating visual or auditory clues related to certain phonemes in a telepractice environment. This restrictiveness may be related with sonority and with differentiation between minimal pairs where visual clues are limited.