Speech-Language Pathologists' Ratings of Speech Accuracy in Children With Speech Sound Disorders

Listening like a speech-training app: Expert and non-expert listeners' goodness ratings of children's speech

Speech training apps are being developed that provide automatic feedback concerning children's production of known target words, as a score on a 1-5 scale. However, this 'goodness' scale is still poorly understood. We investigated listeners' ratings of 'how many stars the app should provide as feedback' on children's utterances, and whether listener agreement is affected by clinical experience and/or access to anchor stimuli. In addition, we explored the association between goodness ratings and clinical measures of speech accuracy; the Percentage of Consonants Correct (PCC) and the Percentage of Phonemes Correct (PPC). Twenty speech-language pathologists and 20 non-expert listeners participated; half of the listeners in each group had access to anchor stimuli. The listeners rated 120 words, collected from children with and without speech sound disorder. Concerning reliability, intra-rater agreement was generally high, whereas inter-rater agreement was moderate. Access to anchor stimuli was associated with higher agreement, but only for non-expert listeners. Concerning the association between goodness ratings and the PCC/PPC, correlations were moderate for both listener groups, under both conditions. The results indicate that the task of rating goodness is difficult, regardless of clinical experience, and that access to anchor stimuli is insufficient for achieving reliable ratings. This raises concerns regarding the 1-5 rating scale as the means of feedback in speech training apps. More specific listener instructions, particularly regarding the intended context for the app, are suggested in collection of human ratings underlying the development of speech training apps. Until then, alternative means of feedback should be preferred.

A Goal-Writing Framework for Motor-Based Intervention for Childhood Apraxia of Speech

PURPOSE

There are multiple frameworks for goal writing that are applicable to the practice of speech-language pathology. Motor-based speech disorders are a subset of speech sound disorders that are thought to require specific elements of intervention that are typically not addressed in the traditional frameworks used in the clinical setting. The purpose of this tutorial is to review general approaches of goal writing and suggest additional elements that may be used to improve the efficiency and effectiveness of treatment for childhood motor speech disorders, specifically childhood apraxia of speech (CAS).

METHOD

Existing models of goal writing were reviewed to ascertain elements common to most of these models. A basic framework was chosen and modified to include behaviors, conditions, and approaches to goal measurement tailored to the clinical needs of children with CAS. A resource for clinical decision making for children with CAS was developed to inform goal writing at the onset of treatment and adaptations that occur over the course of treatment. Case studies are presented to demonstrate how the presented framework can be applied to writing goals for motor-based treatment for two different children with CAS.

DISCUSSION

Children with CAS require a specialized approach to intervention, which requires goals to reflect the unique clinical needs of this population. This tutorial offers resources that use the best available research evidence and current understanding of effective treatment practices for CAS to guide clinical decision making for motor-based intervention and goal writing. This tutorial is intended to guide treatment planning across varied settings to facilitate progress and optimize treatment outcomes for children with CAS.

The Multilevel Word Accuracy Composite Scale: A Novel Measure of Speech Production in Childhood Apraxia of Speech

PURPOSE

The Multilevel word Accuracy Composite Scale (MACS) is a novel whole-word measure of speech production accuracy designed to evaluate behaviors commonly targeted in motor-based intervention for childhood apraxia of speech (CAS). The MACS yields a composite score generated through ratings of segmental accuracy, word structure maintenance, prosody, and movement transition. This study examined the validity of the MACS through comparison to established measures of speech accuracy. Reliability was also examined within and between practicing speech-language pathologists (SLPs).

METHOD

The MACS was used to rate 117 tokens produced by children with severe CAS. Ratings were performed in the laboratory setting by two expert raters and by practicing SLPs (N = 19). Concurrent validity was estimated through comparison of expert MACS ratings (i.e., MACS score and each component rating) to measures of speech accuracy (percent phoneme correct and the 3-point scale) using correlational analyses. Reliability was examined between expert raters and across SLP raters using the intraclass correlation coefficient to examine interrater reliability of expert ratings, in addition to inter- and intrarater reliability of SLP ratings.

RESULTS

Correlation analyses between MACS ratings (i.e., MACS score and component ratings) and existing measures of speech accuracy revealed small to large positive correlations between measures. Reliability analyses revealed moderate to excellent reliability for MACS ratings performed by expert raters and between (interrater) and within (intrarater) SLP raters.

CONCLUSIONS

Analyses of concurrent validity indicate that the MACS aligns with established measures, yet contributes novel elements for rating speech accuracy. Results further support the MACS as a reliable measure for rating speech accuracy in children with severe speech impairment for ratings performed by expert raters and practicing clinicians.

A Contemporary Review of Clinical Factors Involved in Speech-Perspectives from a Prosthodontist Point of View

Background and Objectives: Learning to speak properly requires a fully formed brain, good eyesight, and a functioning auditory system. Defective phonation is the outcome of a failure in the development of any of the systems or components involved in speech production. Dentures with strong phonetic skills can be fabricated with the help of a dentist who has a firm grasp of speech production and phonetic characteristics. Every dentist strives to perfect their craft by perfecting the balance between the technical, cosmetic, and acoustic aspects of dentistry, or "phonetics". The ideal prosthesis for a patient is one that not only sounds good but also functions well mechanically and aesthetically. Words are spoken by using articulators that alter their size and form. Conclusions: Therefore, a prosthesis should be made in such a way that it does not interfere with the ability to communicate. As a result, a prosthodontist has to have a solid grasp of how speech is made and the numerous parts that go into it.

Transcribing multilingual children's and adults' speech

Speech-language pathologists (SLPs) face challenges in transcription and diagnosis of speech sound disorders (SSD) in multilingual children due to ambient language influences and cross-linguistic transfer. The VietSpeech Multilingual Transcription Protocol, a 4-step process to undertake impressionistic transcription of multilingual speech was tested using data from Vietnamese-Australian children (n = 69) and adult family members (n = 85). The transcription team included an English-speaking SLP, a Vietnamese-English-speaking linguist and accredited interpreter, and two Vietnamese-English-speaking SLPs. (1) Training: The team completed training together in Vietnamese and English phonology. (2) Speech assessment: The participants were assessed using the Diagnostic Evaluation of Articulation and Phonology (DEAP) in English and the Vietnamese Speech Assessment (VSA). (3) Transcription comparison: Inter-rater reliability for 10 children and 12 adults was calculated using consonant-by-consonant agreement. For English the 3-way inter-rater agreement was 92.62% for children and 88.69% for adults. For Vietnamese the 4-way inter-rater agreement was 86.57% for children and 96.05% for adults. There was a significant correlation between speech accuracy and inter-rater reliability for children's consonants in English (r = 0.95) and Vietnamese (r = 0.91), and adults' consonants in English (r = 0.90), but not for Vietnamese (r = 0.49). Reliability was influenced by phoneme class and whether the target consonant was shared between languages. (4) Rule generation and consensus: Rules based on near functional equivalence were implemented to maintain consistency and reach consensus. SLPs who do not speak clients' home languages can be supported to transcribe multilingual speech by working with multilingual teams, and understanding personal limitations during multilingual speech assessments.

Graduate Student Clinicians' Perceptions of Child Speech Sound Errors

Purpose

Speech-language pathologists (SLPs) rely on auditory perception to form judgments on child speech. This can be challenging for graduate student clinicians with limited clinical experience as they often need to judge children's speech errors using their auditory perception. This study examined how consistently graduate student clinicians used a 3-point perceptual rating scale to judge child speech.

Method

Twenty-four graduate student clinicians rated single words produced by children with typically developing speech and language skills and children with speech sound disorders. All participants rated the productions using a 3-point scale, where "2" was an accurate production, "1" was a close approximation, and "0" was an inaccurate production. Ratings were solely based on the auditory signal. These ratings were compared to a consensus rating formed by two experienced SLPs.

Results

Graduate student clinicians reached substantial agreement with the expert SLP rating. They reached the highest percentage agreement when rating accurate productions, and the lowest agreement when rating inaccurate productions.

Conclusions

Graduate student clinicians reached substantial agreement with expert SLP rating in judging child speech using a 3-point scale when provided with detailed descriptions of each rating category. These results are consistent with previous findings on the role that clinical experience plays in speech error perception tasks and highlight the need for additional listening training in speech-language pathology graduate programs.