Methodology for Perceptual Assessment of Speech in Patients with Cleft Palate: A Critical Review of the Literature

Models for Predicting Velopharyngeal Competence Based on Speech and Resonance Errors and Velopharyngeal Area Estimation

OBJECTIVE

To develop tools for predicting velopharyngeal competence (VPC) based on auditory-perceptual assessment and its correlation with objective measures of velopharyngeal orifice area.

DESIGN

Methodological study.

PARTICIPANTS AND METHODS

Sixty-two patients with repaired cleft palate, aged 6 to 45 years, underwent aerodynamic evaluation by means of the pressure-flow technique and audiovisual recording of speech samples. Three experienced speech-language pathologists analysed the speech samples by rating the following resonance, visual, and speech variables: hypernasality, audible nasal air emission, nasal turbulence, weak pressure consonants, facial grimacing, active nonoral errors, and overall velopharyngeal competence. The correlation between the perceptual speech variables and velopharyngeal orifice area estimates was analysed with Spearman's correlation coefficient. Two statistical models (discriminant and exploratory) were used to predict VPC based on the orifice area estimates. Sensitivity and specificity analyses were performed to verify the clinical applicability of the models.

RESULTS

There was a strong correlation between VPC (based on the orifice area estimates) and each speech variable. Both models showed 88.7% accuracy in predicting VPC. The sensitivity and specificity for the discriminant model were 92.3% and 97.2%, respectively, and 96.2% and 94.4% for the exploratory model.

CONCLUSION

Two predictor models based on ratings of resonance, visual, and speech variables and a simple calculation of a composite variable, SOMA (Eng. "sum"), were developed and found to be efficient in predicting VPC defined by orifice estimates categories based on aerodynamic measurements. Both tools may contribute to the diagnosis of velopharyngeal dysfunction in clinical practice.

Reliability of data on percent consonants correct and its associated quality indicator in the Swedish cleft lip and palate registry

BACKGROUND

Data in national health care quality registries must be valid and reliable in order to enable open comparisons of results.

AIM

To assess the reliability of data on percent consonants correct (PCC) and its associated quality indicator ≥86% correct consonants in the Swedish quality registry for patients born with cleft lip and palate (CLP) registry.

METHODS

Six independent speech-language pathologists re-assessed the audio recordings of 96 five-year-olds with PCC data in the CLP registry. Target consonants of a single-word picture-naming test were phonetically transcribed, and PCC was calculated. The reliability of PCC data was assessed with the intraclass correlation coefficient (ICC). The reliability of the quality indicator ≥86% correct consonants was assessed with point-by-point percentage agreement and Cohen's kappa.

RESULTS

Intra- and inter-judge agreement for PCC was excellent with ICCs above 0.9, and so was the agreement of data from the CLP registry and the six judges' re-assessments. The percentage agreement between all judges and the CLP registry for the quality indicator ≥86% correct consonants was poor (67%). However, in 88% of the cases, results from four judges and the CLP registry agreed, corresponding to good agreement. The mean of all kappa values for six judges and the CLP registry corresponded to good agreement (0.72).

CONCLUSIONS

The results indicate the PCC data in the CLP registry and the quality indicator ≥86% correct consonants to be reliable. When differences in outcome between treatment centres are detected, the raw data collected should always be re-examined before drawing definitive conclusions.

Diagnosing and Managing Velopharyngeal Insufficiency in Patients With Cleft Palate After Primary Palatoplasty

Velopharyngeal insufficiency (VPI) after palatoplasty is caused by improper anatomy preventing velopharyngeal closure and manifests as a hypernasal resonance, audible nasal emissions, weak pressure consonants, compensatory articulation, reduced speech loudness, and nostril or facial grimacing. A multidisciplinary team using multimodal instruments (speech analysis, nasoendoscopy, videofluoroscopy, nasometry, and magnetic resonance imaging) to evaluate velopharyngeal function should manage these patients. Careful monitoring of velopharyngeal function by a speech pathologist remains paramount for early identification of VPI and the perceptual assessment should follow a standardized protocol. The greatest methodology problem in CLP studies has been the use of highly variable speech samples making comparison of published results impossible. It is hoped that ongoing international collaborative efforts to standardize procedures for collection and analysis of perceptual data will help this issue. Speech therapy is the mainstay treatment for velopharyngeal mislearning and compensatory articulation, but it cannot improve hypernasality, nasal emissions, or weak pressure consonants, and surgery is the definitive treatment for VPI. Although many surgical methods are available, there is no conclusive data to guide procedure choice. The goal of this review article is to present a review of established diagnostic and management techniques of VPI.

Effect of perceptive-auditory training on the classification of speech hypernasality

PURPOSE

To analyze the effect of auditory-perceptual training by inexperienced speech-language pathologists in the classification of hypernasality in individuals with cleft lip and palate and compare their classification of hypernasality individually, with the gold standard evaluation, before and after this training.

METHODS

Three inexperienced speech-language pathologists used a four-point scale to assess 24 high-pressure speech samples from individuals with cleft lip and palate, before and after auditory-perceptual training. The speech samples corresponded to six samples of each degree of hypernasality. The speech-language pathologists received auditory-perceptual training during the assessments. They had access to anchor samples and immediate feedback of correct answers regarding the degree of hypernasality in training.

RESULTS

There was no significant difference in the overall percentage of correct answers when comparing before and after the auditory-perceptual training. There was a significant association and agreement of the three evaluators with a gold standard evaluation after training, with an increase in agreement for a single evaluator for absent and mild degrees of hypernasality. The dichotomous analysis of the data showed an increase in the Kappa Index of Agreement of this evaluator. Although there was an increase in the Index of Agreement between evaluators for absent, mild, and severe hypernasality, this increase did not reach statistical significance.

CONCLUSION

The auditory-perceptual training provided did not result in a significant improvement in the hypernasality classification for the inexperienced speech-language pathologists, even though the individual data analysis showed that the training favored one of the evaluators. Further studies involving gradual and more extensive auditory-perceptual training may favor the classification of hypernasality by inexperienced SLPs.

Myanmar Articulation, Resonation, Nasal Emission, and Nasal Turbulence Test: A Preliminary Study

Background  This article describes the development of the Myanmar Articulation, Resonation, Nasal Emission, and Nasal Turbulence test for children with cleft lip and palate (CLP), and evaluation of its validity and reliability. Methods  It was created by three Thai researchers and a Burmese research assistant based on Burmese phonology. The content validity was evaluated by six Burmese language experts. All test items were divided into three groups: high-pressure oral consonants, low-pressure oral consonants, and nasal consonants. Results  All items (58-word and 32-phrase/sentence) gave an excellent level of the expert agreement (item-level content validity indexes = 1.00). The target items were illustrated as color pictures. Each picture was clearly drawn and easy to identify. As a pilot study of face validity, all pictures were administered to 10 typical-developing children. The actual testing was assessed by 10 CLP children, and the developed test was analyzed through consultation of the Burmese teachers and interpreters from a speech camp. Testing scores for a total including three groups of target items were shown acceptable for internal consistency reliability (ranged from 0.4 to 0.88). Conclusion  The constructed test is valid in terms of its content.

How differences in anatomy and physiology and other aetiology affect the way we label and describe speech in individuals with cleft lip and palate

BACKGROUND

Speech in individuals with cleft lip and/or palate (CLP) is a complex myriad of presenting symptoms. It is uniquely associated with the structural difference of velopharyngeal insufficiency (VPI), together with a wide and heterogeneous range of other aetiologies which often co-occur. The nature of the speech sound disorder (SSD) including VPI may also change over the course of an individual's care pathway. Differences in terminology and approaches to analysis are currently used, resulting in confusion internationally. Additionally, current diagnostic labels and classification systems in SSD do not capture the complexity and full nature of speech characteristics in CLP.

AIMS

This paper aims to explore the different aetiologies of cleft palate/VPI speech and to relate aetiology with speech characteristic(s). In so doing, it attempts to unravel the different terminology used in the field, describing commonalities and differences, and identifying overlaps with the speech summary patterns used in the United Kingdom and elsewhere. The paper also aims to explore the applicability of current diagnostic labels and classification systems in the non-cleft SSD literature and illustrate certain implications for speech intervention in CLP.

METHODS AND PROCEDURES

The different aetiologies were identified from the literature and mapped onto cleft palate/VPI speech characteristics. Different terminology and approaches to analysis are defined and overlaps described. The applicability of current classification systems in SSD is discussed including additional diagnostic labels proposed in the field.

OUTCOMES AND RESULTS

Aetiologies of cleft palate/VPI speech identified include developmental (cognitive-linguistic), middle ear disease and fluctuating hearing loss, altered oral structure, abnormal facial growth, VPI-structural (abnormal palate muscle) and VPI-iatrogenic (maxillary advancement surgery). There are four main terminologies used to describe cleft palate/VPI speech: active/passive and compensatory/obligatory, which overlap with the four categories used in the UK speech summary patterns: anterior oral cleft speech characteristics (CSCs), posterior oral CSCs, non-oral CSCs and passive CSCs, although not directly comparable. Current classification systems in non-cleft SSD do not sufficiently capture the full nature and complexity of cleft palate/VPI speech.

CONCLUSIONS AND IMPLICATIONS

Our attempt at identifying the heterogeneous range of aetiologies provides clinicians with a better understanding of cleft palate/VPI speech to inform the management pathway and the nature and type of speech intervention required. We hope that the unravelling of the different terminology in relation to the UK speech summary patterns, and those used elsewhere, reduces confusion and provides more clarity for clinicians in the field. Diagnostic labels and classification require international agreement.

WHAT THIS PAPER ADDS

What is already known on the subject Speech associated with cleft palate/velopharyngeal insufficiency (VPI) is a complex myriad of speech characteristics with a wide and heterogeneous range of aetiologies. Different terminology and speech summary patterns are used to describe the speech characteristics. The traditional classification of cleft palate/VPI speech is Articulation Disorder, although evidence is building for Phonological Disorder and contrastive approaches in cleft speech intervention. What this paper adds to existing knowledge This paper explores the range of aetiologies of cleft palate/VPI speech (e.g., altered oral structure, abnormal facial growth, abnormal palate muscle and iatrogenic aetiologies) and attempts to relate aetiology with speech characteristic(s). An attempt is made at unravelling the different terminology used in relation to a well-known and validated approach to analysis, used in the United Kingdom and elsewhere. Complexities of current diagnostic labels and classifications in Speech Sound Disorder to describe cleft palate/VPI speech are discussed. What are the potential or actual clinical implications of this work? There needs to be a common language for describing and summarising cleft palate/VPI speech. Speech summary patterns based on narrow phonetic transcription and correct identification of aetiology are essential for the accurate classification of the speech disorder and identification of speech intervention approaches. There is an urgent need for research to identify the most appropriate type of contrastive (phonological) approach in cleft lip and/or palate.

Incorporating Velopharyngeal MRI into the Clinical Decision-Making Process for a Patient Presenting with Velopharyngeal Dysfunction Following a Failed Palatoplasty

This clinical report describes the implementation of magnetic resonance imaging (MRI) to evaluate a patient with long-standing velopharyngeal dysfunction. She was referred to the craniofacial clinic at age 10 with no prior surgical history and subsequently completed a Furlow palatoplasty due to a suspected submucous cleft palate. However, results were unfavorable with minimal improvement in speech or resonance. The clinical presentation, treatment, outcomes, and contributions from MRI for secondary surgical planning are described. Addition of MRI into the clinical workflow provided insights into the anatomy and physiology of the velopharyngeal mechanism that were unable to be obtained from nasendoscopy and speech evaluation alone.

Relationship Between Auditory-Perceptual and Objective Measures of Resonance in Children with Cleft Palate: Effects of Intelligibility and Dysphonia

To investigate the relationship between auditory-perceptual ratings of resonance and nasometry scores in children with cleft palate. Factors which may impact this relationship were examined including articulation, intelligibility, dysphonia, sex, and cleft-related diagnosis.

Retrospective, observational cohort study.

Outpatient pediatric cranio-facial anomalies clinic.

Four hundred patients <18 years of age identified with CP ± L, seen for auditory-perceptual and nasometry evaluations of hypernasality as well as assessments of articulation and voice.

Relationship between auditory-perceptual ratings of resonance and nasometry scores.

Pearson's correlations indicated that auditory-perceptual resonance ratings and nasometry scores were significantly correlated across oral-sound stimuli on the picture-cued portion of the MacKay-Kummer SNAP-R Test (r values .69 to.72) and the zoo reading passage (r = .72). Linear regression indicated that intelligibility (p ≤ .001) and dysphonia (p = .009) significantly impacted the relationship between perceptual and objective assessments of resonance on the Zoo passage. Moderation analyses indicated that the relationship between auditory-perceptual and nasometry values weakened as severity of speech intelligibility increased (P < .001) and when children presented with moderate dysphonia (p ≤ .001). No significant impact of articulation testing or sex were observed.

Speech intelligibility and dysphonia alter the relationship between auditory-perceptual and nasometry assessments of hypernasality in children with cleft palate. SLPs should be aware of potential sources of auditory-perceptual bias and shortcomings of the Nasometer when following patients with limited intelligibility or moderate dysphonia. Future study may identify the mechanisms by which intelligibility and dysphonia affect auditory-perceptual and nasometry evaluations.

Speech Symptoms of Velopharyngeal Insufficiency and the Incidence of Secondary Speech Surgery in 10-Year-Old Children With Unilateral Cleft Lip and Palate: Comparison of 2 Randomized Surgical Methods for Primary Palatal Surgery

OBJECTIVE

To compare speech symptoms of velopharyngeal insufficiency (VPI) and incidence of secondary speech surgery in 10-year-old Finnish children with unilateral cleft lip and palate (UCLP) following primary palatal surgery using 2 surgical methods.

DESIGN

Single center analysis within the Scandcleft multicenter randomized controlled trial of primary surgery for UCLP.

MATERIALS AND METHODS

Patients comprised 79 nonsyndromic 10-year-old children with UCLP. Two randomized surgical methods were used in the primary palatal surgery: soft palate closure at 4 months and hard palate closure at 12 months (Arm A) and closure of both the soft and hard palate at 12 months (Arm C). Speech symptoms of VPI were analyzed from standardized video recordings by 2 experienced speech pathologists. The incidences of surgery for correcting VPI, fistula closure, and speech therapy were evaluated retrospectively from patient records.

RESULTS

No differences in speech symptoms of VPI, need for VPI surgery or speech therapy were found between the surgical methods. Of all 79 children, 33% had had VPI surgery and 61% had speech therapy. The number of fistulas was significantly higher in Arm A (25%) than in Arm C (2%). Moderate to severe speech symptoms of VPI (hypernasality, continuous nasal air leakage, weak pressure consonants, and/or compensatory articulation) were found in 11% of the children.

CONCLUSION

No differences were present between groups in speech symptoms of VPI or need for VPI surgery or speech therapy between the 2 surgical methods. One third of the children had undergone VPI surgery. Most of the children (89%) had good or relatively good speech.

Agreements between speech language pathologists and naïve listeners' judgements of intelligibility in children with cleft palate

Speech-language pathologists (SLPs) working in interdisciplinary craniofacial teams need to know how much their judgments of speech intelligibility could predict the patient's communication difficulties with non-clinical communicative partners. This study examines the relationship between experienced SLPs and naïve listeners in judgments of speech intelligibility in speakers with cleft palate. A speech perception study was conducted using speech samples from 20 speakers with velopharyngeal insufficiency (VPI) following cleft palate. Speech samples were presented to 70 naïve listeners and 10 SLPs who were experts in cleft palate treatment. Speech intelligibility scores from naïve listeners' orthographic transcriptions were obtained as the percentage of correctly identified words. Speech intelligibility scores from SLPs were obtained using a five-point rating scale. Spearman rank correlation indicated a very high level of overall agreement between naïve listeners and SLPs at the speaker level scores (r_s = -.94, p < .001). While the listeners' judgment seems highly related across highly intelligible speakers, the differences in agreements increase when the speaker is unintelligible. The high correlations between scores for naïve listeners and SLPs suggest that speech intelligibility in children with VPI could be predicted by ratings done in the clinic by expert SLPs.

Influence of an Intensive Speech Therapy Program on the Speech of Individuals with Cleft Lip and Palate

Introduction  Compensatory articulations are speech disorders due to the attempt of the individual with cleft palate/velopharyngeal dysfunction to generate intraoral pressure to produce high-pressure consonants. Speech therapy is the indicated intervention for their correction, and an intensive speech therapy meets the facilitating conditions for the correction of glottal stop articulation, which is the most common compensatory articulation. Objective  To investigate the influence of an intensive speech therapy program (ISTP) to correct glottal stop articulation in the speech of individuals with cleft palate. Methods  Speech recordings of 37 operated cleft palate participants of both genders (mean age = 19 years old) were rated by 3 experienced speech/language pathologists. Their task was to rate the presence and absence of glottal stops in the 6 Brazilian Portuguese occlusive consonants (p, b, t, d, k, g) distributed within several places in 6 sentences. Results  Out of the 325 pretherapy target consonants rated with glottal stop, 197 (61%) remained with this error, and 128 (39%) no longer presented it. The comparison of the pre- and posttherapy results showed: a) a statical significance for the p1, p2, p3, p4, t1, k1, k2 and d6 consonants (McNemar test; p  < 0.05); b) a statistical significance for the p consonant in relation to the k, b, d, g consonants and for the t consonant in relation to the b, d, and g consonants (chi-squared test; p  < 0.05) in the comparison of the proportion improvement among the 6 occlusive consonants. Conclusion  The ISTP influenced the correction of glottal stops in the speech of individuals with cleft palate.

The Correlation Between Perceptual Ratings and Nasalance Scores in Resonance Disorders: A Systematic Review

INTRODUCTION

Assessment of resonance characteristics is essential in research and clinical practice in individuals with velopharyngeal impairment. The purpose of this study was to systematically review correlations between auditory-perceptual ratings and nasalance scores obtained by a nasometer in individuals with resonance disorders and to identify factors that affected the correlations between these two measures.

METHOD

Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, a systematic search was conducted for studies reporting a correlation between nasality ratings and nasalance scores using six electronic databases based on predefined inclusion and exclusion criteria.

RESULTS

A total of 27 studies were included in this systematic review. Characteristics of study components including participants, types of assessment and stimuli, correlation coefficients, and reliability values of each study were identified, and a narrative synthesis was conducted. The methodological quality of each study was also appraised. The correlation level between nasalance values and nasality ratings varied from nonsignificant to strong (r = .92). The quality rating scores of the selected studies ranged from 44% to 94%, with an average score of 75%.

DISCUSSION

Factors that did or did not affect the varied correlation between nasality ratings and nasalance scores were discussed. Speech stimuli and the listeners' background were associated with correlations between the two measures. In addition, the sex of the speakers could be a factor affecting its correlation. However, the types of perceptual scales and listening conditions did not influence its correlations between the two measures.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19653207.

Exploration of the Influences of Temporary Velum Paralysis on Auditory-Perceptual, Acoustic, and Tomographical Markers

Purpose To better understand hypernasality (HN), we explored the relations between velopharyngeal orifice, auditory perception of HN, and acoustic-spectral measures in an in vivo within-subject design: (a) with a normally functioning velum as the control condition and (b) with a temporarily paralyzed velum as the experimental condition. Method The velum of eight volunteers was injected with ropivacaine hydrochloride (Naropin) in the area of the levator veli palatini and tensor veli palatini muscles to induce temporary velopharyngeal inadequacy (VPI) and HN. Sustained [a] and [i] and oronasal text readings were recorded, and 3D cone-beam computed tomography images of the vocal tract were built before and during velar anesthesia. Differences between conditions and correlations in normal-to-numb differences between velopharyngeal cross-sectional area (VP_area), mean ratings of HN severity, and nine acoustic-spectral measures were determined. Results Three subjects already had some incomplete velopharyngeal closure in the control condition. Temporary motor nerve blockage of the velum (increased VP_area) was accomplished in seven subjects, leading to increased HN and changes in three acoustic-spectral measures. Furthermore, significant correlations only emerged between VP_area, HN, and Model_Kataoka. Conclusions In most of the participants, it was possible to temporarily increase the velopharyngeal orifice to investigate HN while controlling other speech variables and cephalic morphology. Although this study was exploratory and its are findings preliminary, it provided additional evidence for the possible clinical value of Model_Kataoka, A ₃-P ₀, and B _F1 for the objective measurement of VPI or HN.

The effect of intervelar veloplasty under magnification (Sommerlad's Technique) without tympanostomy on middle ear effusion in cleft palate patients

Objective

Different surgical techniques and management approaches have been introduced to manage the cleft palate (CP) and its complications, such as otitis media with effusion (OME) and auditory problems. The optimal method, as well as the ideal time for palatoplasty and ventilation tube insertion, are the subject of controversy in the literature. We aimed to evaluate The Effect of Intervelar Veloplasty under Magnification (Sommerlad’s Technique) without Tympanostomy on Middle Ear Effusion in Cleft Palate Patients.

Methods

non-syndromic cleft palate patients from birth to 24 months who needed primary palatoplasty from April 2017 to 2019 were enrolled in this study. intravelar veloplasty (IVVP) surgery under magnification has been done by the same surgeon. Likewise, Otoscopy, Auditory Brainstem Response (ABR), and tympanometry were performed for all the patients before and six months after palatoplasty.

Results

Tympanograms were classified into two categories according to shape and middle ear pressure, and it was done in 42 children (84 ears). Type B curve was seen in 40 cases (80 ears) before surgery which reduced significantly (P < 0.005) to 12 cases in the left ear and 14 cases in the right ear after surgery. So, after surgery, 70 % of the tympanogram of left ears and 66.6 % of the tympanogram of Rt ears were in normal condition (type A tympanometry). ABR was done for 43 patients (86 ears) before surgery and six months after palatoplasty. Data were shown that 40 of the patients had mild to moderate hearing loss before surgery, which reduced significantly (P < 0.005) to 9 in the left ear and 11 in the right ear after palatoplasty. So, after surgery, 79 % of ABR of left ears and 73.8 % of ABR of right ears were in normal status (normal hearing threshold).

Conclusions

Intervelar veloplasty under magnification (Sommerlad’s technique) significantly improved the middle ear effusion without the need for tympanostomy tube insertion.

Assessment of Intelligibility in Children with Velopharyngeal Insufficiency: The Relationship between Intelligibility in Context Scale and Experimental Measures

PURPOSE

The purpose of this study was to investigate the clinical application of the Intelligibility in Context Scale (ICS) instrument in children with velopharyngeal insufficiency (VPI). This study investigated the relationship between clinical speech outcomes and parental reports of speech intelligibility across various communicative partners.

METHODS

The ICS was completed by the parents of 20 English-speaking children aged 4-12 years diagnosed with VPI. The parents were asked to rate their children's speech intelligibility across communication partners using a 5-point scale. Clinical metrics obtained using standard clinical transcription on the Picture-Cued SNAP-R Test were: (1) percentage of consonants correct (PCC), (2) percentage of vowels correct (PVC), and (3) percentage of phonemes correct (PPC). Nasalance from nasometer data was included as an indirect measure of nasality. Intelligibility scores obtained from naive listener's transcriptions and speech-language pathologists' (SLP) ratings were compared with the ICS results.

RESULT

Greater PCC, PPC, PVC, and transcription-based intelligibility values were significantly associated with higher ICS values, respectively (r[20] = 0.84, 0.82, 0.51, and 0.70, respectively; p < 0.05 in all cases). There was a negative and significant correlation between ICS mean scores and SLP ratings of intelligibility (r = -0.74; p < 0.001). There was no significant correlation between ICS values and nasalance scores (r[20] = -0.28; p = 0.22).

CONCLUSION

The high correlations obtained between the ICS with PCC and PPC measures indicate that articulation accuracy has had a great impact on parents' decision-making regarding intelligibility in this population. Significant agreement among ICS scores with naive listener transcriptions and clinical ratings supports use of the ICS in practice.

Furlow Palatoplasty: Should We Also Focus on the Size of the Nasopharynx?

OBJECTIVES

(1) To determine the incidence rate of velopharyngeal dysfunction (VPD) according to 7 speech criteria post-Furlow palatoplasty. (2) To find an anatomical measurement of the cleft palate (or combination of measurements) associated with the occurrence of VPD.

STUDY DESIGN

Retrospective cohort study.

PARTICIPANTS AND METHODS

Fifty-six patients with cleft palate ± cleft lip underwent palatoplasty with the Furlow technique at the age of 10 months. Pre-and post-palatoplasty cleft palate measurements were collected during the procedure. Three blinded speech-language pathologists (SLPs) retrospectively scored the patients from the chart data at age 4. Student t test and receiver operating characteristic curve analysis were used to evaluate the association and predictive capacity between cleft measurements and parameters (M&P) with all VPD criteria.

RESULTS

The SLPs found an incidence of VPD according to 7 criteria: hypernasality (11%), audible nasal emission (4%), nasal rustle (14%), compensatory errors (4%), impairment of speech understandability (7%), and impairment of speech acceptability (16%). The SLPs recommended a secondary surgical procedure in 5 patients (9%). A statistically significant association was found between, respectively, 17 and 5 M&P and the occurrence of compensatory errors and audible nasal emission. Our data suggest that the length of the cleft, the cleft area, and the postoperative transversal size of the nasopharynx are the best indicators of the future positivity of VPD criteria.

CONCLUSION

The size of the postoperative transverse nasopharyngeal area during the primary cleft palate procedure may become the focus of the next generation of cleft surgeons to reduce the incidence of VPD.

Reliability results of perceptual ratings of resonance, nasal airflow and speech acceptability in patients with cleft palate by Ugandan speech-language pathologists following a two-day workshop

INTRODUCTION

To meet the scarcity of training and/or educational initiatives in Uganda regarding state-of-the-art speech diagnosis and treatment in patients with cleft palate, a workshop was organized for all interested speech-language pathologists and health care workers.

OBJECTIVE

To evaluate and compare the inter- and intra-rater reliability of the perceptual evaluation of hypernasality, hyponasality, nasal emission, nasal turbulence and speech acceptability before and after a two-day workshop in Ugandan speech-language pathologists.

METHODS

On the first day, perceptual speech evaluation was discussed and practiced. Perceptual exercises included individual ratings of a specific speech variable followed by a group discussion and consensus listening exercises in listener pairs. The second day focused on speech treatment. Ten Ugandan speech-language pathologists rated speech samples of Ugandan patients with a CP ± L before and immediately following the two-day workshop. Inter- and intra-rater reliability of the perceptual ratings of hypernasality, hyponasality, nasal emission, nasal turbulence and speech acceptability were determined by means of the absolute percentage of agreement. The Wilcoxon signed-rank test was used to compare results at both time points.

RESULTS

Overall inter- and intra-rater reliability improved when observing the absolute percentage agreement. However, median agreement results only showed enhanced reliability for hypernasality, hyponasality and nasal turbulence whereas (limited) deteriorated reliability was observed for nasal emission and speech acceptability. Regarding inter-rater reliability only the median percentage agreement for hyponasality exceeded 50% (median: 56.3%). Overall, better results were found for intra-rater reliability, with only weak results for speech acceptability.

DISCUSSION AND CONCLUSION

Training positively affected reliability results. Nonetheless, this improvement was not achieved for each speech variable and reliability improvements were modest. Findings indicate the need for continued training and the search for the most effective training paradigm and feedback techniques, whilst taking into account clinical relevance and practical considerations.

Robust Estimation of Hypernasality in Dysarthria with Acoustic Model Likelihood Features

Hypernasality is a common characteristic symptom across many motor-speech disorders. For voiced sounds, hypernasality introduces an additional resonance in the lower frequencies and, for unvoiced sounds, there is reduced articulatory precision due to air escaping through the nasal cavity. However, the acoustic manifestation of these symptoms is highly variable, making hypernasality estimation very challenging, both for human specialists and automated systems. Previous work in this area relies on either engineered features based on statistical signal processing or machine learning models trained on clinical ratings. Engineered features often fail to capture the complex acoustic patterns associated with hypernasality, whereas metrics based on machine learning are prone to overfitting to the small disease-specific speech datasets on which they are trained. Here we propose a new set of acoustic features that capture these complementary dimensions. The features are based on two acoustic models trained on a large corpus of healthy speech. The first acoustic model aims to measure nasal resonance from voiced sounds, whereas the second acoustic model aims to measure articulatory imprecision from unvoiced sounds. To demonstrate that the features derived from these acoustic models are specific to hypernasal speech, we evaluate them across different dysarthria corpora. Our results show that the features generalize even when training on hypernasal speech from one disease and evaluating on hypernasal speech from another disease (e.g., training on Parkinson's disease, evaluation on Huntington's disease), and when training on neurologically disordered speech but evaluating on cleft palate speech.

Pharyngeal bulb prosthesis and speech outcome in patients with cleft palate

Introduction

Individuals with cleft palate can present with velopharyngeal dysfunction after primary palatoplasty and require a secondary treatment due to insufficiency. In these cases, the pharyngeal bulb prosthesis can be used temporarily while awaiting secondary surgery.

Objective

This study aimed to investigate the outcome of treatment of hypernasality with pharyngeal bulb prosthesis in patients with history of cleft palate presenting with velopharyngeal insufficiency after primary palatal surgery. We hypothesized that the use of the pharyngeal bulb prosthesis is an effective approach to eliminate hypernasality related to velopharyngeal insufficiency in patients with cleft palate.

Methods

Thirty speakers of Brazilian Portuguese (15 males and 15 females) with operated cleft palate, ages ranging from 6 to 14 years (mean: 9 years; SD = 1.87 years), participated in the study. All patients were fitted with a pharyngeal bulb prosthesis to manage velopharyngeal insufficiency while they were awaiting corrective surgery to be scheduled. Auditory-perceptual analysis of speech recorded in the conditions with and without pharyngeal bulb prosthesis were obtained from three listeners who rated the presence or absence of hypernasality for this study.

Results

Seventy percent of the patients eliminated hypernasality while employing the pharyngeal bulb prosthesis, while 30% still presented with hypernasality. The comparison was statistically significant (p < 0.001).

Conclusion

The use of the pharyngeal bulb prosthesis is an effective approach to eliminate hypernasality related to velopharyngeal insufficiency.

Incidence of cleft-related speech problems in children with an isolated cleft lip

Objectives

Clinicians agree that children with isolated cleft lip have fewer cleft-associated problems than children with cleft lip and palate. Unfortunately, for isolated cleft lip children, the risk of cleft-associated problems is unknown and maybe underestimated. Often, these children do not get the required follow-up by a multidisciplinary team and thereby not the known benefits in supporting their development. This study examines the incidence of cleft-related speech problems and ear problems in children with isolated cleft lip.

Materials and methods

A prospective study was performed on all children born with an isolated cleft lip and treated at the Wilhelmina Children’s Hospital in Utrecht between January 2007 and April 2014. Data were collected for sex, date of birth, genetics, cleft lip type, date of cleft lip repair, type of repair, speech/language problems, and ear problems.

Results

This study included 75 patients (59% male). The mean age of the children at the moment of speech examination was 32.5 months (SD 6.1). Eighteen of the 75 children (24%) needed speech and language therapy; however, only one child (1.3%) had a cleft-related speech problem. Sixteen of the 75 patients (21%) reported a history of one or more episodes of acute otitis media (AOM)/otitis media with effusion (OME) during the first 6 years.

Conclusion/clinical relevance

This is the first prospective study analyzing the incidence of cleft-related speech problems in children with an isolated cleft lip. These children do not have a higher risk of cleft-related speech problems or AOM/OME when compared to the general population. However, children with an isolated cleft do have a higher incidence of speech therapy.

Electronic supplementary material

The online version of this article (10.1007/s00784-020-03367-5) contains supplementary material, which is available to authorized users.

Transforming assessment of speech in children with cleft palate via online crowdsourcing

Objective

Speech intelligibility is fundamental to social interactions and a critical surgical outcome in patients with cleft palate. Online crowdsourcing is a burgeoning technology, with potential to mitigate the burden of limited accessibility to speech-language-pathologists (SLPs). This pilot study investigates the concordance of online crowdsourced evaluations of hypernasality with SLP ratings of children with cleft palate.

Methods

Six audio-phrases each from children with cleft palate were assessed by online crowdsourcing using Amazon Mechanical Turk (MTurk), and compared to SLP’s gold-standard hypernasality score on the Pittsburgh Weighted Speech Score (PWSS). Phrases were presented to MTurk crowdsourced lay-raters to assess hypernasality on a Likert scale analogous to the PWSS. The survey included clickable reference audio samples for different levels of hypernasality.

Results

1,088 unique online crowdsourced speech ratings were collected on 16 sentences of 3 children with cleft palate aged 4–8 years, with audio averaging 6.5 years follow-up after cleft palate surgery. Patient 1 crowd-mean was 2.62 (SLP rated 2–3); Patient 2 crowd-mean 2.66 (SLP rated 3); and Patient 3 crowd-mean 1.76 (SLP rated 2). Rounded for consistency with PWSS scale, all patients matched SLP ratings. Different sentences had different accuracies compared to the SLP gold standard scores.

Conclusion

Online crowdsourced ratings of hypernasal speech in children with cleft palate were concordant with SLP ratings, predicting SLP scores in all 3 patients. This novel technology has potential for translation in clinical speech assessments, and may serve as a valuable screening tool for non-experts to identify children requiring further assessment and intervention by a qualified speech language pathology expert.

Reliability of Speech Variables and Speech-Related Quality Indicators in the Swedish Cleft Lip and Palate Registry

OBJECTIVE

To assess the reliability of speech variables and speech-related quality indicators in the Swedish quality registry for cleft lip and palate (CLP).

DESIGN

Retrospective study.

SETTING

Primary care university hospitals.

PARTICIPANTS

Fifty-two 5-year-old children with unilateral CLP and 41 with bilateral CLP.

MAIN OUTCOME MEASURES

Registry data for "percent nonoral errors" and "perceived velopharyngeal competence" (VPC) were compared to reassessments by 4 independent judges based on audio recordings. Interjudge agreement for "percent consonants correct" (PCC) and the reliability of 3 quality indicators were also assessed. Agreement was calculated with single measures intraclass correlation coefficient (ICC) for articulation outcomes, quadratic weighted κ and ICC for VPC, and percentage agreement and κ for quality indicators.

RESULTS

When the agreement between registry data and the judges' reassessments was assessed, the ICC was 0.79 for percent nonoral errors. For VPC, the κ coefficient was 0.66 to 0.75 and the ICC was 0.73. Interjudge agreement for PCC calculated with ICC was 0.85. For the quality indicator "proportion of children with ≥86% correct consonants," all 4 judges were in agreement for 72% of the cases. For "proportion of children without nonoral speech errors" and "proportion of children with competent or marginally incompetent velopharyngeal function," the agreement between registry data and the 4 judges was 89% and 85%, respectively.

CONCLUSIONS

The results indicate that registry data on PCC, percent nonoral errors, VPC, and the quality indicators "proportion of children without nonoral speech errors" and "proportion of children with competent or marginally incompetent velopharyngeal function" are reliable.

Velopharyngeal Closure and Resonance in Children Following Early Cleft Palate Repair: Outcome Measurement

Introduction Timing of cleft palate repair and the method of speech outcome measurement in children with cleft lip and palate are much debated topics. The associated problems and quality of life in these children depend on the timing of the surgery.

Aim The aim of this study was to investigate the velopharyngeal (VP) function and resonance parameters in children following early cleft palate repair.

Method A total of 25 Kannada-speaking children with early repaired cleft palate were subjected to speech assessment and videofluoroscopic assessment. Perceptual speech parameters measured were severity of hypernasality and presence of nasal air emission. Videofluoroscopy was interpreted in terms of closure ratios to predict the severity of VP dysfunction.

Results The analysis of videofluoroscopic images indicated that 48% of children had complete VP closure and 52% had perceptually normal resonance. A good correlation was found between the closure ratio and hypernasality.

Conclusion Understanding the perceptual speech parameters and their structural correlates for outcome measurement will give better evidence for refining the existing treatment protocols. Data on a larger population are warranted for establishing predictors of optimum speech outcome.

Stages in the Development and Validation of a Belgian Dutch Outcome Tool for the Perceptual Evaluation of Speech in Patients With Cleft Palate

Objective:

To develop and validate a Belgian Dutch outcome tool for the perceptual evaluation of speech in patients with cleft palate.

Setting:

Cleft palate team in a tertiary university hospital.

Methods:

The tool was based on the Cleft Audit Protocol for Speech–Augmented (John et al., 2006; Sell et al., 2009), with adaptations to some of the speech variables and the structured listening protocol. Following a preliminary listening experiment in phase 1, the tool was optimized. In the second phase, a listening experiment with 4 experienced listeners was set up to assess face validity, inter- and intrarater reliability and criterion validity.

Results:

Results of phase 1 indicated good to very good inter- and intrarater reliability for the majority of the speech variables, good discriminant validity, and varying sensitivity and specificity based on a comparison with nasalance values and the Nasality Severity Index 2.0 (criterion validity). Results of phase 2 showed good to very good interrater reliability for 5 of the 14 variables and good intrarater reliability in 3 of the 4 experienced listeners. Sensitivity and specificity were sufficient, except the specificity of the hypernasality judgments in comparison with the nasalance values of the oral text. Overall, listeners positively judged the face validity of the tool.

Conclusion:

The 2-phase evaluation indicated varying validity and reliability results. Future studies will aim to optimize validity and reliability of the developed tool based on adaptations to the listening protocol, the addition of speech variables, and the inclusion of a more elaborate training.

Protocols for Reporting Speech Outcomes following Palatoplasty or Velopharyngeal Surgery: A Literature Review

Background:

To determine best practices, surgeons who perform cleft palate surgery or surgery for velopharyngeal insufficiency need to be able to compare their outcomes in normalizing the velopharyngeal valve.

Methods:

We conducted a comprehensive review of articles that reported speech/resonance outcomes following palatoplasty or surgery for velopharyngeal insufficiency. We analyzed protocols that were used and how the results were reported. We found 170 articles, published between 1990 and 2014, that met our inclusion criteria.

Results:

Most studies (66%) had a sample size of <50 subjects, were retrospective (67%), were not blinded (83%), and did not report the use of reliability (68%). Most studies included 1 evaluator (27%) or 2 evaluators (30%). Only 80% of the articles specified that at least one speech pathologist was an evaluator. Most articles (56%) did not specify the speech samples used, and 65% used an informal test or did not specify the type of test used. Most studies used a perceptual rating scale for articulation (75%) and resonance (83%). Only 39% of the studies included an evaluation of velopharyngeal function. Finally, objective measures were used in only 28% of the studies (9% used aerodynamic measures and 19% used nasometry).

Conclusions:

Because these articles showed significant variability in how speech/resonance is evaluated and how the outcomes are reported, it is virtually impossible to compare results to determine best surgical procedures. Suggestions are given to standardize outcome measures to improve comparability of data.

Perceptual evaluation of hypernasality, audible nasal airflow and speech understandability using ordinal and visual analogue scaling and their relation with nasalance scores

PURPOSE

Perceptual assessments remain the most commonly utilized procedure to diagnose and evaluate resonance disorders. However, the discussion continues about which rating scale has to be applied. Therefore, this study aimed to compare the reliability and validity of ordinal and visual analogue scales to rate hypernasality, audible nasal airflow and speech understandability.

METHODS

Four experienced speech-language pathologists rated 35 speech samples of children with a range of hypernasality, audible nasal airflow and speech understandability, using an ordinal scale and a visual analogue scale. Intraclass correlations coefficients determined intra- and inter-rater reliability. The model of best fit was determined by plotting both rating scales against each other. A Pearson correlation coefficient verified the relationship between both rating scales and nasalance scores determined by a Nasometer.

RESULTS

Good intra- and inter-rater reliability was found for both rating scales. A multiple regression analysis revealed a curvilinear relationship between both rating scales, indicating a slight preference to rate all parameters by a visual analogue scale. Comparable correlations with nasalance scores were found.

CONCLUSIONS

This study confirms that visual analogue scale ratings form a reliable and valid alternative for ordinal ratings in the perceptual judgments of hypernasality, audible nasal airflow and speech understandability. A combination of both rating scales may even combine the advantages and eliminate their limitations. However, further research is necessary to verify how this new approach can be implemented in available protocols for clinical practice, audits and research.

Intelligibility assessment of cleft lip and palate speech using Gaussian posteriograms based on joint spectro-temporal features

Intelligibility is considered as one of the primary measures for speech rehabilitation of individuals with a cleft lip and palate (CLP). Currently, speech processing and machine-learning-based objective methods are gaining more research interest as a way to quantify speech intelligibility. In this work, joint spectro-temporal features computed from a time-frequency representation of speech are explored to derive speech representations based on Gaussian posteriograms. A comparative framework using dynamic time warping (DTW) is used to quantify the intelligibility of child CLP speech. The DTW distance is used to score sentence-level intelligibility and tested for correlation with perceptual intelligibility ratings obtained from expert speech-language pathologists. A baseline DTW system using the conventional Mel-frequency cepstral coefficients (MFCCs) is also developed to compare the performance of the proposed system. Spearman's rank correlation coefficient between the objective intelligibility scores and the perceptual intelligibility rating is studied. A Williams significance test is conducted to assess the statistical significance of the correlation difference between the methods. The results show that the system based on joint spectro-temporal features significantly outperforms the MFCC-based system.

Problems With Reliability of Speech Variables for Use in Quality Registries for Cleft Lip and Palate—Experiences From the Swedish Cleft Lip and Palate Registry

Objective:

To test the reliability of the speech data in the Swedish quality registry for cleft lip and palate.

Design:

Retrospective study.

Setting:

Primary care university hospital.

Participants:

Ninety-four children born with cleft palate with or without cleft lip between 2005 and 2009 who had been assessed and registered in the quality registry at the age of 5 years.

Main Outcome Measures:

Data in the registry on percent oral consonants correct, percent oral errors, percent nonoral errors, perceived velopharyngeal function (PVPF), and intelligibility were compared with results based on reassessments by 3 independent raters from audio recordings. Agreement was calculated by the intraclass correlation coefficient (ICC), quadratic weighted kappa, and percentage agreement.

Results:

Absolute agreement calculated by average measures ICC for percent oral consonants correct, percent oral errors, and percent nonoral errors was above >0.90. Single measures ICC for percent oral consonants correct was 0.82, for percent oral errors 0.69, and for percent nonoral errors 0.83. The kappa coefficient for PVPF was 0.5 to 0.59 and for intelligibility 0.65 to 0.77. Exact percentage agreement for PVPF was 33% and for intelligibility 47.8%.

Conclusions:

The data on oral consonants correct and nonoral errors in the quality registry seem to be reliable. The data on oral errors, PVPF, and intelligibility should be interpreted with caution. If differences among treatment centers are detected, one should go back and examine the collected raw data before drawing any definitive conclusions about treatment outcome.

Validity and Reliability of Visual Analog Scaling for Assessment of Hypernasality and Audible Nasal Emission in Children with Repaired Cleft Palate

Objective

To investigate the validity and reliability of multiple listener judgments of hypernasality and audible nasal emission, in children with repaired cleft palate, using visual analog scaling (VAS) and equal-appearing interval (EAI) scaling.

Design

Prospective comparative study of multiple listener ratings of hypernasality and audible nasal emission.

Setting

Multisite institutional.

Participants

Five trained and experienced speech-language pathologist listeners from the Americleft Speech Project.

Measures

Average VAS and EAI ratings of hypernasality and audible nasal emission/turbulence for 12 video-recorded speech samples from the Americleft Speech Project. Intrarater and interrater reliability was computed, as well as linear and polynomial models of best fit.

Results

Intrarater and interrater reliability was acceptable for both rating methods; however, reliability was higher for VAS as compared to EAI ratings. When VAS ratings were plotted against EAI ratings, results revealed a stronger curvilinear relationship.

Conclusions

The results of this study provide additional evidence that alternate rating methods such as VAS may offer improved validity and reliability over EAI ratings of speech. VAS should be considered a viable method for rating hypernasality and nasal emission in speech in children with repaired cleft palate.

Speech Intelligibility of Patients with Cleft Lip and Palate after Placement of Speech Prosthesis

Objective:

To evaluate the speech intelligibility of patients with clefts before and after placement of a speech prosthesis.

Design:

Cross-sectional.

Setting:

Hospital for Rehabilitation of Craniofacial Anomalies, University of São Paulo (HRAC/USP), Bauru, Brazil.

Patients:

Twenty-seven patients with unoperated cleft palate or operated cleft palate presenting with velopharyngeal insufficiency (VPI) after primary palatoplasty, treated with speech prosthesis, aged 8 to 63 years.

Interventions:

Patients were fitted with palatopharyngeal obturators or pharyngeal bulbs, suitable to their dental needs. Five speech-language pathologists blindly evaluated speech samples of the patients with and without the prosthesis.

Main Outcome Measures:

Classification of speech samples according to a scoring system developed for speech intelligibility problems: 1 (normal), 2 (mild), 3 (mild to moderate), 4 (moderate), 5 (moderate to severe), and 6 (severe). Results were evaluated by the calculation of means of all judges for each patient in both situations.

Results:

The judges presented significant agreement (W = .789, p < .01). Speech intelligibility was significantly better after placement of the prosthesis for both unoperated patients (Z = 1.93, p = .02) and operated patients with VPI after primary palatoplasty (Z = 1.78, p = .03).

Conclusions:

Speech intelligibility may be improved by rehabilitation of patients with cleft palate using a speech prosthesis. Speech therapy is needed to eliminate any compensatory articulation productions developed prior to prosthetic management.

Speech in Children with an Isolated Cleft Palate: A Longitudinal Perspective

Objective

To describe articulation and speech symptoms related to velopharyngeal impairment in children born with an isolated cleft palate.

Design

Blind assessment of speech at 3, 5, 7, and 10 years of age was performed. Two subgroups were formed based on the results at age 5 years, the no-VPI group and the VPI group, and they were compared with controls.

Setting

A university hospital.

Patients

Twenty-six children born with isolated cleft palate. Seventeen children served as controls.

Interventions

Soft palate closure at 7 months and hard palate closure at a mean age of 3 years and 11 months if the cleft extended into the hard palate.

Main Outcome Measures

Perceptual assessments of four variables related to velopharyngeal function and of articulation errors were performed at all ages. Phonetic transcriptions of target speech sounds were obtained at 5, 7, and 10 years and nasalance scores were obtained at age 10 years.

Results

The no-VPI group continued to have no or minor difficulties. The VPI group improved but continued to have moderate velopharyngeal impairment. Both groups differed significantly from the controls at age 10 years. Persistent velopharyngeal impairment, as well as glottal misarticulation, were mostly found in children with the cleft as a part of a syndrome or together with multiple malformations.

Conclusion

Small changes in velopharyngeal impairment were found across ages. Improvement seemed to be related to surgical intervention, and persistent problems seemed to be related to the presence of additional multiple malformations or syndromes.

Scandcleft randomised trials of primary surgery for unilateral cleft lip and palate: 5. Speech outcomes in 5-year-olds - consonant proficiency and errors

BACKGROUND AND AIM

Normal articulation before school start is a main objective in cleft palate treatment. The aim was to investigate if differences exist in consonant proficiency at age 5 years between children with unilateral cleft lip and palate (UCLP) randomised to different surgical protocols for primary palatal repair. A secondary aim was to estimate burden of care in terms of received additional secondary surgeries and speech therapy.

DESIGN

Three parallel group, randomised clinical trials were undertaken as an international multicentre study by 10 cleft teams in five countries: Denmark, Finland, Norway, Sweden, and the UK.

METHODS

Three different surgical protocols for primary palatal repair were tested against a common procedure in the total cohort of 448 children born with non-syndromic UCLP. Speech audio- and video-recordings of 391 children (136 girls and 255 boys) were available and transcribed phonetically. The main outcome measure was Percent Consonants Correct (PCC) from blinded assessments.

RESULTS

In Trial 1, arm A showed statistically significant higher PCC scores (82%) than arm B (78%) (p = .045). No significant differences were found between prevalences in Trial 2, A: 79%, C: 82%; or Trial 3, A: 80%, D: 85%. Across all trials, girls achieved better PCC scores, excluding s-errors, than boys (91.0% and 87.5%, respectively) (p = .01).

CONCLUSIONS

PCC scores were higher in arm A than B in Trial 1, whereas no differences were found between arms in Trials 2 or 3. The burden of care in terms of secondary pharyngeal surgeries, number of fistulae, and speech therapy visits differed.

TRIAL REGISTRATION

ISRCTN29932826.

A Cross-Sectional Study of Speech in 10-Year-Old Children with Cleft Palate: Results and Issues of Rater Reliability

Objectives:

To describe speech based on perceptual evaluation in a group of 10-year-old children with cleft palate. A secondary aim was to investigate the reliability of speech-language pathologists’ perceptual assessment of cleft palate speech.

Design:

Retrospective cross-sectional study in children with cleft palate. External raters made assessments from randomized speech recordings.

Subjects:

Thirty-eight children with unilateral cleft lip and palate (UCLP) or cleft palate only (CPO) and 10 children in a comparison group.

Main Outcome Measures:

Ratings of hypernasality, hyponasality, audible nasal air leakage, weak pressure consonants, and articulation. Exact agreement and weighted kappa values were used for reliability.

Results:

Hypernasality was found in 25% of children with a cleft of the soft palate (CSP), 33% of children with a cleft of the hard and soft palate (CHSP), and 67% of children with a UCLP. Similar results were found for audible nasal air leakage. Articulation errors were found in 6% of the CHSP group and 25% of the UCLP group, whereas no child in the CSP group had articulation errors. The reliability was moderate to good for different variables, with lowest values for hypernasality.

Conclusions:

Speech results in this series seem less satisfactory than those reported in other published international studies, but it is difficult to draw any certain conclusions about speech results because of large methodological differences. Further developments to ensure high reliability of perceptual ratings of speech are called for.

The Cleft Audit Protocol for Speech—Augmented: A Validated and Reliable Measure for Auditing Cleft Speech

Objectives

To develop an assessment tool for use in intercenter audit studies of cleft speech and to test its acceptability, validity, and reliability. The tool is to be used systematically to record and report speech outcomes, providing an indication of treatment needs and continuing burden of care.

Setting

Regional Cleft Center, U.K.

Methods

The Cleft Audit Protocol for Speech—Augmented (CAPS-A) was developed by three cleft speech experts who identified the key features required from existing assessment measures. Criterion validity was assessed by comparing the Cleft Audit Protocol for Speech—Augmented outcomes reported for 20 cases with clinical assessment results and other investigations. Intra- and interrater reliability were tested following the training of specialist speech and language therapists who used the Cleft Audit Protocol for Speech—Augmented on two occasions to assess 10 cases. The raters evaluated acceptability and ease of using a questionnaire.

Results

The mean percentage agreement for criterion validity in each section was 87% (range 70% to 100%). Both intra- and interexaminer reliability were rated as good/very good (Kappa 0.61 to 1.00) for seven sections and moderate (Kappa 0.41 to 0.60) for three sections. Raters reported that the Cleft Audit Protocol for Speech—Augmented was acceptable and easy to use with appropriate training.

Conclusion

An acceptable, valid, and reliable cleft speech audit tool has been developed based on a small sample. The Cleft Audit Protocol for Speech—Augmented is recommended for use in intercenter audit studies in the U.K. and Ireland and could be used in other English-speaking countries. In addition, it has wider applicability for use in reporting speech outcomes of surgical procedures.

Scandcleft randomised trials of primary surgery for unilateral cleft lip and palate: 4. Speech outcomes in 5-year-olds - velopharyngeal competency and hypernasality

BACKGROUND AND AIM

Adequate velopharyngeal function and speech are main goals in the treatment of cleft palate. The objective was to investigate if there were differences in velopharyngeal competency (VPC) and hypernasality at age 5 years in children with unilateral cleft lip and palate (UCLP) operated on with different surgical methods for primary palatal repair. A secondary aim was to estimate burden of care in terms of received additional secondary surgeries and speech therapy.

DESIGN

Three parallel group, randomised clinical trials were undertaken as an international multicentre study by 10 cleft teams in five countries: Denmark, Finland, Sweden, Norway, and the UK.

METHODS

Three different surgical protocols for primary palatal repair were tested against a common procedure in the total cohort of 448 children born with a non-syndromic UCLP. Speech audio and video recordings of 391 children (136 girls, 255 boys) were available and perceptually analysed. The main outcome measures were VPC and hypernasality from blinded assessments.

RESULTS

There were no statistically significant differences between the prevalences in the arms in any of the trials. VPC: Trial 1, A: 58%, B: 61%; Trial 2, A: 57%, C: 54%; Trial 3, A: 35%, D: 51%. No hypernasality: Trial 1, A: 54%, B: 44%; Trial 2, A: 47%, C: 51%; Trial 3, A: 34%, D: 49%.

CONCLUSIONS

No differences were found regarding VPC and hypernasality at age 5 years after different methods for primary palatal repair. The burden of care in terms of secondary pharyngeal surgeries, number of fistulae, and speech therapy visits differed.

TRIAL REGISTRATION

ISRCTN29932826.

A non-language-specific speech test to evaluate the speech of cleft patients from different language and cultural backgrounds - A pilot study

Cleft speech tests are not universally available. We developed a tool to fill this gap, especially in the context of a cleft mission setting. We performed a pilot study to evaluate the test's ability to differentiate between the speech of cleft patients and healthy individuals from three different language backgrounds. We used 78 made-up, nonsensical syllables to evaluate hypernasality, nasal emissions, and consonant errors. Cleft (n = 41) and non-cleft (n = 39) individuals from three countries were included in this study. Two speech and language pathologists, blinded to the examination, rated the audio recording independently. Patients from Germany (n = 12; mean age 15.2), Iran (n = 14; mean age 7), and India (n = 15; mean age 14.7 years) were evaluated. We observed a significant difference in each category (p < 0.05) between patients and control subjects of the same language and cultural background. Hypernasality was affected the most. The test proved to possess the correct phonetic characteristics to reveal and provoke relevant cleft speech pathologies independent of cultural and language backgrounds. The test sounds posed no articulatory difficulties to non-cleft individuals, with some exceptions regarding non-specific consonant errors. A comparison with other existing tests will further illuminate its value as a speech test.

Delayed primary palatal closure in resource-poor countries: Speech results in Ugandan older children and young adults with cleft (lip and) palate

AIMS

Unrepaired clefts still regularly occur in resource-poor countries as a result of limited health-care access. The purpose of the present study was to report resonance, airflow and articulation characteristics following delayed (≥8years) primary palatal closure.

METHODS

Fifteen Ugandan participants with cleft (lip and) palate (CP±L) were included as well as 15 age- and gender-matched Ugandan subjects without clefts. Palatal closure was performed at a mean age of 15;10 years using the Sommerlad technique. Speech evaluations were carried out on a single occasion postoperatively (mean age: 18;10 years). Resonance and nasal airflow were perceptually evaluated and detailed phonetic and phonological assessments were carried out. Additionally, nasalance values were determined.

RESULTS

Nasal emission occurred postoperatively in only 27% (4/15) of the patients, whereas resonance disorders and articulation errors were prevalent in 87% (13/15) of the patient group. Compared with the control group, a significantly higher prevalence of hypernasality and significantly higher nasalance values for all oral and oronasal speech samples were obtained in the CP±L group. Moreover, significantly smaller consonant inventories and significantly more phonetic and phonological disorders were observed.

CONCLUSIONS

Delayed palatal repair (≥8years) seems to be insufficient to eliminate nasal airflow errors, resonance abnormalities, and articulation disorders. In order to prevent patients' late presentation at specialized centers, the availability of high quality surgical cleft palate treatment should increase as well as people's awareness of the possibility and importance of early surgical intervention. Moreover, speech therapy following delayed palatal closure would be beneficial. Furthermore, a standardized and validated protocol for speech assessment in future studies is advocated.

A Standard Set of Outcome Measures for the Comprehensive Appraisal of Cleft Care

Care of the patient with cleft lip and/or palate remains complex. Prior attempts at aggregating data to study the effectiveness of specific interventions or overall treatment protocols have been hindered by a lack of data standards. There exists a critical need to better define the outcomes- particularly those that matter most to patients and their families-and to standardize the methods by which these outcomes will be measured. This report summarizes the recommendations of an international, multidisciplinary working group with regard to which outcomes a typical cleft team could track, how those outcomes could be measured and recorded, and what strategies may be employed to sustainably implement a system for prospective data collection. It is only by agreeing on a common, standard set of outcome measures for the comprehensive appraisal of cleft care that intercenter comparisons can become possible. This is important for quality-improvement endeavors, comparative effectiveness research, and value-based health-care reform.

Does the recording medium influence phonetic transcription of cleft palate speech?

BACKGROUND

In recent years, analyses of cleft palate speech based on phonetic transcriptions have become common. However, the results vary considerably among different studies. It cannot be excluded that differences in assessment methodology, including the recording medium, influence the results.

AIMS

To compare phonetic transcriptions from audio and audio/video recordings of cleft palate speech by means of outcomes of per cent correct consonants (PCC) and differences in consonant transcriptions.

METHODS & PROCEDURES

Thirty-two 3-year-olds born with cleft palate were audio and audio/video recorded while performing a single-word test by picture naming. The recordings were transcribed according to the International Phonetic Alphabet. The transcriptions from the audio and the audio/video recordings were analysed with regard to PCC, differences in the use of phonetic consonant symbols and the use of diacritics.

OUTCOMES & RESULTS

PCC was higher when the calculation was based on transcriptions from audio recordings than when based on audio/video recordings. No such differences were seen when age-appropriate consonant processes were scored as correct. Consonants were not excluded as often in the transcriptions from audio/video recordings as they were in the transcriptions from audio recordings, and more target consonants were transcribed as dental/alveolar in the transcriptions from audio/video recordings and palatal/velar/uvular in the transcriptions from audio recordings than vice versa. Further, interdental articulation, linguolabial articulation and audible nasal air leakage were more common in the transcriptions from audio/video recordings than in those from audio recordings. All these differences were statistically significant.

CONCLUSIONS & IMPLICATIONS

Phonetic transcription is influenced to some extent by visual cues. However, as long as age-appropriate articulatory and phonological simplification processes are scored as correct when evaluating consonant production in the speech of young children born with cleft palate using phonetic transcription, the recording medium does not seem to affect the results.

Perceptual Judgments of Resonance, Nasal Airflow, Understandability, and Acceptability in Speakers with Cleft Palate: Ordinal versus Visual Analogue Scaling

Objective

To investigate the reliability of ordinal versus visual analogue scaling (VAS) ratings for perceptual judgments of nasal resonance, nasal airflow, understandability, and acceptability in speakers with cleft palate.

Design

Within-subjects comparative study.

Setting

Multisite.

Participants

Five specialist speech and language therapists from U.K. Regional Cleft Centres.

Outcome Measures

Participants rated 30 audio speech samples obtained from the Speech and Language Therapy archives of Great Ormond Street Hospital. They rated the identified speech parameters using each scaling method, with 1 month between rating tasks. The model of best fit was determined to examine validity, and both intra- and inter-rater reliability were also computed.

Results

VAS ratings were valid for all parameters when plotted against ordinal ratings, and the model of best fit revealed only a slightly stronger curvilinear than linear relationship between the scaling methods. Intra-rater reliability was high for both rating methods across all six speech parameters. There was also high inter-rater reliability for both ordinal and VAS ratings of hypernasality, nasal emission, nasal turbulence, understandability, and acceptability, and for the ordinal ratings of hyponasality.

Conclusions

Perceptual judgments of nasal resonance, nasal airflow, understandability, and acceptability were similar using VAS and ordinal scaling, indicating that both scaling methods were appropriate for measuring the cleft speech parameters. VAS, however, may offer statistical advantages, and there is a growing body of evidence advocating its use for the measurement of prothetic speech parameters.

Perceptual Assessment of Velopharyngeal Dysfunction by Otolaryngology Residents

OBJECTIVE

To assess the ability of otolaryngology residents to rate the hypernasal resonance of patients with velopharyngeal dysfunction. We hypothesize that experience (postgraduate year [PGY] level) and training will result in improved ratings of speech samples.

STUDY DESIGN

Prospective cohort study.

SETTING

Otolaryngology training programs at 2 academic medical centers.

SUBJECTS AND METHODS

Thirty otolaryngology residents (PGY 1-5) were enrolled in the study. All residents rated 30 speech samples at 2 separate times. Half the residents completed a training module between the rating exercises, with the other half serving as a control group. Percentage agreement with the expert rating of each speech sample and intrarater reliability were calculated for each resident. Analysis of covariance was used to model accuracy at session 2.

RESULTS

The median percentage agreement at session 1 was 53.3% for all residents. At the second session, the median scores were 53.3% for the control group and 60% for the training group, but this difference was not statistically significant. Intrarater reliability was moderate for both groups. Residents were more accurate in their ratings of normal and severely hypernasal speech. There was no correlation between rating accuracy and PGY level. Score at session 1 positively correlated with score at session 2.

CONCLUSION

Perceptual training of otolaryngology residents has the potential to improve their ratings of hypernasal speech. Length of time in residency may not be best predictor of perceptual skill. Training modalities incorporating practice with hypernasal speech samples could improve rater skills and should be studied more extensively.

Influência da amostra de fala na classificação perceptiva da hipernasalidade

RESUMO Objetivo Investigar a influência do tipo de amostra de fala, conversa espontânea ou repetição de sentenças, sobre o índice de concordância intra e interavaliadores obtido na classificação perceptiva da hipernasalidade. Métodos Foram selecionadas e editadas 120 amostras de fala gravadas em áudio (60 contendo trechos de conversa espontânea e 60 contendo repetição de sentenças) de indivíduos com fissura de palato±lábio reparada, de ambos os sexos, com idade entre 6 e 52 anos (média=21±10 anos). Três fonoaudiólogas experientes, utilizando seus critérios internos, classificaram a hipernasalidade em escala de 4 pontos: 1=ausente, 2=leve, 3=moderada e 4=grave, primeiramente na amostra de conversa espontânea e, 30 dias depois, na repetição de sentenças. Os índices de concordância intra e interavaliadores foram estabelecidos para ambos os tipos de amostra de fala e comparados entre si por meio do Teste Z com nível de significância de 5%. Resultados A comparação dos índices de concordância intra-avaliadores entre os dois tipos de amostra de fala mostrou aumento dos coeficientes obtidos na análise da repetição de sentenças em relação aos obtidos na conversa espontânea, já a comparação entre os índices de concordância interavaliadores não mostrou diferença significante entre as três avaliadoras para os dois tipos de amostras de fala. Conclusão A repetição de sentenças favoreceu a confiabilidade do julgamento perceptivo da hipernasalidade de um mesmo avaliador, visto que a concordância intra-avaliadores na análise desta amostra de fala foi maior. No entanto, o tipo de amostra de fala não influenciou a concordância entre diferentes avaliadores.

The relationship between the Nasality Severity Index 2.0 and perceptual judgments of hypernasality

PURPOSE

The Nasality Severity Index 2.0 (NSI 2.0) forms a new, multiparametric approach in the identification of hypernasality. The present study aimed to investigate the correlation between the NSI 2.0 scores and the perceptual assessment of hypernasality.

METHOD

Speech samples of 35 patients, representing a range of nasality from normal to severely hypernasal, were rated by four expert speech-language pathologists using visual analogue scaling (VAS) judging the degree of hypernasality, audible nasal airflow (ANA) and speech intelligibility. Inter- and intra-listener reliability was verified using intraclass correlation coefficients. Correlations between NSI 2.0 scores and its parameters (i.e. nasalance score of an oral text and vowel /u/, voice low tone to high tone ratio of the vowel /i/) and the degree of hypernasality were determined using Pearson correlation coefficients. Multiple linear regression analysis was used to investigate the possible influence of ANA and speech intelligibility on the NSI 2.0 scores.

RESULTS

Overall good to excellent inter- and intra-listener reliability was found for the perceptual ratings. A moderate, but significant negative correlation between NSI 2.0 scores and perceived hypernasality (r=-0.64) was found, in which a more negative NSI 2.0 score indicates the presence of more severe hypernasality. No significant influence of ANA or intelligibility on the NSI 2.0 was observed based on the regression analysis.

CONCLUSION

Because the NSI 2.0 correlates significantly with perceived hypernasality, it provides an easy-to-interpret severity score of hypernasality which will facilitate the evaluation of therapy outcomes, communication to the patient and other clinicians, and decisions for treatment planning, based on a multiparametric approach. However, research is still necessary to further explore the instrumental correlates of perceived hypernasality.

LEARNING OUTCOMES

The reader will be able to (1) describe and discuss current issues and influencing variables regarding perceptual ratings of hypernasality; (2) describe and discuss the relationship between the Nasality Severity Index 2.0, a new multiparametric approach to hypernasality, and perceptual judgments of hypernasality based on visual analogue scale ratings; (3) compare these results with the correlations based on a single parameter approach and (4) describe and discuss the possible influence of audible nasal airflow and speech intelligibility on the NSI 2.0 scores.

Speech characteristics after articulation therapy in children with cleft palate and velopharyngeal dysfunction - A single case experimental design

OBJECTIVE

The aim of this study was to investigate the impact of an intensive 10-week course of articulation therapy on articulation errors in cleft lip and palate patients who have Velopharyngeal Insufficiency (VPI), non-oral and passive cleft speech characteristics.

METHODS

Five children with cleft palate (+/-cleft lip) with VPI and non-oral and passive cleft speech characteristics underwent 40 intensive articulation therapies over 10 weeks in a single case experimental design. The percentage of non-oral CSCs (NCSCs), passive CSCs (PCSCs), stimulable consonants (SC), correct consonants in word imitation (CCI), and correct consonants in picture naming (CCN) were captured at baseline, during intervention and in follow up phases. Visual analysis and two effect size indexes of Percentage of Nonoverlapping Data and Percentage of Improvement Rate Difference were analyzed.

RESULTS

Articulation therapy resulted in visible decrease in NCSCs for all 5 participants across the intervention phases. Intervention was effective in changing percentage of passive CSCs in two different ways; it reduced the PCSCs in three cases and resulted in an increase in PCSCs in the other two cases. This was interpreted as intervention having changed the non-oral CSCs to consonants produced within the oral cavity but with passive characteristics affecting manner of production including weakness, nasalized plosives and nasal realizations of plosives and fricatives. Percent SC increased throughout the intervention period in all five patients. All participants demonstrated an increase in percentage of CCI and CCN suggesting an increase in the consonant inventory. Follow-up data showed that all the subjects were able to maintain their ability to articulate learned phonemes correctly even after a 4-week break from intervention.

CONCLUSION

This single case experimental study supports the hypothesis that speech intervention in patients with VPI can result in an improvement in oral placements and passive CSCs.

Influência do treinamento dos avaliadores no julgamento perceptivo da hipernasalidade

RESUMO Introdução Alto índice de concordância no julgamento perceptivo da hipernasalidade entre diferentes avaliadores é difícil de ser alcançado. O treinamento prévio dos avaliadores e a padronização dos critérios de análise podem ser estratégias eficazes para minimizar o efeito da subjetividade do julgamento perceptivo e aumentar a concordância entre os avaliadores. Objetivo Investigar a influência do treinamento prévio sobre a concordância entre diferentes avaliadores no julgamento perceptivo da hipernasalidade. Métodos Três fonoaudiólogas experientes analisaram 77 amostras de fala, de indivíduos com fissura de palato reparada. Na primeira etapa, as avaliadoras classificaram a hipernasalidade utilizando seus próprios critérios, em uma escala de quatro pontos. Setenta dias depois, foram submetidas a um treinamento para a definição das amostras utilizadas como referências para o julgamento na etapa seguinte. Na segunda etapa as avaliadoras julgaram as mesmas amostras e classificaram a hipernasalidade com a mesma escala, utilizando como critério as referências definidas no treinamento. Índices de concordância intra e interavaliadores foram estabelecidos nas duas etapas utilizando-se o coeficiente Kappa e foram comparados por meio do teste Z. Resultados Os índices de concordância intra-avaliadores obtidos entre as duas etapas variou de 0,38 para 0,92, com diferença estatisticamente significativa para uma das avaliadoras (p=0,004). O índice de concordância quanto ao grau de hipernasalidade obtido entre as três avaliadoras após o treinamento (0,54) foi significativamente maior do que o obtido antes do treinamento (0,37; p=0,044). Conclusão O treinamento das avaliadoras e a definição de critérios para a classificação da hipernasalidade levam ao aumento do índice de concordância intra e interavaliadores.

Multiple phonetically trained-listener comparisons of speech before and after articulatory intervention in two children with repaired submucous cleft palate

Cleft Palate (CP) assessments based on phonetic transcription are the "gold standard" therapy outcome measure, despite reliability difficulties. Here we propose a novel perceptual evaluation, applied to ultrasound-visual biofeedback (U-VBF) therapy and therapy using visual articulatory models (VAMs) for two children with repaired submucous CP. Three comparisons were made: post VAM, post U-VBF and overall pre- and post-therapy. Twenty-two phonetically-trained listeners were asked to determine whether pre- or post-therapy recordings sounded "closer to the English target", using their own implicit phonological knowledge (prompted via orthographic representation). Results are compared with segment-oriented percent target consonant correct (PTCC) derived from phonetic transcriptions. Listener judgements and PTCC suggest that both children made improvements using both VAM and U-VBF. Statistical analysis showed listener agreement in each comparison, though agreement was weak. However, perceptual evaluation offers a straightforward method of evaluating the effectiveness of interventions and can be used by phonetically trained or lay listeners.