Reliability and validity of speech & pause measures during passage reading in ALS

The relationship of rate and pause features to the communicative participation of people living with ALS

INTRODUCTION/AIMS

Many people living with amyotrophic lateral sclerosis (PALS) report restrictions in their day-to-day communication (communicative participation). However, little is known about which speech features contribute to these restrictions. This study evaluated the effects of common speech symptoms in PALS (reduced overall speaking rate, slowed articulation rate, and increased pausing) on communicative participation restrictions.

METHODS

Participants completed surveys (the Communicative Participation Item Bank-short form; the self-entry version of the ALS Functional Rating Scale-Revised) and recorded themselves reading the Bamboo Passage aloud using a smartphone app. Rate and pause measures were extracted from the recordings. The association of various demographic, clinical, self-reported, and acoustic speech features with communicative participation was evaluated with bivariate correlations. The contribution of salient rate and pause measures to communicative participation was assessed using multiple linear regression.

RESULTS

Fifty seven people living with ALS participated in the study (mean age = 61.1 years). Acoustic and self-report measures of speech and bulbar function were moderately to highly associated with communicative participation (Spearman rho coefficients ranged from rs = 0.48 to rs = 0.77). A regression model including participant age, sex, articulation rate, and percent pause time accounted for 57% of the variance of communicative participation ratings.

DISCUSSION

Even though PALS with slowed articulation rate and increased pausing may convey their message clearly, these speech features predict communicative participation restrictions. The identification of quantitative speech features, such as articulation rate and percent pause time, is critical to facilitating early and targeted intervention and for monitoring bulbar decline in ALS.

Effects of SPEAK OUT! & LOUD Crowd on Functional Speech Measures in Parkinson's Disease

PURPOSE

This study investigated the effects of the SPEAK OUT! & LOUD Crowd therapy program on speaking rate, percent pause time, intelligibility, naturalness, and communicative participation in individuals with Parkinson's disease (PD).

METHOD

Six adults with PD completed 12 individual SPEAK OUT! sessions across four consecutive weeks followed by group-based LOUD Crowd sessions for five consecutive weeks. Most therapy sessions were conducted via telehealth, with two participants completing the SPEAK OUT! portion in person. Speech samples were recorded at six time points: three baseline time points prior to SPEAK OUT!, two post-SPEAK OUT! time points, and one post-LOUD Crowd time point. Acoustic measures of speaking rate and percent pause time and listener ratings of speech intelligibility and naturalness were obtained for each time point. Participant self-ratings of communicative participation were also collected at pre- and posttreatment time points.

RESULTS

Results showed significant improvement in communicative participation scores at a group level following completion of the SPEAK OUT! & LOUD Crowd treatment program. Two participants showed a significant decrease in speaking rate and increase in percent pause time following treatment. Changes in intelligibility and naturalness were not statistically significant.

CONCLUSIONS

These findings provide preliminary support for the effectiveness of the SPEAK OUT! & LOUD Crowd treatment program in improving communicative participation for people with mild-to-moderate hypokinetic dysarthria secondary to PD. This study is also the first to demonstrate positive effects of this treatment program for people receiving the therapy via telehealth.

Speech timing and monosyllabic diadochokinesis measures in the assessment of amyotrophic lateral sclerosis in Canadian French

PURPOSE

The primary objective of this study was to determine if speech and pause measures obtained using a passage reading task and timing measures from a monosyllabic diadochokinesis (DDK) task differ across speakers of Canadian French diagnosed with amyotrophic lateral sclerosis (ALS) presenting with and without bulbar symptoms, and healthy controls. The secondary objective was to determine if these measures can reflect the severity of bulbar symptoms.

METHOD

A total of 29 Canadian French speakers with ALS (classified as bulbar symptomatic [n = 14] or pre-symptomatic [n = 15]) and 17 age-matched healthy controls completed a passage reading task and a monosyllabic DDK task (/pa/ and /ta/), for up to three follow-up visits. Measures of speaking rate, total duration, speech duration, and pause events were extracted from the passage reading recordings using a semi-automated speech and pause analysis procedure. Manual analysis of DDK recordings provided measures of DDK rate and variability.

RESULT

Group comparisons revealed significant differences (p = < .05) between the symptomatic group and the pre-symptomatic and control groups for all passage measures and DDK rates. Only the DDK rate in /ta/ differentiated the pre-symptomatic and control groups. Repeated measures correlations revealed moderate correlations (rrm = > 0.40; p = < 0.05) between passage measures of total duration, speaking rate, speech duration, and number of pauses, and ALSFRS-R total and bulbar scores, as well as between DDK rate and ALSFRS-R total score.

CONCLUSION

Speech and pause measures in passage and timing measures in monosyllabic DDK tasks might be suitable for monitoring bulbar functional symptoms in French speakers with ALS, but more work is required to identify which measures are sensitive to the earliest stages of the disease.

The combination of accent method and phonemic contrast: an innovative strategy to improve speech production on post-stroke dysarthria

Introduction

Speech production includes segmental and suprasegmental features, which interact and cooperate with each other. Impaired speech production is common in individuals with post-stroke dysarthria. The commonly used phonemic contrast therapy and Accent Method in clinical practice can improve the segmental and suprasegmental aspects, respectively. This study aimed to explore the feasibility and immediate effectiveness of the combination of specific rhythm patterns of the Accent Method and phonemic contrast on speech production.

Methods

Fifteen poststroke dysarthria patients (12 males and three females) first received accentuation task of three rhythm patterns (Largo-slow, Andante-medium, Allegro-fast) and later received speech task in appropriate rhythm patterns combined with phonemic contrast materials and non-phonemic contrast materials. Speech parameters were analyzed by considering speech clarity and prosody.

Results

The results showed that the number of correct target syllables, sentence clarity, and standard deviation of intensity increased significantly, and the average length of pauses and abnormal pause times decreased significantly in Andante (medium) compared to other rhythms. The number of correct target syllables, sentence clarity, and standard deviation of intensity increased significantly compared with those in the non-phonemic contrast in Andante (medium).

Conclusion

The combination of phonemic contrast and Accent Method was verified to have an immediate effect on speech production in Mandarin speakers with post-stroke dysarthria and could be further validated in other diseases with impaired speech production in the clinic in the future.

Motor Unit Number Index of the Upper Trapezius: A Meta-Analysis and Cross-sectional Study of Its Reliability

Motor unit number index of the upper trapezius (MUNIX-Trapezius) is a candidate biomarker for bulbar lower motor neuron function; however, reliability data is incomplete. To assess MUNIX-Trapezius reliability in controls, we conducted a systematic review, a cross-sectional study (n = 20), and a meta-analysis. We demonstrated a high inter- and intra-rater intraclass correlation (0.86 and 0.94, respectively), indicating that MUNIX-Trapezius is reliable with between-study variability moderated by age and MUNIX technique. With further validation, this measure can serve as a disease monitoring and response biomarker of bulbar function in the therapeutic development for amyotrophic lateral sclerosis.

A deep learning-based telemonitoring application to automatically assess oral diadochokinesis in patients with bulbar amyotrophic lateral sclerosis

BACKGROUND AND OBJECTIVES

Timely identification of dysarthria progression in patients with bulbar-onset amyotrophic lateral sclerosis (ALS) is relevant to have a comprehensive assessment of the disease evolution. To this goal literature recognized the utmost importance of the assessment of the number of syllables uttered by a subject during the oral diadochokinesis (DDK) test.

METHODS

To support clinicians, this work proposes a remote deep learning-based system, which consists (i) of a web application to acquire audio tracks of bulbar-onset ALS patients and healthy control subjects while performing the oral DDK test (i.e., repeating the /pa/, /pa-ta-ka/ and /oo-ee/ syllables) and (ii) a DDK-AID network designed to process the acquired audio signals which have different duration and to output the number of per-task syllables repeated by the subject.

RESULTS

The DDK-AID network overcomes the comparative method achieving a mean Accuracy of 90.23 in counting syllables repeated by the eleven bulbar-onset ALS-patients while performing the oral DDK test.

CONCLUSIONS

The proposed remote monitoring system, in the light of the achieved performance, represents an important step towards the implementation of self-service telemedicine systems which may ensure customised care plans.

Improving Perceptual Speech Ratings: The Effects of Auditory Training on Judgments of Dysarthric Speech

PURPOSE

Auditory training has been shown to reduce rater variability in perceptual voice assessment. Because rater variability is also a central issue in the auditory-perceptual assessment of dysarthria, this study sought to determine if training produces a meaningful change in rater reliability, criterion validity, and scaling magnitude of four features: overall speech impairment, articulatory imprecision, monotony, and slow rate.

METHOD

Forty-four nonexperts randomized to training and nontraining listener groups completed a pretest and posttest. Only the former group underwent auditory training between pre- and posttests. For both testing and training, listeners rated samples from speakers with amyotrophic lateral sclerosis (ALS), speakers with Parkinson's disease (PD), and neurologically healthy control speakers using separate visual analog scales (VASs) for each of the four features. Intraclass correlation coefficients were used to compare inter- and intrarater reliability between pre- and posttest for both listener groups. For criterion validity, severity ratings from the two nonexpert listener groups were compared to those of two experienced listeners for all four features. To determine changes in scaling magnitude, raw VAS scores for each feature were compared from pre- to posttest within the two nonexpert listener groups. Scaling changes were also compared between the two listener groups for the pre- and posttest conditions.

RESULTS AND CONCLUSIONS

In the training group, a meaningful improvement in interrater reliability was observed for some features in all three speaker groups, but not in the nontraining group. In contrast, for intrarater reliability, in the nontraining group, a meaningful improvement was observed for many features in all three speaker groups, but only for PD monotony and slow rate in the training group. All ratings from the nonexpert listeners were valid except for monotony. Raw VAS scores did not meaningfully change from pre- to posttest for any of the features, but there was a trend toward lower scores posttraining, mainly for the ALS samples. Modifications to the auditory training paradigm to further improve reliability and validity, along with future goals for optimizing training, are discussed.

Amyotrophic Lateral Sclerosis-Bulbar Dysfunction Index-Remote: Test-Retest and Interrater Reliability of Candidate Items

PURPOSE

The primary aim of this study was to establish the reliability of candidate items as a step in the development of the Amyotrophic Lateral Sclerosis-Bulbar Dysfunction Index-Remote (ALS-BDI-Remote), a novel tool being developed for the detection and monitoring of bulbar signs and symptoms in remote settings.

METHOD

The set of candidate items included 40 items covering three domains: cranial nerve examination, auditory-perceptual evaluation, and functional assessment. Forty-eight participants diagnosed with ALS and exhibiting a range of bulbar disease severity were included. Data collection for each participant took place on Zoom over three sessions. During Session 1, the participants were instructed to adjust their Zoom settings and to optimize their recording environment (e.g., lighting, background noise). Their cognition and eating were screened to determine their ability to follow instructions and their eligibility to perform the swallowing and chewing tasks. During Session 2, two speech-language pathologists (SLPs) administered the tool consecutively to determine the items' interrater reliability. During Session 3, one of the SLPs readministered the tool within 2 weeks of Session 1 to assess test-retest reliability. The reliability of each item was estimated using weighted kappa and the percentage of agreement. To be considered reliable, the items had to reach a threshold of 0.5 weighted kappa or 80% percentage agreement (if skewed distribution of the scores) for both interrater and test-retest reliability.

RESULTS

In total, 33 of the 40 candidate items reached the reliability cutoff for both reliability analyses. All assessment domains included reliable items. Items requiring very good visualization of structures or movements were generally less reliable.

CONCLUSIONS

This study resulted in the selection of reliable items to be included in the next version of the ALS-BDI-Remote, which will undergo psychometric evaluation (reliability, validity, and responsiveness analyses). Additionally, the results contributed to our understanding of the remote administration of SLP assessments for telehealth applications.

Lexical Characteristics of the Speech Intelligibility Test: Effects on Transcription Intelligibility for Speakers With Multiple Sclerosis and Parkinson's Disease

PURPOSE

Lexical characteristics of speech stimuli can significantly impact intelligibility. However, lexical characteristics of the widely used Speech Intelligibility Test (SIT) are unknown. We aimed to (a) define variation in neighborhood density, word frequency, grammatical word class, and type-token ratio across a large corpus of SIT sentences and tests and (b) determine the relationship of lexical characteristics to speech intelligibility in speakers with multiple sclerosis (MS), Parkinson's disease (PD), and neurologically healthy controls.

METHOD

Using an extant database of 92 speakers (32 controls, 30 speakers with MS, and 30 speakers with PD), percent correct intelligibility scores were obtained for the SIT. Neighborhood density, word frequency, word class, and type-token ratio were calculated and summed for each of the 11 sentences of each SIT test. The distribution of each characteristic across SIT sentences and tests was examined. Linear mixed-effects models were performed to assess the relationship between intelligibility and the lexical characteristics.

RESULTS

There was large variability in the distribution of lexical characteristics across this large corpus of SIT sentences and tests. Modeling revealed a relationship between intelligibility and the lexical characteristics, with word frequency and word class significantly contributing to the model.

CONCLUSIONS

Three primary findings emerged: (a) There was considerable variability in lexical characteristics both within and across the large corpus of SIT tests; (b) there was not a robust association between intelligibility and the lexical characteristics; and (c) findings from a study demonstrating an effect of neighborhood density and word frequency on intelligibility were replicated. Clinical and research implications of the findings are discussed, and three exemplar SIT tests systematically controlling for neighborhood density and word frequency are provided.

Validation of automated pipeline for the assessment of a motor speech disorder in amyotrophic lateral sclerosis (ALS)

Background and objective

Amyotrophic lateral sclerosis (ALS) frequently causes speech impairments, which can be valuable early indicators of decline. Automated acoustic assessment of speech in ALS is attractive, and there is a pressing need to validate such tools in line with best practices, including analytical and clinical validation. We hypothesized that data analysis using a novel speech assessment pipeline would correspond strongly to analyses performed using lab-standard practices and that acoustic features from the novel pipeline would correspond to clinical outcomes of interest in ALS.

Methods

We analyzed data from three standard speech assessment tasks (i.e., vowel phonation, passage reading, and diadochokinesis) in 122 ALS patients. Data were analyzed automatically using a pipeline developed by Winterlight Labs, which yielded 53 acoustic features. First, for analytical validation, data were analyzed using a lab-standard analysis pipeline for comparison. This was followed by univariate analysis (Spearman correlations between individual features in Winterlight and in-lab datasets) and multivariate analysis (sparse canonical correlation analysis (SCCA)). Subsequently, clinical validation was performed. This included univariate analysis (Spearman correlation between automated acoustic features and clinical measures) and multivariate analysis (interpretable autoencoder-based dimensionality reduction).

Results

Analytical validity was demonstrated by substantial univariate correlations (Spearman's ρ > 0.70) between corresponding pairs of features from automated and lab-based datasets, as well as interpretable SCCA feature groups. Clinical validity was supported by strong univariate correlations between automated features and clinical measures (Spearman's ρ > 0.70), as well as associations between multivariate outputs and clinical measures.

Conclusion

This novel, automated speech assessment feature set demonstrates substantial promise as a valid tool for analyzing impaired speech in ALS patients and for the further development of these technologies.

Video-Based Facial Movement Analysis in the Assessment of Bulbar Amyotrophic Lateral Sclerosis: Clinical Validation

PURPOSE

Facial movement analysis during facial gestures and speech provides clinically useful information for assessing bulbar amyotrophic lateral sclerosis (ALS). However, current kinematic methods have limited clinical application due to the equipment costs. Recent advancements in consumer-grade hardware and machine/deep learning made it possible to estimate facial movements from videos. This study aimed to establish the clinical validity of a video-based facial analysis for disease staging classification and estimation of clinical scores.

METHOD

Fifteen individuals with ALS and 11 controls participated in this study. Participants with ALS were stratified into early and late bulbar ALS groups based on their speaking rate. Participants were recorded with a three-dimensional (3D) camera (color + depth) while repeating a simple sentence 10 times. The lips and jaw movements were estimated, and features related to sentence duration and facial movements were used to train a machine learning model for multiclass classification and to predict the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) bulbar subscore and speaking rate.

RESULTS

The classification model successfully separated healthy controls, the early ALS group, and the late ALS group with an overall accuracy of 96.1%. Video-based features demonstrated a high ability to estimate the speaking rate (adjusted R ² = .82) and a moderate ability to predict the ALSFRS-R bulbar subscore (adjusted R ² = .55).

CONCLUSIONS

The proposed approach based on a 3D camera and machine learning algorithms represents an easy-to-use and inexpensive system that can be included as part of a clinical assessment of bulbar ALS to integrate facial movement analysis with other clinical data seamlessly.

The efficacy of acoustic-based articulatory phenotyping for characterizing and classifying four divergent neurodegenerative diseases using sequential motion rates

Despite the impacts of neurodegeneration on speech function, little is known about how to comprehensively characterize the resulting speech abnormalities using a set of objective measures. Quantitative phenotyping of speech motor impairments may have important implications for identifying clinical syndromes and their underlying etiologies, monitoring disease progression over time, and improving treatment efficacy. The goal of this research was to investigate the validity and classification accuracy of comprehensive acoustic-based articulatory phenotypes in speakers with distinct neurodegenerative diseases. Articulatory phenotypes were characterized based on acoustic features that were selected to represent five components of motor performance: Coordination, Consistency, Speed, Precision, and Rate. The phenotypes were first used to characterize the articulatory abnormalities across four progressive neurologic diseases known to have divergent speech motor deficits: amyotrophic lateral sclerosis (ALS), progressive ataxia (PA), Parkinson's disease (PD), and the nonfluent variant of primary progressive aphasia and progressive apraxia of speech (nfPPA + PAOS). We then examined the efficacy of articulatory phenotyping for disease classification. Acoustic analyses were conducted on audio recordings of 217 participants (i.e., 46 ALS, 52 PA, 60 PD, 20 nfPPA + PAOS, and 39 controls) during a sequential speech task. Results revealed evidence of distinct articulatory phenotypes for the four clinical groups and that the phenotypes demonstrated strong classification accuracy for all groups except ALS. Our results highlight the phenotypic variability present across neurodegenerative diseases, which, in turn, may inform (1) the differential diagnosis of neurological diseases and (2) the development of sensitive outcome measures for monitoring disease progression or assessing treatment efficacy.

Rate of speech decline in individuals with amyotrophic lateral sclerosis

Although speech declines rapidly in some individuals with amyotrophic lateral sclerosis (ALS), longitudinal changes in speech have rarely been characterized. The study objectives were to model the rate of decline in speaking rate and speech intelligibility as a function of disease onset site, sex, and age at onset in 166 individuals with ALS; and estimate time to speech loss from symptom onset. We also examined the association between clinical (speaking rate/intelligibility) measures and patient-reported measures of ALS progression (ALSFRS-R). Speech measures declined faster in the bulbar-onset group than in the spinal-onset group. The rate of decline was not significantly affected by sex and age. Functional speech was still maintained at 60 months since disease onset for most patients with spinal onset. However, the time to speech loss was 23 months based on speaking rate < 120 (w/m) and 32 months based on speech intelligibility < 85% in individuals with ALS-bulbar onset. Speech measures were more responsive to functional decline than were the patient-reported measures. The findings of this study will inform future work directed toward improving speech prognosis in ALS, which is critical for determining the appropriate timing of interventions, providing appropriate counseling for patients, and evaluating functional changes during clinical trials.

Minimally Detectable Change of Speech Intelligibility in Speakers With Multiple Sclerosis and Parkinson's Disease

PURPOSE

This study sought to determine the minimally detectable change (MDC) of sentence intelligibility for speakers with multiple sclerosis (MS) and Parkinson's disease (PD).

METHOD

Speakers included 78 participants consisting of 32 neurologically healthy control speakers, 30 speakers with MS, and 16 speakers with PD. All speakers were recorded reading 11 sentences comprising the Speech Intelligibility Test (SIT), which were subsequently transcribed by inexperienced listeners. Percent correct scores were calculated for each sentence. An average percent correct score was also calculated for each speaker. The MDC at the 95% confidence interval was calculated using the following formula: MDC₉₅ = 1.96 × √2 × standard error of measurement. Speakers were divided into operationally defined categories of severity, and MDCs were calculated for each category to permit comparison to MDCs reported for speakers with amyotrophic lateral sclerosis (ALS). Kruskal-Wallis tests were conducted to compare MDCs between groups and severity categories.

RESULTS

The average MDC₉₅ for control speakers was 5.53% (range = 3.21%-7.47%) and was statistically smaller than MDCs for speakers with MS (average = 10.08%, range = 5.30%-15.62%) and those for speakers with PD (average = 10.98%, range = 8.60%-13.98%). Statistical analyses further revealed significant differences between MDCs across severity categories.

CONCLUSIONS

In agreement with previous work in ALS conducted under similar conditions (i.e., orthographic transcription of SIT sentences in a quiet listening environment), the MDC₉₅ of speech intelligibility ranged from 3% to 10% for speakers with MS and PD who have mildly impaired speech. These estimates are a step toward the development of a universal language with which to evaluate speech changes in a variety of patient populations.

Validating Automatic Diadochokinesis Analysis Methods Across Dysarthria Severity and Syllable Task in Amyotrophic Lateral Sclerosis

PURPOSE

Oral diadochokinesis (DDK) is a standard dysarthria assessment task. To extract automatic and semi-automatic DDK measurements, numerous DDK analysis algorithms based on acoustic signal processing are available, including amplitude based, spectral based, and hybrid. However, these algorithms have been predominantly validated in individuals with no perceptible to mild dysarthria. The behavior of these algorithms across dysarthria severity is largely unknown. Likewise, these algorithms have not been tested equally for various syllable types. The goal of this study was to evaluate the performance of five common DDK algorithms as a function of dysarthria severity, considering syllable types.

METHOD

We analyzed 282 DDK recordings of /ba/, /pa/, and /ta/ from 145 participants with amyotrophic lateral sclerosis. Recordings were stratified into mild, moderate, or severe dysarthria groups based on individual performance on the Speech Intelligibility Test. Analysis included manual and automatic estimation of the number of syllables, DDK rate, and cycle-to-cycle temporal variability (cTV). Validation metrics included Bland-Altman mixed-effects limits of agreement between manual and automatic syllable counts, recall and precision between manual and automatic syllable boundary detection, and Kendall's tau-b correlations between manual and algorithm-detected DDK rate and cTV.

RESULTS

The amplitude-based algorithm (absolute energy) yielded the strongest correlations with manual analysis across all severity groups for DDK rate (τ b = 0.7-0.84) and cTV (τ b = 0.7-0.84) and the narrowest limits of agreement (-5.92 to 7.12 syllable difference). Moreover, this algorithm also provided the highest mean recall and precision across severity groups for /ba/ and /pa/, but with significantly more variation for/ta/.

CONCLUSIONS

Algorithms based on signal energy analysis appeared to be the most robust for DDK analysis across dysarthria severity and syllable types; however, it remains prone to error against severe dysarthria and alveolar syllable context. Further development is needed to address this important issue.

Protocol for psychometric evaluation of the Amyotrophic Lateral Sclerosis - Bulbar Dysfunction Index (ALS-BDI): a prospective longitudinal study

INTRODUCTION

Early detection and tracking of bulbar dysfunction in amyotrophic lateral sclerosis (ALS) are critical for directing management of the disease. Current clinical bulbar assessment tools are lacking, while existing physiological instrumental assessments are often inaccessible and cost-prohibitive for clinical application. The goal of our research is to develop and validate a brief and reliable, clinician-administered assessment tool-the ALS-Bulbar Dysfunction Index (ALS-BDI). This publication describes the study protocol that has been established to ascertain the tools' psychometric properties.

METHODS AND ANALYSIS

The ALD-BDI's development closely follows guidelines outlined by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). Through the proposed study protocol, we expect to establish psychometric properties of both individual test items of the ALS-BDI as well as the final version of the entire tool, including test-retest and inter-rater reliability, construct validity using gold-standard assessment methods and responsiveness.

ETHICS AND DISSEMINATION

This study has been reviewed and approved by research ethics boards at two data collection sites: Sunnybrook Health Science Centre, primary (Toronto, Canada; ID3080) and Mass General Brigham (#2013P001746, Boston, USA). Prior to participation in the study, the participants sign the informed consent in accordance with the Declaration of Helsinki. Once validated, the ALS-BDI will be disseminated to key stakeholders. Following validation, the ALS-BDI and any required training material will be implemented for clinical use in a context of a multidisciplinary ALS clinic and used as an outcome measure for clinical trials in ALS research.

"You Say Severe, I Say Mild": Toward an Empirical Classification of Dysarthria Severity

PURPOSE

The main purpose of this study was to create an empirical classification system for speech severity in patients with dysarthria secondary to amyotrophic lateral sclerosis (ALS) by exploring the reliability and validity of speech-language pathologists' (SLPs') ratings of dysarthric speech.

METHOD

Ten SLPs listened to speech samples from 52 speakers with ALS and 20 healthy control speakers. SLPs were asked to rate the speech severity of the speakers using five response options: normal, mild, moderate, severe, and profound. Four severity-surrogate measures were also calculated: SLPs transcribed the speech samples for the calculation of speech intelligibility and rated the effort it took to understand the speakers on a visual analog scale. In addition, speaking rate and intelligible speaking rate were calculated for each speaker. Intrarater and interrater reliability were calculated for each measure. We explored the validity of clinician-based severity ratings by comparing them to the severity-surrogate measures. Receiver operating characteristic (ROC) curves were conducted to create optimal cutoff points for defining dysarthria severity categories.

RESULTS

Intrarater and interrater reliability for the clinician-based severity ratings were excellent and were comparable to reliability for the severity-surrogate measures explored. Clinician severity ratings were strongly associated with all severity-surrogate measures, suggesting strong construct validity. We also provided a range of values for each severity-surrogate measure within each severity category based on the cutoff points obtained from the ROC analyses.

CONCLUSIONS

Clinician severity ratings of dysarthric speech are reliable and valid. We discuss the underlying challenges that arise when selecting a stratification measure and offer recommendations for a classification scheme when stratifying patients and research participants into speech severity categories.

Assessment of dysarthria and dysphagia in patients with amyotrophic lateral sclerosis: Review of the current evidence

Bulbar dysfunction is a common presentation of amyotrophic lateral sclerosis (ALS) and significantly impacts quality of life of people with ALS (PALS). The current paper reviews measurements of dysarthria and dysphagia specific to ALS to identify efficient and valid assessment measures. Using such assessment measures will lead to improved management of bulbar dysfunction in ALS. Measures reviewed for dysarthria in PALS are organized into three categories: acoustic, kinematic, and strength. A set of criteria are used to evaluate the effectiveness of the measures' identification of speech impairments, measurement of functional verbal communication, and clinical applicability. Assessments reviewed for dysphagia in PALS are organized into six categories: patient reported outcomes, dietary intake, pulmonary function and airway defense capacity, bulbar function, dysphagia/aspiration screens, and instrumental evaluations. Measurements that have good potential for clinical use are highlighted in both topic areas. Additionally, areas of improvement for clinical practice and research are identified and discussed. In general, no single speech measure fulfilled all the criteria, although a few measures were identified as potential diagnostic tools. Similarly, few objective measures that were validated and replicated with large sample sizes were found for diagnosis of dysphagia in PALS. Importantly, clinical applicability was found to be limited; thus, a collaborative team focused on implementation science would be helpful to improve the clinical uptake of assessments. Overall, the review highlights the need for further development of clinically viable and efficient measurements that use a multidisciplinary approach.

Two Distinct Clinical Phenotypes of Bulbar Motor Impairment in Amyotrophic Lateral Sclerosis

Objective: Understanding clinical variants of motor neuron diseases such as amyotrophic lateral sclerosis (ALS) is critical for discovering disease mechanisms and across-patient differences in therapeutic response. The current work describes two clinical subgroups of patients with ALS that, despite similar levels of bulbar motor involvement, have disparate clinical and functional speech presentations.

Methods: Participants included 47 healthy control speakers and 126 speakers with ALS. Participants with ALS were stratified into three clinical subgroups (i.e., bulbar asymptomatic, bulbar symptomatic high speech function, and bulbar symptomatic low speech function) based on clinical metrics of bulbar motor impairment. Acoustic and lip kinematic analytics were derived from each participant's recordings of reading samples and a rapid syllable repetition task. Group differences were reported on clinical scales of ALS and bulbar motor severity and on multiple speech measures.

Results: The high and low speech-function subgroups were found to be similar on many of the dependent measures explored. However, these two groups were differentiated on the basis of an acoustic measure used as a proxy for tongue movement.

Conclusion: This study supports the hypothesis that high and low speech-function subgroups do not differ solely in overall severity, but rather, constitute two distinct bulbar motor phenotypes. The findings suggest that the low speech-function group exhibited more global involvement of the bulbar muscles than the high speech-function group that had relatively intact lingual function. This work has implications for clinical measures used to grade bulbar motor involvement, suggesting that a single bulbar measure is inadequate for capturing differences among phenotypes.

Validation of Articulatory Rate and Imprecision Judgments in Speech of Individuals With Amyotrophic Lateral Sclerosis

Purpose Perceptual judgments of articulatory function are commonly used by speech-language pathologists to evaluate articulatory performance in individuals with amyotrophic lateral sclerosis (ALS). The goal of this study was to evaluate the psychometric properties (e.g., reliability, validity) of these perceptual measures to inform their application as part of a comprehensive bulbar assessment tool in ALS. Method Preexisting data from 51 individuals with ALS were obtained from a larger longitudinal study. Five independent raters provided perceptual judgments of articulatory rate and imprecision in a sentence task. Inter- and intrarater reliability of these judgments were assessed. Perceptual ratings were correlated with an acoustic measure of articulatory rate, in syllables per second, obtained from passage-reading recordings. Both perceptual and acoustic measures were correlated with gold-standard kinematic tongue and jaw movement measures, recorded from sentences using electromagnetic articulography. Results The results revealed good inter- and intrarater reliability of perceptual judgments of articulatory function. Strong correlations were observed between perceptual ratings of articulatory rate and imprecision and acoustic measures of articulatory rate and kinematic measures of tongue speed. Conclusions These findings support the clinical application of perceptual judgments of articulatory function as valid and reliable measures of underlying articulatory changes in bulbar ALS. Additional research is needed to understand the responsiveness of these measures to clinical changes in articulatory function in ALS.