Reliability and validity of speech & pause measures during passage reading in ALS

Progress Toward Estimating the Minimal Clinically Important Difference of Intelligibility: A Crowdsourced Perceptual Experiment

PURPOSE

The purpose of the current study was to estimate the minimal clinically important difference (MCID) of sentence intelligibility in control speakers and in speakers with dysarthria due to multiple sclerosis (MS) and Parkinson's disease (PD).

METHOD

Sixteen control speakers, 16 speakers with MS, and 16 speakers with PD were audio-recorded reading aloud sentences in habitual, clear, fast, loud, and slow speaking conditions. Two hundred forty nonexpert crowdsourced listeners heard paired conditions of the same sentence content from a speaker and indicated if one condition was more understandable than another. Listeners then used the Global Ratings of Change (GROC) Scale to indicate how much more understandable that condition was than the other. Listener ratings were compared with objective intelligibility scores obtained previously via orthographic transcriptions from nonexpert listeners. Receiver operating characteristic (ROC) curves and average magnitude of intelligibility difference per level of the GROC Scale were evaluated to determine the sensitivity, specificity, and accuracy of potential cutoff scores in intelligibility for establishing thresholds of important change.

RESULTS

MCIDs derived from the ROC curves were invalid. However, the average magnitude of intelligibility difference derived valid and useful thresholds. The MCID of intelligibility was determined to be about 7% for a small amount of difference and about 15% for a large amount of difference.

CONCLUSIONS

This work demonstrates the feasibility of the novel experimental paradigm for collecting crowdsourced perceptual data to estimate MCIDs. Results provide empirical evidence that clinical tools for the perception of intelligibility by nonexpert listeners could consist of three categories, which emerged from the data ("no difference," "a little bit of difference," "a lot of difference"). The current work is a critical step toward development of a universal language with which to evaluate changes in intelligibility as a result of neurological injury, disease progression, and speech-language therapy.

Speech motor impairment in ALS is associated with multiregional cortical thinning beyond primary motor cortex

Introduction

Cortical thinning is well-documented in individuals with amyotrophic lateral sclerosis (ALS), yet its association with speech deterioration remains understudied. This study characterizes anatomical changes in the brain within the context of speech impairment patterns in individuals with ALS, providing insight into the disease's multiregional spread and biology.

Methods

To evaluate patterns of cortical thickness in speakers with ALS with and without functional speech changes compared to healthy controls (HCs) using whole-brain and region of interest (ROI) analyses. Forty individuals with ALS and 22 HCs underwent a T1-weighted 3-Tesla magnetic resonance imaging (MRI). Individuals with ALS were divided into two groups based on the preserved speech [ps-ALS] (n = 18) or deteriorated speech [ds-ALS] (n = 22) as measured by the ALSFRSF-R speech subscore (=4 or <4 points, respectively). Sixteen a priori-defined and automatically segmented cortical and subcortical brain ROIs were selected based on their previously documented roles in speech production. Two cortical thickness analyses were performed: (1) group-level whole-brain surface-based analyses and (2) group-level ROI analyses. A case study of 6 ALS individuals examined the cortical thickness, and their speech was characterized using quantitative and qualitative measures.

Results

Based on the group-level whole-brain surface-based analyses, the ds-ALS group demonstrated significant cortical thinning compared to HCs in the left primary motor and somatosensory cortices and the right inferior parietal lobe with its adjacent lateral occipital cortical regions. The ps-ALS group demonstrated no significant cortical thinning compared to HCs. Based on the group-level ROI analyses, the ds-ALS group demonstrated significant cortical thinning compared to HCs in bilateral middle motor cortices, right posterior dorsal premotor cortex, and left anterior cingulate cortex. The case study analysis revealed that ALS speakers with speech features characteristic of spastic dysarthria exhibited cortical thinning, while those with speech features characteristic of flaccid dysarthria did not.

Discussion

Individuals with ALS have anatomical changes involving multiregional neocortical areas beyond the primary motor cortex that may manifest as subjective (i.e., clinical judgment) and objective (i.e., speaking rate) changes in speech production. Further longitudinal work in ALS is needed to better understand the link between MRI cortical thickness changes and bulbar dysfunction.

Access for ALL in ALS: A large-scale, inclusive, collaborative consortium to unlock the molecular and genetic mechanisms of amyotrophic lateral sclerosis

Recent progress in therapeutics for amyotrophic lateral sclerosis (ALS) has spurred development and imbued the field of ALS with hope for more breakthroughs, yet substantial scientific gaps persist. This unmet need remains a stark reminder that innovative paradigms are needed to invigorate ALS research. To move toward more informative, targeted, and personalized drug development, the National Institutes of Health (NIH) established a national ALS clinical research consortium called Access for ALL in ALS (ALL ALS). This new consortium is a multi-institutional effort that aims to organize the ALS clinical research landscape in the United States. ALL ALS is operating in partnership with several stakeholders to operationalize the recommendations of the Accelerating Access to Critical Therapies for ALS Act (ACT for ALS) Public Private Partnership. ALL ALS will provide a large-scale, centralized, and readily accessible infrastructure for the collection and storage of a wide range of data from people living with ALS (symptomatic cohort) or who may be at risk of developing ALS (asymptomatic ALS gene carriers). Importantly, ALL ALS is designed to encourage community engagement, equity, and inclusion. The consortium is prioritizing the enrollment of geographically, ethnoculturally, and socioeconomically diverse participants. Collected data include longitudinal clinical data and biofluids, genomic, and digital biomarkers that will be harmonized and linked to the central Accelerating Medicines Partnership for ALS (AMP ALS) portal for sharing with the research community. The aim of ALL ALS is to deliver a comprehensive, inclusive, open-science dataset to help researchers answer important scientific questions of clinical relevance in ALS.

Multimodal speech biomarkers for remote monitoring of ALS disease progression

Amyotrophic lateral sclerosis (ALS) is a progressive neurodegenerative disease that severely impacts affected persons' speech and motor functions, yet early detection and tracking of disease progression remain challenging. The current gold standard for monitoring ALS progression, the ALS functional rating scale - revised (ALSFRS-R), is based on subjective ratings of symptom severity, and may not capture subtle but clinically meaningful changes due to a lack of granularity. Multimodal speech measures which can be automatically collected from patients in a remote fashion allow us to bridge this gap because they are continuous-valued and therefore, potentially more granular at capturing disease progression. Here we investigate the responsiveness and sensitivity of multimodal speech measures in persons with ALS (pALS) collected via a remote patient monitoring platform in an effort to quantify how long it takes to detect a clinically-meaningful change associated with disease progression. We recorded audio and video from 278 participants and automatically extracted multimodal speech biomarkers (acoustic, orofacial, linguistic) from the data. We find that the timing alignment of pALS speech relative to a canonical elicitation of the same prompt and the number of words used to describe a picture are the most responsive measures at detecting such change in both pALS with bulbar (n = 36) and non-bulbar onset (n = 107). Interestingly, the responsiveness of these measures is stable even at small sample sizes. We further found that certain speech measures are sensitive enough to track bulbar decline even when there is no patient-reported clinical change, i.e. the ALSFRS-R speech score remains unchanged at 3 out of a total possible score of 4. The findings of this study have the potential to facilitate improved, accelerated and cost-effective clinical trials and care.

The relationship of rate and pause features to the communicative participation of people living with ALS

INTRODUCTION/AIMS

Many people living with amyotrophic lateral sclerosis (PALS) report restrictions in their day-to-day communication (communicative participation). However, little is known about which speech features contribute to these restrictions. This study evaluated the effects of common speech symptoms in PALS (reduced overall speaking rate, slowed articulation rate, and increased pausing) on communicative participation restrictions.

METHODS

Participants completed surveys (the Communicative Participation Item Bank-short form; the self-entry version of the ALS Functional Rating Scale-Revised) and recorded themselves reading the Bamboo Passage aloud using a smartphone app. Rate and pause measures were extracted from the recordings. The association of various demographic, clinical, self-reported, and acoustic speech features with communicative participation was evaluated with bivariate correlations. The contribution of salient rate and pause measures to communicative participation was assessed using multiple linear regression.

RESULTS

Fifty seven people living with ALS participated in the study (mean age = 61.1 years). Acoustic and self-report measures of speech and bulbar function were moderately to highly associated with communicative participation (Spearman rho coefficients ranged from rs = 0.48 to rs = 0.77). A regression model including participant age, sex, articulation rate, and percent pause time accounted for 57% of the variance of communicative participation ratings.

DISCUSSION

Even though PALS with slowed articulation rate and increased pausing may convey their message clearly, these speech features predict communicative participation restrictions. The identification of quantitative speech features, such as articulation rate and percent pause time, is critical to facilitating early and targeted intervention and for monitoring bulbar decline in ALS.

Injection Laryngoplasty of Unilateral Vocal Fold Paralysis Evaluated With Pause and Speech Measurements

OBJECTIVE

The purpose of this study was to examine a number of pause-and-speech-measurements in patients with unilateral vocal fold paralysis, before and after injection laryngoplasty. The non-invasive measurements were selected to investigate and explain the treatment effect on connected speech in these patients.

STUDY DESIGN

Retrospective study with repeated measurements design.

METHOD

Voice recordings of 24 patients with unilateral vocal fold paralysis from before and after injection laryngoplasty in local anesthesia were analyzed retrospectively with the computer program Praat. Measurements examined were number of pauses, average pause duration, pause ratio (expressing the amount of pausing during a reading-aloud task), number of breath groups, average duration of breath groups, articulation rate, speaking rate, maximum phonation time, and Voice Handicap Index.

RESULTS

Injection laryngoplasty had a significant improving effect on the number of pauses, pause ratio, number of breath groups, average duration of breath groups, articulation rate, speaking rate, maximum phonation time, and Voice Handicap Index. Maximum phonation time before treatment correlated with several pause and speech measurements.

CONCLUSION

The results showed that treatment with injection laryngoplasty had a clear effect on several pause and speech measurements and that these measurements correlated with maximum phonation time, but not with Voice Handicap Index.

Effects of SPEAK OUT! & LOUD Crowd on Functional Speech Measures in Parkinson's Disease

PURPOSE

This study investigated the effects of the SPEAK OUT! & LOUD Crowd therapy program on speaking rate, percent pause time, intelligibility, naturalness, and communicative participation in individuals with Parkinson's disease (PD).

METHOD

Six adults with PD completed 12 individual SPEAK OUT! sessions across four consecutive weeks followed by group-based LOUD Crowd sessions for five consecutive weeks. Most therapy sessions were conducted via telehealth, with two participants completing the SPEAK OUT! portion in person. Speech samples were recorded at six time points: three baseline time points prior to SPEAK OUT!, two post-SPEAK OUT! time points, and one post-LOUD Crowd time point. Acoustic measures of speaking rate and percent pause time and listener ratings of speech intelligibility and naturalness were obtained for each time point. Participant self-ratings of communicative participation were also collected at pre- and posttreatment time points.

RESULTS

Results showed significant improvement in communicative participation scores at a group level following completion of the SPEAK OUT! & LOUD Crowd treatment program. Two participants showed a significant decrease in speaking rate and increase in percent pause time following treatment. Changes in intelligibility and naturalness were not statistically significant.

CONCLUSIONS

These findings provide preliminary support for the effectiveness of the SPEAK OUT! & LOUD Crowd treatment program in improving communicative participation for people with mild-to-moderate hypokinetic dysarthria secondary to PD. This study is also the first to demonstrate positive effects of this treatment program for people receiving the therapy via telehealth.

Multimodal Speech Biomarkers for Remote Monitoring of ALS Disease Progression

Amyotrophic lateral sclerosis (ALS) is a progressive neurodegenerative disease that severely impacts affected persons' speech and motor functions, yet early detection and tracking of disease progression remain challenging. The current gold standard for monitoring ALS progression, the ALS functional rating scale - revised (ALSFRS-R), is based on subjective ratings of symptom severity, and may not capture subtle but clinically meaningful changes due to a lack of granularity. Multimodal speech measures which can be automatically collected from patients in a remote fashion allow us to bridge this gap because they are continuous-valued and therefore, potentially more granular at capturing disease progression. Here we investigate the responsiveness and sensitivity of multimodal speech measures in persons with ALS (pALS) collected via a remote patient monitoring platform in an effort to quantify how long it takes to detect a clinically-meaningful change associated with disease progression. We recorded audio and video from 278 participants and automatically extracted multimodal speech biomarkers (acoustic, orofacial, linguistic) from the data. We find that the timing alignment of pALS speech relative to a canonical elicitation of the same prompt and the number of words used to describe a picture are the most responsive measures at detecting such change in both pALS with bulbar (n = 36) and non-bulbar onset (n = 107). Interestingly, the responsiveness of these measures is stable even at small sample sizes. We further found that certain speech measures are sensitive enough to track bulbar decline even when there is no patient-reported clinical change, i.e. the ALSFRS-R speech score remains unchanged at 3 out of a total possible score of 4. The findings of this study have the potential to facilitate improved, accelerated and cost-effective clinical trials and care.

Speech timing and monosyllabic diadochokinesis measures in the assessment of amyotrophic lateral sclerosis in Canadian French

PURPOSE

The primary objective of this study was to determine if speech and pause measures obtained using a passage reading task and timing measures from a monosyllabic diadochokinesis (DDK) task differ across speakers of Canadian French diagnosed with amyotrophic lateral sclerosis (ALS) presenting with and without bulbar symptoms, and healthy controls. The secondary objective was to determine if these measures can reflect the severity of bulbar symptoms.

METHOD

A total of 29 Canadian French speakers with ALS (classified as bulbar symptomatic [n = 14] or pre-symptomatic [n = 15]) and 17 age-matched healthy controls completed a passage reading task and a monosyllabic DDK task (/pa/ and /ta/), for up to three follow-up visits. Measures of speaking rate, total duration, speech duration, and pause events were extracted from the passage reading recordings using a semi-automated speech and pause analysis procedure. Manual analysis of DDK recordings provided measures of DDK rate and variability.

RESULT

Group comparisons revealed significant differences (p = < .05) between the symptomatic group and the pre-symptomatic and control groups for all passage measures and DDK rates. Only the DDK rate in /ta/ differentiated the pre-symptomatic and control groups. Repeated measures correlations revealed moderate correlations (rrm = > 0.40; p = < 0.05) between passage measures of total duration, speaking rate, speech duration, and number of pauses, and ALSFRS-R total and bulbar scores, as well as between DDK rate and ALSFRS-R total score.

CONCLUSION

Speech and pause measures in passage and timing measures in monosyllabic DDK tasks might be suitable for monitoring bulbar functional symptoms in French speakers with ALS, but more work is required to identify which measures are sensitive to the earliest stages of the disease.

The combination of accent method and phonemic contrast: an innovative strategy to improve speech production on post-stroke dysarthria

Introduction

Speech production includes segmental and suprasegmental features, which interact and cooperate with each other. Impaired speech production is common in individuals with post-stroke dysarthria. The commonly used phonemic contrast therapy and Accent Method in clinical practice can improve the segmental and suprasegmental aspects, respectively. This study aimed to explore the feasibility and immediate effectiveness of the combination of specific rhythm patterns of the Accent Method and phonemic contrast on speech production.

Methods

Fifteen poststroke dysarthria patients (12 males and three females) first received accentuation task of three rhythm patterns (Largo-slow, Andante-medium, Allegro-fast) and later received speech task in appropriate rhythm patterns combined with phonemic contrast materials and non-phonemic contrast materials. Speech parameters were analyzed by considering speech clarity and prosody.

Results

The results showed that the number of correct target syllables, sentence clarity, and standard deviation of intensity increased significantly, and the average length of pauses and abnormal pause times decreased significantly in Andante (medium) compared to other rhythms. The number of correct target syllables, sentence clarity, and standard deviation of intensity increased significantly compared with those in the non-phonemic contrast in Andante (medium).

Conclusion

The combination of phonemic contrast and Accent Method was verified to have an immediate effect on speech production in Mandarin speakers with post-stroke dysarthria and could be further validated in other diseases with impaired speech production in the clinic in the future.

Motor Unit Number Index of the Upper Trapezius: A Meta-Analysis and Cross-sectional Study of Its Reliability

Motor unit number index of the upper trapezius (MUNIX-Trapezius) is a candidate biomarker for bulbar lower motor neuron function; however, reliability data is incomplete. To assess MUNIX-Trapezius reliability in controls, we conducted a systematic review, a cross-sectional study (n = 20), and a meta-analysis. We demonstrated a high inter- and intra-rater intraclass correlation (0.86 and 0.94, respectively), indicating that MUNIX-Trapezius is reliable with between-study variability moderated by age and MUNIX technique. With further validation, this measure can serve as a disease monitoring and response biomarker of bulbar function in the therapeutic development for amyotrophic lateral sclerosis.

A deep learning-based telemonitoring application to automatically assess oral diadochokinesis in patients with bulbar amyotrophic lateral sclerosis

BACKGROUND AND OBJECTIVES

Timely identification of dysarthria progression in patients with bulbar-onset amyotrophic lateral sclerosis (ALS) is relevant to have a comprehensive assessment of the disease evolution. To this goal literature recognized the utmost importance of the assessment of the number of syllables uttered by a subject during the oral diadochokinesis (DDK) test.

METHODS

To support clinicians, this work proposes a remote deep learning-based system, which consists (i) of a web application to acquire audio tracks of bulbar-onset ALS patients and healthy control subjects while performing the oral DDK test (i.e., repeating the /pa/, /pa-ta-ka/ and /oo-ee/ syllables) and (ii) a DDK-AID network designed to process the acquired audio signals which have different duration and to output the number of per-task syllables repeated by the subject.

RESULTS

The DDK-AID network overcomes the comparative method achieving a mean Accuracy of 90.23 in counting syllables repeated by the eleven bulbar-onset ALS-patients while performing the oral DDK test.

CONCLUSIONS

The proposed remote monitoring system, in the light of the achieved performance, represents an important step towards the implementation of self-service telemedicine systems which may ensure customised care plans.

Improving Perceptual Speech Ratings: The Effects of Auditory Training on Judgments of Dysarthric Speech

PURPOSE

Auditory training has been shown to reduce rater variability in perceptual voice assessment. Because rater variability is also a central issue in the auditory-perceptual assessment of dysarthria, this study sought to determine if training produces a meaningful change in rater reliability, criterion validity, and scaling magnitude of four features: overall speech impairment, articulatory imprecision, monotony, and slow rate.

METHOD

Forty-four nonexperts randomized to training and nontraining listener groups completed a pretest and posttest. Only the former group underwent auditory training between pre- and posttests. For both testing and training, listeners rated samples from speakers with amyotrophic lateral sclerosis (ALS), speakers with Parkinson's disease (PD), and neurologically healthy control speakers using separate visual analog scales (VASs) for each of the four features. Intraclass correlation coefficients were used to compare inter- and intrarater reliability between pre- and posttest for both listener groups. For criterion validity, severity ratings from the two nonexpert listener groups were compared to those of two experienced listeners for all four features. To determine changes in scaling magnitude, raw VAS scores for each feature were compared from pre- to posttest within the two nonexpert listener groups. Scaling changes were also compared between the two listener groups for the pre- and posttest conditions.

RESULTS AND CONCLUSIONS

In the training group, a meaningful improvement in interrater reliability was observed for some features in all three speaker groups, but not in the nontraining group. In contrast, for intrarater reliability, in the nontraining group, a meaningful improvement was observed for many features in all three speaker groups, but only for PD monotony and slow rate in the training group. All ratings from the nonexpert listeners were valid except for monotony. Raw VAS scores did not meaningfully change from pre- to posttest for any of the features, but there was a trend toward lower scores posttraining, mainly for the ALS samples. Modifications to the auditory training paradigm to further improve reliability and validity, along with future goals for optimizing training, are discussed.

Amyotrophic Lateral Sclerosis-Bulbar Dysfunction Index-Remote: Test-Retest and Interrater Reliability of Candidate Items

PURPOSE

The primary aim of this study was to establish the reliability of candidate items as a step in the development of the Amyotrophic Lateral Sclerosis-Bulbar Dysfunction Index-Remote (ALS-BDI-Remote), a novel tool being developed for the detection and monitoring of bulbar signs and symptoms in remote settings.

METHOD

The set of candidate items included 40 items covering three domains: cranial nerve examination, auditory-perceptual evaluation, and functional assessment. Forty-eight participants diagnosed with ALS and exhibiting a range of bulbar disease severity were included. Data collection for each participant took place on Zoom over three sessions. During Session 1, the participants were instructed to adjust their Zoom settings and to optimize their recording environment (e.g., lighting, background noise). Their cognition and eating were screened to determine their ability to follow instructions and their eligibility to perform the swallowing and chewing tasks. During Session 2, two speech-language pathologists (SLPs) administered the tool consecutively to determine the items' interrater reliability. During Session 3, one of the SLPs readministered the tool within 2 weeks of Session 1 to assess test-retest reliability. The reliability of each item was estimated using weighted kappa and the percentage of agreement. To be considered reliable, the items had to reach a threshold of 0.5 weighted kappa or 80% percentage agreement (if skewed distribution of the scores) for both interrater and test-retest reliability.

RESULTS

In total, 33 of the 40 candidate items reached the reliability cutoff for both reliability analyses. All assessment domains included reliable items. Items requiring very good visualization of structures or movements were generally less reliable.

CONCLUSIONS

This study resulted in the selection of reliable items to be included in the next version of the ALS-BDI-Remote, which will undergo psychometric evaluation (reliability, validity, and responsiveness analyses). Additionally, the results contributed to our understanding of the remote administration of SLP assessments for telehealth applications.

Lexical Characteristics of the Speech Intelligibility Test: Effects on Transcription Intelligibility for Speakers With Multiple Sclerosis and Parkinson's Disease

PURPOSE

Lexical characteristics of speech stimuli can significantly impact intelligibility. However, lexical characteristics of the widely used Speech Intelligibility Test (SIT) are unknown. We aimed to (a) define variation in neighborhood density, word frequency, grammatical word class, and type-token ratio across a large corpus of SIT sentences and tests and (b) determine the relationship of lexical characteristics to speech intelligibility in speakers with multiple sclerosis (MS), Parkinson's disease (PD), and neurologically healthy controls.

METHOD

Using an extant database of 92 speakers (32 controls, 30 speakers with MS, and 30 speakers with PD), percent correct intelligibility scores were obtained for the SIT. Neighborhood density, word frequency, word class, and type-token ratio were calculated and summed for each of the 11 sentences of each SIT test. The distribution of each characteristic across SIT sentences and tests was examined. Linear mixed-effects models were performed to assess the relationship between intelligibility and the lexical characteristics.

RESULTS

There was large variability in the distribution of lexical characteristics across this large corpus of SIT sentences and tests. Modeling revealed a relationship between intelligibility and the lexical characteristics, with word frequency and word class significantly contributing to the model.

CONCLUSIONS

Three primary findings emerged: (a) There was considerable variability in lexical characteristics both within and across the large corpus of SIT tests; (b) there was not a robust association between intelligibility and the lexical characteristics; and (c) findings from a study demonstrating an effect of neighborhood density and word frequency on intelligibility were replicated. Clinical and research implications of the findings are discussed, and three exemplar SIT tests systematically controlling for neighborhood density and word frequency are provided.

Responsiveness, Sensitivity and Clinical Utility of Timing-Related Speech Biomarkers for Remote Monitoring of ALS Disease Progression

In this study, we describe the responsiveness of timing-related measures extracted from read speech in persons with ALS (pALS) collected via a remote patient monitoring platform in an effort to quantify how long it takes to detect a clinically-meaningful change associated with disease progression. We found that the timing alignment of pALS speech relative to a canonical elicitation of the same prompt is the most responsive measure, of the ones considered in this study, at detecting such change in both pALS with bulbar (n = 35) and non-bulbar onset (n = 94). We further evaluated the sensitivity of speech metrics in tracking disease progression in pALS while their ALSFRS-R speech score remained unchanged at 3 out of a total possible score of 4. We observed that timing-related speech metrics showed significant longitudinal changes even after accounting for learning effects. The findings of this study have the potential to inform disease prognosis and functional outcomes of clinical trials.

Validation of automated pipeline for the assessment of a motor speech disorder in amyotrophic lateral sclerosis (ALS)

Background and objective

Amyotrophic lateral sclerosis (ALS) frequently causes speech impairments, which can be valuable early indicators of decline. Automated acoustic assessment of speech in ALS is attractive, and there is a pressing need to validate such tools in line with best practices, including analytical and clinical validation. We hypothesized that data analysis using a novel speech assessment pipeline would correspond strongly to analyses performed using lab-standard practices and that acoustic features from the novel pipeline would correspond to clinical outcomes of interest in ALS.

Methods

We analyzed data from three standard speech assessment tasks (i.e., vowel phonation, passage reading, and diadochokinesis) in 122 ALS patients. Data were analyzed automatically using a pipeline developed by Winterlight Labs, which yielded 53 acoustic features. First, for analytical validation, data were analyzed using a lab-standard analysis pipeline for comparison. This was followed by univariate analysis (Spearman correlations between individual features in Winterlight and in-lab datasets) and multivariate analysis (sparse canonical correlation analysis (SCCA)). Subsequently, clinical validation was performed. This included univariate analysis (Spearman correlation between automated acoustic features and clinical measures) and multivariate analysis (interpretable autoencoder-based dimensionality reduction).

Results

Analytical validity was demonstrated by substantial univariate correlations (Spearman's ρ > 0.70) between corresponding pairs of features from automated and lab-based datasets, as well as interpretable SCCA feature groups. Clinical validity was supported by strong univariate correlations between automated features and clinical measures (Spearman's ρ > 0.70), as well as associations between multivariate outputs and clinical measures.

Conclusion

This novel, automated speech assessment feature set demonstrates substantial promise as a valid tool for analyzing impaired speech in ALS patients and for the further development of these technologies.

Video-Based Facial Movement Analysis in the Assessment of Bulbar Amyotrophic Lateral Sclerosis: Clinical Validation

PURPOSE

Facial movement analysis during facial gestures and speech provides clinically useful information for assessing bulbar amyotrophic lateral sclerosis (ALS). However, current kinematic methods have limited clinical application due to the equipment costs. Recent advancements in consumer-grade hardware and machine/deep learning made it possible to estimate facial movements from videos. This study aimed to establish the clinical validity of a video-based facial analysis for disease staging classification and estimation of clinical scores.

METHOD

Fifteen individuals with ALS and 11 controls participated in this study. Participants with ALS were stratified into early and late bulbar ALS groups based on their speaking rate. Participants were recorded with a three-dimensional (3D) camera (color + depth) while repeating a simple sentence 10 times. The lips and jaw movements were estimated, and features related to sentence duration and facial movements were used to train a machine learning model for multiclass classification and to predict the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) bulbar subscore and speaking rate.

RESULTS

The classification model successfully separated healthy controls, the early ALS group, and the late ALS group with an overall accuracy of 96.1%. Video-based features demonstrated a high ability to estimate the speaking rate (adjusted R ² = .82) and a moderate ability to predict the ALSFRS-R bulbar subscore (adjusted R ² = .55).

CONCLUSIONS

The proposed approach based on a 3D camera and machine learning algorithms represents an easy-to-use and inexpensive system that can be included as part of a clinical assessment of bulbar ALS to integrate facial movement analysis with other clinical data seamlessly.

The efficacy of acoustic-based articulatory phenotyping for characterizing and classifying four divergent neurodegenerative diseases using sequential motion rates

Despite the impacts of neurodegeneration on speech function, little is known about how to comprehensively characterize the resulting speech abnormalities using a set of objective measures. Quantitative phenotyping of speech motor impairments may have important implications for identifying clinical syndromes and their underlying etiologies, monitoring disease progression over time, and improving treatment efficacy. The goal of this research was to investigate the validity and classification accuracy of comprehensive acoustic-based articulatory phenotypes in speakers with distinct neurodegenerative diseases. Articulatory phenotypes were characterized based on acoustic features that were selected to represent five components of motor performance: Coordination, Consistency, Speed, Precision, and Rate. The phenotypes were first used to characterize the articulatory abnormalities across four progressive neurologic diseases known to have divergent speech motor deficits: amyotrophic lateral sclerosis (ALS), progressive ataxia (PA), Parkinson's disease (PD), and the nonfluent variant of primary progressive aphasia and progressive apraxia of speech (nfPPA + PAOS). We then examined the efficacy of articulatory phenotyping for disease classification. Acoustic analyses were conducted on audio recordings of 217 participants (i.e., 46 ALS, 52 PA, 60 PD, 20 nfPPA + PAOS, and 39 controls) during a sequential speech task. Results revealed evidence of distinct articulatory phenotypes for the four clinical groups and that the phenotypes demonstrated strong classification accuracy for all groups except ALS. Our results highlight the phenotypic variability present across neurodegenerative diseases, which, in turn, may inform (1) the differential diagnosis of neurological diseases and (2) the development of sensitive outcome measures for monitoring disease progression or assessing treatment efficacy.

Rate of speech decline in individuals with amyotrophic lateral sclerosis

Although speech declines rapidly in some individuals with amyotrophic lateral sclerosis (ALS), longitudinal changes in speech have rarely been characterized. The study objectives were to model the rate of decline in speaking rate and speech intelligibility as a function of disease onset site, sex, and age at onset in 166 individuals with ALS; and estimate time to speech loss from symptom onset. We also examined the association between clinical (speaking rate/intelligibility) measures and patient-reported measures of ALS progression (ALSFRS-R). Speech measures declined faster in the bulbar-onset group than in the spinal-onset group. The rate of decline was not significantly affected by sex and age. Functional speech was still maintained at 60 months since disease onset for most patients with spinal onset. However, the time to speech loss was 23 months based on speaking rate < 120 (w/m) and 32 months based on speech intelligibility < 85% in individuals with ALS-bulbar onset. Speech measures were more responsive to functional decline than were the patient-reported measures. The findings of this study will inform future work directed toward improving speech prognosis in ALS, which is critical for determining the appropriate timing of interventions, providing appropriate counseling for patients, and evaluating functional changes during clinical trials.

Minimally Detectable Change of Speech Intelligibility in Speakers With Multiple Sclerosis and Parkinson's Disease

PURPOSE

This study sought to determine the minimally detectable change (MDC) of sentence intelligibility for speakers with multiple sclerosis (MS) and Parkinson's disease (PD).

METHOD

Speakers included 78 participants consisting of 32 neurologically healthy control speakers, 30 speakers with MS, and 16 speakers with PD. All speakers were recorded reading 11 sentences comprising the Speech Intelligibility Test (SIT), which were subsequently transcribed by inexperienced listeners. Percent correct scores were calculated for each sentence. An average percent correct score was also calculated for each speaker. The MDC at the 95% confidence interval was calculated using the following formula: MDC₉₅ = 1.96 × √2 × standard error of measurement. Speakers were divided into operationally defined categories of severity, and MDCs were calculated for each category to permit comparison to MDCs reported for speakers with amyotrophic lateral sclerosis (ALS). Kruskal-Wallis tests were conducted to compare MDCs between groups and severity categories.

RESULTS

The average MDC₉₅ for control speakers was 5.53% (range = 3.21%-7.47%) and was statistically smaller than MDCs for speakers with MS (average = 10.08%, range = 5.30%-15.62%) and those for speakers with PD (average = 10.98%, range = 8.60%-13.98%). Statistical analyses further revealed significant differences between MDCs across severity categories.

CONCLUSIONS

In agreement with previous work in ALS conducted under similar conditions (i.e., orthographic transcription of SIT sentences in a quiet listening environment), the MDC₉₅ of speech intelligibility ranged from 3% to 10% for speakers with MS and PD who have mildly impaired speech. These estimates are a step toward the development of a universal language with which to evaluate speech changes in a variety of patient populations.

Validating Automatic Diadochokinesis Analysis Methods Across Dysarthria Severity and Syllable Task in Amyotrophic Lateral Sclerosis

PURPOSE

Oral diadochokinesis (DDK) is a standard dysarthria assessment task. To extract automatic and semi-automatic DDK measurements, numerous DDK analysis algorithms based on acoustic signal processing are available, including amplitude based, spectral based, and hybrid. However, these algorithms have been predominantly validated in individuals with no perceptible to mild dysarthria. The behavior of these algorithms across dysarthria severity is largely unknown. Likewise, these algorithms have not been tested equally for various syllable types. The goal of this study was to evaluate the performance of five common DDK algorithms as a function of dysarthria severity, considering syllable types.

METHOD

We analyzed 282 DDK recordings of /ba/, /pa/, and /ta/ from 145 participants with amyotrophic lateral sclerosis. Recordings were stratified into mild, moderate, or severe dysarthria groups based on individual performance on the Speech Intelligibility Test. Analysis included manual and automatic estimation of the number of syllables, DDK rate, and cycle-to-cycle temporal variability (cTV). Validation metrics included Bland-Altman mixed-effects limits of agreement between manual and automatic syllable counts, recall and precision between manual and automatic syllable boundary detection, and Kendall's tau-b correlations between manual and algorithm-detected DDK rate and cTV.

RESULTS

The amplitude-based algorithm (absolute energy) yielded the strongest correlations with manual analysis across all severity groups for DDK rate (τ b = 0.7-0.84) and cTV (τ b = 0.7-0.84) and the narrowest limits of agreement (-5.92 to 7.12 syllable difference). Moreover, this algorithm also provided the highest mean recall and precision across severity groups for /ba/ and /pa/, but with significantly more variation for/ta/.

CONCLUSIONS

Algorithms based on signal energy analysis appeared to be the most robust for DDK analysis across dysarthria severity and syllable types; however, it remains prone to error against severe dysarthria and alveolar syllable context. Further development is needed to address this important issue.

Protocol for psychometric evaluation of the Amyotrophic Lateral Sclerosis - Bulbar Dysfunction Index (ALS-BDI): a prospective longitudinal study

INTRODUCTION

Early detection and tracking of bulbar dysfunction in amyotrophic lateral sclerosis (ALS) are critical for directing management of the disease. Current clinical bulbar assessment tools are lacking, while existing physiological instrumental assessments are often inaccessible and cost-prohibitive for clinical application. The goal of our research is to develop and validate a brief and reliable, clinician-administered assessment tool-the ALS-Bulbar Dysfunction Index (ALS-BDI). This publication describes the study protocol that has been established to ascertain the tools' psychometric properties.

METHODS AND ANALYSIS

The ALD-BDI's development closely follows guidelines outlined by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). Through the proposed study protocol, we expect to establish psychometric properties of both individual test items of the ALS-BDI as well as the final version of the entire tool, including test-retest and inter-rater reliability, construct validity using gold-standard assessment methods and responsiveness.

ETHICS AND DISSEMINATION

This study has been reviewed and approved by research ethics boards at two data collection sites: Sunnybrook Health Science Centre, primary (Toronto, Canada; ID3080) and Mass General Brigham (#2013P001746, Boston, USA). Prior to participation in the study, the participants sign the informed consent in accordance with the Declaration of Helsinki. Once validated, the ALS-BDI will be disseminated to key stakeholders. Following validation, the ALS-BDI and any required training material will be implemented for clinical use in a context of a multidisciplinary ALS clinic and used as an outcome measure for clinical trials in ALS research.

"You Say Severe, I Say Mild": Toward an Empirical Classification of Dysarthria Severity

PURPOSE

The main purpose of this study was to create an empirical classification system for speech severity in patients with dysarthria secondary to amyotrophic lateral sclerosis (ALS) by exploring the reliability and validity of speech-language pathologists' (SLPs') ratings of dysarthric speech.

METHOD

Ten SLPs listened to speech samples from 52 speakers with ALS and 20 healthy control speakers. SLPs were asked to rate the speech severity of the speakers using five response options: normal, mild, moderate, severe, and profound. Four severity-surrogate measures were also calculated: SLPs transcribed the speech samples for the calculation of speech intelligibility and rated the effort it took to understand the speakers on a visual analog scale. In addition, speaking rate and intelligible speaking rate were calculated for each speaker. Intrarater and interrater reliability were calculated for each measure. We explored the validity of clinician-based severity ratings by comparing them to the severity-surrogate measures. Receiver operating characteristic (ROC) curves were conducted to create optimal cutoff points for defining dysarthria severity categories.

RESULTS

Intrarater and interrater reliability for the clinician-based severity ratings were excellent and were comparable to reliability for the severity-surrogate measures explored. Clinician severity ratings were strongly associated with all severity-surrogate measures, suggesting strong construct validity. We also provided a range of values for each severity-surrogate measure within each severity category based on the cutoff points obtained from the ROC analyses.

CONCLUSIONS

Clinician severity ratings of dysarthric speech are reliable and valid. We discuss the underlying challenges that arise when selecting a stratification measure and offer recommendations for a classification scheme when stratifying patients and research participants into speech severity categories.

Assessment of dysarthria and dysphagia in patients with amyotrophic lateral sclerosis: Review of the current evidence

Bulbar dysfunction is a common presentation of amyotrophic lateral sclerosis (ALS) and significantly impacts quality of life of people with ALS (PALS). The current paper reviews measurements of dysarthria and dysphagia specific to ALS to identify efficient and valid assessment measures. Using such assessment measures will lead to improved management of bulbar dysfunction in ALS. Measures reviewed for dysarthria in PALS are organized into three categories: acoustic, kinematic, and strength. A set of criteria are used to evaluate the effectiveness of the measures' identification of speech impairments, measurement of functional verbal communication, and clinical applicability. Assessments reviewed for dysphagia in PALS are organized into six categories: patient reported outcomes, dietary intake, pulmonary function and airway defense capacity, bulbar function, dysphagia/aspiration screens, and instrumental evaluations. Measurements that have good potential for clinical use are highlighted in both topic areas. Additionally, areas of improvement for clinical practice and research are identified and discussed. In general, no single speech measure fulfilled all the criteria, although a few measures were identified as potential diagnostic tools. Similarly, few objective measures that were validated and replicated with large sample sizes were found for diagnosis of dysphagia in PALS. Importantly, clinical applicability was found to be limited; thus, a collaborative team focused on implementation science would be helpful to improve the clinical uptake of assessments. Overall, the review highlights the need for further development of clinically viable and efficient measurements that use a multidisciplinary approach.

Two Distinct Clinical Phenotypes of Bulbar Motor Impairment in Amyotrophic Lateral Sclerosis

Objective: Understanding clinical variants of motor neuron diseases such as amyotrophic lateral sclerosis (ALS) is critical for discovering disease mechanisms and across-patient differences in therapeutic response. The current work describes two clinical subgroups of patients with ALS that, despite similar levels of bulbar motor involvement, have disparate clinical and functional speech presentations.

Methods: Participants included 47 healthy control speakers and 126 speakers with ALS. Participants with ALS were stratified into three clinical subgroups (i.e., bulbar asymptomatic, bulbar symptomatic high speech function, and bulbar symptomatic low speech function) based on clinical metrics of bulbar motor impairment. Acoustic and lip kinematic analytics were derived from each participant's recordings of reading samples and a rapid syllable repetition task. Group differences were reported on clinical scales of ALS and bulbar motor severity and on multiple speech measures.

Results: The high and low speech-function subgroups were found to be similar on many of the dependent measures explored. However, these two groups were differentiated on the basis of an acoustic measure used as a proxy for tongue movement.

Conclusion: This study supports the hypothesis that high and low speech-function subgroups do not differ solely in overall severity, but rather, constitute two distinct bulbar motor phenotypes. The findings suggest that the low speech-function group exhibited more global involvement of the bulbar muscles than the high speech-function group that had relatively intact lingual function. This work has implications for clinical measures used to grade bulbar motor involvement, suggesting that a single bulbar measure is inadequate for capturing differences among phenotypes.

Validation of Articulatory Rate and Imprecision Judgments in Speech of Individuals With Amyotrophic Lateral Sclerosis

Purpose Perceptual judgments of articulatory function are commonly used by speech-language pathologists to evaluate articulatory performance in individuals with amyotrophic lateral sclerosis (ALS). The goal of this study was to evaluate the psychometric properties (e.g., reliability, validity) of these perceptual measures to inform their application as part of a comprehensive bulbar assessment tool in ALS. Method Preexisting data from 51 individuals with ALS were obtained from a larger longitudinal study. Five independent raters provided perceptual judgments of articulatory rate and imprecision in a sentence task. Inter- and intrarater reliability of these judgments were assessed. Perceptual ratings were correlated with an acoustic measure of articulatory rate, in syllables per second, obtained from passage-reading recordings. Both perceptual and acoustic measures were correlated with gold-standard kinematic tongue and jaw movement measures, recorded from sentences using electromagnetic articulography. Results The results revealed good inter- and intrarater reliability of perceptual judgments of articulatory function. Strong correlations were observed between perceptual ratings of articulatory rate and imprecision and acoustic measures of articulatory rate and kinematic measures of tongue speed. Conclusions These findings support the clinical application of perceptual judgments of articulatory function as valid and reliable measures of underlying articulatory changes in bulbar ALS. Additional research is needed to understand the responsiveness of these measures to clinical changes in articulatory function in ALS.