A Novel Hierarchical Framework for Measuring the Complexity and Irregularity of Multimodal Speech Signals and Its Application in the Assessment of Speech Impairment in Amyotrophic Lateral Sclerosis

A multimodal approach to automated hierarchical assessment of bulbar involvement in amyotrophic lateral sclerosis

Introduction

As a hallmark feature of amyotrophic lateral sclerosis (ALS), bulbar involvement leads to progressive declines of speech and swallowing functions, significantly impacting social, emotional, and physical health, and quality of life. Standard clinical tools for bulbar assessment focus primarily on clinical symptoms and functional outcomes. However, ALS is known to have a long, clinically silent prodromal stage characterized by complex subclinical changes at various levels of the bulbar motor system. These changes accumulate over time and eventually culminate in clinical symptoms and functional declines. Detection of these subclinical changes is critical, both for mechanistic understanding of bulbar neuromuscular pathology and for optimal clinical management of bulbar dysfunction in ALS. To this end, we developed a novel multimodal measurement tool based on two clinically readily available, noninvasive instruments-facial surface electromyography (sEMG) and acoustic techniques-to hierarchically assess seven constructs of bulbar/speech motor control at the neuromuscular and acoustic levels. These constructs, including prosody, pause, functional connectivity, amplitude, rhythm, complexity, and regularity, are both mechanically and clinically relevant to bulbar involvement.

Methods

Using a custom-developed, fully automated data analytic algorithm, a variety of features were extracted from the sEMG and acoustic recordings of a speech task performed by 13 individuals with ALS and 10 neurologically healthy controls. These features were then factorized into 10 composite outcome measures using confirmatory factor analysis. Statistical and machine learning techniques were applied to these composite outcome measures to evaluate their reliability (internal consistency), validity (concurrent and construct), and efficacy for early detection and progress monitoring of bulbar involvement in ALS.

Results

The composite outcome measures were demonstrated to (1) be internally consistent and structurally valid in measuring the targeted constructs; (2) hold concurrent validity with the existing clinical and functional criteria for bulbar assessment; and (3) outperform the outcome measures obtained from each constituent modality in differentiating individuals with ALS from healthy controls. Moreover, the composite outcome measures combined demonstrated high efficacy for detecting subclinical changes in the targeted constructs, both during the prodromal stage and during the transition from prodromal to symptomatic stages.

Discussion

The findings provided compelling initial evidence for the utility of the multimodal measurement tool for improving early detection and progress monitoring of bulbar involvement in ALS, which have important implications in facilitating timely access to and delivery of optimal clinical care of bulbar dysfunction.

Machine Learning Prediction of Tongue Pressure in Elderly Patients with Head and Neck Tumor: A Cross-Sectional Study

Background: This investigation sought to cross validate the predictors of tongue pressure recovery in elderly patients' post-treatment for head and neck tumors, leveraging advanced machine learning techniques. Methods: By employing logistic regression, support vector regression, random forest, and extreme gradient boosting, the study analyzed an array of variables including patient demographics, surgery types, dental health status, and age, drawn from comprehensive medical records and direct tongue pressure assessments. Results: Among the models, logistic regression emerged as the most effective, demonstrating an accuracy of 0.630 [95% confidence interval (CI): 0.370-0.778], F1 score of 0.688 [95% confidence interval (CI): 0.435-0.853], precision of 0.611 [95% confidence interval (CI): 0.313-0.801], recall of 0.786 [95% confidence interval (CI): 0.413-0.938] and an area under the receiver operating characteristic curve of 0.626 [95% confidence interval (CI): 0.409-0.806]. This model distinctly highlighted the significance of glossectomy (p = 0.039), the presence of functional teeth (p = 0.043), and the patient's age (p = 0.044) as pivotal factors influencing tongue pressure, setting the threshold for statistical significance at p < 0.05. Conclusions: The analysis underscored the critical role of glossectomy, the presence of functional natural teeth, and age as determinants of tongue pressure in logistics regression, with the presence of natural teeth and the tumor site located in the tongue consistently emerging as the key predictors across all computational models employed in this study.

A Fine-Grained Temporal Analysis of Multimodal Oral Diadochokinetic Performance to Assess Speech Impairment in Amyotrophic Lateral Sclerosis

PURPOSE

This study used a semiautomated fine-grained temporal analysis to extract features of temporal oral diadochokinetic (DDK) performance across multiple modalities and tasks, from neurologically healthy and impaired individuals secondary to amyotrophic lateral sclerosis (ALS). The aims were to (a) delineate temporal oral DDK deficits relating to the neuromotor pathology of ALS and (b) identify the optimal task-feature combinations to detect speech impairment in ALS.

METHOD

Mandibular myoelectric, kinematic, and acoustic data were acquired from 13 individuals with ALS and 10 healthy controls producing three alternating motion rate tasks and one sequential motion rate task. Twenty-seven features were extracted from the multimodal data, characterizing three temporal constructs: duration/rate, variability, and coordination. The disease impacts on these features were assessed across tasks, and the task eliciting the greatest disease-related change was identified for each feature. Such "optimal" task-feature combinations were fed into logistic regression to differentiate individuals with ALS from healthy controls.

RESULTS

Temporal deficits in ALS were characterized by (a) increased duration and variability and reduced coordination of jaw muscle activities, (b) increased duration and variability and altered temporal symmetry of jaw velocity profile, (c) increased muscle-burst-to-peak-velocity duration, and (d) increased motion-to-voice onset duration. These temporal features were differentially affected across tasks. The optimal task-feature combinations, which were further clustered into three composite factors reflecting temporal variability, coarser-grained duration, and finer-grained duration, differentiated ALS from controls with an F1 score of 0.86 (precision = 1.00, recall = 0.75).

CONCLUSIONS

Temporal oral DDK deficits are likely attributed to a hierarchy of interrelated neurophysiological and biomechanical factors associated with the neuromotor pathology of ALS. These deficits, as assessed crossmodally, provide previously unavailable insights into the multifaceted timing impairment of oromotor performance in ALS. The optimal task-feature combinations targeting these deficits show promise as quantitative markers for (early) detection of speech impairment in ALS.

Intergenerational choral singing to improve communication outcomes in Parkinson's disease: Development of a theoretical framework and an integrated measurement tool

Purpose: This study presented an initial step towards developing the evidence base for intergenerational choral singing as a communication-focussed rehabilitative approach for Parkinson's disease (PD).Method: A theoretical framework was established to conceptualise the rehabilitative effect of intergenerational choral singing on four domains of communication impairments - motor drive, timing mechanism, sensorimotor integration, higher-level cognitive and affective functions - as well as activity/participation, and quality of life. A computer-assisted multidimensional acoustic analysis was developed to objectively assess the targeted domains of communication impairments. Voice Handicap Index and the World Health Organization's Quality of Life assessment-abbreviated version were used to obtain patient-reported outcomes at the activity/participation and quality of life levels. As a proof of concept, a single subject with PD was recruited to participate in 9 weekly 1-h intergenerational choir rehearsals. The subject was assessed before, 1 week post, and 8 weeks post-choir.Result: Notable trends of improvement were observed in multiple domains of communication impairments at 1 week post-choir. Some improvements were maintained at 8 weeks post-choir. Patient-reported outcomes exhibited limited pre-post changes.Conclusion: This study provided the theoretical groundwork and an empirical measurement tool for future validation of intergenerational choral singing as a novel rehabilitation for PD.

Effects of Speaking Rate on Variability of Second Formant Frequency Transitions in Dysarthria

INTRODUCTION

This study examined the utility of multiple second formant (F2) slope metrics to capture differences in speech production for individuals with dysarthria and healthy controls as a function of speaking rate. In addition, the utility of F2 slope metrics for predicting severity of intelligibility impairment in dysarthria was examined.

METHODS

Twenty three speakers with Parkinson's disease and mild to moderate hypokinetic dysarthria (HD), 9 speakers with various neurological diseases and mild to severe ataxic or ataxic-spastic dysarthria (AD), and 26 age-matched healthy control speakers (CON) participated in a sentence repetition task. Sentences were produced at habitual, fast, and slow speaking rate. A variety of metrics were derived from the rising F2 transition portion of the diphthong /ai/. To obtain measures of intelligibility for the two clinical speaker groups, 15 undergraduate SLP students participated in a transcription experiment.

RESULTS

Significantly shallower slopes were found for the speakers with HD compared to control speakers. Steeper F2 slopes were associated with increased speaking rate for all groups. Higher variability in F2 slope metrics was found for the speakers with AD compared to the two other speaker groups. For both clinical speaker groups, there was a negative association between intelligibility and F2 slope variability metrics, indicating lower variability in speech production was associated with higher intelligibility.

DISCUSSION

F2 slope metrics were sensitive to dysarthria presence, dysarthria type, and speaking rate. The current study provided evidence that the use of F2 slope variability measures has additional value to F2 slope averaged measures for predicting severity of intelligibility impairment in dysarthria.

Functional Role of Temporal Patterning of Articulation in Speech Production: A Novel Perspective Toward Global Timing-Based Motor Speech Assessment and Rehabilitation

PURPOSE

This study aimed to (a) relate temporal patterning of articulation to functional speech outcomes in neurologically healthy and impaired speakers, (b) identify changes in temporal patterning of articulation in neurologically impaired speakers, and (c) evaluate how these changes can be modulated by speaking rate manipulation.

METHOD

Thirteen individuals with amyotrophic lateral sclerosis (ALS) and 10 neurologically healthy controls read a sentence 3 times, first at their habitual rate and then at a voluntarily slowed rate. Temporal patterning of articulation was assessed by 24 features characterizing the modulation patterns within (intra) and between (inter) four articulators (tongue tip, tongue body, lower lip, and jaw) at three linguistically relevant, hierarchically nested timescales corresponding to stress, syllable, and onset-rime/phoneme. For Aim 1, the features for the habitual rate condition were factorized and correlated with two functional speech outcomes-speech intelligibility and intelligible speaking rate. For Aims 2 and 3, the features were compared between groups and rate conditions, respectiely.

RESULTS

For Aim 1, the modulation features combined were moderately to strongly correlated with intelligibility (R ² = .51-.53) and intelligible speaking rate (R ² = .63-.73). For Aim 2, intra-articulator modulation was impaired in ALS, manifested by moderate-to-large decreases in modulation depth at all timescales and cross-timescale phase synchronization. Interarticulator modulation was relatively unaffected. For Aim 3, voluntary rate reduction improved several intra-articulator modulation features identified as being susceptible to the disease effect in individuals with ALS.

CONCLUSIONS

Disrupted temporal patterning of articulation, presumably reflecting impaired articulatory entrainment to linguistic rhythms, may contribute to functional speech declines in ALS. These impairments tend to be improved through voluntary rate reduction, possibly by reshaping the temporal template of motor plans to better accommodate the disease-related neuromechanical constraints in the articulatory system. These findings shed light on a novel perspective toward global timing-based motor speech assessment and rehabilitation.

Relationship between rate-elicited changes in muscular-kinematic control strategies and acoustic performance in individuals with ALS-A multimodal investigation

INTRODUCTION

As a key control variable, duration has been long suspected to mediate the organization of speech motor control strategies, which has management implications for neuromotor speech disorders. This study aimed to experimentally delineate the role of duration in organizing speech motor control in neurologically healthy and impaired speakers using a voluntary speaking rate manipulation paradigm.

METHODS

Thirteen individuals with amyotrophic lateral sclerosis (ALS) and 10 healthy controls performed a sentence reading task three times, first at their habitual rate, then at a slower rate. A multimodal approach combining surface electromyography, kinematic, and acoustic technologies was used to record jaw muscle activities, jaw kinematics, and speech acoustics. Six muscular-kinematic features were extracted and factor-analyzed to characterize the organization of the mandibular control hierarchy. Five acoustic features were extracted, measuring the spectrotemporal properties of the diphthong /ɑɪ/ and the plosives /t/ and /k/.

RESULTS

The muscular-kinematic features converged into two interpretable latent factors, reflecting the level and cohesiveness/flexibility of mandibular control, respectively. Voluntary rate reduction led to a trend toward (1) finer, less cohesive, and more flexible mandibular control, and (2) increased range and decreased transition slope of the diphthong formants, across neurologically healthy and impaired groups. Differential correlations were found between the rate-elicited changes in mandibular control and acoustic performance for neurologically healthy and impaired speakers.

CONCLUSIONS

The results provided empirical evidence for the long-suspected but previously unsubstantiated role of duration in (re)organizing speech motor control strategies. The rate-elicited reorganization of muscular-kinematic control contributed to the acoustic performance of healthy speakers, in ways consistent with theoretical predictions. Such contributions were less consistent in impaired speakers, implying the complex nature of speaking rate reduction in ALS, possibly reflecting an interplay of disease-related constraints and volitional duration control. This information may help to stratify and identify candidates for the rate manipulation therapy.