Assessment of speech impairment in patients with Parkinson's disease from acoustic quantifications of oral diadochokinetic sequences

Exploring Spectrogram-Based Audio Classification for Parkinson's Disease: A Study on Speech Classification and Qualitative Reliability Verification

Patients suffering from Parkinson's disease suffer from voice impairment. In this study, we introduce models to classify normal and Parkinson's patients using their speech. We used an AST (audio spectrogram transformer), a transformer-based speech classification model that has recently outperformed CNN-based models in many fields, and a CNN-based PSLA (pretraining, sampling, labeling, and aggregation), a high-performance model in the existing speech classification field, for the study. This study compares and analyzes the models from both quantitative and qualitative perspectives. First, qualitatively, PSLA outperformed AST by more than 4% in accuracy, and the AUC was also higher, with 94.16% for AST and 97.43% for PSLA. Furthermore, we qualitatively evaluated the ability of the models to capture the acoustic features of Parkinson's through various CAM (class activation map)-based XAI (eXplainable AI) models such as GradCAM and EigenCAM. Based on PSLA, we found that the model focuses well on the muffled frequency band of Parkinson's speech, and the heatmap analysis of false positives and false negatives shows that the speech features are also visually represented when the model actually makes incorrect predictions. The contribution of this paper is that we not only found a suitable model for diagnosing Parkinson's through speech using two different types of models but also validated the predictions of the model in practice.

Effects of stepped speech rehabilitation and psychological intervention on speech disorders and cognitive function in Parkinson disease patients

To examine the impact of stepwise speech rehabilitation exercise therapy in the treatment of patients with Parkinson speech problems under psychological intervention on clinical results and cognitive functioning. Parkinson speech disorder patients who met the inclusion criteria were selected and divided into a control group and an observation group for training respectively. The control group used conventional nursing methods, including training in orofacial movement, vocalization, pitch, volume and breath control. The observation group used stepwise speech rehabilitation exercise intervention combined with psychotherapy nursing programme. In the statistical analysis, independent sample t-test and chi-square test were used to test the significance of the data processing methods. In the statistical analysis of baseline functional level (P > .05). The difference was not statistically significant. After 7 weeks of training, the mFDA level and speech intelligibility increased in both the observation and control groups. From the situation analysis of "modified drinking test" and the comparison of UPDRS-I scores, it can be seen that dysphagia and Parkinson dysphasia were reduced in both groups after training. The observation group spontaneous speech dimension was greater than the control group by around 0.07 in the aphasia comparison. Both groups displayed an upward trend in their MMSE and Montreal Cognitive Assessment (MoCA) when measuring cognitive function; the evaluation of P300, constructive function, and quality of life revealed this. The observation group P300 potential score was 0.13 points higher than that of the control group. The therapeutic training of stepped speech rehabilitation exercise care combined with psychological intervention has significant nursing effects on patients with Parkinson disease speech disorders, and the patients' cognitive functions have been effectively improved.

Consonant articulation acoustics and intelligibility in Swedish speakers with Parkinson's disease: a pilot study

Imprecise consonant articulation is common in speakers with Parkinson's disease and can affect intelligibility. The research on the relationship between acoustic speech measures and intelligibility in Parkinson's disease is limited, and most of the research has been conducted on English. This pilot study investigated aspects of consonant articulation acoustics in eleven Swedish speakers with Parkinson's disease and six neurologically healthy persons. The focus of the study was on consonant cluster production, articulatory motion rate and variation, and voice onset time, and how these acoustic features correlate with speech intelligibility. Among the measures in the present study, typicality ratings of heterorganic consonant clusters /spr/ and /skr/ had the strongest correlations with intelligibility. Measures based on syllable repetition, such as repetition rate and voice onset time, showed varying results with weak to moderate correlations with intelligibility. One conclusion is that some acoustic measures may be more sensitive than others to the impact of the underlying sensory-motor impairment and dysarthria on speech production and intelligibility in speakers with Parkinson's disease. Some aspects of articulation appear to be equally demanding in terms of acoustic realisation for elderly healthy speakers and for speakers with Parkinson's disease, such as sequential motion rate measures. Clinically, this would imply that for the purpose of detecting signs of disordered speech motor control, choosing measures with less variation among older speakers without articulation impairment would lead to more robust results.

Wav2DDK: Analytical and Clinical Validation of an Automated Diadochokinetic Rate Estimation Algorithm on Remotely Collected Speech

PURPOSE

Oral diadochokinesis is a useful task in assessment of speech motor function in the context of neurological disease. Remote collection of speech tasks provides a convenient alternative to in-clinic visits, but scoring these assessments can be a laborious process for clinicians. This work describes Wav2DDK, an automated algorithm for estimating the diadochokinetic (DDK) rate on remotely collected audio from healthy participants and participants with amyotrophic lateral sclerosis (ALS).

METHOD

Wav2DDK was developed using a corpus of 970 DDK assessments from healthy and ALS speakers where ground truth DDK rates were provided manually by trained annotators. The clinical utility of the algorithm was demonstrated on a corpus of 7,919 assessments collected longitudinally from 26 healthy controls and 82 ALS speakers. Corpora were collected via the participants' own mobile device, and instructions for speech elicitation were provided via a mobile app. DDK rate was estimated by parsing the character transcript from a deep neural network transformer acoustic model trained on healthy and ALS speech.

RESULTS

Algorithm estimated DDK rates are highly accurate, achieving .98 correlation with manual annotation, and an average error of only 0.071 syllables per second. The rate exactly matched ground truth for 83% of files and was within 0.5 syllables per second for 95% of files. Estimated rates achieve a high test-retest reliability (r = .95) and show good correlation with the revised ALS functional rating scale speech subscore (r = .67).

CONCLUSION

We demonstrate a system for automated DDK estimation that increases efficiency of calculation beyond manual annotation. Thorough analytical and clinical validation demonstrates that the algorithm is not only highly accurate, but also provides a convenient, clinically relevant metric for tracking longitudinal decline in ALS, serving to promote participation and diversity of participants in clinical research.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.23787033.

Intelligent speech technologies for transcription, disease diagnosis, and medical equipment interactive control in smart hospitals: A review

The growing and aging of the world population have driven the shortage of medical resources in recent years, especially during the COVID-19 pandemic. Fortunately, the rapid development of robotics and artificial intelligence technologies help to adapt to the challenges in the healthcare field. Among them, intelligent speech technology (IST) has served doctors and patients to improve the efficiency of medical behavior and alleviate the medical burden. However, problems like noise interference in complex medical scenarios and pronunciation differences between patients and healthy people hamper the broad application of IST in hospitals. In recent years, technologies such as machine learning have developed rapidly in intelligent speech recognition, which is expected to solve these problems. This paper first introduces IST's procedure and system architecture and analyzes its application in medical scenarios. Secondly, we review existing IST applications in smart hospitals in detail, including electronic medical documentation, disease diagnosis and evaluation, and human-medical equipment interaction. In addition, we elaborate on an application case of IST in the early recognition, diagnosis, rehabilitation training, evaluation, and daily care of stroke patients. Finally, we discuss IST's limitations, challenges, and future directions in the medical field. Furthermore, we propose a novel medical voice analysis system architecture that employs active hardware, active software, and human-computer interaction to realize intelligent and evolvable speech recognition. This comprehensive review and the proposed architecture offer directions for future studies on IST and its applications in smart hospitals.

Speech and Nonspeech Parameters in the Clinical Assessment of Dysarthria: A Dimensional Analysis

Nonspeech (or paraspeech) parameters are widely used in clinical assessment of speech impairment in persons with dysarthria (PWD). Virtually every standard clinical instrument used in dysarthria diagnostics includes nonspeech parameters, often in considerable numbers. While theoretical considerations have challenged the validity of these measures as markers of speech impairment, only a few studies have directly examined their relationship to speech parameters on a broader scale. This study was designed to investigate how nonspeech parameters commonly used in clinical dysarthria assessment relate to speech characteristics of dysarthria in individuals with movement disorders. Maximum syllable repetition rates, accuracies, and rates of isolated and repetitive nonspeech oral-facial movements and maximum phonation times were compared with auditory-perceptual and acoustic speech parameters. Overall, 23 diagnostic parameters were assessed in a sample of 130 patients with movement disorders of six etiologies. Each variable was standardized for its distribution and for age and sex effects in 130 neurotypical speakers. Exploratory Graph Analysis (EGA) and Confirmatory Factor Analysis (CFA) were used to examine the factor structure underlying the diagnostic parameters. In the first analysis, we tested the hypothesis that nonspeech parameters combine with speech parameters within diagnostic dimensions representing domain-general motor control principles. In a second analysis, we tested the more specific hypotheses that diagnostic parameters split along effector (lip vs. tongue) or functional (speed vs. accuracy) rather than task boundaries. Our findings contradict the view that nonspeech parameters currently used in dysarthria diagnostics are congruent with diagnostic measures of speech characteristics in PWD.

Speech error rates after a sports-related concussion

Background

Alterations in speech have long been identified as indicators of various neurologic conditions including traumatic brain injury, neurodegenerative diseases, and stroke. The extent to which speech errors occur in milder brain injuries, such as sports-related concussions, is unknown. The present study examined speech error rates in student athletes after a sports-related concussion compared to pre-injury speech performance in order to determine the presence and relevant characteristics of changes in speech production in this less easily detected neurologic condition.

Methods

A within-subjects pre/post-injury design was used. A total of 359 Division I student athletes participated in pre-season baseline speech testing. Of these, 27 athletes (18-22 years) who sustained a concussion also participated in speech testing in the days immediately following diagnosis of concussion. Picture description tasks were utilized to prompt connected speech samples. These samples were recorded and then transcribed for identification of errors and disfluencies. These were coded by two trained raters using a 6-category system that included 14 types of error metrics.

Results

Repeated measures analysis of variance was used to compare the difference in error rates at baseline and post-concussion. Results revealed significant increases in the speech error categories of pauses and time fillers (interjections/fillers). Additionally, regression analysis showed that a different pattern of errors and disfluencies occur after a sports-related concussion (primarily time fillers) compared to pre-injury (primarily pauses).

Conclusion

Results demonstrate that speech error rates increase following even mild head injuries, in particular, sports-related concussion. Furthermore, the speech error patterns driving this increase in speech errors, rate of pauses and interjections, are distinct features of this neurological injury, which is in contrast with more severe injuries that are marked by articulation errors and an overall reduction in verbal output. Future studies should consider speech as a diagnostic tool for concussion.

Oral and Laryngeal Diadochokinesis Across the Life Span: A Scoping Review of Methods, Reference Data, and Clinical Applications

PURPOSE

The aim of this study was to conduct a scoping review of research on oral and laryngeal diadochokinesis (DDK) in children and adults, either typically developing/developed or with a clinical diagnosis.

METHOD

Searches were conducted with PubMed/MEDLINE, Google Scholar, CINAHL, and legacy sources in retrieved articles. Search terms included the following: DDK, alternating motion rate, maximum repetition rate, sequential motion rate, and syllable repetition rate.

RESULTS

Three hundred sixty articles were retrieved and included in the review. Data source tables for children and adults list the number and ages of study participants, DDK task, and language(s) spoken. Cross-sectional data for typically developing children and typically developed adults are compiled for the monosyllables /pʌ/, /tʌ/, and /kʌ/; the trisyllable /pʌtʌkʌ/; and laryngeal DDK. In addition, DDK results are summarized for 26 disorders or conditions.

DISCUSSION

A growing number of multidisciplinary reports on DDK affirm its role in clinical practice and research across the world. Atypical DDK is not a well-defined singular entity but rather a label for a collection of disturbances associated with diverse etiologies, including motoric, structural, sensory, and cognitive. The clinical value of DDK can be optimized by consideration of task parameters, analysis method, and population of interest.

On the Primary Influences of Age on Articulation and Phonation in Maximum Performance Tasks

Maximum performance tasks have been identified as possible domains where incipient signs of neurological disease may be detected in simple speech and voice samples. However, it is likely that these will simultaneously be influenced by the age and sex of the speaker. In this study, a comprehensive set of acoustic quantifications were collected from the literature and applied to productions of sustained [a] productions and Alternating Motion Rate diadochokinetic (DDK) syllable sequences made by 130 (62 women, 68 men) healthy speakers, aged 20–90 years. The participants were asked to produce as stable (sustained [a] and DDK) and fast (DDK) productions as possible. The full set of features were reduced to a functional subset that most efficiently modeled sex-specific differences between younger and older speakers using a cross-validation procedure. Twelve measures of [a] and 16 measures of DDK sequences were identified across men and women and investigated in terms of how they were altered with increasing age of speakers. Increased production instability is observed in both tasks, primarily above the age of 60 years. DDK sequences were slower in older speakers, but also altered in their syllable and segment level acoustic properties. Increasing age does not appear to affect phonation or articulation uniformly, and men and women are affected differently in most quantifications investigated.

Language as a biomarker for psychosis: A natural language processing approach

Human ratings of conceptual disorganization, poverty of content, referential cohesion and illogical thinking have been shown to predict psychosis onset in prospective clinical high risk (CHR) cohort studies. The potential value of linguistic biomarkers has been significantly magnified, however, by recent advances in natural language processing (NLP) and machine learning (ML). Such methodologies allow for the rapid and objective measurement of language features, many of which are not easily recognized by human raters. Here we review the key findings on language production disturbance in psychosis. We also describe recent advances in the computational methods used to analyze language data, including methods for the automatic measurement of discourse coherence, syntactic complexity, poverty of content, referential coherence, and metaphorical language. Linguistic biomarkers of psychosis risk are now undergoing cross-validation, with attention to harmonization of methods. Future directions in extended CHR networks include studies of sources of variance, and combination with other promising biomarkers of psychosis risk, such as cognitive and sensory processing impairments likely to be related to language. Implications for the broader study of social communication, including reciprocal prosody, face expression and gesture, are discussed.