1
|
Baldanzi C, Crispiatico V, Fusari G, Saibene FL, Arcuri P, Meloni M, Cattaneo D, Vitali C. Correlation between voice intensity and swallowing function in subjects with Parkinson's disease. Neurol Sci 2025; 46:713-721. [PMID: 39375256 DOI: 10.1007/s10072-024-07782-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Accepted: 09/23/2024] [Indexed: 10/09/2024]
Abstract
INTRODUCTION People with Parkinson's Disease (PD) experience reduced voice intensity and dysphagia. Organs related to voice production and swallowing are structurally and neurologically intertwined. Thus, instrumental voice assessment may be useful in identifying voice impairments that can show swallowing disorders. Timely assessment of swallowing disorders may prevent the occurrence of malnutrition, dehydration, pneumonia, and death. OBJECTIVE The aim of this study was to investigate the relationship between voice intensity and swallowing function in PD. METHODS 30 participants with PD were recruited. Motor disability was evaluated by the Unified Parkinson's Disease Rating Scale part III; voice intensity was assessed by PRAAT software during sustained /a/ and 1 min of monologue. The Penetration Aspiration Scale, the Dysphagia Outcome Severity Scale, and the Videofluoroscopic Dysphagia Scale were used to assess swallowing during videofluoroscopy. Spearman correlation coefficients, logistic, and linear models were used to analyze data. RESULTS Voice intensity correlated with swallowing: as voice intensity decreased, swallowing function deteriorated (Spearman coefficients from -0.42 to -0.72 across scales), and this holds even when adjusted for MDS-UPDRS motor scores. Swallowing impairment is 56 times more likely (p<0.01) when the voice intensity is below the normal cut-off score (60 dB) with a positive predictive value of 93%. CONCLUSIONS Reduction in voice intensity is indicative of a higher risk of swallowing dysfunction. Thus, an instrumental voice analysis seems to be a non-invasive, lowcost, easy-to-use tool to identify people with PD in need of an assessment to allow for timely swallowing management and reduction of complications caused by dysphagia.
Collapse
Affiliation(s)
| | | | | | | | | | - Mario Meloni
- Neurology Unit, Azienda Ospedaliero-Universitaria, Cagliari, Italy
| | - Davide Cattaneo
- IRCCS Fondazione Don Carlo Gnocchi, Milan, Italy
- Department of Physiopathology and Transplants, University of Milan, Milan, Italy
| | | |
Collapse
|
2
|
Tian Y, Hu J, Wang Q, Qiao J, Wen H, Ye Q, Dou Z. Association Between Cognitive Impairment and Dysphagia: A Two-Sample Mendelian Randomization Study. Brain Behav 2025; 15:e70295. [PMID: 39924987 PMCID: PMC11808188 DOI: 10.1002/brb3.70295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/18/2024] [Revised: 12/30/2024] [Accepted: 01/05/2025] [Indexed: 02/11/2025] Open
Abstract
INTRODUCTION Previous observational studies have implied a correlation between cognitive impairment and dysphagia, but some have indicated no correlation between the two. Such contradictory findings may have been influenced by small sample sizes and potential confounders. In this Mendelian randomization (MR) analysis, we genetically estimated a causal relationship between cognitive impairment and dysphagia. METHODS The study included a large meta-analysis of genome-wide association studies (GWAS) of cognitive impairment in 269,867 individuals of European ancestry and pooled data from a GWAS of dysphagia in 165,765 individuals of European ancestry (cases 3497, controls 161,968). We then used five different complementary MR methods, including IVW, MR-Egger, MR-RAPS, weighted median, and weighted mean, to estimate causality between cognitive impairment and dysphagia and finally also assessed heterogeneity and horizontal pleiotropy by extensive sensitivity tests. RESULTS No evidence of heterogeneity in the effect of instrumental variables was found in Cochran's Q test; therefore, a fixed effects model was used. IVW analysis (OR: 1.206, 95% CI: [1.041, 1.371], p = 0.00508) found that cognitive impairment was associated with an increased risk of dysphagia and that there was a causal association between the two. Also, the weighted median (OR: 1.248, 95% CI: [1.012, 1.484], p = 0.0253), weighted mode (OR: 1.216, 95% CI: [1.043, 1.389], p = 0.0412), and MR-RAPS (OR: 1.225, 95% CI: [1.069, 1.381], p = 0.00627) validated the conclusions. Furthermore, extensive sensitivity analyses found no evidence of heterogeneity or horizontal pleiotropy, confirming the reliability of this MR result. CONCLUSION Our MR study demonstrated a causal effect of cognitive impairment on dysphagia from a genetic perspective, suggesting that individuals with a history of cognitive impairment require specific clinical attention to prevent the development of dysphagia.
Collapse
Affiliation(s)
- Yueqin Tian
- Department of Rehabilitation MedicineThe Third Affiliated Hospital, Sun Yat‐sen UniversityGuangzhouChina
| | - Jiahui Hu
- Clinical Medical College of Acu‐Moxi and RehabilitationGuangzhou University of Chinese MedicineGuangzhouChina
| | - Qianqian Wang
- Clinical Medical College of Acu‐Moxi and RehabilitationGuangzhou University of Chinese MedicineGuangzhouChina
| | - Jia Qiao
- Department of Rehabilitation MedicineThe Third Affiliated Hospital, Sun Yat‐sen UniversityGuangzhouChina
| | - Hongmei Wen
- Department of Rehabilitation MedicineThe Third Affiliated Hospital, Sun Yat‐sen UniversityGuangzhouChina
| | - Qiuping Ye
- Department of Rehabilitation MedicineThe Third Affiliated Hospital, Sun Yat‐sen UniversityGuangzhouChina
| | - Zulin Dou
- Department of Rehabilitation MedicineThe Third Affiliated Hospital, Sun Yat‐sen UniversityGuangzhouChina
| |
Collapse
|
3
|
He Y, Wang X, Huang T, Zhao W, Fu Z, Zheng Q, Jin L, Kim H, Liu H. The Study of Speech Acoustic Characteristics of Elderly Individuals with Presbyphagia in Ningbo, China. J Voice 2024:S0892-1997(24)00334-5. [PMID: 39414424 DOI: 10.1016/j.jvoice.2024.09.041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 09/22/2024] [Accepted: 09/23/2024] [Indexed: 10/18/2024]
Abstract
The feasibility of using acoustic parameters to predict presbyphagia has been preliminarily confirmed. Considering that age and gender can influence the results of acoustic parameters, this study aimed to further explore the specific effects of age and gender on acoustic parameter analysis of the elderly population over 60 years old with presbyphagia. A total of 45 participants were enrolled and divided into three groups (60-69 years old, 70-79 years old, and 80-89 years old). Acoustic parameters, including maximum phonation time, first to third formant frequencies (F1-F3) of /a/, /i/, and /u/, oral diadochokinesis, the acoustic vowel space, and laryngeal diadochokinesis (LDDK), were extracted and calculated. Two-way analysis of variance was used to analyze the correlations between acoustic parameters and age and gender. The result indicates that /hʌ/ LDDK rate had significant differences in age groups, presenting the 80-89 age group being significantly slower than the 60-69 age group. F1/a/, F2/a/, F2/i/, F3/i/, and F2i/F2u differed systematically between genders, with males being lower and smaller than females. Changes that were consistent with /hʌ/ LDDK regularity, confirmed by greater regularity in females. No significant differences were observed for other acoustic parameters. No significant interactions were revealed. According to the preliminary data, we hypothesized that respiratory capacity and control during vocal fold abduction weaken with aging. This highlights the importance of continuously monitoring the respiratory impact on swallowing function in elderly individuals. Additionally, gender influenced several acoustic parameters, indicating the necessity to differentiate between genders when assessing presbyphagia using acoustic parameters, especially focusing on swallowing function in elderly males in Ningbo.
Collapse
Affiliation(s)
- YuHan He
- Faculty of Education, Beijing Normal University, Beijing, China; Department of Rehabilitation Sciences, East China Normal University, Shanghai, China
| | - XiaoYu Wang
- Department of Rehabilitation Sciences, East China Normal University, Shanghai, China
| | - TianYi Huang
- Department of Rehabilitation Sciences, East China Normal University, Shanghai, China
| | - WenSheng Zhao
- Department of Rehabilitation Sciences, East China Normal University, Shanghai, China
| | - Zhen Fu
- Department of Rehabilitation, Shanghai Tongren Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qin Zheng
- Department of Women and Children's Health Care, Shanghai First Maternity and Infant Hospital, Obstetrics and Gynecology Hospital of Tongji University, Shanghai, China
| | - LingJing Jin
- Department of Neurology and Neurological Rehabilitation, Shanghai Yangzhi Rehabilitation Hospital (Shanghai Sunshine Rehabilitation Center), School of Medicine, Tongji University, Shanghai, China
| | - HaKyung Kim
- Department of Rehabilitation Sciences, East China Normal University, Shanghai, China.
| | - HengXin Liu
- Department of Otolaryngology, Head and Neck Surgery, Beijing Children's Hospital Affiliated to Capital Medical University, National Center for Children's Health, Beijing, China; Beijing Key Laboratory for Pediatric Diseases of Otolaryngology Head and Neck Surgery, Beijing, China
| |
Collapse
|
4
|
Heo S, Uhm KE, Yuk D, Kwon BM, Yoo B, Kim J, Lee J. Deep learning approach for dysphagia detection by syllable-based speech analysis with daily conversations. Sci Rep 2024; 14:20270. [PMID: 39217249 PMCID: PMC11365951 DOI: 10.1038/s41598-024-70774-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 08/21/2024] [Indexed: 09/04/2024] Open
Abstract
Dysphagia, a disorder affecting the ability to swallow, has a high prevalence among the older adults and can lead to serious health complications. Therefore, early detection of dysphagia is important. This study evaluated the effectiveness of a newly developed deep learning model that analyzes syllable-segmented data for diagnosing dysphagia, an aspect not addressed in prior studies. The audio data of daily conversations were collected from 16 patients with dysphagia and 24 controls. The presence of dysphagia was determined by videofluoroscopic swallowing study. The data were segmented into syllables using a speech-to-text model and analyzed with a convolutional neural network to perform binary classification between the dysphagia patients and control group. The proposed model in this study was assessed in two different aspects. Firstly, with syllable-segmented analysis, it demonstrated a diagnostic accuracy of 0.794 for dysphagia, a sensitivity of 0.901, a specificity of 0.687, a positive predictive value of 0.742, and a negative predictive value of 0.874. Secondly, at the individual level, it achieved an overall accuracy of 0.900 and area under the curve of 0.953. This research highlights the potential of deep learning modal as an early, non-invasive, and simple method for detecting dysphagia in everyday environments.
Collapse
Affiliation(s)
- Seokhyeon Heo
- Department of Rehabilitation Medicine, Konkuk University Medical Center, 120-1 Neungdong-ro, Gwangjin-gu, Seoul, 05030, Republic of Korea
| | - Kyeong Eun Uhm
- Department of Rehabilitation Medicine, Konkuk University Medical Center, 120-1 Neungdong-ro, Gwangjin-gu, Seoul, 05030, Republic of Korea
| | - Doyoung Yuk
- Department of Rehabilitation Medicine, Konkuk University Medical Center, 120-1 Neungdong-ro, Gwangjin-gu, Seoul, 05030, Republic of Korea
| | - Bo Mi Kwon
- Department of Rehabilitation Medicine, Konkuk University Medical Center, 120-1 Neungdong-ro, Gwangjin-gu, Seoul, 05030, Republic of Korea
| | - Byounghyun Yoo
- Center for Artificial Intelligence, Korea Institute of Science and Technology, 5 Hwarangro14-gil, Seongbuk-gu, Seoul, 02792, Republic of Korea
| | - Jisoo Kim
- Faculty of Software Major in Artificial Intelligence, Jeju National University, 102 Jejudaehak-ro, Jeju-si, 63243, Republic of Korea.
| | - Jongmin Lee
- Department of Rehabilitation Medicine, Konkuk University Medical Center, 120-1 Neungdong-ro, Gwangjin-gu, Seoul, 05030, Republic of Korea.
| |
Collapse
|
5
|
Brahmi Z, Mahyoob M, Al-Sarem M, Algaraady J, Bousselmi K, Alblwi A. Exploring the Role of Machine Learning in Diagnosing and Treating Speech Disorders: A Systematic Literature Review. Psychol Res Behav Manag 2024; 17:2205-2232. [PMID: 38835654 PMCID: PMC11149643 DOI: 10.2147/prbm.s460283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Accepted: 05/07/2024] [Indexed: 06/06/2024] Open
Abstract
Purpose Speech disorders profoundly impact the overall quality of life by impeding social operations and hindering effective communication. This study addresses the gap in systematic reviews concerning machine learning-based assistive technology for individuals with speech disorders. The overarching purpose is to offer a comprehensive overview of the field through a Systematic Literature Review (SLR) and provide valuable insights into the landscape of ML-based solutions and related studies. Methods The research employs a systematic approach, utilizing a Systematic Literature Review (SLR) methodology. The study extensively examines the existing literature on machine learning-based assistive technology for speech disorders. Specific attention is given to ML techniques, characteristics of exploited datasets in the training phase, speaker languages, feature extraction techniques, and the features employed by ML algorithms. Originality This study contributes to the existing literature by systematically exploring the machine learning landscape in assistive technology for speech disorders. The originality lies in the focused investigation of ML-speech recognition for impaired speech disorder users over ten years (2014-2023). The emphasis on systematic research questions related to ML techniques, dataset characteristics, languages, feature extraction techniques, and feature sets adds a unique and comprehensive perspective to the current discourse. Findings The systematic literature review identifies significant trends and critical studies published between 2014 and 2023. In the analysis of the 65 papers from prestigious journals, support vector machines and neural networks (CNN, DNN) were the most utilized ML technique (20%, 16.92%), with the most studied disease being Dysarthria (35/65, 54% studies). Furthermore, an upsurge in using neural network-based architectures, mainly CNN and DNN, was observed after 2018. Almost half of the included studies were published between 2021 and 2022).
Collapse
Affiliation(s)
- Zaki Brahmi
- Department of Computer Science, Taibah University, Madina, Kingdom of Saudi Arabia
| | - Mohammad Mahyoob
- Department of Languages and Translation, Taibah University, Madina, Kingdom of Saudi Arabia
| | - Mohammed Al-Sarem
- Department of Computer Science, Taibah University, Madina, Kingdom of Saudi Arabia
| | | | - Khadija Bousselmi
- Department of Computer Science, LISTIC, University of Savoie Mont Blanc, Chambéry, France
| | - Abdulaziz Alblwi
- Department of Computer Science, Taibah University, Madina, Kingdom of Saudi Arabia
| |
Collapse
|
6
|
Srinivasan Y, Liu A, Rameau A. Machine learning in the evaluation of voice and swallowing in the head and neck cancer patient. Curr Opin Otolaryngol Head Neck Surg 2024; 32:105-112. [PMID: 38116798 DOI: 10.1097/moo.0000000000000948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2023]
Abstract
PURPOSE OF REVIEW The purpose of this review is to present recent advances and limitations in machine learning applied to the evaluation of speech, voice, and swallowing in head and neck cancer. RECENT FINDINGS Novel machine learning models incorporating diverse data modalities with improved discriminatory capabilities have been developed for predicting toxicities following head and neck cancer therapy, including dysphagia, dysphonia, xerostomia, and weight loss as well as guiding treatment planning. Machine learning has been applied to the care of posttreatment voice and swallowing dysfunction by offering objective and standardized assessments and aiding innovative technologies for functional restoration. Voice and speech are also being utilized in machine learning algorithms to screen laryngeal cancer. SUMMARY Machine learning has the potential to help optimize, assess, predict, and rehabilitate voice and swallowing function in head and neck cancer patients as well as aid in cancer screening. However, existing studies are limited by the lack of sufficient external validation and generalizability, insufficient transparency and reproducibility, and no clear superior predictive modeling strategies. Algorithms and applications will need to be trained on large multiinstitutional data sets, incorporate sociodemographic data to reduce bias, and achieve validation through clinical trials for optimal performance and utility.
Collapse
Affiliation(s)
- Yashes Srinivasan
- Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York
| | - Amy Liu
- University of California, San Diego, School of Medicine, San Diego, California, USA
| | - Anaïs Rameau
- Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York
| |
Collapse
|
7
|
Kim JM, Kim MS, Choi SY, Ryu JS. Prediction of dysphagia aspiration through machine learning-based analysis of patients' postprandial voices. J Neuroeng Rehabil 2024; 21:43. [PMID: 38555417 PMCID: PMC10981344 DOI: 10.1186/s12984-024-01329-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 02/26/2024] [Indexed: 04/02/2024] Open
Abstract
BACKGROUND Conventional diagnostic methods for dysphagia have limitations such as long wait times, radiation risks, and restricted evaluation. Therefore, voice-based diagnostic and monitoring technologies are required to overcome these limitations. Based on our hypothesis regarding the impact of weakened muscle strength and the presence of aspiration on vocal characteristics, this single-center, prospective study aimed to develop a machine-learning algorithm for predicting dysphagia status (normal, and aspiration) by analyzing postprandial voice limiting intake to 3 cc. METHODS Conducted from September 2021 to February 2023 at Seoul National University Bundang Hospital, this single center, prospective cohort study included 198 participants aged 40 or older, with 128 without suspected dysphagia and 70 with dysphagia-aspiration. Voice data from participants were collected and used to develop dysphagia prediction models using the Multi-Layer Perceptron (MLP) with MobileNet V3. Male-only, female-only, and combined models were constructed using 10-fold cross-validation. Through the inference process, we established a model capable of probabilistically categorizing a new patient's voice as either normal or indicating the possibility of aspiration. RESULTS The pre-trained models (mn40_as and mn30_as) exhibited superior performance compared to the non-pre-trained models (mn4.0 and mn3.0). Overall, the best-performing model, mn30_as, which is a pre-trained model, demonstrated an average AUC across 10 folds as follows: combined model 0.8361 (95% CI 0.7667-0.9056; max 0.9541), male model 0.8010 (95% CI 0.6589-0.9432; max 1.000), and female model 0.7572 (95% CI 0.6578-0.8567; max 0.9779). However, for the female model, a slightly higher result was observed with the mn4.0, which scored 0.7679 (95% CI 0.6426-0.8931; max 0.9722). Additionally, the other models (pre-trained; mn40_as, non-pre-trained; mn4.0 and mn3.0) also achieved performance above 0.7 in most cases, and the highest fold-level performance for most models was approximately around 0.9. The 'mn' in model names refers to MobileNet and the following number indicates the 'width_mult' parameter. CONCLUSIONS In this study, we used mel-spectrogram analysis and a MobileNetV3 model for predicting dysphagia aspiration. Our research highlights voice analysis potential in dysphagia screening, diagnosis, and monitoring, aiming for non-invasive safer, and more effective interventions. TRIAL REGISTRATION This study was approved by the IRB (No. B-2109-707-303) and registered on clinicaltrials.gov (ID: NCT05149976).
Collapse
Affiliation(s)
- Jung-Min Kim
- Department of Health Science and Technology, Graduate School of Convergence Science and Technology, Seoul National University, Seoul, South Korea
- Department of Rehabilitation Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea
| | - Min-Seop Kim
- Department of Multimedia Engineering, Dongguk University, Seoul, South Korea
| | - Sun-Young Choi
- Department of Rehabilitation Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea
| | - Ju Seok Ryu
- Department of Rehabilitation Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea.
- Seoul National University College of Medicine, 82 Gumi-Ro 173 Beon-Gil, Bundang-Gu, Seongnam-Si, Seoul, Gyeonggi-Do, 13620, South Korea.
| |
Collapse
|
8
|
Migliorelli L, Scoppolini Massini L, Coccia M, Villani L, Frontoni E, Squartini S. A deep learning-based telemonitoring application to automatically assess oral diadochokinesis in patients with bulbar amyotrophic lateral sclerosis. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 242:107840. [PMID: 37832429 DOI: 10.1016/j.cmpb.2023.107840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 09/15/2023] [Accepted: 10/01/2023] [Indexed: 10/15/2023]
Abstract
BACKGROUND AND OBJECTIVES Timely identification of dysarthria progression in patients with bulbar-onset amyotrophic lateral sclerosis (ALS) is relevant to have a comprehensive assessment of the disease evolution. To this goal literature recognized the utmost importance of the assessment of the number of syllables uttered by a subject during the oral diadochokinesis (DDK) test. METHODS To support clinicians, this work proposes a remote deep learning-based system, which consists (i) of a web application to acquire audio tracks of bulbar-onset ALS patients and healthy control subjects while performing the oral DDK test (i.e., repeating the /pa/, /pa-ta-ka/ and /oo-ee/ syllables) and (ii) a DDK-AID network designed to process the acquired audio signals which have different duration and to output the number of per-task syllables repeated by the subject. RESULTS The DDK-AID network overcomes the comparative method achieving a mean Accuracy of 90.23 in counting syllables repeated by the eleven bulbar-onset ALS-patients while performing the oral DDK test. CONCLUSIONS The proposed remote monitoring system, in the light of the achieved performance, represents an important step towards the implementation of self-service telemedicine systems which may ensure customised care plans.
Collapse
Affiliation(s)
- Lucia Migliorelli
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy; AIDAPT S.r.l., Ancona, Italy.
| | - Lorenzo Scoppolini Massini
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy; AIDAPT S.r.l., Ancona, Italy
| | - Michela Coccia
- Centro Clinico NeuroMuscular Omnicentre (NeMO), Fondazione Serena Onlus, Ancona, Italy
| | - Laura Villani
- Department of Neuroscience, Neurorehabilitation Clinic, Azienda Ospedaliero-Universitaria delle Marche, Ancona, Italy
| | - Emanuele Frontoni
- AIDAPT S.r.l., Ancona, Italy; Department of Political Science, Communication and International Relations, Università degli Studi di Macerata, Macerata, Italy; Nemo Lab, Milan, Italy
| | - Stefano Squartini
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| |
Collapse
|
9
|
Xu H, Zheng W, Zhang Y, Zhao D, Wang L, Zhao Y, Wang W, Yuan Y, Zhang J, Huo Z, Wang Y, Zhao N, Qin Y, Liu K, Xi R, Chen G, Zhang H, Tang C, Yan J, Ge Q, Cheng H, Lu Y, Gao L. A fully integrated, standalone stretchable device platform with in-sensor adaptive machine learning for rehabilitation. Nat Commun 2023; 14:7769. [PMID: 38012169 PMCID: PMC10682047 DOI: 10.1038/s41467-023-43664-7] [Citation(s) in RCA: 33] [Impact Index Per Article: 16.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 11/16/2023] [Indexed: 11/29/2023] Open
Abstract
Post-surgical treatments of the human throat often require continuous monitoring of diverse vital and muscle activities. However, wireless, continuous monitoring and analysis of these activities directly from the throat skin have not been developed. Here, we report the design and validation of a fully integrated standalone stretchable device platform that provides wireless measurements and machine learning-based analysis of diverse vibrations and muscle electrical activities from the throat. We demonstrate that the modified composite hydrogel with low contact impedance and reduced adhesion provides high-quality long-term monitoring of local muscle electrical signals. We show that the integrated triaxial broad-band accelerometer also measures large body movements and subtle physiological activities/vibrations. We find that the combined data processed by a 2D-like sequential feature extractor with fully connected neurons facilitates the classification of various motion/speech features at a high accuracy of over 90%, which adapts to the data with noise from motion artifacts or the data from new human subjects. The resulting standalone stretchable device with wireless monitoring and machine learning-based processing capabilities paves the way to design and apply wearable skin-interfaced systems for the remote monitoring and treatment evaluation of various diseases.
Collapse
Affiliation(s)
- Hongcheng Xu
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Weihao Zheng
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Yang Zhang
- Department of Medical Electronics, School of Biomedical Engineering, Air Force Medical University, Xi'an, 710032, China
| | - Daqing Zhao
- Department of Otolaryngology-Head and Neck Surgery, The Second Affiliated Hospital of Air Force Medical University, Xi'an, 710032, China
| | - Lu Wang
- Department of Otolaryngology-Head and Neck Surgery, The Second Affiliated Hospital of Air Force Medical University, Xi'an, 710032, China
| | - Yunlong Zhao
- Pen-Tung Sah Institute of Micro-Nano Science and Technology, Xiamen University, Xiamen, 361102, China
| | - Weidong Wang
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China.
| | - Yangbo Yuan
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Ji Zhang
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Zimin Huo
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Yuejiao Wang
- Applied Mechanics Laboratory, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Ningjuan Zhao
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Yuxin Qin
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Ke Liu
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Ruida Xi
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Gang Chen
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Haiyan Zhang
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Chu Tang
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710126, China
| | - Junyu Yan
- School of Mechano-Electronic Engineering, Xidian University, Xian, 710071, China
| | - Qi Ge
- Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, 518055, China
| | - Huanyu Cheng
- Department of Engineering Science and Mechanics, The Pennsylvania State University, University Park, PA, 16802, USA.
| | - Yang Lu
- Department of Mechanical Engineering, The University of Hong Kong, Pokfulam, Hong Kong, 999077, Hong Kong SAR.
| | - Libo Gao
- Pen-Tung Sah Institute of Micro-Nano Science and Technology, Xiamen University, Xiamen, 361102, China.
| |
Collapse
|
10
|
Saab R, Balachandar A, Mahdi H, Nashnoush E, Perri LX, Waldron AL, Sadeghian A, Rubenfeld G, Crowley M, Boulos MI, Murray BJ, Khosravani H. Machine-learning assisted swallowing assessment: a deep learning-based quality improvement tool to screen for post-stroke dysphagia. Front Neurosci 2023; 17:1302132. [PMID: 38130696 PMCID: PMC10734030 DOI: 10.3389/fnins.2023.1302132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 11/07/2023] [Indexed: 12/23/2023] Open
Abstract
Introduction Post-stroke dysphagia is common and associated with significant morbidity and mortality, rendering bedside screening of significant clinical importance. Using voice as a biomarker coupled with deep learning has the potential to improve patient access to screening and mitigate the subjectivity associated with detecting voice change, a component of several validated screening protocols. Methods In this single-center study, we developed a proof-of-concept model for automated dysphagia screening and evaluated the performance of this model on training and testing cohorts. Patients were admitted to a comprehensive stroke center, where primary English speakers could follow commands without significant aphasia and participated on a rolling basis. The primary outcome was classification either as a pass or fail equivalent using a dysphagia screening test as a label. Voice data was recorded from patients who spoke a standardized set of vowels, words, and sentences from the National Institute of Health Stroke Scale. Seventy patients were recruited and 68 were included in the analysis, with 40 in training and 28 in testing cohorts, respectively. Speech from patients was segmented into 1,579 audio clips, from which 6,655 Mel-spectrogram images were computed and used as inputs for deep-learning models (DenseNet and ConvNext, separately and together). Clip-level and participant-level swallowing status predictions were obtained through a voting method. Results The models demonstrated clip-level dysphagia screening sensitivity of 71% and specificity of 77% (F1 = 0.73, AUC = 0.80 [95% CI: 0.78-0.82]). At the participant level, the sensitivity and specificity were 89 and 79%, respectively (F1 = 0.81, AUC = 0.91 [95% CI: 0.77-1.05]). Discussion This study is the first to demonstrate the feasibility of applying deep learning to classify vocalizations to detect post-stroke dysphagia. Our findings suggest potential for enhancing dysphagia screening in clinical settings. https://github.com/UofTNeurology/masa-open-source.
Collapse
Affiliation(s)
- Rami Saab
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Arjun Balachandar
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Hamza Mahdi
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Eptehal Nashnoush
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Lucas X. Perri
- Goodfellow-Waldron Initiative in Stroke Innovation and Recovery, Division of Neurology, Neurology Quality and Innovation Lab, University of Toronto, Toronto, ON, Canada
| | - Ashley L. Waldron
- Goodfellow-Waldron Initiative in Stroke Innovation and Recovery, Division of Neurology, Neurology Quality and Innovation Lab, University of Toronto, Toronto, ON, Canada
| | - Alireza Sadeghian
- Department of Computer Science, Faculty of Science, Toronto Metropolitan University, Toronto, ON, Canada
| | - Gordon Rubenfeld
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Interdepartmental Division of Critical Care, Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Mark Crowley
- Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Mark I. Boulos
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
| | - Brian J. Murray
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Houman Khosravani
- Hurvitz Brain Sciences Program, Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
- Goodfellow-Waldron Initiative in Stroke Innovation and Recovery, Division of Neurology, Neurology Quality and Innovation Lab, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
11
|
Romero Arias T, Redondo Cortés I, Pérez Del Olmo A. Biomechanical Parameters of Voice in Parkinson's Disease Patients. Folia Phoniatr Logop 2023; 76:91-101. [PMID: 37499642 DOI: 10.1159/000533289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 07/24/2023] [Indexed: 07/29/2023] Open
Abstract
INTRODUCTION Previous research on voice in Parkinson's disease (PD) has consistently demonstrated alterations in acoustic parameters, including fundamental frequency (F0), maximum phonation time, Shimmer, and Jitter. However, investigations into acoustic parameter alterations in individuals with PD are limited. METHODS We conducted an experimental study involving 20 PD patients (six women and fourteen men). Subjective measures of voice (VHI-30 scale and GRBAS) and objective measures using the OnlineLAB App tool for analyzing biomechanical correlates of voice were recorded. The app analyzed a total of 22 biomechanical parameters of voice. RESULTS The results of subjective measures were consistent with findings from previous studies. However, the results of objective measures did not align with studies that employed acoustic measures. CONCLUSIONS The biomechanical analysis revealed alterations in various parameters according to gender. These findings open up a new avenue of research in voice analysis for patients with PD, whether through acoustic or biomechanical analysis, aiming to determine whether the observed changes in these patients' voices are attributable to age or disease progression. This line of investigation will help elucidate the relative contribution of these factors to vocal alterations in PD patients and provide a more comprehensive understanding of the underlying mechanisms.
Collapse
Affiliation(s)
- Tatiana Romero Arias
- Faculty of Health Sciences, Speech Therapy Section, Pontifical University of Salamanca, Salamanca, Spain
| | - Inés Redondo Cortés
- Faculty of Health Sciences, Speech Therapy Section, Pontifical University of Salamanca, Salamanca, Spain
| | - Adrián Pérez Del Olmo
- Faculty of Health Sciences, Speech Therapy Section, Pontifical University of Salamanca, Salamanca, Spain
| |
Collapse
|
12
|
Idrisoglu A, Dallora AL, Anderberg P, Berglund JS. Applied Machine Learning Techniques to Diagnose Voice-Affecting Conditions and Disorders: Systematic Literature Review. J Med Internet Res 2023; 25:e46105. [PMID: 37467031 PMCID: PMC10398366 DOI: 10.2196/46105] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 04/26/2023] [Accepted: 05/23/2023] [Indexed: 07/20/2023] Open
Abstract
BACKGROUND Normal voice production depends on the synchronized cooperation of multiple physiological systems, which makes the voice sensitive to changes. Any systematic, neurological, and aerodigestive distortion is prone to affect voice production through reduced cognitive, pulmonary, and muscular functionality. This sensitivity inspired using voice as a biomarker to examine disorders that affect the voice. Technological improvements and emerging machine learning (ML) technologies have enabled possibilities of extracting digital vocal features from the voice for automated diagnosis and monitoring systems. OBJECTIVE This study aims to summarize a comprehensive view of research on voice-affecting disorders that uses ML techniques for diagnosis and monitoring through voice samples where systematic conditions, nonlaryngeal aerodigestive disorders, and neurological disorders are specifically of interest. METHODS This systematic literature review (SLR) investigated the state of the art of voice-based diagnostic and monitoring systems with ML technologies, targeting voice-affecting disorders without direct relation to the voice box from the point of view of applied health technology. Through a comprehensive search string, studies published from 2012 to 2022 from the databases Scopus, PubMed, and Web of Science were scanned and collected for assessment. To minimize bias, retrieval of the relevant references in other studies in the field was ensured, and 2 authors assessed the collected studies. Low-quality studies were removed through a quality assessment and relevant data were extracted through summary tables for analysis. The articles were checked for similarities between author groups to prevent cumulative redundancy bias during the screening process, where only 1 article was included from the same author group. RESULTS In the analysis of the 145 included studies, support vector machines were the most utilized ML technique (51/145, 35.2%), with the most studied disease being Parkinson disease (PD; reported in 87/145, 60%, studies). After 2017, 16 additional voice-affecting disorders were examined, in contrast to the 3 investigated previously. Furthermore, an upsurge in the use of artificial neural network-based architectures was observed after 2017. Almost half of the included studies were published in last 2 years (2021 and 2022). A broad interest from many countries was observed. Notably, nearly one-half (n=75) of the studies relied on 10 distinct data sets, and 11/145 (7.6%) used demographic data as an input for ML models. CONCLUSIONS This SLR revealed considerable interest across multiple countries in using ML techniques for diagnosing and monitoring voice-affecting disorders, with PD being the most studied disorder. However, the review identified several gaps, including limited and unbalanced data set usage in studies, and a focus on diagnostic test rather than disorder-specific monitoring. Despite the limitations of being constrained by only peer-reviewed publications written in English, the SLR provides valuable insights into the current state of research on ML-based voice-affecting disorder diagnosis and monitoring and highlighting areas to address in future research.
Collapse
Affiliation(s)
- Alper Idrisoglu
- Department of Health, Blekinge Institute of Technology, Karslkrona, Sweden
| | - Ana Luiza Dallora
- Department of Health, Blekinge Institute of Technology, Karslkrona, Sweden
| | - Peter Anderberg
- Department of Health, Blekinge Institute of Technology, Karslkrona, Sweden
- School of Health Sciences, University of Skövde, Skövde, Sweden
| | | |
Collapse
|
13
|
Lai DKH, Cheng ESW, Lim HJ, So BPH, Lam WK, Cheung DSK, Wong DWC, Cheung JCW. Computer-aided screening of aspiration risks in dysphagia with wearable technology: a Systematic Review and meta-analysis on test accuracy. Front Bioeng Biotechnol 2023; 11:1205009. [PMID: 37441197 PMCID: PMC10334490 DOI: 10.3389/fbioe.2023.1205009] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 06/20/2023] [Indexed: 07/15/2023] Open
Abstract
Aspiration caused by dysphagia is a prevalent problem that causes serious health consequences and even death. Traditional diagnostic instruments could induce pain, discomfort, nausea, and radiation exposure. The emergence of wearable technology with computer-aided screening might facilitate continuous or frequent assessments to prompt early and effective management. The objectives of this review are to summarize these systems to identify aspiration risks in dysphagic individuals and inquire about their accuracy. Two authors independently searched electronic databases, including CINAHL, Embase, IEEE Xplore® Digital Library, PubMed, Scopus, and Web of Science (PROSPERO reference number: CRD42023408960). The risk of bias and applicability were assessed using QUADAS-2. Nine (n = 9) articles applied accelerometers and/or acoustic devices to identify aspiration risks in patients with neurodegenerative problems (e.g., dementia, Alzheimer's disease), neurogenic problems (e.g., stroke, brain injury), in addition to some children with congenital abnormalities, using videofluoroscopic swallowing study (VFSS) or fiberoptic endoscopic evaluation of swallowing (FEES) as the reference standard. All studies employed a traditional machine learning approach with a feature extraction process. Support vector machine (SVM) was the most famous machine learning model used. A meta-analysis was conducted to evaluate the classification accuracy and identify risky swallows. Nevertheless, we decided not to conclude the meta-analysis findings (pooled diagnostic odds ratio: 21.5, 95% CI, 2.7-173.6) because studies had unique methodological characteristics and major differences in the set of parameters/thresholds, in addition to the substantial heterogeneity and variations, with sensitivity levels ranging from 21.7% to 90.0% between studies. Small sample sizes could be a critical problem in existing studies (median = 34.5, range 18-449), especially for machine learning models. Only two out of the nine studies had an optimized model with sensitivity over 90%. There is a need to enlarge the sample size for better generalizability and optimize signal processing, segmentation, feature extraction, classifiers, and their combinations to improve the assessment performance. Systematic Review Registration: (https://www.crd.york.ac.uk/prospero/), identifier (CRD42023408960).
Collapse
Affiliation(s)
- Derek Ka-Hei Lai
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Ethan Shiu-Wang Cheng
- Department of Electronic and Information Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Hyo-Jung Lim
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Bryan Pak-Hei So
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Wing-Kai Lam
- Sports Information and External Affairs Centre, Hong Kong Sports Institute Ltd, Hong Kong, China
| | - Daphne Sze Ki Cheung
- School of Nursing, The Hong Kong Polytechnic University, Hong Kong, China
- Research Institute of Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| | - Duo Wai-Chi Wong
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - James Chung-Wai Cheung
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
- Research Institute of Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
14
|
Hoffmann J, Roldan-Vasco S, Krüger K, Niekiel F, Hansen C, Maetzler W, Orozco-Arroyave JR, Schmidt G. Pilot Study: Magnetic Motion Analysis for Swallowing Detection Using MEMS Cantilever Actuators. SENSORS (BASEL, SWITZERLAND) 2023; 23:3594. [PMID: 37050654 PMCID: PMC10099077 DOI: 10.3390/s23073594] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 03/22/2023] [Accepted: 03/28/2023] [Indexed: 06/19/2023]
Abstract
The swallowing process involves complex muscle coordination mechanisms. When alterations in such mechanisms are produced by neurological conditions or diseases, a swallowing disorder known as dysphagia occurs. The instrumental evaluation of dysphagia is currently performed by invasive and experience-dependent techniques. Otherwise, non-invasive magnetic methods have proven to be suitable for various biomedical applications and might also be applicable for an objective swallowing assessment. In this pilot study, we performed a novel approach for deglutition evaluation based on active magnetic motion sensing with permanent magnet cantilever actuators. During the intake of liquids with different consistency, we recorded magnetic signals of relative movements between a stationary sensor and a body-worn actuator on the cricoid cartilage. Our results indicate the detection capability of swallowing-related movements in terms of a characteristic pattern. Consequently, the proposed technique offers the potential for dysphagia screening and biofeedback-based therapies.
Collapse
Affiliation(s)
- Johannes Hoffmann
- Department of Electrical and Information Engineering, Faculty of Engineering, Kiel University, 24118 Kiel, Germany
| | - Sebastian Roldan-Vasco
- GITA Lab, Faculty of Engineering, Universidad de Antioquia, Medellín 050010, Colombia
- Faculty of Engineering, Instituto Tecnológico Metropolitano, Medellín 050536, Colombia
| | - Karolin Krüger
- Department of Electrical and Information Engineering, Faculty of Engineering, Kiel University, 24118 Kiel, Germany
| | - Florian Niekiel
- Fraunhofer Institute for Silicon Technology ISIT, 25524 Itzehoe, Germany
| | - Clint Hansen
- Department of Neurology, Kiel University, 24118 Kiel, Germany
| | - Walter Maetzler
- Department of Neurology, Kiel University, 24118 Kiel, Germany
| | - Juan Rafael Orozco-Arroyave
- GITA Lab, Faculty of Engineering, Universidad de Antioquia, Medellín 050010, Colombia
- Pattern Recognition Lab, Friedrich-Alexander-Universität, 91054 Erlangen, Germany
| | - Gerhard Schmidt
- Department of Electrical and Information Engineering, Faculty of Engineering, Kiel University, 24118 Kiel, Germany
| |
Collapse
|
15
|
Lim HJ, Lai DKH, So BPH, Yip CCK, Cheung DSK, Cheung JCW, Wong DWC. A Comprehensive Assessment Protocol for Swallowing (CAPS): Paving the Way towards Computer-Aided Dysphagia Screening. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:2998. [PMID: 36833691 PMCID: PMC9963613 DOI: 10.3390/ijerph20042998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Revised: 02/04/2023] [Accepted: 02/06/2023] [Indexed: 06/18/2023]
Abstract
Dysphagia is one of the most common problems among older adults, which might lead to aspiration pneumonia and eventual death. It calls for a feasible, reliable, and standardized screening or assessment method to prompt rehabilitation measures and mitigate the risks of dysphagia complications. Computer-aided screening using wearable technology could be the solution to the problem but is not clinically applicable because of the heterogeneity of assessment protocols. The aim of this paper is to formulate and unify a swallowing assessment protocol, named the Comprehensive Assessment Protocol for Swallowing (CAPS), by integrating existing protocols and standards. The protocol consists of two phases: the pre-test phase and the assessment phase. The pre-testing phase involves applying different texture or thickness levels of food/liquid and determining the required bolus volume for the subsequent assessment. The assessment phase involves dry (saliva) swallowing, wet swallowing of different food/liquid consistencies, and non-swallowing (e.g., yawning, coughing, speaking, etc.). The protocol is designed to train the swallowing/non-swallowing event classification that facilitates future long-term continuous monitoring and paves the way towards continuous dysphagia screening.
Collapse
Affiliation(s)
- Hyo-Jung Lim
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Derek Ka-Hei Lai
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Bryan Pak-Hei So
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | | | - Daphne Sze Ki Cheung
- School of Nursing, The Hong Kong Polytechnic University, Hong Kong, China
- Research Institute of Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| | - James Chung-Wai Cheung
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
- Research Institute of Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| | - Duo Wai-Chi Wong
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
16
|
Konradi J, Zajber M, Betz U, Drees P, Gerken A, Meine H. AI-Based Detection of Aspiration for Video-Endoscopy with Visual Aids in Meaningful Frames to Interpret the Model Outcome. SENSORS (BASEL, SWITZERLAND) 2022; 22:9468. [PMID: 36502169 PMCID: PMC9736280 DOI: 10.3390/s22239468] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 06/17/2023]
Abstract
Disorders of swallowing often lead to pneumonia when material enters the airways (aspiration). Flexible Endoscopic Evaluation of Swallowing (FEES) plays a key role in the diagnostics of aspiration but is prone to human errors. An AI-based tool could facilitate this process. Recent non-endoscopic/non-radiologic attempts to detect aspiration using machine-learning approaches have led to unsatisfying accuracy and show black-box characteristics. Hence, for clinical users it is difficult to trust in these model decisions. Our aim is to introduce an explainable artificial intelligence (XAI) approach to detect aspiration in FEES. Our approach is to teach the AI about the relevant anatomical structures, such as the vocal cords and the glottis, based on 92 annotated FEES videos. Simultaneously, it is trained to detect boluses that pass the glottis and become aspirated. During testing, the AI successfully recognized the glottis and the vocal cords but could not yet achieve satisfying aspiration detection quality. While detection performance must be optimized, our architecture results in a final model that explains its assessment by locating meaningful frames with relevant aspiration events and by highlighting suspected boluses. In contrast to comparable AI tools, our framework is verifiable and interpretable and, therefore, accountable for clinical users.
Collapse
Affiliation(s)
- Jürgen Konradi
- Institute of Physical Therapy, Prevention and Rehabilitation, University Medical Center of the Johannes Gutenberg-University Mainz, 55131 Mainz, Germany
| | - Milla Zajber
- Department for Health Care & Nursing, Catholic University of Applied Sciences, 55122 Mainz, Germany
| | - Ulrich Betz
- Institute of Physical Therapy, Prevention and Rehabilitation, University Medical Center of the Johannes Gutenberg-University Mainz, 55131 Mainz, Germany
| | - Philipp Drees
- Department of Orthopedics and Trauma Surgery, University Medical Center of the Johannes Gutenberg-University Mainz, 55131 Mainz, Germany
| | - Annika Gerken
- Fraunhofer Institute for Digital Medicine MEVIS, 28359 Bremen, Germany
| | - Hans Meine
- Fraunhofer Institute for Digital Medicine MEVIS, 28359 Bremen, Germany
| |
Collapse
|
17
|
Park HY, Park D, Kang HS, Kim H, Lee S, Im S. Post-stroke respiratory complications using machine learning with voice features from mobile devices. Sci Rep 2022; 12:16682. [PMID: 36202829 PMCID: PMC9537337 DOI: 10.1038/s41598-022-20348-8] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 09/12/2022] [Indexed: 11/11/2022] Open
Abstract
Abnormal voice may identify those at risk of post-stroke aspiration. This study was aimed to determine whether machine learning algorithms with voice recorded via a mobile device can accurately classify those with dysphagia at risk of tube feeding and post-stroke aspiration pneumonia and be used as digital biomarkers. Voice samples from patients referred for swallowing disturbance in a university-affiliated hospital were collected prospectively using a mobile device. Subjects that required tube feeding were further classified to high risk of respiratory complication, based on the voluntary cough strength and abnormal chest x-ray images. A total of 449 samples were obtained, with 234 requiring tube feeding and 113 showing high risk of respiratory complications. The eXtreme gradient boosting multimodal models that included abnormal acoustic features and clinical variables showed high sensitivity levels of 88.7% (95% CI 82.6–94.7) and 84.5% (95% CI 76.9–92.1) in the classification of those at risk of tube feeding and at high risk of respiratory complications; respectively. In both cases, voice features proved to be the strongest contributing factors in these models. Voice features may be considered as viable digital biomarkers in those at risk of respiratory complications related to post-stroke dysphagia.
Collapse
Affiliation(s)
- Hae-Yeon Park
- Department of Rehabilitation Medicine, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - DoGyeom Park
- Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
| | - Hye Seon Kang
- Department of Pulmonary, Allergy and Critical Care Medicine, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea.,Department of Internal Medicine, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - HyunBum Kim
- Department of Otolaryngology-Head and Neck Surgery, Yeouido St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Seungchul Lee
- Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea. .,Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH), 223, 5th Engineering Building, 77 Cheongam-Ro, Nam-Gu, Pohang, 37673, Gyeongbuk, Republic of Korea.
| | - Sun Im
- Department of Rehabilitation Medicine, Bucheon St. Mary's Hospital, College of Medicine, Catholic University of Korea, 327 Sosa-ro, Seoul, Bucheon-si, 14647, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
18
|
The global prevalence of oropharyngeal dysphagia in different populations: a systematic review and meta-analysis. J Transl Med 2022; 20:175. [PMID: 35410274 PMCID: PMC9003990 DOI: 10.1186/s12967-022-03380-0] [Citation(s) in RCA: 54] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 04/04/2022] [Indexed: 01/21/2023] Open
Abstract
Background Oropharyngeal dysphagia (OD) refers to any abnormality in the physiology of swallowing in the upper gastrointestinal tract, which leads to the related clinical complications, such as malnutrition, dehydration, and sever complication, such as aspiration pneumonia, suffocation, and eventually, premature death. The previous studies indicated a various range of prevalence of OD. The present systematic review and meta-analysis aimed to standardize the global prevalence of OD in different populations. Methods A systematic literature review was conducted using Embase, Scopus, PubMed, Web of Science (WoS) databases, and Google Scholar motor engine using related MeSH/Emtree and Free Text words, with no time limitation until November 2021. The heterogeneity among studies was quantified using I2 index and the random effects model was used, due to the high heterogeneity among the results of studies included in the meta-analysis. Results The systematic literature search retrieved 2092 studies. After excluding the irrelevant studies, ultimately 27 articles with a sample size of 9841 were included in the meta-analysis. After combining the studies, the overall estimate of the global prevalence rate of OD was 43.8% (95% CI 33.3–54.9%) and the highest prevalence rate was estimated in Africa with 64.2% (95% CI 53.2–73.9%). Given the subgroup analysis based on the study population, the highest prevalence of OD was related to Dementia with 72.4% (95% CI 26.7–95.0%). The results of meta-regression indicated that the prevalence of OD has an increasing trend with the enhancement of year of publication and mean age. Conclusion The results of the present systematic review and meta-analysis revealed that the prevalence of OD is high in different populations and its trend has been increasing in recent years. Therefore, the appropriate strategies should be applied to reduce the prevalence of OD by finding its causation and monitoring at all levels, as well as providing feedback to hospitals.
Collapse
|
19
|
Artificial intelligence in gastrointestinal and hepatic imaging: past, present and future scopes. Clin Imaging 2022; 87:43-53. [DOI: 10.1016/j.clinimag.2022.04.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2021] [Revised: 03/09/2022] [Accepted: 04/11/2022] [Indexed: 11/19/2022]
|
20
|
Kent RD, Kim Y, Chen LM. Oral and Laryngeal Diadochokinesis Across the Life Span: A Scoping Review of Methods, Reference Data, and Clinical Applications. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2022; 65:574-623. [PMID: 34958599 DOI: 10.1044/2021_jslhr-21-00396] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
PURPOSE The aim of this study was to conduct a scoping review of research on oral and laryngeal diadochokinesis (DDK) in children and adults, either typically developing/developed or with a clinical diagnosis. METHOD Searches were conducted with PubMed/MEDLINE, Google Scholar, CINAHL, and legacy sources in retrieved articles. Search terms included the following: DDK, alternating motion rate, maximum repetition rate, sequential motion rate, and syllable repetition rate. RESULTS Three hundred sixty articles were retrieved and included in the review. Data source tables for children and adults list the number and ages of study participants, DDK task, and language(s) spoken. Cross-sectional data for typically developing children and typically developed adults are compiled for the monosyllables /pʌ/, /tʌ/, and /kʌ/; the trisyllable /pʌtʌkʌ/; and laryngeal DDK. In addition, DDK results are summarized for 26 disorders or conditions. DISCUSSION A growing number of multidisciplinary reports on DDK affirm its role in clinical practice and research across the world. Atypical DDK is not a well-defined singular entity but rather a label for a collection of disturbances associated with diverse etiologies, including motoric, structural, sensory, and cognitive. The clinical value of DDK can be optimized by consideration of task parameters, analysis method, and population of interest.
Collapse
Affiliation(s)
- Ray D Kent
- Department of Communication Sciences and Disorders, University of Wisconsin-Madison
| | - Yunjung Kim
- School of Communication Sciences & Disorders, Florida State University, Tallahassee
| | - Li-Mei Chen
- Department of Foreign Languages and Literature, National Cheng Kung University, Tainan, Taiwan
| |
Collapse
|