1
|
Nobel SMN, Swapno SMMR, Islam MR, Safran M, Alfarhood S, Mridha MF. A machine learning approach for vocal fold segmentation and disorder classification based on ensemble method. Sci Rep 2024; 14:14435. [PMID: 38910146 DOI: 10.1038/s41598-024-64987-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2024] [Accepted: 06/14/2024] [Indexed: 06/25/2024] Open
Abstract
In the healthcare domain, the essential task is to understand and classify diseases affecting the vocal folds (VFs). The accurate identification of VF disease is the key issue in this domain. Integrating VF segmentation and disease classification into a single system is challenging but important for precise diagnostics. Our study addresses this challenge by combining VF illness categorization and VF segmentation into a single integrated system. We utilized two effective ensemble machine learning methods: ensemble EfficientNetV2L-LGBM and ensemble UNet-BiGRU. We utilized the EfficientNetV2L-LGBM model for classification, achieving a training accuracy of 98.88%, validation accuracy of 97.73%, and test accuracy of 97.88%. These exceptional outcomes highlight the system's ability to classify different VF illnesses precisely. In addition, we utilized the UNet-BiGRU model for segmentation, which attained a training accuracy of 92.55%, a validation accuracy of 89.87%, and a significant test accuracy of 91.47%. In the segmentation task, we examined some methods to improve our ability to divide data into segments, resulting in a testing accuracy score of 91.99% and an Intersection over Union (IOU) of 87.46%. These measures demonstrate skill of the model in accurately defining and separating VF. Our system's classification and segmentation results confirm its capacity to effectively identify and segment VF disorders, representing a significant advancement in enhancing diagnostic accuracy and healthcare in this specialized field. This study emphasizes the potential of machine learning to transform the medical field's capacity to categorize VF and segment VF, providing clinicians with a vital instrument to mitigate the profound impact of the condition. Implementing this innovative approach is expected to enhance medical procedures and provide a sense of optimism to those globally affected by VF disease.
Collapse
Affiliation(s)
- S M Nuruzzaman Nobel
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, 1216, Bangladesh
| | - S M Masfequier Rahman Swapno
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, 1216, Bangladesh
| | - Md Rajibul Islam
- Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Mejdl Safran
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, P. O. Box 51178, 11543, Riyadh, Saudi Arabia.
| | - Sultan Alfarhood
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, P. O. Box 51178, 11543, Riyadh, Saudi Arabia
| | - M F Mridha
- Department of Computer Science, American International University-Bangladesh, Dhaka, 1229, Bangladesh
| |
Collapse
|
2
|
Kim HB, Song J, Park S, Lee YO. Classification of laryngeal diseases including laryngeal cancer, benign mucosal disease, and vocal cord paralysis by artificial intelligence using voice analysis. Sci Rep 2024; 14:9297. [PMID: 38654036 DOI: 10.1038/s41598-024-58817-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 04/03/2024] [Indexed: 04/25/2024] Open
Abstract
Voice change is often the first sign of laryngeal cancer, leading to diagnosis through hospital laryngoscopy. Screening for laryngeal cancer solely based on voice could enhance early detection. However, identifying voice indicators specific to laryngeal cancer is challenging, especially when differentiating it from other laryngeal ailments. This study presents an artificial intelligence model designed to distinguish between healthy voices, laryngeal cancer voices, and those of the other laryngeal conditions. We gathered voice samples of individuals with laryngeal cancer, vocal cord paralysis, benign mucosal diseases, and healthy participants. Comprehensive testing was conducted to determine the best mel-frequency cepstral coefficient conversion and machine learning techniques, with results analyzed in-depth. In our tests, laryngeal diseases distinguishing from healthy voices achieved an accuracy of 0.85-0.97. However, when multiclass classification, accuracy ranged from 0.75 to 0.83. These findings highlight the challenges of artificial intelligence-driven voice-based diagnosis due to overlaps with benign conditions but also underscore its potential.
Collapse
Affiliation(s)
- Hyun-Bum Kim
- Department of Otolaryngology-Head and Neck Surgery, The Catholic University of Korea, Seoul, South Korea
| | - Jaemin Song
- Department of Industrial and Data Engineering, Hongik University, Seoul, South Korea
| | - Seho Park
- Department of Industrial and Data Engineering, Hongik University, Seoul, South Korea
| | - Yong Oh Lee
- Department of Industrial and Data Engineering, Hongik University, Seoul, South Korea.
| |
Collapse
|
3
|
Kuo HC, Hsieh YP, Tseng HH, Wang CT, Fang SH, Tsao Y. Toward Real-World Voice Disorder Classification. IEEE Trans Biomed Eng 2023; 70:2922-2932. [PMID: 37099463 DOI: 10.1109/tbme.2023.3270532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/27/2023]
Abstract
OBJECTIVE Voice disorders significantly compromise individuals' ability to speak in their daily lives. Without early diagnosis and treatment, these disorders may deteriorate drastically. Thus, automatic classification systems at home are desirable for people who are inaccessible to clinical disease assessments. However, the performance of such systems may be weakened due to the constrained resources and domain mismatch between the clinical data and noisy real-world data. METHODS This study develops a compact and domain-robust voice disorder classification system to identify the utterances of health, neoplasm, and benign structural diseases. Our proposed system utilizes a feature extractor model composed of factorized convolutional neural networks and subsequently deploys domain adversarial training to reconcile the domain mismatch by extracting domain-invariant features. RESULTS The results show that the unweighted average recall in the noisy real-world domain improved by 13% and remained at 80% in the clinic domain with only slight degradation. The domain mismatch was effectively eliminated. Moreover, the proposed system reduced the usage of both memory and computation by over 73.9%. CONCLUSION By deploying factorized convolutional neural networks and domain adversarial training, domain-invariant features can be derived for voice disorder classification with limited resources. The promising results confirm that the proposed system can significantly reduce resource consumption and improve classification accuracy by considering the domain mismatch. SIGNIFICANCE To the best of our knowledge, this is the first study that jointly considers real-world model compression and noise-robustness issues in voice disorder classification. The proposed system is intended for application to embedded systems with limited resources.
Collapse
|
4
|
Yang Q, Li X, Ding X, Xu F, Ling Z. Deep learning-based speech analysis for Alzheimer's disease detection: a literature review. Alzheimers Res Ther 2022; 14:186. [PMID: 36517837 PMCID: PMC9749308 DOI: 10.1186/s13195-022-01131-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 11/23/2022] [Indexed: 12/23/2022]
Abstract
BACKGROUND Alzheimer's disease has become one of the most common neurodegenerative diseases worldwide, which seriously affects the health of the elderly. Early detection and intervention are the most effective prevention methods currently. Compared with traditional detection methods such as traditional scale tests, electroencephalograms, and magnetic resonance imaging, speech analysis is more convenient for automatic large-scale Alzheimer's disease detection and has attracted extensive attention from researchers. In particular, deep learning-based speech analysis and language processing techniques for Alzheimer's disease detection have been studied and achieved impressive results. METHODS To integrate the latest research progresses, hundreds of relevant papers from ACM, DBLP, IEEE, PubMed, Scopus, Web of Science electronic databases, and other sources were retrieved. We used these keywords for paper search: (Alzheimer OR dementia OR cognitive impairment) AND (speech OR voice OR audio) AND (deep learning OR neural network). CONCLUSIONS Fifty-two papers were finally retained after screening. We reviewed and presented the speech databases, deep learning methods, and model performances of these studies. In the end, we pointed out the mainstreams and limitations in the current studies and provided a direction for future research.
Collapse
Affiliation(s)
- Qin Yang
- iFlytek Research, iFlytek Co.Ltd, Hefei, China
| | - Xin Li
- grid.59053.3a0000000121679639NELSLIP, University of Science and Technology of China, Hefei, China ,iFlytek Research, iFlytek Co.Ltd, Hefei, China
| | - Xinyun Ding
- iFlytek Research, iFlytek Co.Ltd, Hefei, China
| | - Feiyang Xu
- iFlytek Research, iFlytek Co.Ltd, Hefei, China
| | - Zhenhua Ling
- grid.59053.3a0000000121679639NELSLIP, University of Science and Technology of China, Hefei, China
| |
Collapse
|
5
|
Leite DRA, de Moraes RM, Lopes LW. Different Performances of Machine Learning Models to Classify Dysphonic and Non-Dysphonic Voices. J Voice 2022:S0892-1997(22)00353-8. [PMID: 36513560 DOI: 10.1016/j.jvoice.2022.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 10/28/2022] [Accepted: 11/01/2022] [Indexed: 12/14/2022]
Abstract
OBJECTIVE To analyze the performance of 10 different machine learning (ML) classifiers for discrimination between dysphonic and non-dysphonic voices, using a variance threshold as a method for the selection and reduction of acoustic measurements used in the classifier. METHOD We analyzed 435 samples of individuals (337 female and 98 male), with a mean age of 41.07 ± 13.73 years, of which 384 were dysphonic and 51 were non-dysphonic. From the sustained /ε/ vowel sample, 34 acoustic measurements were extracted, including traditional perturbation and noise measurements, cepstral/spectral measurements, and measurements based on nonlinear models. The variance method was used to select the best set of acoustic measurements. We tested the performance of the best-selected set with 10 ML classifiers using precision, sensitivity, specificity, accuracy, and F1-Score measurements. The kappa coefficient was used to verify the reproducibility between the two datasets (training and testing). RESULTS The naive Bayes (NB) and stochastic gradient descent classifier (SGDC) models performed best in terms of accuracy, AUC, sensitivity, and specificity for a reduced dataset of 15 acoustic measures compared to the full dataset of 34 acoustic measures. SGDC and NB obtained the best performance results, with an accuracy of 0.91 and 0.76, respectively. These two classifiers presented moderate agreement, with a Kappa of 0.57 (SGDC) and 0.45 (NB). CONCLUSION Among the tested models, the NB and SGDC models performed better in discriminating between dysphonic and non-dysphonic voices from a set of 15 acoustic measures.
Collapse
Affiliation(s)
- Danilo Rangel Arruda Leite
- Department of Statistics, Graduate Program in Health Decision Models, Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil; Brazilian Hospital Services Company- Ebserh, Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil
| | - Ronei Marcos de Moraes
- Department of Statistics, Graduate Program in Health Decision Models, Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil; Department of Statistics, Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil
| | - Leonardo Wanderley Lopes
- Department of Statistics, Graduate Program in Health Decision Models, Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil; Department of Speech-Language and Hearing Sciences, Graduate Program in Linguistics, Universidade Federal da Paraíba - UFPB, João Pessoa, Paraíba, Brasil.
| |
Collapse
|
6
|
Deb S, Dandapat S. Analysis of out-of-breath speech for assessment of person’s physical fitness. COMPUT SPEECH LANG 2022. [DOI: 10.1016/j.csl.2022.101391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
7
|
Fu D, Zhang X, Chen D, Hu W. Pathological Voice Detection Based on Phase Reconstitution and Convolutional Neural Network. J Voice 2022:S0892-1997(22)00270-3. [PMID: 36280493 DOI: 10.1016/j.jvoice.2022.08.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/25/2022] [Accepted: 08/26/2022] [Indexed: 11/06/2022]
Abstract
The nonlinear dynamic features can effectively describe the acoustic characteristics of normal and pathological voice. In this paper, the phase space reconstruction and convolution neural network are used to classify the normal and pathological voice. The phase space information of normal and pathological voice is reconstructed using delay time and embedding dimension, the one-dimensional signal is converted to a two-dimensional matrix, and the reconstructed trajectory graph sample of the signal is generated. The trajectory graph samples are used as the input of the VGG-like convolutional neural network, and the graphical features are extracted to achieve a classification of normal and pathological voice. In order to overcome the lack of clinical data, a data enhancement scheme is used. The experiment which classifies the normal and pathological voice is carried out on three pathological databases respectively, i.e. the Massachusetts eye and ear infirmary (MEEI) database, Saarbrücken voice database (SVD) database, and a clinical database collected by the authors. Five-fold cross validation is used and the average recognition rates on the three databases are 99.42%, 97.30% and 95.88% respectively. The average recognition rates are 96.04% and 92.27% for normal, vocal fold paralysis and vocal fold non-paralysis voice in MEEI database and SVD database. The experimental results show that the method has high classification recognition rate and good robustness, and has certain universal applicability for the recognition of the normal and pathological voice.
Collapse
Affiliation(s)
- Deli Fu
- College of Electronic Engineering, Guangxi Normal University, Guilin, Guangxi, China
| | - Xuehui Zhang
- College of Electronic Engineering, Guangxi Normal University, Guilin, Guangxi, China
| | - Dandan Chen
- College of Electronic Engineering, Guangxi Normal University, Guilin, Guangxi, China.
| | - Weiping Hu
- College of Electronic Engineering, Guangxi Normal University, Guilin, Guangxi, China
| |
Collapse
|
8
|
Pakravan M, Jahed M. Significant pathological voice discrimination by computing posterior distribution of balanced accuracy. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
9
|
Reid J, Parmar P, Lund T, Aalto DK, Jeffery CC. Development of a machine-learning based voice disorder screening tool. Am J Otolaryngol 2022; 43:103327. [PMID: 34923280 DOI: 10.1016/j.amjoto.2021.103327] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 12/08/2021] [Indexed: 01/20/2023]
Abstract
OBJECTIVE Early recognition and referral are crucial for voice disorder management. Limited availability of subspecialists, poor primary care awareness, and the need for specialized equipment impede effective care. Thus, there is a need for a tool to improve voice pathology screening. Machine learning algorithms (MLAs) have shown promise in analyzing acoustic characteristics of phonation. However, few studies report clinical applications of MLAs for voice pathology detection. The objective of this study was to design and validate a MLA for detecting pathological voices. METHODS A MLA was developed for voice analysis. Audio samples converted into spectrograms were inputted into a pre-existing VGG19 convolutional neural network (CNN) and image-classifier. The resulting feature map was classified as either pathological or healthy using a Support Vector Machine (SVM) binary linear classifier. This combined MLA was "trained" with 950 sustained "/i/" vowel audio samples from the Saarbrucken Voice Database (SVD), which contains subjects with and without voice disorders. The trained MLA was "tested" with 406 SVD samples to determine sensitivity, specificity, and overall accuracy. External validation of the MLA was performed using clinical voice samples collected from patients attending a subspecialty voice clinic. RESULTS The MLA detected pathologies in SVD samples with 98.5% sensitivity, 97.1% specificity and 97.8% overall accuracy. In 30 samples obtained prospectively from voice clinic patients, the MLA detected pathologies with 100% sensitivity, 96.3% specificity and 96.7% overall accuracy. CONCLUSIONS This study demonstrates that a MLA using a simple audio input can detect diverse vocal pathologies with high sensitivity and specificity. Thus, this algorithm shows promise as a potential screening tool.
Collapse
Affiliation(s)
- Jonathan Reid
- Division of Otolaryngology-Head and Neck Surgery, Department of Surgery, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Preet Parmar
- Department of Physics, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Tyler Lund
- Faculty of Engineering, University of Alberta, Edmonton, AB, Canada
| | - Daniel K Aalto
- Communication Sciences and Disorders, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
| | - Caroline C Jeffery
- Division of Otolaryngology-Head and Neck Surgery, Department of Surgery, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada; Communication Sciences and Disorders, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada.
| |
Collapse
|
10
|
Lyakso E, Frolova O, Grigoriev A, Filatova Y, Makhnytkina O. Recognition of Emotional States of Children with down Syndrome by Facial Expression: Perceptual and Automatic Analysis of Dynamic Images. EXPERIMENTAL PSYCHOLOGY (RUSSIA) 2022. [DOI: 10.17759/exppsy.2022150310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
The study is devoted to the investigation of the recognition of the emotional state of children with Down syndrome (DS) by their facial expression. For this purpose, a series of perceptual experiments involving adults (n=75) and automatic analysis of the facial expressions of children (n=35, aged 5—16 years) were carried out using the FaceReader program. The ability of adults to recognize the emotional states of children: joy — neutral (calm state) — sadness — anger, by open faces and faces with masks over the eyes and mouth is shown. Better recognition of the state of joy and neutral state under the condition of an open face and a decrease in recognition accuracy in a mask in the eye area compared to the absence of a mask and a mask in the mouth area were found. Automatic recognition of the states of joy and neutral states is better than the states of sadness and anger, if the face is open and the mask in the mouth area of the child. The conditions for use the automatic recognition of facial expression in children with DS and for applying the method of perceptual analysis for identifying the specificity of the child emotional sphere development are discussed.
Collapse
|
11
|
Geng L, Shan H, Xiao Z, Wang W, Wei M. Voice pathology detection and classification from speech signals and EGG signals based on a multimodal fusion method. BIOMED ENG-BIOMED TE 2021; 66:613-625. [PMID: 34845886 DOI: 10.1515/bmt-2021-0112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 11/12/2021] [Indexed: 11/15/2022]
Abstract
Automatic voice pathology detection and classification plays an important role in the diagnosis and prevention of voice disorders. To accurately describe the pronunciation characteristics of patients with dysarthria and improve the effect of pathological voice detection, this study proposes a pathological voice detection method based on a multi-modal network structure. First, speech signals and electroglottography (EGG) signals are mapped from the time domain to the frequency domain spectrogram via a short-time Fourier transform (STFT). The Mel filter bank acts on the spectrogram to enhance the signal's harmonics and denoise. Second, a pre-trained convolutional neural network (CNN) is used as the backbone network to extract sound state features and vocal cord vibration features from the two signals. To obtain a better classification effect, the fused features are input into the long short-term memory (LSTM) network for voice feature selection and enhancement. The proposed system achieves 95.73% for accuracy with 96.10% F1-score and 96.73% recall using the Saarbrucken Voice Database (SVD); thus, enabling a new method for pathological speech detection.
Collapse
Affiliation(s)
- Lei Geng
- School of Life Sciences, Tiangong University, Tianjin, China.,Tianjin Key Laboratory of Optoelectronic Detection Technology and System, Tianjin, China
| | - Hongfeng Shan
- School of Electronic and Information Engineering, Tiangong University, Tianjin, China.,Tianjin Key Laboratory of Optoelectronic Detection Technology and System, Tianjin, China
| | - Zhitao Xiao
- School of Life Sciences, Tiangong University, Tianjin, China.,Tianjin Key Laboratory of Optoelectronic Detection Technology and System, Tianjin, China
| | - Wei Wang
- Department of Otorhinolaryngology Head and Neck Surgery, Tianjin First Central Hospital, Tianjin, China.,Institute of Otolaryngology of Tianjin, Tianjin, China.,Key Laboratory of Auditory Speech and Balance Medicine, Tianjin, China.,Key Clinical Discipline of Tianjin (Otolaryngology), Tianjin, China.,Otolaryngology Clinical Quality Control Centre, Tianjin, China
| | - Mei Wei
- Department of Otorhinolaryngology Head and Neck Surgery, Tianjin First Central Hospital, Tianjin, China.,Institute of Otolaryngology of Tianjin, Tianjin, China.,Key Laboratory of Auditory Speech and Balance Medicine, Tianjin, China.,Key Clinical Discipline of Tianjin (Otolaryngology), Tianjin, China.,Otolaryngology Clinical Quality Control Centre, Tianjin, China
| |
Collapse
|
12
|
Martínez-Nicolás I, Llorente TE, Martínez-Sánchez F, Meilán JJG. Ten Years of Research on Automatic Voice and Speech Analysis of People With Alzheimer's Disease and Mild Cognitive Impairment: A Systematic Review Article. Front Psychol 2021; 12:620251. [PMID: 33833713 PMCID: PMC8021952 DOI: 10.3389/fpsyg.2021.620251] [Citation(s) in RCA: 54] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Accepted: 02/15/2021] [Indexed: 11/25/2022] Open
Abstract
Background: The field of voice and speech analysis has become increasingly popular over the last 10 years, and articles on its use in detecting neurodegenerative diseases have proliferated. Many studies have identified characteristic speech features that can be used to draw an accurate distinction between healthy aging among older people and those with mild cognitive impairment and Alzheimer's disease. Speech analysis has been singled out as a cost-effective and reliable method for detecting the presence of both conditions. In this research, a systematic review was conducted to determine these features and their diagnostic accuracy. Methods: Peer-reviewed literature was located across multiple databases, involving studies that apply new procedures of automatic speech analysis to collect behavioral evidence of linguistic impairments along with their diagnostic accuracy on Alzheimer's disease and mild cognitive impairment. The risk of bias was assessed by using JBI and QUADAS-2 checklists. Results: Thirty-five papers met the inclusion criteria; of these, 11 were descriptive studies that either identified voice features or explored their cognitive correlates, and the rest were diagnostic studies. Overall, the studies were of good quality and presented solid evidence of the usefulness of this technique. The distinctive acoustic and rhythmic features found are gathered. Most studies record a diagnostic accuracy over 88% for Alzheimer's and 80% for mild cognitive impairment. Conclusion: Automatic speech analysis is a promising tool for diagnosing mild cognitive impairment and Alzheimer's disease. The reported features seem to be indicators of the cognitive changes in older people. The specific features and the cognitive changes involved could be the subject of further research.
Collapse
Affiliation(s)
- Israel Martínez-Nicolás
- Faculty of Psychology, University of Salamanca, Salamanca, Spain.,Institute of Neuroscience of Castilla y León, University of Salamanca, Salamanca, Spain
| | - Thide E Llorente
- Faculty of Psychology, University of Salamanca, Salamanca, Spain.,Institute of Neuroscience of Castilla y León, University of Salamanca, Salamanca, Spain
| | | | - Juan José G Meilán
- Faculty of Psychology, University of Salamanca, Salamanca, Spain.,Institute of Neuroscience of Castilla y León, University of Salamanca, Salamanca, Spain
| |
Collapse
|
13
|
Gómez-García J, Moro-Velázquez L, Arias-Londoño J, Godino-Llorente J. On the design of automatic voice condition analysis systems. Part III: review of acoustic modelling strategies. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102049] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
14
|
|
15
|
Chen L, Wang C, Chen J, Xiang Z, Hu X. Voice Disorder Identification by using Hilbert-Huang Transform (HHT) and K Nearest Neighbor (KNN). J Voice 2020; 35:932.e1-932.e11. [PMID: 32402664 DOI: 10.1016/j.jvoice.2020.03.009] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2020] [Revised: 03/12/2020] [Accepted: 03/18/2020] [Indexed: 11/27/2022]
Abstract
OBJECTIVES Clinical evaluation of dysphonic voices involves a multidimensional approach, including a variety of instrumental and noninstrumental measures. Acoustic analyses provide an objective, noninvasive and intelligent measures of voice quality. Based on sound recordings, this paper proposes a new classification method of voice disorders with HHT and KNN. METHODS In this research, 12 features of each sample is calculated by HHT. Based on the algorithm of Linear Prediction Coefficient (LPCC), a sample can be characterized by 9 features. After each sample is expressed by 21 features, the classifier is constructed based on KNN. In addition, classifier based on KNN was further compared with random forest and extra trees classifiers in relation to their classification performance of voice disorder. RESULTS The experiment results revel that classifier based on KNN showed better performance than other two classifiers with accuracy rate of 93.3%, precision of 93%, recall rate of 95%, F1-score of 94% and the area of receiver operating characteristic curve is 0.976. CONCLUSIONS The method put forward in this paper can be effectively used to classify voice disorders.
Collapse
Affiliation(s)
- Lili Chen
- School of Mechatronics and Vehicle Engineering, Chongqing Jiaotong University, Chongqing, China
| | - Chaoyu Wang
- School of Mechatronics and Vehicle Engineering, Chongqing Jiaotong University, Chongqing, China
| | - Junjiang Chen
- School of Mechatronics and Vehicle Engineering, Chongqing Jiaotong University, Chongqing, China
| | - Zejun Xiang
- Chongqing Survey Institute, Chongqing, China
| | - Xue Hu
- The Department of Blood Transfusion, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China.
| |
Collapse
|
16
|
Fonseca ES, Guido RC, Junior SB, Dezani H, Gati RR, Mosconi Pereira DC. Acoustic investigation of speech pathologies based on the discriminative paraconsistent machine (DPM). Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101615] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
17
|
Teixeira JP, Alves N, Fernandes PO. Vocal Acoustic Analysis. INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS 2020. [DOI: 10.4018/ijehmc.2020010103] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Vocal acoustic analysis is becoming a useful tool for the classification and recognition of laryngological pathologies. This technique enables a non-invasive and low-cost assessment of voice disorders, allowing a more efficient, fast, and objective diagnosis. In this work, ANN and SVM were experimented on to classify between dysphonic/control and vocal cord paralysis/control. A vector was made up of 4 jitter parameters, 4 shimmer parameters, and a harmonic to noise ratio (HNR), determined from 3 different vowels at 3 different tones, with a total of 81 features. Variable selection and dimension reduction techniques such as hierarchical clustering, multilinear regression analysis and principal component analysis (PCA) was applied. The classification between dysphonic and control was made with an accuracy of 100% for female and male groups with ANN and SVM. For the classification between vocal cords paralysis and control an accuracy of 78,9% was achieved for female group with SVM, and 81,8% for the male group with ANN.
Collapse
Affiliation(s)
- João Paulo Teixeira
- Research Centre in Digitalization and Intelligent Robotics (CEDRI) and Applied Management Research Unit (UNIAG), Instituto Politécnico de Bragança, Bragança, Portugal
| | - Nuno Alves
- Instituto Politécnico de Bragança, Bragança, Portugal
| | - Paula Odete Fernandes
- Applied Management Research Unit (UNIAG), Instituto Politécnico de Bragança, Bragança, Portugal
| |
Collapse
|
18
|
On the design of automatic voice condition analysis systems. Part I: Review of concepts and an insight to the state of the art. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2018.12.024] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
19
|
Hegde S, Shetty S, Rai S, Dodderi T. A Survey on Machine Learning Approaches for Automatic Detection of Voice Disorders. J Voice 2018; 33:947.e11-947.e33. [PMID: 30316551 DOI: 10.1016/j.jvoice.2018.07.014] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2018] [Revised: 07/06/2018] [Accepted: 07/10/2018] [Indexed: 10/28/2022]
Abstract
The human voice production system is an intricate biological device capable of modulating pitch and loudness. Inherent internal and/or external factors often damage the vocal folds and result in some change of voice. The consequences are reflected in body functioning and emotional standing. Hence, it is paramount to identify voice changes at an early stage and provide the patient with an opportunity to overcome any ramification and enhance their quality of life. In this line of work, automatic detection of voice disorders using machine learning techniques plays a key role, as it is proven to help ease the process of understanding the voice disorder. In recent years, many researchers have investigated techniques for an automated system that helps clinicians with early diagnosis of voice disorders. In this paper, we present a survey of research work conducted on automatic detection of voice disorders and explore how it is able to identify the different types of voice disorders. We also analyze different databases, feature extraction techniques, and machine learning approaches used in these research works.
Collapse
Affiliation(s)
- Sarika Hegde
- NMAM Institute of Technology, Udupi, Karnataka, India.
| | | | - Smitha Rai
- NMAM Institute of Technology, Udupi, Karnataka, India
| | - Thejaswi Dodderi
- Nitte Institute of Speech & Hearing, Mangaluru, Karnataka, India
| |
Collapse
|
20
|
Detection of Pathological Voice Using Cepstrum Vectors: A Deep Learning Approach. J Voice 2018; 33:634-641. [PMID: 29567049 DOI: 10.1016/j.jvoice.2018.02.003] [Citation(s) in RCA: 56] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2017] [Accepted: 02/06/2018] [Indexed: 01/20/2023]
Abstract
OBJECTIVES Computerized detection of voice disorders has attracted considerable academic and clinical interest in the hope of providing an effective screening method for voice diseases before endoscopic confirmation. This study proposes a deep-learning-based approach to detect pathological voice and examines its performance and utility compared with other automatic classification algorithms. METHODS This study retrospectively collected 60 normal voice samples and 402 pathological voice samples of 8 common clinical voice disorders in a voice clinic of a tertiary teaching hospital. We extracted Mel frequency cepstral coefficients from 3-second samples of a sustained vowel. The performances of three machine learning algorithms, namely, deep neural network (DNN), support vector machine, and Gaussian mixture model, were evaluated based on a fivefold cross-validation. Collective cases from the voice disorder database of MEEI (Massachusetts Eye and Ear Infirmary) were used to verify the performance of the classification mechanisms. RESULTS The experimental results demonstrated that DNN outperforms Gaussian mixture model and support vector machine. Its accuracy in detecting voice pathologies reached 94.26% and 90.52% in male and female subjects, based on three representative Mel frequency cepstral coefficient features. When applied to the MEEI database for validation, the DNN also achieved a higher accuracy (99.32%) than the other two classification algorithms. CONCLUSIONS By stacking several layers of neurons with optimized weights, the proposed DNN algorithm can fully utilize the acoustic features and efficiently differentiate between normal and pathological voice samples. Based on this pilot study, future research may proceed to explore more application of DNN from laboratory and clinical perspectives.
Collapse
|
21
|
Borsky M, Mehta DD, Van Stan JH, Gudnason J. Modal and non-modal voice quality classification using acoustic and electroglottographic features. IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING 2017; 25:2281-2291. [PMID: 33748320 PMCID: PMC7971071 DOI: 10.1109/taslp.2017.2759002] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The goal of this study was to investigate the performance of different feature types for voice quality classification using multiple classifiers. The study compared the COVAREP feature set; which included glottal source features, frequency warped cepstrum and harmonic model features; against the mel-frequency cepstral coefficients (MFCCs) computed from the acoustic voice signal, acoustic-based glottal inverse filtered (GIF) waveform, and electroglottographic (EGG) waveform. Our hypothesis was that MFCCs can capture the perceived voice quality from either of these three voice signals. Experiments were carried out on recordings from 28 participants with normal vocal status who were prompted to sustain vowels with modal and non-modal voice qualities. Recordings were rated by an expert listener using the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V), and the ratings were transformed into a dichotomous label (presence or absence) for the prompted voice qualities of modal voice, breathiness, strain, and roughness. The classification was done using support vector machines, random forests, deep neural networks and Gaussian mixture model classifiers, which were built as speaker independent using a leave-one-speaker-out strategy. The best classification accuracy of 79.97% was achieved for the full COVAREP set. The harmonic model features were the best performing subset, with 78.47% accuracy, and the static+dynamic MFCCs scored at 74.52%. A closer analysis showed that MFCC and dynamic MFCC features were able to classify modal, breathy, and strained voice quality dimensions from the acoustic and GIF waveforms. Reduced classification performance was exhibited by the EGG waveform.
Collapse
|
22
|
Development of the Arabic Voice Pathology Database and Its Evaluation by Using Speech Features and Machine Learning Algorithms. JOURNAL OF HEALTHCARE ENGINEERING 2017; 2017:8783751. [PMID: 29201333 PMCID: PMC5672151 DOI: 10.1155/2017/8783751] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2016] [Revised: 04/04/2017] [Accepted: 05/02/2017] [Indexed: 11/17/2022]
Abstract
A voice disorder database is an essential element in doing research on automatic voice disorder detection and classification. Ethnicity affects the voice characteristics of a person, and so it is necessary to develop a database by collecting the voice samples of the targeted ethnic group. This will enhance the chances of arriving at a global solution for the accurate and reliable diagnosis of voice disorders by understanding the characteristics of a local group. Motivated by such idea, an Arabic voice pathology database (AVPD) is designed and developed in this study by recording three vowels, running speech, and isolated words. For each recorded samples, the perceptual severity is also provided which is a unique aspect of the AVPD. During the development of the AVPD, the shortcomings of different voice disorder databases were identified so that they could be avoided in the AVPD. In addition, the AVPD is evaluated by using six different types of speech features and four types of machine learning algorithms. The results of detection and classification of voice disorders obtained with the sustained vowel and the running speech are also compared with the results of an English-language disorder database, the Massachusetts Eye and Ear Infirmary (MEEI) database.
Collapse
|
23
|
Muhammad G, Alsulaiman M, Ali Z, Mesallam TA, Farahat M, Malki KH, Al-nasheri A, Bencherif MA. Voice pathology detection using interlaced derivative pattern on glottal source excitation. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2016.08.002] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
24
|
Ali Z, Talha M, Alsulaiman M. A Practical Approach: Design and Implementation of a Healthcare Software for Screening of Dysphonic Patients. IEEE ACCESS 2017; 5:5844-5857. [DOI: 10.1109/access.2017.2693282] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
25
|
Cordeiro H, Fonseca J, Guimarães I, Meneses C. Hierarchical Classification and System Combination for Automatically Identifying Physiological and Neuromuscular Laryngeal Pathologies. J Voice 2016; 31:384.e9-384.e14. [PMID: 27743845 DOI: 10.1016/j.jvoice.2016.09.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2016] [Revised: 09/08/2016] [Accepted: 09/08/2016] [Indexed: 11/26/2022]
Abstract
OBJECTIVES Speech signal processing techniques have provided several contributions to pathologic voice identification, in which healthy and unhealthy voice samples are evaluated. A less common approach is to identify laryngeal pathologies, for which the use of a noninvasive method for pathologic voice identification is an important step forward for preliminary diagnosis. In this study, a hierarchical classifier and a combination of systems are used to improve the accuracy of a three-class identification system (healthy, physiological larynx pathologies, and neuromuscular larynx pathologies). METHOD Three main subject classes were considered: subjects with physiological larynx pathologies (vocal fold nodules and edemas: 59 samples), subjects with neuromuscular larynx pathologies (unilateral vocal fold paralysis: 59 samples), and healthy subjects (36 samples). The variables used in this study were a speech task (sustained vowel /a/ or continuous reading speech), features with or without perceptual information, and features with or without direct information about formants evaluated using single classifiers. A hierarchical classification system was designed based on this information. RESULTS The resulting system combines an analysis of continuous speech by way of the commonly used sustained vowel /a/ to obtain spectral and perceptual speech features. It achieved an accuracy of 84.4%, which represents an improvement of approximately 9% compared with the stand-alone approach. For pathologic voice identification, the accuracy obtained was 98.7%, and the identification accuracy for the two pathology classes was 81.3%. CONCLUSIONS Hierarchical classification and system combination create significant benefits and introduce a modular approach to the classification of larynx pathologies.
Collapse
Affiliation(s)
- Hugo Cordeiro
- Department of Electrical Engineering, Faculty of Sciences and Technology of the New University of Lisbon, 2829-516 Caparica, Portugal; Department of Electronics, Telecommunications and Computers, Higher Institute of Engineering of Lisbon, 1959-007 Lisbon, Portugal.
| | - José Fonseca
- Department of Electrical Engineering, Faculty of Sciences and Technology of the New University of Lisbon, 2829-516 Caparica, Portugal
| | - Isabel Guimarães
- Department of Speech and Language Therapy, School of Health Sciences at Alcoitão, 2649-506 Alcabideche, Portugal
| | - Carlos Meneses
- Department of Electronics, Telecommunications and Computers, Higher Institute of Engineering of Lisbon, 1959-007 Lisbon, Portugal
| |
Collapse
|
26
|
Enhancement of a text-independent speaker verification system by using feature combination and parallel structure classifiers. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2470-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
27
|
Al-Nasheri A, Muhammad G, Alsulaiman M, Ali Z, Mesallam TA, Farahat M, Malki KH, Bencherif MA. An Investigation of Multidimensional Voice Program Parameters in Three Different Databases for Voice Pathology Detection and Classification. J Voice 2016; 31:113.e9-113.e18. [PMID: 27105857 DOI: 10.1016/j.jvoice.2016.03.019] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2015] [Accepted: 03/31/2016] [Indexed: 10/21/2022]
Abstract
BACKGROUND AND OBJECTIVE Automatic voice-pathology detection and classification systems may help clinicians to detect the existence of any voice pathologies and the type of pathology from which patients suffer in the early stages. The main aim of this paper is to investigate Multidimensional Voice Program (MDVP) parameters to automatically detect and classify the voice pathologies in multiple databases, and then to find out which parameters performed well in these two processes. MATERIALS AND METHODS Samples of the sustained vowel /a/ of normal and pathological voices were extracted from three different databases, which have three voice pathologies in common. The selected databases in this study represent three distinct languages: (1) the Arabic voice pathology database; (2) the Massachusetts Eye and Ear Infirmary database (English database); and (3) the Saarbruecken Voice Database (German database). A computerized speech lab program was used to extract MDVP parameters as features, and an acoustical analysis was performed. The Fisher discrimination ratio was applied to rank the parameters. A t test was performed to highlight any significant differences in the means of the normal and pathological samples. RESULTS The experimental results demonstrate a clear difference in the performance of the MDVP parameters using these databases. The highly ranked parameters also differed from one database to another. The best accuracies were obtained by using the three highest ranked MDVP parameters arranged according to the Fisher discrimination ratio: these accuracies were 99.68%, 88.21%, and 72.53% for the Saarbruecken Voice Database, the Massachusetts Eye and Ear Infirmary database, and the Arabic voice pathology database, respectively.
Collapse
Affiliation(s)
- Ahmed Al-Nasheri
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia
| | - Ghulam Muhammad
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia.
| | - Mansour Alsulaiman
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia
| | - Zulfiqar Ali
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia; Centre for Intelligent Signal and Imaging Research (CISIR), Department of Electrical and Electronic Engineering, Universiti Tekhnologi PETRONAS, Tronoh, Perak 31750, Malaysia
| | - Tamer A Mesallam
- ENT Department, College of Medicine, King Saud University, Riyadh, Saudi Arabia; Research Chair of Voice, Swallowing, and Communication Disorders, King Saud University, Riyadh, Saudi Arabia; ENT Department, College of Medicine, Al-Menoufiya University, Shebin Alkoum, Egypt
| | - Mohamed Farahat
- ENT Department, College of Medicine, King Saud University, Riyadh, Saudi Arabia; Research Chair of Voice, Swallowing, and Communication Disorders, King Saud University, Riyadh, Saudi Arabia
| | - Khalid H Malki
- ENT Department, College of Medicine, King Saud University, Riyadh, Saudi Arabia; Research Chair of Voice, Swallowing, and Communication Disorders, King Saud University, Riyadh, Saudi Arabia
| | - Mohamed A Bencherif
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia
| |
Collapse
|
28
|
Al-Nasheri A, Muhammad G, Alsulaiman M, Ali Z. Investigation of Voice Pathology Detection and Classification on Different Frequency Regions Using Correlation Functions. J Voice 2016; 31:3-15. [PMID: 26992554 DOI: 10.1016/j.jvoice.2016.01.014] [Citation(s) in RCA: 52] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2015] [Accepted: 01/27/2016] [Indexed: 11/27/2022]
Abstract
OBJECTIVES AND BACKGROUND Automatic voice pathology detection and classification systems effectively contribute to the assessment of voice disorders, which helps clinicians to detect the existence of any voice pathologies and the type of pathology from which patients suffer in the early stages. This work concentrates on developing an accurate and robust feature extraction for detecting and classifying voice pathologies by investigating different frequency bands using correlation functions. In this paper, we extracted maximum peak values and their corresponding lag values from each frame of a voiced signal by using correlation functions as features to detect and classify pathological samples. These features are investigated in different frequency bands to see the contribution of each band on the detection and classification processes. MATERIAL AND METHODS Various samples of sustained vowel /a/ of normal and pathological voices were extracted from three different databases: English, German, and Arabic. A support vector machine was used as a classifier. We also performed a t test to investigate the significant differences in mean of normal and pathological samples. RESULTS The best achieved accuracies in both detection and classification were varied depending on the band, the correlation function, and the database. The most contributive bands in both detection and classification were between 1000 and 8000 Hz. In detection, the highest acquired accuracies when using cross-correlation were 99.809%, 90.979%, and 91.168% in the Massachusetts Eye and Ear Infirmary, Saarbruecken Voice Database, and Arabic Voice Pathology Database databases, respectively. However, in classification, the highest acquired accuracies when using cross-correlation were 99.255%, 98.941%, and 95.188% in the three databases, respectively.
Collapse
Affiliation(s)
- Ahmed Al-Nasheri
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.
| | - Ghulam Muhammad
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Mansour Alsulaiman
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Zulfiqar Ali
- Digital Speech Processing Group, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|
29
|
Moro-Velázquez L, Gómez-García JA, Godino-Llorente JI. Voice Pathology Detection Using Modulation Spectrum-Optimized Metrics. Front Bioeng Biotechnol 2016; 4:1. [PMID: 26835449 PMCID: PMC4718980 DOI: 10.3389/fbioe.2016.00001] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2015] [Accepted: 01/06/2016] [Indexed: 11/13/2022] Open
Abstract
There exist many acoustic parameters employed for pathological assessment tasks, which have served as tools for clinicians to distinguish between normophonic and pathological voices. However, many of these parameters require an appropriate tuning in order to maximize its efficiency. In this work, a group of new and already proposed modulation spectrum (MS) metrics are optimized considering different time and frequency ranges pursuing the maximization of efficiency for the detection of pathological voices. The optimization of the metrics is performed simultaneously in two different voice databases in order to identify what tuning ranges produce a better generalization. The experiments were cross-validated so as to ensure the validity of the results. A third database is used to test the optimized metrics. In spite of some differences, results indicate that the behavior of the metrics in the optimization process follows similar tendencies for the tuning databases, confirming the generalization capabilities of the proposed MS metrics. In addition, the tuning process reveals which bands of the modulation spectra have relevant information for each metric, which has a physical interpretation respecting the phonatory system. Efficiency values up to 90.6% are obtained in one tuning database, while in the other, the maximum efficiency reaches 71.1%. Obtained results also evidence a separability between normophonic and pathological states using the proposed metrics, which can be exploited for voice pathology detection or assessment.
Collapse
|
30
|
Automatic voice pathology detection and classification using vocal tract area irregularity. Biocybern Biomed Eng 2016. [DOI: 10.1016/j.bbe.2016.01.004] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
31
|
Modulation Spectra Morphological Parameters: A New Method to Assess Voice Pathologies according to the GRBAS Scale. BIOMED RESEARCH INTERNATIONAL 2015; 2015:259239. [PMID: 26557656 PMCID: PMC4628766 DOI: 10.1155/2015/259239] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2015] [Revised: 05/04/2015] [Accepted: 05/04/2015] [Indexed: 11/17/2022]
Abstract
Disordered voices are frequently assessed by speech pathologists using perceptual evaluations. This might lead to problems caused by the subjective nature of the process and due to the influence of external factors which compromise the quality of the assessment. In order to increase the reliability of the evaluations, the design of automatic evaluation systems is desirable. With that in mind, this paper presents an automatic system which assesses the Grade and Roughness level of the speech according to the GRBAS perceptual scale. Two parameterization methods are used: one based on the classic Mel-Frequency Cepstral Coefficients, which has already been used successfully in previous works, and other derived from modulation spectra. For the latter, a new group of parameters has been proposed, named Modulation Spectra Morphological Parameters: MSC, DRB, LMR, MSH, MSW, CIL, PALA, and RALA. In methodology, PCA and LDA are employed to reduce the dimensionality of feature space, and GMM classifiers to evaluate the ability of the proposed features on distinguishing the different levels. Efficiencies of 81.6% and 84.7% are obtained for Grade and Roughness, respectively, using modulation spectra parameters, while MFCCs performed 80.5% and 77.7%. The obtained results suggest the usefulness of the proposed Modulation Spectra Morphological Parameters for automatic evaluation of Grade and Roughness in the speech.
Collapse
|
32
|
Ali Z, Elamvazuthi I, Alsulaiman M, Muhammad G. Automatic Voice Pathology Detection With Running Speech by Using Estimation of Auditory Spectrum and Cepstral Coefficients Based on the All-Pole Model. J Voice 2015; 30:757.e7-757.e19. [PMID: 26522263 DOI: 10.1016/j.jvoice.2015.08.010] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2015] [Accepted: 08/13/2015] [Indexed: 11/15/2022]
Abstract
BACKGROUND AND OBJECTIVE Automatic voice pathology detection using sustained vowels has been widely explored. Because of the stationary nature of the speech waveform, pathology detection with a sustained vowel is a comparatively easier task than that using a running speech. Some disorder detection systems with running speech have also been developed, although most of them are based on a voice activity detection (VAD), that is, itself a challenging task. Pathology detection with running speech needs more investigation, and systems with good accuracy (ACC) are required. Furthermore, pathology classification systems with running speech have not received any attention from the research community. In this article, automatic pathology detection and classification systems are developed using text-dependent running speech without adding a VAD module. METHOD A set of three psychophysics conditions of hearing (critical band spectral estimation, equal loudness hearing curve, and the intensity loudness power law of hearing) is used to estimate the auditory spectrum. The auditory spectrum and all-pole models of the auditory spectrums are computed and analyzed and used in a Gaussian mixture model for an automatic decision. RESULTS In the experiments using the Massachusetts Eye & Ear Infirmary database, an ACC of 99.56% is obtained for pathology detection, and an ACC of 93.33% is obtained for the pathology classification system. The results of the proposed systems outperform the existing running-speech-based systems. DISCUSSION The developed system can effectively be used in voice pathology detection and classification systems, and the proposed features can visually differentiate between normal and pathological samples.
Collapse
Affiliation(s)
- Zulfiqar Ali
- Centre for Intelligent Signal and Imaging Research, Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Tronoh 31750, Perak, Malaysia; Digital Speech Processing Group, Department of Computer Engineering, King Saud University, Riyadh 11543, Saudi Arabia.
| | - Irraivan Elamvazuthi
- Centre for Intelligent Signal and Imaging Research, Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Tronoh 31750, Perak, Malaysia
| | - Mansour Alsulaiman
- Digital Speech Processing Group, Department of Computer Engineering, King Saud University, Riyadh 11543, Saudi Arabia
| | - Ghulam Muhammad
- Digital Speech Processing Group, Department of Computer Engineering, King Saud University, Riyadh 11543, Saudi Arabia
| |
Collapse
|
33
|
Ali Z, Elamvazuthi I, Alsulaiman M, Muhammad G. Detection of Voice Pathology using Fractal Dimension in a Multiresolution Analysis of Normal and Disordered Speech Signals. J Med Syst 2015; 40:20. [DOI: 10.1007/s10916-015-0392-2] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2015] [Accepted: 10/22/2015] [Indexed: 11/30/2022]
|
34
|
Muhammad G, Melhem M. Pathological voice detection and binary classification using MPEG-7 audio features. Biomed Signal Process Control 2014. [DOI: 10.1016/j.bspc.2014.02.001] [Citation(s) in RCA: 68] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
35
|
Vaiciukynas E, Verikas A, Gelzinis A, Bacauskiene M, Kons Z, Satt A, Hoory R. Fusion of voice signal information for detection of mild laryngeal pathology. Appl Soft Comput 2014. [DOI: 10.1016/j.asoc.2014.01.012] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|