Validity and Reliability Study of Bahasa Malaysia Version of Voice Handicap Index-10

Reliability, Measurement Error, and Responsiveness of the Voice Handicap Index: A Systematic Review and Meta-analysis

OBJECTIVE

To analyze the reliability, measurement error, and responsiveness of the Voice Handicap Index (VHI) for measuring voice handicap in individuals with voice disorders.

METHODS

This systematic review followed the recommendations of the COnsensus-based Standards for the Selection of Health Measurement INstruments. Studies that validated the VHI, analyzed the measurement properties of reliability, measurement error, or responsiveness, and had dysphonic individuals as the study population were included. The following electronic databases were searched: Cochrane Library, EMBASE, LILACS, PubMed, Scopus, and Web of Science. The manual search was carried out on gray literature in the Biblioteca Digital Brasileira de Teses e Dissertações and ProQuest Dissertation & Theses, in addition to mapping citations and consulting an expert in the field. Evidence selection, data extraction, risk of bias analysis, certainty of evidence, and good psychometric measurements were performed by two blinded and independent reviewers. A meta-analysis was performed using Fisher's transformed r-to-z correlation coefficient and standardized mean difference. Heterogeneity was calculated using Tau² and I² statistical tests in JAMOVI 2.3.2 software.

RESULTS

Eighty studies were included in the meta-analysis. When assessing the risk of bias, most studies were classified as inadequate during the reliability and measurement error stages. In the responsiveness stage, they were classified as doubtful in the sensitivity and specificity sub-boxes and good in the comparison sub-box with a gold standard instrument. For psychometric properties, most studies were classified as indeterminate in terms of both reliability and responsiveness. In test-retest reliability and responsiveness, the average outcome differed significantly from zero, indicating agreement between the test and retest moments and a significant reduction in the VHI score after intervention. Considering certainty of the evidence, the level of evidence was very low in both the reliability and responsiveness stages. The analyzed studies did not evaluate observational errors, and hence, they were not considered in this review.

CONCLUSION

The VHI proved to be reliable and responsive in measuring voice handicap. However, it should be used with caution, as there is heterogeneity, a risk of bias, and no adherence to the analysis of observational error.

Adaptation and Validation of the Persian Version of the Voice Handicap Index-10 (VHI-10)

OBJECTIVES

Voice disorders can profoundly impact health, quality of life, job performance, and social interactions. Traditional evaluations have expanded to include quality-of-life assessments, emphasizing self-reported outcomes. The Voice Handicap Index (VHI) stands out among relevant questionnaires, with the VHI-10 being a concise derivative. This study was conducted to translate and validate the Voice Handicap Index-10 (VHI-10) questionnaire for Persian speakers, enhancing clinical assessments of voice disorders and quality of life.

METHODS

This cross-sectional study, conducted in Iran, involved (1) translating the VHI-10 into Persian, (2) confirming face and content validity using Content Validity Ratio (CVR), and Content Validity Index (CVI), and (3) evaluating its reliability through a survey. A panel of experts confirmed the validity, and reliability of the study, which was assessed using Cronbach's alpha, Spearman-Brown, and Guttman coefficients. The survey involved 225 participants, including 150 healthy people and 75 patients with voice disorders, who were selected using a convenience sampling method.

RESULTS

All question items demonstrated a CVI greater than 0.79 and a CVR between 0.62 and 1. Reliability analysis yielded high Cronbach's alpha values for functional, physical, and emotional domains (0.909) and total (0.961). The mean overall scores of VHI-10 for healthy and disordered groups were 18.78 and 0.74, respectively. The VHI-10 effectively discriminated between healthy and disordered groups in all domains, with an accuracy of 97.33%. The determined cut-off point was 4.5, with a strong area under the Receiver Operating Characteristic (ROC) curve (0.989).

CONCLUSION

This study successfully adapted and validated the Persian version of the VHI-10. The questionnaire demonstrated high reliability and validity, distinguishing between individuals with and without voice disorders. This Persian version is now a valuable tool for speech and language pathologists conducting clinical voice evaluations in Iran and also it could be applied in studies to determine the effects of voice problems on participant's quality of life.

Psychometric Properties of the Voice Handicap Index-10 in Kannada

OBJECTIVES

This study aimed to derive the 10-item voice handicap index in the Kannada language (VHI-K10) from the existing VHI-30 in Kannada (VHI-K30). We also aimed to examine several psychometric properties of the newly derived VHI-K10, such as internal consistency, reliability, concurrent validity, discriminant validity, and diagnostic accuracy.

METHODS

Initially, VHI-K10 was derived from the existing VHI-K30 through item reduction, consistent with the recommendations for item reduction of the voice handicap index. This newly derived VHI-K10 was administered to 273 individuals (199 individuals with dysphonia and 74 individuals with normal voice quality). We also obtained phonation and reading samples from the participants. The obtained data were subjected to appropriate statistical analysis to determine several psychometric properties.

RESULTS

The newly derived VHI-K10 was found to have a strong internal consistency (Cronbach's α = 0.93). We also found strong test-retest reliability for VHI-K10, with an intraclass correlation coefficient of 0.933. There was a strong statistically significant correlation between the VHI-K10 and the existing VHI-K30 for both individuals with dysphonia (ρ = 0.924, P < 0.001) and individuals with normal voice quality (ρ = 0.798, P < 0.001). However, the correlation of VHI-K10 with the auditory-perceptual measure of GRBAS was fair (ρ = 0.353, P < 0.001) for individuals with dysphonia and was not statistically significant for individuals with normal voice quality. Further, the diagnostic accuracy of VHI-K10 was found to be excellent, with an area under the curve (AROC) value of 0.926 with a cut-off point of ≥6.5, which was slightly superior to that of VHI-K30 (AROC = 0.909, cut-off point ≥21.5).

CONCLUSIONS

The shortened 10-item version of the voice handicap index in Kannada is consistent with versions of the VHI-10 in other languages. This version of the VHI-10 in Kannada is found to be a robust tool with strong psychometric properties.

Internal Consistency of the Voice Handicap Index in Individuals With Dysphonia: A Systematic Review and Meta-Analysis

OBJECTIVE

To analyze the internal consistency of the Voice Handicap Index (VHI) for evaluating the vocal handicap of individuals with dysphonia.

METHODS

This is a systematic review. Studies with a cross-sectional design and including a population of individuals with dysphonia, which validated the VHI and analyzed its internal consistency, were included. The following electronic databases were searched: Cochrane Library, EMBASE, LILACS, and PubMed, including Medline, Scopus, and Web of Science. A manual search was performed in gray literature through the Biblioteca Digital Brasileira de Teses e Dissertações and ProQuest Dissertation & Theses. In addition, the list of references of studies selected in the electronic search was mapped, and an expert in the area was consulted. Two reviewers blindly and independently conducted the selection, data extraction, and analysis of the risk of bias, the certainty of the evidence, and good psychometric measures. A meta-analysis was performed with a random effects model using the JAMOVI 2.3.2 software.

RESULTS

Forty-nine studies were analyzed. In risk of bias assessment, the studies were classified as having inadequate structural validity and very good internal consistency. The analysis of good psychometric properties indicated indeterminate structural validity and insufficient internal consistency. The overall value of Cronbach's alpha was estimated at 0.94, thus suggesting a very good internal consistency. However, there was high heterogeneity. The level of certainty of the evidence was too low for internal consistency.

CONCLUSION

The VHI proved to be a consistent and reliable patient-reported outcome measure to evaluate voice handicap in individuals with dysphonia; however, studies are heterogeneous, and the certainty of evidence is very low.

The accuracy of an Online Sequential Extreme Learning Machine in detecting voice pathology using the Malaysian Voice Pathology Database

BACKGROUND

A multidimensional voice quality assessment is recommended for all patients with dysphonia, which requires a patient visit to the otolaryngology clinic. The aim of this study was to determine the accuracy of an online artificial intelligence classifier, the Online Sequential Extreme Learning Machine (OSELM), in detecting voice pathology. In this study, a Malaysian Voice Pathology Database (MVPD), which is the first Malaysian voice database, was created and tested.

METHODS

The study included 382 participants (252 normal voices and 130 dysphonic voices) in the proposed database MVPD. Complete data were obtained for both groups, including voice samples, laryngostroboscopy videos, and acoustic analysis. The diagnoses of patients with dysphonia were obtained. Each voice sample was anonymized using a code that was specific to each individual and stored in the MVPD. These voice samples were used to train and test the proposed OSELM algorithm. The performance of OSELM was evaluated and compared with other classifiers in terms of the accuracy, sensitivity, and specificity of detecting and differentiating dysphonic voices.

RESULTS

The accuracy, sensitivity, and specificity of OSELM in detecting normal and dysphonic voices were 90%, 98%, and 73%, respectively. The classifier differentiated between structural and non-structural vocal fold pathology with accuracy, sensitivity, and specificity of 84%, 89%, and 88%, respectively, while it differentiated between malignant and benign lesions with an accuracy, sensitivity, and specificity of 92%, 100%, and 58%, respectively. Compared to other classifiers, OSELM showed superior accuracy and sensitivity in detecting dysphonic voices, differentiating structural versus non-structural vocal fold pathology, and between malignant and benign voice pathology.

CONCLUSION

The OSELM algorithm exhibited the highest accuracy and sensitivity compared to other classifiers in detecting voice pathology, classifying between malignant and benign lesions, and differentiating between structural and non-structural vocal pathology. Hence, it is a promising artificial intelligence that supports an online application to be used as a screening tool to encourage people to seek medical consultation early for a definitive diagnosis of voice pathology.

Adaptation and Validation of the Self-Evaluation of Communication Experiences after Laryngectomy (SECEL) Questionnaire into Bahasa Malaysia

BACKGROUND

Communication adjustment from patients' perspective is paramount to ensure optimization of voice rehabilitation post laryngectomy. Very few specific self-rating tools exist with the Self-Evaluation of Communication Experiences after Laryngectomy (SECEL) having the most evidence regarding validity, reliability and clinical utility.

OBJECTIVES

This study aimed to translate and validate a Bahasa Malaysia version of SECEL (mSECEL) using a validated framework of transcultural adaptation.

METHODS

This cross-sectional study was conducted in the Otorhinolaryngology, Department of Universiti Kebangsaan Malaysia Medical Centre from February 2019 to May 2020. The mSECEL was produced following a rigorous forward and backward translation. Eighty-three laryngectomees (78 male, five female) using various methods of alaryngeal communication (47 voice prosthesis, 29 electrolarynx, three esophageal speech and four pen and paper), completed the mSECEL and mVHI-10 before head and neck and flexible laryngoscopic examinations. The mSECEL was repeated in 2 weeks via telephone interview or clinic visit. Its reliability was assessed using intraclass correlation. The Pearson product-moment correlation test was used to analyze correlation between the mSECEL and mVHI-10.

RESULTS

The mSECEL questionnaire showed strong internal consistency with the Cronbach alpha of >0.90 for total score, Environmental and Attitude subscale. The test-retest reliability for total mSECEL score was high with the intraclass correlation of 0.97. There was a highly significant positive correlation between the mSECEL total score and mVHI-10 (P < 0.001). Items in the General subscale showed poorer internal consistency with Cronbach alpha ranging 0.55-0.46 and poor correlation with mVHI-10.

CONCLUSIONS

The Bahasa Malaysia version of the SECEL measure is a valid and reliable instrument to evaluate communication perception after laryngectomy. Future studies should consider subscale validation and further abbreviation of its items to make this measure clinically relevant.

Determining Cutoff Point in Bahasa Malaysia Version of Voice Handicap Index-10 (mVHI-10)

OBJECTIVE

Determining the cutoff point on Bahasa Malaysia version of Voice Handicap Index (mVHI-10) questionnaire scores for distinguishing between dysphonic and normal voice samples.

STUDY DESIGN

A cross-sectional study was conducted in the tertiary hospital, Otorhinolaryngology-Head and Neck clinic.

METHODS

The study involved 205 subjects (105 in the dysphonia group; 100 in the normal group) with a complete database of flexible laryngoscopy/stroboscopy, voice recording, acoustic analysis, and mVHI-10 score. A sample with a discrepancy between subjective evaluation and acoustic analysis results was excluded from the study. Each classified dataset matched with the respective mVHI-10 questionnaire score. Finally, all the collected data were subjected to data analysis.

RESULTS

The best cutoff point for mVHI-10 was 7.5 by the receiver operating characteristic curve, with an area under the curve value of 0.997. Its sensitivity, specificity, positive predictive value, and negative predictive value were 92.4%, 100.0%, 100.0%, and 93.0%, respectively.

CONCLUSIONS

The best cutoff point for mVHI-10 is 7.5, as determined by stringent data evaluation and rigorous statistical analysis. With excellent diagnostic accuracy properties, it enhances the usage of the mVHI-10 questionnaire as an excellent screening tool. Nevertheless, we advocate multidimensional voice assessment for diagnostic purposes.

Validation of the Polish Version of Voice Handicap Index-10

PURPOSE

The aim of this study was to adapt and evaluate the psychometric properties of the Polish version of the VHI-10.

METHODS

We enrolled 183 subjects-118 patients with voice disorders and 65 without voice disorders.

RESULTS

All items were correlated with each other and were strongly correlated with the total score (rho ≥ 0.70), the only exception being item five (rho = 0.56). Internal consistency was very high, with Cronbach's alpha = 0.92. There was a statistically significant difference between patients with voice disorders and healthy controls in terms of VHI-10 global score (U = 251.0; P < 0.001). There was a statistically significant negative correlation between mean phonation time (MPT) and VHI-10 (rho = -0.30; P < 0.01). Only the amplitude perturbation quotient (APQ) was correlated positively with the global score (rho = 0.22; P = 0.020). There were statistically significant and positive correlations between VHI-10 scores and GRBAS evaluation. Correlations between global scores of VHI-30 and VHI-10, and between VHI-30 subscales and the corresponding items from VHI-10, were very strong (respectively 0.97 and 0.89-0.94). In the patient group, there was high test-retest reproducibility (intraclass correlation = 0.91). A cut-off value of 8.5 points was estimated.

CONCLUSION

The Polish version of VHI-10 showed excellent internal consistency, good test-retest reproducibility, and had clinical validity. It is a useful brief tool for self-reported evaluation and reliable assessment of patients with voice disorders.

Primary Nonselective Laryngeal Reinnervation in Iatrogenic Acute Recurrent Laryngeal Nerve Injury: Case Series and Literature Review

Treating an acutely injured recurrent laryngeal nerve by primary nonselective laryngeal reinnervation (LR) during thyroidectomy is encouraged to minimize postoperative morbidity. Performing a concurrent transoral temporary injection laryngoplasty (IL) may improve the patient's voice while waiting for the effect of successful reinnervation. Chronological multidimensional voice outcomes (qualitative and quantitative) and combination of the primary nonselective LR with concurrent transoral IL were not explicitly demonstrated in previous cases that published the literature. In this study, the authors presented the multidimensional voice parameters of 3 patients undergoing primary nonselective LR with concurrent IL during thyroidectomy. The parameters were measured at different time points (2 weeks and 1, 3, 6, and 12 months) following the surgery. Laryngeal electromyography was done at 1 to 2 months and 12 months postsurgery. The results showed that the voices, qualitatively and quantitatively, were within normal range at within 3 months postintervention. The parameters were slightly beyond the normal limit at 3 months and returned to normal at 6 months postintervention and beyond. The LEMG depicted evidence of successful reinnervation in which the motor unit was normal comparable to the opposite normal vocal fold.

Subchordal Cyst Containing Non-degraded Hyaluronic Acid: A Rare Complication of Injection Laryngoplasty

Injection laryngoplasty (IL) with hyaluronic acid (HA) for the treatment of glottic insufficiency has been reported as a safe procedure with low complication rates. The side effects usually present as acute dyspnea, dysphonia, or dysphagia due to local edema, hematoma, or hypersensitivity reactions. These complications commonly resolve with minimal intervention. In the present case, we present an asymptomatic case of a subchordal cyst (SC) in a 30-year-old female after office-based injection laryngoplasty using hyaluronic acid. To the best of our knowledge, this is the first reported case of a subchordal cyst following injection laryngoplasty.

Adult Transglottic Haemangioma with Upper Airway Obstruction: Preservation of Airway and Voice

Adult laryngeal haemangioma is normally seen in the supraglottic or glottic region. Transglottic haemangioma is unusual, and treatment with primary endolaryngeal surgical excision may lead to undesirable bleeding and poor voice outcomes. A 25-year-old female presented with hoarseness and progressive upper airway obstruction symptoms. Videoendoscopy showed haemangioma involving all unilateral subunits of the larynx obstructing half of the subglottis. The transglottic haemangioma was treated with endolaryngeal ethanol injection with prior tracheostomy under local anaesthesia. Endolaryngeal laser surgery was performed later on to remove small residual haemangioma and granuloma. The haemangioma resolved; however, the ethanol injection to the paraglottic space results in vocal fold immobility but with favourable position and good muscle tone and bulk. The patient was successfully decannulated. Post-intervention subjective and objective voice assessments showed normal parameters except slight impairment of voice handicap index-10 with a total score of 12. Adult transglottic haemangioma can cause upper airway obstruction and requires intervention. Excision of the lesion endoscopically without sacrificing voice is achievable.

Malay Version of the mHealth App Usability Questionnaire (M-MAUQ): Translation, Adaptation, and Validation Study

BACKGROUND

Mobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients' health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness.

OBJECTIVE

This study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia.

METHODS

Forward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app.

RESULTS

The content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app.

CONCLUSIONS

The M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

Maximum vocal intensity as a primary outcome measure in unilateral vocal fold paralysis patients

OBJECTIVE

To evaluate voice intensity as the primary outcome measurement when treating unilateral vocal fold paralysis patients.

METHODS

This prospective observational study comprised 34 newly diagnosed unilateral vocal fold paralysis patients undergoing surgical interventions: injection laryngoplasty or medialisation thyroplasty. Voice assessments, including maximum vocal intensity and other acoustic parameters, were performed at baseline and at one and three months post-intervention. Maximum vocal intensity was also repeated within two weeks before any surgical interventions were performed. The results were compared between different time points and between the two intervention groups.

RESULTS

Maximum vocal intensity showed high internal consistency. Statistically significant improvements were seen in maximum vocal intensity, Voice Handicap Index-10 and other acoustic analyses at one and three months post-intervention. A significant moderate negative correlation was demonstrated between maximum vocal intensity and Voice Handicap Index-10, shimmer and jitter. There were no significant differences in voice outcomes between injection laryngoplasty and medialisation thyroplasty patients at any time point.

CONCLUSION

Maximum vocal intensity can be applied as a treatment outcome measure in unilateral vocal fold paralysis patients; it can demonstrate the effectiveness of treatment and moderately correlates with self-reported outcome measures.