Using Rasch Analysis to Evaluate the Reliability and Validity of the Swallowing Quality of Life Questionnaire: An Item Response Theory Approach

A Psychometric Evaluation of the Dysphagia Handicap Index Using Rasch Analysis

Background/Objectives: The Dysphagia Handicap Index (DHI) is commonly used in oropharyngeal dysphagia (OD) research as a self-report measure of functional health status and health-related quality of life. The DHI was developed and validated using classic test theory. The aim of this study was to use item response theory (Rasch analysis) to evaluate the psychometric properties of the DHI. Methods: Prospective, consecutive patient data were collected at dysphagia or otorhinolaryngology clinics. The sample included 256 adults (53.1% male; mean age 65.2) at risk of OD. The measure's response scale, person and item fit characteristics, differential item functioning, and dimensionality were evaluated. Results: The rating scale was ordered but showed a potential gap in the rating category labels for the overall measure. The overall person (0.91) and item (0.97) reliability was excellent. The overall measure reliably separated persons into at least three distinct groups (person separation index = 3.23) based on swallowing abilities, but the subscales showed inadequate separation. All infit mean squares were in the acceptable range except for the underfitting for item 22 (F). More misfitting was evident in the Z-Standard statistics. Differential item functioning results indicated good performance at an item level for the overall measure; however, contrary to expectation, an OD diagnosis presented only with marginal DIF. The dimensionality of the DHI showed two dimensions in contrast to the three dimensions suggested by the original authors. Conclusions: The DHI failed to reproduce the original three subscales. Caution is needed using the DHI subscales; only the DHI total score should be used. A redevelopment of the DHI is needed; however, given the complexities involved in addressing these issues, the development of a new measure that ensures good content validity may be preferred.

Patient-reported outcome measures for dysphagia in head and neck cancer: A systematic review and appraisal of content validity and internal structure

Dysphagia is a major head and neck cancer (HNC) issue. Dysphagia-related patient-reported outcome measures (PROMs) are critical for patient-centred assessment and intervention tailoring. This systematic review aimed to derive a comprehensive inventory of HNC dysphagia PROMs and appraise their content validity and internal structure. Six electronic databases were searched to February 2023 for studies detailing PROM content validity or internal structure. Eligible PROMs were those developed or validated for HNC, with ≥20% of items related to swallowing. Two independent raters screened citations and full-text articles. Critical appraisal followed COSMIN guidelines. Overall, 114 studies were included, yielding 39 PROMs (17 dysphagia-specific and 22 generic). Of included studies, 33 addressed PROM content validity and 78 internal structure. Of all PROMs, only the SOAL met COSMIN standards for both sufficient content validity and internal structure. Notably, the development of 18 PROMs predated the publication of COSMIN standards. In conclusion, this review identified 39 PROMs addressing dysphagia in HNC, of which only one met COSMIN quality criteria. Given that half of PROMs were developed prior to COSMIN guidelines, future application of current standards is needed to establish their psychometric quality.

Evaluation of outcome measures for post-operative dysphagia after anterior cervical discectomy and fusion

PURPOSE

The goal is to conduct a review of the current literature to determine and evaluate the current classification metrics available for quantifying post-operative dysphagia.

METHODS

We surveyed the literature for the subjective and objective measures used to classify dysphagia, and further described and analyzed them in the context of post-operative dysphagia (PD) after anterior cervical spine surgery, with a focus on anterior cervical discectomy and fusion (ACDF). We searched PubMed from the years 2005-2021 using the terms "anterior cervical discectomy and fusion" and "dysphagia or postoperative dysphagia." We included papers that were meta-analyses, systemic reviews, prospective, or retrospective studies. Our selection was further consolidated via abstract and title screening. Ultimately, nineteen articles were included and had full-text reviews.

RESULTS

EAT-10 tool was shown to be more valid and reliable than the commonly used Bazaz grading system. HSS-DDI was found to have a high diagnostic accuracy in stratifying mild, moderate, and severe PD. A shortened 16-item version of the original 44-item SWAL-QOL was found to be statistically and clinically significant. When compared to PROMs, objective tests more accurately diagnose PD.

CONCLUSION

We found that the most valuable subjective tests were the EAT-10 and HSS-DI because they are quick, sensitive, and correlated strongly with the well-established measurements of PD. The MBS and FEES provided accurate measurements of the severity of PD, but they required more time and equipment than the surveys. In some patient populations, such as those with pre-surgical dysphagia, objective testing should always be done.

Supportive care among head and neck cancer patients: An initial validation of the Dutch version of the Performance Status Scale for Head and Neck Cancer (D-PSS-HN)

BACKGROUND

Acute and late toxicities in patients treated with (chemo)radiotherapy for head and neck cancer (HNC) is common and can negatively impact quality of life and performance. Performance status instruments measure the functional ability to perform daily life activities and are important tools in the oncologic population.

AIMS

Since Dutch performance status scales for the HNC population are lacking, we conducted this study to translate the Performance Status Scale for Head and Neck Cancer Patients (PSS-HN) into Dutch (D-PSS-HN) and to validate this version.

METHODS & PROCEDURES

The D-PSS-HN was translated into Dutch according to the internationally described cross-cultural adaptation process. It was administered to HNC patients and together with the Functional Oral Intake Scale completed by a speech and language pathologist at five different time points during the first 5 weeks of (chemo)radiotherapy. Patients were asked each time to complete the Functional Assessment of Cancer Therapy and the Swallowing Quality of Life Questionnaire. Pearson correlation coefficients were used to calculate convergent and discriminant validity and the evolution of D-PSS-HN scores was assessed by means of linear mixed models.

OUTCOMES & RESULTS

A total of 35 patients were recruited and > 98% of the clinician-rated scales were completed. Convergent and discriminant validity were demonstrated, with all correlations rs between 0.467 and 0.819, and between 0.132 and 0.256, respectively. The subscales of the D-PSS-HN are sensitive to detect changes through time.

CONCLUSION & IMPLICATIONS

The D-PSS-HN is a valid and reliable instrument to assess performance status in patients with HNC treated with (chemo)radiotherapy. It is a useful tool to measure HNC patients' current diet level and functional abilities to perform daily life activities.

WHAT THIS PAPER ADDS

What is already known on the subject Acute and late toxicities in patients treated with (chemo)radiotherapy for HNC are common and can negatively impact quality of life and performance. Performance status instruments measure the functional ability to perform daily life activities and are important tools in the oncologic population. However, Dutch performance status scales for the HNC population are lacking. Therefore, we translated the Performance Status Scale for Head and Neck Cancer Patients (PSS-HN) into Dutch (D-PSS-HN) and validated this version. What this paper adds to existing knowledge We translated the PSS-HN and demonstrated its convergent and discriminant validity. The subscales of the D-PSS-HN are sensitive to detect changes through time. What are the potential or actual clinical implications of this work? The D-PSS-HN is a useful tool to measure HNC patients' functional abilities to perform daily life activities. The tool can easily be used in clinical settings: since data collection duration is very short, this facilitates clinical (and research-related) implementation of the scale. Patients' individual needs could be identified by using the D-PSS-HN, resulting in more appropriate approaches and (early) referrals if needed. Interdisciplinary communication could be facilitated.

Measurement Properties of the Health Literacy Questionnaire in the Understanding Multiple Sclerosis Massive Open Online Course Cohort: A Rasch Analysis

Background:

Objective:

Methods:

Key Results:

Conclusion:

Plain Language Summary:

Cross-Cultural Adaptation and Validation of the Italian Version of the Dysphagia Handicap Index (I-DHI)

The Dysphagia Handicap Index (DHI) is a valid Health-related Quality of Life (HRQOL) questionnaire for patients with oropharyngeal dysphagia (OD) of heterogeneous etiologies. The study aimed at crossculturally translating and adapting the DHI into Italian (I-DHI) and analyzing I-DHI reliability, validity, and interpretability. The I-DHI was developed according to Beaton et al. 5-stage process and completed by 75 adult OD patients and 166 healthy adults. Twenty-six patients filled out the I-DHI twice, 2 weeks apart, for test–retest reliability purposes. Sixty-two patients completed the Italian-Swallowing Quality of Life Questionnaire (I-SWAL-QoL) for criterion validity analysis. Construct validity was tested comparing I-DHI scores among patients with different instrumentally assessed and self-rated OD severity, comparing patients and healthy participants and testing Spearman’s correlations among I-DHI subscales. I-DHI interpretability was assessed and normative data were generated. Participants autonomously completed the I-DHI in maximum 10 min. Reliability proved satisfactory for all I-DHI subscales (internal consistency: α > .76; test–retest reliability: intraclass correlation coefficient > .96, k = .81). Mild to moderate correlations (− .26 ≤ ρ ≤ − .72) were found between I-DHI and I-SWAL-QoL subscales. Construct validity proved satisfactory as (i) moderate to strong correlations (.51 ≤ ρ ≤ .90) were found among I-DHI subscales; (ii) patients with more severe instrumentally or self-assessed OD reported higher I-DHI scores (p < .05); and (iii) OD patients scored higher at I-DHI compared to healthy participants (p < .05). Interpretability analyses revealed a floor effect for the Emotional subscale only and higher I-DHI scores (p < .05) for healthy participants > 65 years. In conclusion, the I-DHI is a reliable and valid HRQOL tool for Italian adults with OD.

Cultural Adaptation and Validation of Questionnaires for Evaluation of Health-Related Quality of Life with Dysphagia in Different Countries: A Systematic Review

Dysphagia can have devastating and long-lasting effects on the patient's health-related quality of life (HRQoL). In recent years, a number of questionnaires for the evaluation of the HRQoL of patients with dysphagia have been developed and have been adapted for use in different countries and cultures. However, problems may arise in the process of cultural adaptation and validation, which can affect the quality of the questionnaires and their measurements. This study was conducted to systematically summarize the cultural adaptation and validation of questionnaires for the evaluation of dysphagia-related HRQoL in different countries, assessing the varieties, measurement properties, and qualities of these questionnaires, with the aim of identifying the status of their adaptation and validation and ways in which they might be improved. Four databases were searched, and relevant articles were screened, with data from eligible reports extracted and reviewed. The methodological quality of the included articles was evaluated using the QualSyst critical appraisal tool. The HRQoL questionnaires for patients with dysphagia were assessed using the quality criteria for the measurement properties of health status questionnaires proposed by Terwee et al. and Timmerman et al. 29 studies published between 2008 and 2020 were included. The questionnaires described in these 29 studies were translated into 19 languages and culturally adapted to 21 countries. The adapted questionnaires were based on the Swallowing quality of life questionnaire (SWAL-QOL) by Mchorney et al., the Dysphagia Handicap Index (DHI) by Silbergleit et al., the M.D. Anderson Dysphagia Inventory (MDADI) by Chen et al., and the Eating Assessment Tool-10 (EAT-10) by Belafsky et al. It was found that the questionnaires were reliable and valid instruments for the assessment of dysphagia-related HRQoL, but the quality criteria for cultural adaptation and validation were not strictly followed, especially in the categories of criterion validity, agreement, responsiveness, and interpretability. In conclusion, although the questionnaires were found to be both reliable and valid, the quality criteria should be considered and strictly followed in the cultural adaptation and validation process in the future.

White Paper by the European Society for Swallowing Disorders: Screening and Non-instrumental Assessment for Dysphagia in Adults

This White Paper by the European Society for Swallowing Disorders (ESSD) reports on the current state of screening and non-instrumental assessment for dysphagia in adults. An overview is provided on the measures that are available, and how to select screening tools and assessments. Emphasis is placed on different types of screening, patient-reported measures, assessment of anatomy and physiology of the swallowing act, and clinical swallowing evaluation. Many screening and non-instrumental assessments are available for evaluating dysphagia in adults; however, their use may not be warranted due to poor diagnostic performance or lacking robust psychometric properties. This white paper provides recommendations on how to select best evidence-based screening tools and non-instrumental assessments for use in clinical practice targeting different constructs, target populations and respondents, based on criteria for diagnostic performance, psychometric properties (reliability, validity, and responsiveness), and feasibility. In addition, gaps in research that need to be addressed in future studies are discussed. The following recommendations are made: (1) discontinue the use of non-validated dysphagia screening tools and assessments; (2) implement screening using tools that have optimal diagnostic performance in selected populations that are at risk of dysphagia, such as stroke patients, frail older persons, patients with progressive neurological diseases, persons with cerebral palsy, and patients with head and neck cancer; (3) implement measures that demonstrate robust psychometric properties; and (4) provide quality training in dysphagia screening and assessment to all clinicians involved in the care and management of persons with dysphagia.

Using Classical Test Theory to Determine the Psychometric Properties of the Deglutition Handicap Index

The Deglutition Handicap Index (DHI) is a self-report measure for patients at risk of oropharyngeal dysphagia on deglutition-related aspects of functional health status (FHS) and health-related quality of life (HR-QoL). The DHI consists of 30 items which are subsumed within the Symptom, Functional and Emotional subscales. The purpose of this study was to evaluate the psychometric properties of the DHI using Classic Test Theory according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria. A total of 453 patients with dysphagia with different aetiologies were recruited concurrently at two academic hospitals. Dysphagia was confirmed by fiberoptic endoscopic and/or videofluoroscopic evaluation of swallowing. In addition, a healthy control group of 132 participants were recruited. Structural validity was determined using exploratory and confirmatory factor analyses and internal consistency by calculating Cronbach’s alpha coefficients. Hypothesis testing was evaluated using Mann–Whitney U-tests, linear regression analysis and correlations analysis. Diagnostic performance and receiver operating characteristic curves analysis were calculated. Factor analyses indicated that the DHI is a unidimensional measure. The DHI has good internal consistency with some indication of item redundancy, weak to moderate structural validity and strong hypothesis testing for construct validity. The DHI shows high diagnostic performance as part of criterion validity. These findings support that the DHI is an appropriate choice as a patient self-report measure to evaluate FHS and HR-QoL in dysphagia. Ongoing validation to assess the measure for possible item redundancy and to examine the dimensionality of the DHI using item response theory is recommended.

The presence of dysphagia in patients with cerebellar ataxia, neuropathy and vestibular areflexia syndrome (CANVAS): a subjective and objective study

PURPOSE

The aim of this study was to determine the prevalence of dysphagia in patients with cerebellar ataxia, neuropathy and vestibular areflexia syndrome (CANVAS), characterizing this condition, both in its objective dimension and in terms of quality of life (QoL).

METHODS

A cross-sectional study was developed in 11 patients diagnosed of CANVAS. In all patients, clinical records were reviewed and the Eating assessment tool 10 (EAT-10) was performed as screening of oropharyngeal dysphagia. To evaluate the QoL impairment secondary to dysphagia, we applied the swallowing quality of life questionnaire (SWAL-QOL) and the MD Anderson Dysphagia Inventory (MDADI). To evaluate the deglutition mechanisms impaired, two objective-instrumental studies were performed: the volume-viscosity swallow test (V-VST) and the fiberoptic endoscopic evaluation of swallowing (FEES).

RESULTS

82% of the patients presented an abnormal EAT-10 score. A correlation was found between the EAT-10 and MDADI and between both QoL questionnaires. After the FEES and V-VST analysis, all 11 patients presented some degree of swallow effectiveness impairment, and most of them safety alterations as well.

CONCLUSION

CANVAS remains an underestimated and underdiagnosed condition and the prevalence of swallowing disorders in those patients is higher than expected. Despite the possibility that EAT-10 works as a useful screening test to predict the results in the QoL questionnaires, the absence of correlation between QoL test and instrumental results suggests that to properly evaluate the patients swallowing status, objective instrumental procedures must be conducted.

European white paper: oropharyngeal dysphagia in head and neck cancer

Purpose

To develop a European White Paper document on oropharyngeal dysphagia (OD) in head and neck cancer (HNC). There are wide variations in the management of OD associated with HNC across Europe.

Methods

Experts in the management of specific aspects of OD in HNC across Europe were delegated by their professional medical and multidisciplinary societies to contribute to this document. Evidence is based on systematic reviews, consensus-based position statements, and expert opinion.

Results

Twenty-four sections on HNC-specific OD topics.

Conclusion

This European White Paper summarizes current best practice on management of OD in HNC, providing recommendations to support patients and health professionals. The body of literature and its level of evidence on diagnostics and treatment for OD in HNC remain poor. This is in the context of an expected increase in the prevalence of OD due to HNC in the near future. Contributing factors to increased prevalence include aging of our European population (including HNC patients) and an increase in human papillomavirus (HPV) related cancer, despite the introduction of HPV vaccination in various countries. We recommend timely implementation of OD screening in HNC patients while emphasizing the need for robust scientific research on the treatment of OD in HNC. Meanwhile, its management remains a challenge for European professional associations and policymakers.

Cultural adaptation and validation of the Norwegian version of the swallowing quality of life questionnaire (SWAL-QOL)

Introduction

Oropharyngeal dysphagia (OD) is a disorder that can have devastating and long lasting effects on a person’s medical, mental and psychosocial well-being, thus negatively impacting quality of life. There is currently no validated dysphagia-specific quality of life instrument in Norway. This project aims to evaluate the psychometric properties of the culturally adapted Norwegian version of SWAL-QOL (Nor-SWAL-QOL).

Methods

The original SWAL-QOL was translated into Norwegian according the international translation guidelines. A group of 102 persons with OD and a group of 123 healthy controls were recruited to assess the validity and reliability of the Nor-SWAL-QOL. Correlation analysis of the Nor-SWAL-QOL and the Short Form 36 (SF-36) and correlation analysis of OD group and control group Nor-SWAL-QOL subscale scores were computed to determine convergent, discriminant, and known-groups validity which help comprise construct validity. Internal consistency, test-retest reliability and intraclass correlation coefficient (ICC) were computed for reliability.

Results

Convergent and discriminant validity was demonstrated between Nor-SWAL-QOL subscales and SF-36 domains, and distinguished between persons with and those without oropharyngeal dysphagia on all subscales and on the symptom frequency battery (p < 0.001). Additionally, the Nor-SWAL-QOL differentiated between symptom severity levels within the OD group; those requiring food and liquid modifications and those who are tube fed and not tube fed. Nor-SWAL-QOL showed good reliability with adequate internal consistency (Cronbach’s α ≥0.70), test-retest reliability (Spearman’s rho values 0.68–0.90) and ICC values (0.67–0.89) for all subscales and for the symptom frequency battery.

Conclusion

Access to valid and reliable dysphagia-specific QoL outcome measures for health care practitioners, dysphagia clinicians and researchers is necessary for comprehensive assessment and treatment outcome measures. The Nor-SWAL-QOL exhibits sufficient psychometric properties for implementation in the Norwegian population.