The Development, Assessment, and Selection of Questionnaires

Are quality of care instruments inclusive of older people living with dementia? A scoping review in long-term care settings

More than half of older people in long-term care facilities have dementia. Little is currently known about the methods and instruments which can be used to capture the perspectives of older people, including those with dementia, regarding the quality of care provided in such facilities. The main aims of this scoping review were two-fold. Firstly, to identify quality of care instruments that have been applied in long-term care settings. Secondly, to evaluate how these instruments have been developed and validated, particularly in terms of their applicability among older people with dementia. Seven databases (Medline, Web of Science, Scopus, ProQuest, Ageline, CINHAL and google scholar) were searched for relevant literature without any date limit. We used quality criteria adapted from COSMIN (Consensus-based Standards for the selection of health status Measurement Instruments) guidelines to assess the psychometric properties of the instruments. The search identified 16 quality of care instruments which had been used in long-term care settings. Of which, two (12.5%) were specifically designed for older people with dementia, and three instruments (18.7%) were modified for use with older people with mild to moderate dementia. A variety of methods were used to develop the identified instruments including literature reviews, qualitative interviews, expert panel reviews, pre-testing and piloting with older people. None of the identified instruments had been subjected to comprehensive psychometric assessment. Most instruments for assessing quality of care in long term care settings lack alternative communication techniques tailored to people with dementia. This review highlights the need for more rigorous psychometric testing of existing instruments for assessing quality of care in long-term care settings. Several existing measures show promise and may be taken forward for further testing and development for widespread application with older people, including those living with dementia, in long term care settings.

Systematic Review of Instruments for the Assessment of Patient-Reported Outcomes and Quality of Life in Patients with Childhood Glaucoma

TOPIC

To identify patient-reported outcome measures (PROMs) that have been used in children and adolescents with glaucoma and to evaluate their methodologic quality.

CLINICAL RELEVANCE

Childhood glaucoma impairs vision and quality of life (QoL) throughout all stages of life. Thus, a PROM needs to cover many different age groups and topics. Various instruments have been used to evaluate patient-reported outcomes (PROs) in patients with childhood glaucoma, however, it is unclear which PROM has the highest methodologic quality and complies best with the needs of patients with childhood glaucoma.

METHODS

A systematic literature review was performed searching MEDLINE (PubMed), the Cochrane Library, Web of Science, and PsycINFO (EBSCO). We included peer-reviewed full-text articles of the past 10 years in English, German, or Spanish language that reported PROMs in children with glaucoma. The study selection and methodologic quality assessment of the identified PROMs was performed by 2 independent reviewers using a 7-point checklist. The content was mapped onto the World Health Organization International Classification of Functioning, Disability and Health. The systematic review was prospectively registered in PROSPERO (ID CRD42022353936).

RESULTS

The search strategy retrieved 3295 matches. A total of 2901 studies were screened, and 11 relevant articles were identified using 10 different instruments. The instruments addressed functional visual ability, vision-related QoL, health-related QoL, and life satisfaction. Six instruments were applicable for the use in children. Seven of the questionnaires received the highest number of positive ratings (5/7). None of the instruments considered the views of patients with childhood glaucoma during their development.

CONCLUSION

This systematic review provides a descriptive catalog of vision-specific and generic health PRO instruments that have been used in childhood glaucoma cohorts. An instrument specifically developed for childhood glaucoma is lacking which might result in missing important factors, such as permanent treatment with eye drops, repeated surgeries, and heritability of the disease, when investigating the QoL in children with glaucoma.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Adaptation and validation of a Korean version of the speaking up about patient safety questionnaire (KSUPS-Q)

BACKGROUND

Speaking up by healthcare providers is an essential assertive communication strategy for ensuring patient safety and preventing incidents. However, more is needed to know about speaking up and instruments to assess it in the Korean context. Therefore, we assessed the psychometric properties of the Korean version of the Speaking Up about Patient Safety Questionnaire (KSUPS-Q) for measuring speaking up-related behavior and climate among nurses.

METHODS

The translation and adaptation process followed the guidelines of the International Society for Pharmacoeconomics and Outcomes Research and the World Health Organization. Content validity was assessed by a six-member expert panel using the content validity index. In total, 314 nurses participated in an online survey to examine the psychometric properties. Internal consistencies were tested using Cronbach's alpha and McDonald's omega. Confirmatory factor analyses were conducted to examine the subscales' construct. The convergent validity of the speaking up-related climate scale was assessed by testing correlations with teamwork and safety climate domains of the Safety Attitudes Questionnaire. In addition, we investigated the convergent validity of the speaking up-related behavior scale by examining its correlation with the climate scale.

RESULTS

The reliability of the 11-item behavior scale was satisfactory. Confirmatory factor analysis confirmed that a three-subscale model (perceived concerns, withholding voice, and speaking up) was appropriate (CFI = 0.98, TLI = 0.98, and SRMR = 0.05). Furthermore, the 11-item climate scale demonstrated satisfactory internal consistency. A three-subscale model (psychological safety, encouraging environment, and resignation) was confirmed (CFI = 0.98, TLI = 0.97, and SRMR = 0.05). The convergent validity of the climate scale was verified based on correlations with the teamwork (r = 0.68, p < 0.001) and safety climate (r = 0.68, p < 0.001) domains of the Safety Attitudes Questionnaire. In addition, speaking up-related behavior and climate showed a significant association, indicating that the behavior scale is conceptually valid.

CONCLUSIONS

This study demonstrates that the KSUPS-Q is a valid and reliable instrument in Korea. This instrument can help nurse managers simultaneously monitor the behavior and climate of their organizations and evaluate the outcomes of interventions to enhance speaking up. Future research is needed to explore diverse factors contributing to speaking up, including clinical roles, team relationships, and supportive culture, to identify areas requiring further improvement.

Enhancing life with celiac disease: unveiling effective tools for assessing health-related quality of life

Celiac disease (CD) is an autoimmune chronic enteropathy provoked by gluten ingestion in genetically predisposed individuals. Considering it´s only safe treatment is a lifelong gluten-free diet, the burden of living with the disease becomes evident, as well as the need to assess CD health-related quality of life (HRQOL). This review aims to identify and analyze the instruments used to evaluate the HRQOL of adults with CD. This integrative review using a systematic approach was designed to achieve high scientific standards. Accordingly, the search strategy was developed and executed as recommended by the guideline of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. Detailed individual searches were developed to Pubmed, Science Direct, Scopus, Web of Science, and Google Scholar. After careful analysis of the papers, 43 studies were included, in which seven instruments were identified: Celiac Disease Questionnaire (CDQ) (n=21), Celiac Disease Specific Quality of Life Instrument (CD-QOL) (n=17), Celiac Disease Assessment Questionnaire (CDAQ) (n=4), CeliacQ-7 (n=1), CeliacQ-27 (n=1), Black and Orfila´s self-developed instrument (n=1) and the Coeliac Disease Quality of Life Questionnaire (CDQL) (n=1). The CDQ and CD-QOL were the two most applied instruments. Since the first focuses on the physical and mental symptoms related to the disease and the second focuses on the emotional repercussions of adhering to the GFD treatment for life (dysphoria), the CDQ application is an interesting option for countries that struggle with public policies for CD patients and patients with active CD. The CD-QOL could be used for countries with strict regulations for CD and gluten-free products and populations in remission. When comparing results among different populations, it is preferable to utilize culturally validated instruments, which have been applied across multiple countries, providing greater comparability between study findings.

Daily Functionality of People with Low Vision: The Impact of Visual Acuity, Depression, and Life Orientation-A Cross-Sectional Study

Background

Low vision (LV) has a significant negative impact on the activities of daily life as well as on the psychological health of patients.

Objectives

The objective of this study is to investigate psychological, clinical, and demographic factors that may impact the daily functionality of patients with LV.

Methods

A convenience sample of 53 patients, meeting the WHO criteria for LV, was recruited. Questionnaires on daily functionality, depression, and life orientation (in terms of optimism/pessimism) were administered along with a semistructured personal interview. Key Findings. The main results revealed a significant negative correlation between daily functionality and depression (r = -0.423, p < 0.001). Conversely, there is a positive correlation between daily functionality and visual acuity (r = 0.415, p < 0.001), while years since diagnosis were negatively correlated with depression (r = -0.345, p < 0.001). Depression seems to be a moderate predictor of a person's daily functionality (β = -0.389, p < 0.002), followed by visual acuity (β = -0.344, p = 0.006), explaining the 31.1% of the total variance.

Conclusions

The study supports a correlation between daily functionality and both depression and visual acuity. Optimism as a personality characteristic did not factor into the prediction model for daily functionality, but it showed a strong correlation with lower levels of depressive symptoms. This highlights the potential for developing coping strategies for chronic disease management. Recommendations. The study could serve as a useful guide and may urge clinicians to pay attention to the psychological evaluation of these patients, supporting their unique emotional needs. Mental health professionals can use patients' positive resources to provide appropriate counseling and embrace the coping skills that encourage their engagement in activities of daily life.

Knowledge about age-related eye diseases in the general population in Germany

BACKGROUND

With a rising prevalence of age-related eye diseases, prevention and early diagnosis of these conditions are key goals of public eye health. Disease-related knowledge in the general public supports these goals but there is little data available. Thus, we have assessed knowledge of cataract, glaucoma, age-related macular degeneration (AMD) and diabetic eye disease in the German adult general population in a cross-sectional study and identified target groups for health education interventions.

METHODS

Knowledge assessment content was identified based on a literature review, expert input, and a list of items was generated after a qualitative selection process. The resulting 16-item instrument (4 items per condition) was administered to 1,008 participants from a survey panel, demographically representative of the adult German population. Test properties were evaluated based on a Rasch model and multiple correspondence analysis (MCA). Binary-logistic regression analysis was performed to investigate associations with age, sex, education level, employment status, marital status, income, reported health status, visual difficulties, and recent general practitioner (GP) and ophthalmologist consultations.

RESULTS

Replies were correct for a median of 9 out of 16 (range 2 - 16) items, which differed between conditions (p < 0.0001). Most responses were correct for cataract items (median: 3 / 4) and least were correct for AMD items (median: 2 / 4). 27%, 9%, 1% and 19% of respondents replied correctly to all cataract, glaucoma, AMD and diabetic eye disease-related items, respectively. Rasch analysis suggested an adequate targeting of items and in MCA, no evidence of multidimensionality was present. Older age, being retired, decreased general health and recent GP or ophthalmology consultations were significantly associated with more knowledge about common eye conditions (p ≤ 0.005). GP or ophthalmology consultations remained significant in a multivariable model (p ≤ 0.011).

CONCLUSIONS

Knowledge gaps regarding eye health are considerable in the German general population and should therefore be addressed in educational interventions targeting the public. Special attention when designing such campaigns needs to be paid to infrequent users of the healthcare system. Knowledge of AMD seems to be poorer compared to other eye conditions.

Assessing the Structural Validity of the Knee Injury and Osteoarthritis Outcome Score Scale

BACKGROUND

The Knee Injury and Osteoarthritis Outcome Score (KOOS) scale is used to assess patient perspectives on knee health. However, the structural validity of the KOOS has not been sufficiently tested; therefore, our objective was to assess the KOOS in a large, multi-site database of patient responses who were receiving care for knee pathology.

METHODS

A cross-sectional study was conducted using the Surgical Outcome System (SOS) database. A confirmatory factor analysis (CFA) was conducted to assess the proposed five-factor KOOS using a priori cut-off values. Because model fit indices were not met, a subsequent exploratory factor analysis (EFA) was conducted to identify a parsimonious model. The resulting four-factor structure (i.e., KOOS SF-12) was then assessed using CFA and subjected to multigroup invariance testing.

RESULTS

The original KOOS model did not meet rigorous CFA fit recommendations. The KOOS SF-12 did meet model fit recommendations and passed all invariance testing between intervention procedure, sex, and age groups.

CONCLUSION

The KOOS failed to meet model fit recommendations. The KOOS SF-12 met model fit recommendations, maintained a multi-factorial structure, and was invariant across all tested groups. The KOOS did not demonstrate sound structural validity. A refined KOOS SF-12 model that met recommended model fit indices and invariance testing criteria was identified. Our findings provide initial support for a multidimensional KOOS structure (i.e., KOOS SF-12) that is a more psychometrically sound instrument for measuring patient-reported knee health.

Development and Psychometric Properties of the Chronic Uveitis-Specific Quality of Life Instrument for Patients with Chronic Uveitis

PURPOSE

To develop and assess psychometric properties of a disease-specific quality of life (QOL) assessment tool for patients with chronic uveitis.

METHODS

The initial 42-item chronic uveitis-related QOL questionnaire (CUQOL) was developed by literature review, semi-structured interviews, and expert consultation. Further development and assessment of the CUQOL were performed using Classic Test Theory and Rasch analysis.

RESULTS

The CUQOL version 1.0 was constructed with 28 items in five dimensions. The five subscales satisfied the requirements of unidimensionality, local independence, and threshold ordering. Cronbach's α coefficient for overall and each scale of the CUQOL 1.0 ranged from 0.75 to 0.94, with test-retest intraclass correlation ranging from 0.95 to 0.99. The CUQOL 1.0 has satisfactory convergent validity (r = 0.41-0.82), reasonable known group validity (p < .05), and good responsiveness (p < .05).

CONCLUSIONS

The CUQOL 1.0 is reliable and vaild for evaluating the QOL of patients with chronic uveitis.

Development of the Short-Form Yin Deficiency Scale Using Three Item Reduction Approaches

Background

Yin deficiency (YD) is a pathological condition characterized by emaciation, afternoon fever, dry mouth, and night sweats. The incidence of YD is 23.3%. A 27-item Yin Deficiency Scale (YDS) was developed to estimate the clinical severity of YD. This study aimed to develop three short-form YDS versions to reduce the burden of response time, using three item-reduction approaches: Rasch, equidiscriminatory item-total correlation (EITC), and factor-based analyses.

Methods

Two datasets were analyzed from previous studies (169 outpatients from May to June 2009 and 237 healthy college students from January to April 2016). The optimal response category was examined using Rasch analysis. Items with higher item-total correlations were determined using the EITC. Using a factor-based approach, the items were reduced, while maintaining the original YDS construct. Reliability was estimated using the person separation index (PSI) and Cronbach's α values. The predictive accuracy was examined using the area under the curve (AUC). Finally, the relationship between YD and dysfunctional breathing (DB) was examined using factor scores from the YDS and the Korean version of the Nijmegen Questionnaire (KNQ).

Results

We developed two 14-item YDS versions using the Rasch and EITC approaches, and a 16-item YDS version using a factor-based approach. Rasch analysis suggested an optimal response category of five points. The PSI of Rasch and Cronbach's α of the EITC and factor-based versions were 2.19, 0.855, and 0.827. The AUCs of the three short-form YDS were 0.812, 0.811, and 0.818. The sensitivity of the EITC-YDS was 0.632, which was lower than its specificity of 0.875. The fatigue-related scores of the factor-based YDS were fairly correlated with the factor scores of the KNQ estimating the DB (r = 0.349-0.499).

Conclusion

The 14-item Rasch- and 16-item factor-based YDS may replace the original YDS during YD's primary screening, epidemiological surveys, and health checkups.

A scoping review of the use of visual tools and adapted easy-read approaches in Quality-of-Life instruments for adults

PURPOSE

Self-Reporting using traditional text-based Quality-of-Life (QoL) instruments can be difficult for people living with sensory impairments, communication challenges or changes to their cognitive capacity. Adapted communication techniques, such as Easy-Read techniques, or use of pictures could remove barriers to participation for a wide range of people. This review aimed to identify published studies reporting adapted communication approaches for measuring QoL, the methodology used in their development and validation among adult populations.

METHODS

A scoping review of the literature using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) extension for scoping reviews checklist was undertaken.

RESULTS

The initial search strategy identified 13,275 articles for screening, with 264 articles identified for full text review. Of these 243 articles were excluded resulting in 21 studies for inclusion. The majority focused on the development of an instrument (12 studies) or a combination of development with some aspect of validation or psychometric testing (7 studies). Nineteen different instruments were identified by the review, thirteen were developed from previously developed generic or condition-specific quality of life instruments, predominantly aphasia (7 studies) and disability (4 studies). Most modified instruments included adaptations to both the original questions, as well as the response categories.

CONCLUSIONS

Studies identified in this scoping review demonstrate that several methods have been successfully applied e.g. with people living with aphasia post-stroke and people living with a disability, which potentially could be adapted for application with more diverse populations. A cohesive and interdisciplinary approach to the development and validation of communication accessible versions of QOL instruments, is needed to support widespread application, thereby reducing reliance on proxy assessors and promoting self-assessment of QOL across multiple consumer groups and sectors.

Development of a pharmacy educational environment questionnaire

INTRODUCTION

A robust instrument for measuring the educational environment in a pharmacy patient care setting is currently lacking. The authors aimed to develop a person-reported outcome measure to gauge trainee pharmacists' perceptions of their clinical workplace-based educational environment. This paper reports the various sources of validity evidence.

METHODS

A preliminary, three-domain (system, relationship, and personal), 36-item measurement instrument was developed by incorporating results from literature review, focus group interviews, iterative discussions among educators, and cognitive interviews. The preliminary instrument, together with the Dundee Ready Educational Environment Measure (DREEM) and Orientation to Happiness Scale (OHS), were administered to trainee pharmacists recruited from one pharmacy school and one healthcare cluster in Singapore. Rasch analysis was conducted on the overall instrument as well as three domains: System, Relationship, and Personal.

RESULTS

The 36-item instrument was administered to 145 learners, of which 66 were trainee pharmacists and 79 undergraduate interns. Upon removal of the middle "neutral" category to resolve poorly functioning categories and removal of five poorly functioning items, the overall instrument and its domains generally showed good fit with the Rasch model. Moreover, the overall 31-item Singapore Pharmacy Educational Environment Questionnaire (SPEEQ) and its three domains showed moderate to high convergent correlation with all the five DREEM domains and low to non-significant divergent correlation with the OHS Pleasure of Life subscale.

CONCLUSIONS

Among one sample of pharmacy trainees, the 31-item SPEEQ and its three component domains demonstrated notable validity evidence to gauge trainees' perceptions of their learning environment.

Constructing country-specific quality-of-life item banks for adults with amblyopia and strabismus in Australia and India

CLINICAL RELEVANCE

Understanding the quality-of-life (QoL) impacts of amblyopia and strabismus from the perspectives of patients using validated tools would enable eye care practitioners to provide better clinical management.

BACKGROUND

Item banks are advanced patient reported outcome measures with several advantages over traditional QoL assessment. This paper describes the development of amblyopia and strabismus-specific QoL item banks for two distinct country settings: Australia (high-income) and India (low-middle income) and examines the unique QoL issues.

METHODS

Using a bottom-up systematic approach, the content for the item banks was identified from three sources: existing self-report amblyopia and strabismus questionnaires (n = 22), qualitative literature (n = 5) and prospective qualitative studies in Australia (n = 49) and India (n = 30). The initial item pool underwent item evaluation, construction, and pre-testing to form optimal sets of representative items. The Indian item pools were first developed in English and translated into Hindi and Tamil using a rigorous translation protocol. The differences in QoL experiences that emanated from the qualitative studies and the number of common and unique items in the final item pools were compared.

RESULTS

The final Australian and Indian item pools comprised 312 and 277 items, respectively, covering 11 QoL domains. Two hundred and sixty items (79%) were common to both countries, and 21% were unique. Of the 11 domains, except for activity limitation (64.5%), visual symptoms (73.3%) and emotional impact (75.5%) domains, all other domains had over 80% of items common to both countries. The unique items can be attributed to differences in QoL experiences, individual perspectives, culture, lifestyle, country setting and health systems.

CONCLUSION

Amblyopia has a multifaceted impact on QoL irrespective of the country settings. Despite a huge overlap in QoL impacts between Australia and India, both countries had unique issues, especially activity limitations. The study developed comprehensive, country-specific item pools for Australia and India.

Quality of life after wearing multifocal contact lenses for myopia control for 2 weeks in the BLINK Study

PURPOSE

To validate Pediatric Refractive Error Profile 2 (PREP2) subscales that can be used to evaluate contact lens wearers and compare vision-specific quality of life measurements between children wearing multifocal and single vision contact lenses for 2 weeks.

METHODS

Two hundred and ninety-four myopic children aged 7-11 years (inclusive) were enrolled in the 3-year, double-masked Bifocal Lenses In Nearsighted Kids (BLINK) Study. Participants completed the PREP2 survey after having worn contact lenses for 2 weeks. The Vision, Symptoms, Activities and Overall PREP2 subscales were used to compare participants' subjective assessment while wearing +1.50 or +2.50 D add multifocal or single vision contact lenses. Rasch analysis was used to validate each subscale and to compare participants' subjective assessment of contact lens wear.

RESULTS

Item fit to the Rasch model was good for all scales, with no individual items having infit mean square statistics outside the recommended range (0.7-1.3). Response category function was acceptable for all subscales, with ordered category thresholds. Measurement precision, assessed by the Rasch person reliability statistic, was less than ideal (≥0.8) for three of the subscales, but met the minimum acceptable standard of 0.5. Scores for the Vision subscale differed by treatment assignment (p = 0.03), indicating that participants with the highest add power reported statistically worse quality of vision, although the difference was only 3.9 units on a scale of 1-100. Girls reported fewer symptoms than boys (p = 0.006), but there were no other differences between boys and girls.

CONCLUSIONS

Rasch analysis demonstrates that the PREP2 survey is a valid instrument for assessing refractive error-specific quality of life. These results suggest that vision-related quality of life is not meaningfully affected by 2 weeks of soft multifocal contact lens wear for myopia control.

Evaluating patient-reported outcome measures (PROMs) for future clinical trials in adult patients with optic neuritis

OBJECTIVE

To search for and critically appraise the psychometric quality of patient-reported outcome measures (PROMs) developed or validated in optic neuritis, in order to support high-quality research and care.

METHODS

We systematically searched MEDLINE(Ovid), Embase(Ovid), PsycINFO(Ovid) and CINAHLPlus(EBSCO), and additional grey literature to November 2021, to identify PROM development or validation studies applicable to optic neuritis associated with any systemic or neurologic disease in adults. We included instruments developed using classic test theory or Rasch analysis approaches. We used established quality criteria to assess content development, validity, reliability, and responsiveness, grading multiple domains from A (high quality) to C (low quality).

RESULTS

From 3142 screened abstracts we identified five PROM instruments potentially applicable to optic neuritis: three differing versions of the National Eye Institute (NEI)-Visual Function Questionnaire (VFQ): the 51-item VFQ; the 25-item VFQ and a 10-item neuro-ophthalmology supplement; and the Impact of Visual Impairment Scale (IVIS), a constituent of the Multiple Sclerosis Quality of Life Inventory (MSQLI) handbook, derived from the Functional Assessment of Multiple Sclerosis (FAMS). Psychometric appraisal revealed the NEI-VFQ-51 and 10-item neuro module had some relevant content development but weak psychometric development, and the FAMS had stronger psychometric development using Rasch Analysis, but was only somewhat relevant to optic neuritis. We identified no content or psychometric development for IVIS.

CONCLUSION

There is unmet need for a PROM with strong content and psychometric development applicable to optic neuritis for use in virtual care pathways and clinical trials to support drug marketing authorisation.

Patient-reported outcomes in patients with vitreous floaters: A systematic literature review

Seeking treatment for bothersome vitreous floaters is patient driven. To measure the impact of floaters and treatment on an individual's quality of life, patient-reported outcome measurements (PROMs) are essential. We review all studies using a PROM for patients with floaters. We evaluated content coverage against quality-of-life domains previously identified in other ophthalmic disorders, and against a qualitative study investigating quality-of-life issues in patients with floaters. We assessed measurement properties of PROMs using an extensive range of psychometric quality criteria. We identified 59 studies using 28 different PROMs. Many PROMs were not specifically developed for patients with floaters. Floater-specific PROMs were mostly based on content validation from an ophthalmologist or researcher perspective; two included a patient perspective. Using the outcomes of the qualitative study, we found that the floater-specific PROMs were narrow in their content coverage, with most items relating to visual symptoms and activity limitations. Testing the psychometric quality of PROMs was rare, and when employed mostly limited to responsiveness and known group validity. The remarkable high number of floater-specific PROMs reveals a need for such measurements in ophthalmology. Unfortunately, reporting on psychometric quality is limited, and content development is most often done without patient involvement.

Ontario Cataract Quality Outcome Initiative: appropriateness and prioritization of cataract surgery

OBJECTIVE

To explore the utility of the Catquest 9SF visual function (VF) questionnaire along with visual acuity (VA) for determining appropriateness and priority for cataract surgery. To evaluate the feasibility of administering the Catquest-9SF in a clinical setting using web-based electronic data capture and interpretation.

DESIGN

Prospective multicentred interventional observational study.

PARTICIPANTS

Subjects undergoing sequential cataract surgery in both eyes at 4 sites in Ontario.

METHODS

We recorded best-corrected VA (BCVA) and VA with current correction (CCVA) in each eye and both eyes (OU) and Catquest-9SF responses on a tablet before and after cataract surgery. Linear regression models were employed to test for associations between VA and visual function (VF).

RESULTS

Preoperative BCVA and CCVA in the worse eye were significant predictors of change in VF (p = 0.006 and p = 0.008, respectively); subjects with worse VA had a greater improvement in VF after surgery. There was a significant association between improvement in VF and improvement in CCVA OU (p = 0.001). Fourteen of 151 subjects (9%) had no improvement or worse VF scores after surgery. Within this group, 10 of 14 subjects had a preoperative score ≤-3, which is suggestive of minimal visual disability. Within this subset, 4 of 14 subjects (2.6%) had a preoperative BCVA of 20/30 or better in their worse eye.

CONCLUSIONS

For patient groups with equal VA, the Catquest-9SF score can help determine priority for surgery. Web-based data capture and interpretation allow for efficient virtual assessments of VF. A BCVA in the worse eye of 20/30 or better combined with a Catquest-9SF score <-3 can be used as a guideline for lowest priority.

Evaluating Psychometric Properties of the International Knee Documentation Committee Subjective Knee Form in a Heterogeneous Sample of Post-Operative Patients

Background

The International Knee Document Committee Subjective Knee Form (IKDC-SKF) is a patient-reported outcome measure used in orthopedics and sports medicine. Further psychometric assessment is necessary to confirm measurement properties in a large, heterogenous sample.

Purpose

The purpose of the study was to assess the psychometric properties of the IKDC-SKF in a large, heterogenous sample.

Study Design

Cross-Sectional Study.

Methods

An exploratory factor analysis (EFA) was conducted to identify a sound latent structure and to assess internal consistency in a large sample of patients who underwent knee arthroscopy. A confirmatory factor analysis (CFA) was conducted to confirm structural validity. Multi-group invariance was conducted to assess factorial stability across sex and age groups, while longitudinal invariance procedures were performed to assess stability over time.

Results

A 3-factor, 9-item IKDC-SKF short form was identified with EFA procedures. The model was confirmed with CFA (CFI = 0.983; TLI = 0.975; IFI = 0.983; RMSEA = 0.057), while a sound 2-factor, 6-item model was also identified (CFI = 1.0; TLI = 0.999; IFI = 1.0; RMSEA = 0.11). The 9-item IKDC-SKF short form was invariant across groups but not time; removal of a single item (i.e., 8-item IKDC-SKF short form) resulted in longitudinal invariance. The 6-item IKDC-SKF short form was invariant across groups and time.

Conclusion

The 6-item, 8-item, and 9-item short form versions of the IKDC-SKF exceed contemporary fit recommendations and present as plausible alternatives to the IKDC-SKF with improved measurement properties, reduced scale response burden, and evidence of multi-group and longitudinal invariance. Further, the 6- and 8-item IKDC-SKF short forms may be used to assess group differences or change across time.# Level of evidence hereLevel 3©The Author(s).

Italian translation and validation of the Contact Lens Dry Eye Questionnaire-8 (CLDEQ-8)

PURPOSE

To translate and validate an Italian version of the CLDEQ-8 (CLDEQ-8_IT).

METHODS

The study was carried out in two phases. In the first phase, a cross-cultural adaptation of CLDEQ-8 to Italian was performed by forward and backward translation in sequence. In the second phase, a multi-centre study was conducted for the validation of the questionnaire. Validity CLDEQ-8_IT was evaluated against three gestalt questions: overall opinion of soft contact lenses (CLs), global self-assessments of eye sensitivity and eye dryness. Reliability was evaluated by test-retest assessment in a subgroup of subjects. Finally, the psychometric properties of CLDEQ-8_IT were explored by Rasch analysis.

RESULTS

Two hundred and forty soft CL wearers, fluent Italian speakers (73 males and 167 females), between 18 and 70 years of age were enrolled. A significant correlation was found between CLDEQ-8_IT and each of the three Gestalt questions. The cutoff score of 12 points demonstrated the best balance between sensitivity and specificity in differentiating wearers grading their CLs as "Excellent/Very good" from those reporting their overall opinion as "Good/Fair/Poor". The Intraclass Correlation Coefficient between test and retest was 0.88 (95% CI: 0.81-0.92). Finally, infit and outfit statistics using Rasch analysis for the 8 items were in a good range, however Principal Components Analysis revealed a certain degree of multi-dimensionality of the instrument. Also, item 8 analysis could be computed after merging the last two response categories.

CONCLUSION

The CLDEQ-8_IT showed very good validity and reliability in measuring symptoms of CL wearers, comparable to the original English language version. A cut-off of 12 was confirmed as yielding the best balance between sensitivity and specificity in detecting CL wearers who could benefit from clinical management of their CL-related symptoms. Collapsing of the response options 5 and 6 in the last item of questionnaire could optimise its functioning.

Development and Validation of the Life for Low Vision Questionnaire (LIFE4LVQ) Using Rasch Analysis: A Questionnaire Evaluating Ability and Independence

Low vision (LV) has a substantial impact on an individual’s daily functionality and patient-reported outcome measures (PROMs) are increasingly incorporated into the evaluation of this problem. The objective of this study was to describe the design of the new “Life for Low Vision Questionnaire (LIFE4LVQ)”, as a measure of daily functionality in LV and to explore its psychometric properties. A total of 294 participants completed the LIFE4LVQ and the data were subjected to Rasch analysis to determine the psychometric properties of the questionnaire, including response category ordering, item fit statistics, principal component analysis, precision, differential item functioning, and targeting. Test–retest reliability was evaluated with an interval of three weeks and intraclass correlation coefficients (ICC) were used. The correlation between the questionnaire score and Best Corrected Visual Acuity (BCVA) was examined using Spearman’s correlation coefficient. Rasch analysis revealed that for most items the infit and outfit mean square fit values were close to 1, both for the whole scale and its subscales (ability and independence). The separation index for person measures was 5.18 with a reliability of 0.96, indicating good discriminant ability and adequate model fit. Five response categories were found for all items. The ICC was 0.96 (p < 0.001; 95% CI, 0.93–0.98), suggesting excellent repeatability of the measure. Poorer BCVA was significantly associated with worse scores (rho = 0.559, p < 0.001), indicating excellent convergent validity. The functional, 40-item LIFE4LVQ proved to be a reliable and valid tool that effectively measures the impact of LV on ability and independence.

Psychometric Properties of a Modified Athlete Burnout Questionnaire in the Collegiate Athletics Setting

CONTEXT

Mental health is an important component of holistic care in athletic settings. Burnout is one of many factors associated with poor mental health, and clinicians should assess for these symptoms. The Athlete Burnout Questionnaire (ABQ) has been proposed as a measure of burnout in athletes; however, design concerns are prevalent within the scale, and psychometric analyses have resulted in inconsistent measurement properties, limiting the usefulness of the scale for accurate assessment of burnout in athletes. The objective of our study was to assess the factor structure of the Alternate Modified ABQ-15v2 using confirmatory factor analysis. If model fit was inadequate, a secondary purpose was to identify a psychometrically sound alternate ABQ model.

DESIGN

Observational study.

METHODS

Intercollegiate athletes and dancers pursuing a degree in dance (n = 614) were recruited from programs across the United States. Individuals had varied health statuses (eg, healthy, injured), scholarship support, and participated in a variety of intercollegiate sports. A confirmatory factor analysis was conducted on the modified 15-item ABQ (Alternate Modified ABQ-15v2). Exploratory factor analysis and covariance modeling of a proposed alternate 9-item scale (ABQ-9) was conducted and multigroup invariance analysis was assessed across athlete category, class standing, and student-athlete scholarship status to assess consistency of item interpretation across subgroups.

RESULTS

The Modified ABQ did not meet recommended model fit criteria. The ABQ-9 met all recommended model fit indices but was not invariant across athlete category.

CONCLUSIONS

The ABQ-9 may be a viable and efficient option for assessing burnout in the collegiate athletics setting. However, further research is needed to validate the ABQ-9 in a cross-validation study.

A review of patient-reported outcome measures used in uveitis

We review patient-reported outcome measures (PROMs) used to evaluate the quality of life (QoL) in uveitis and provide a quality assessment of the psychometric properties of the PROMs, making it easier to choose the best questionnaire for uveitis. Our review included 158 articles. A total of 98 PROMs were used to measure QoL in uveitis and the National Eye Institute Visual Function Questionnaire 25 (NEI VFQ -25) was the most frequently used PROM in these studies. There were 5 uveitis-specific PROMs, but they were meant for either birdshot choroidopathy or cytomegalovirus retinitis or paediatric uveitis. There are no PROMs developed explicitly for the more common, anterior uveitis, intermediate uveitis, panuveitis, and chronic uveitis. The uveitis-specific PROMs performed better in our quality assessment criteria compared to other PROMs. However, these PROMs were constructed using traditional classical test theory and have not been assessed using the modern family of psychometric assessment methods such as Rasch analysis. As new therapeutic modalities for uveitis such as the new biological agents and steroid implants, continue to evolve, a comprehensive PROM will be increasingly valued in clinical trial settings to compare the effects of treatments from the patient's perspective.

Examining daily disposable soft contact lens wearers' attitudes and beliefs using the Health Belief Model

PURPOSE

To use the Health Belief Model (HBM) to understand daily disposable (DD) soft contact lens (SCL) wearers' attitudes and beliefs.

METHODS

A convenience sample of DD SCL wearers (18-33 years) was enrolled at two sites. Participants were queried about demographics, SCL wear and HBM constructs. Rasch analysis was used to assess the psychometric properties of the survey instrument and generate scores for each HBM subscale. ANOVA was used to determine relationships among HBM constructs, subject demographics and DD SCL-related health behaviours.

RESULTS

One hundred people participated (mean ± SD), age = 24.2 ± 3.9 years, 76% female. Thirty-seven percent reported sleeping in DD SCLs and 25% reported reusing DD SCLs. Self-report of reusing DD SCLs was associated with scores on the benefits: reuse (p = 0.02) and barriers (p = 0.007) subscales, and sleeping in lenses was associated with scores on the susceptibility (p = 0.05), benefits: wear behaviours (p = 0.006) and barriers (p = 0.01) subscales. Rasch analysis showed some subscales demonstrated multidimensionality.

CONCLUSIONS

Selected health belief constructs were associated with DD SCL-related behaviours including reusing and overnight wear. Increased understanding of SCL attitudes and beliefs could inform patient education and interventions to decrease risks associated with improper SCL wear.

Defining Daily Disposable Contact Lens Wear in a Clinical Study

SIGNIFICANCE

The U.S. Food and Drug Administration regulates contact lenses as prescription medical devices and defines daily disposable lenses for single use; however, safety comparisons between daily disposable and reusable lenses rely on the lens-wearing regimen. When inappropriately discerned, studies may erroneously report replacement regimen, resulting in inaccurate risk rates.

PURPOSE

This study aimed to explore different measures for defining daily disposable wearers in the context of a clinical study.

METHODS

A secondary analysis of data from five multisite fieldings (n = 1059) from the Contact Lens Risk Survey was performed. Descriptive statistics were used to examine self-reported lens replacement, use of lens case, and manufacturer's recommended replacement frequency as defined by the participants' selection of their habitual lenses using a photographic aide. Daily disposable wearers were identified as reporting daily replacement (by self-report and lens identification) and not using a lens case. If there was a discrepancy among these three factors, the lens assignment was assessed as a majority response (two of three) or as missing if conflicting information was reported.

RESULTS

The cohort was approximately two-thirds (68.7%) female and ranged from 12 to 33 years of age. A total of 154 participants (14.5%) were classified as daily disposable wearers and 896 (84.6%) as reusable wearers. Congruence was observed among all three daily disposable assignment factors for only 106 wearers (68.8%). The greatest discrepancy among daily disposable wearers was the report of using a lens case (n = 32 [20.8%]). In contrast, reusable lens wearers were more likely to report agreement across all three factors (n = 798 [89.1%], P < .001).

CONCLUSIONS

This analysis suggests that the report of not using a lens case is a more conservative surrogate for true single-use lens wear, as one in five may be storing and reusing their daily disposable lenses.

Confirmatory Factor Analysis of the Hip Disability and Osteoarthritis Outcome Score (HOOS) and Associated Sub-scales

Background

Hip Disability and Osteoarthritis Outcome Score (HOOS), HOOS-Joint Replacement (JR), HOOS Physical Function (PS), and HOOS-12 item scale have been suggested as reliable and valid instruments for assessing hip disability. However, factorial validity, invariance across subgroups, and repeated measures of the scale across different populations have not been well supported in the literature.

Purpose

The primary study objectives were to: (1) assess model fit and psychometric properties of the original 40-item HOOS scale, (2) assess model fit of the HOOS-JR, (3) assess model fit of the HOOS-PS, and (4) assess model fit of the HOOS-12. A secondary objective was to perform multigroup invariance testing across physical activity level and hip pathology subgroups for models that met recommended fit indices.

Study Design

Cross-Sectional Study.

Methods

Individual confirmatory factor analyses (CFAs) were conducted for the HOOS, HOOS-JR, HOOS-PS, and HOOS-12. Additionally, multigroup invariance testing (i.e., activity level, injury type) was conducted on the HOOS-JR and HOOS-PS.

Results

Model fit indices did not meet contemporary recommendations for the HOOS and the HOOS-12. Model fit indices for the HOOS-JR and the HOOS-PS met some, but not all, contemporary recommendations. Invariance criteria was met for the HOOS-JR and HOOS-PS.

Conclusion

The scale structure of the HOOS and HOOS-12 were not supported; however, preliminary evidence to support the scale structure of the HOOS-JR and HOOS-PS was found. Clinicians and researchers who utilize the scales should do so with caution due to their limitations and untested properties until further research establishes the full psychometric properties of these scales and recommendations for their continued use.

Vision-specific and cancer-specific quality of life in ocular graft-versus-host disease after allogeneic hematopoietic stem cell transplantation

PURPOSE

To compare the vision-specific and cancer-specific quality of life (QOL) between patients with and without ocular graft-versus-host disease (oGVHD) after allogeneic hematopoietic stem cell transplantation (alloHCT).

METHODS

This cross-sectional observational study analyzed 142 patients after alloHCT including 94 patients with oGVHD and 48 without. oGVHD was diagnosed according to International Chronic Ocular GVHD Consensus Group (ICOGCG) criteria. QOL was assessed by using the 25-item National Eye Institute Visual Function Questionnaire (NEI VFQ-25) and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 (EORTC QLQ-C30).

RESULTS

Compared with non-oGVHD patients, patients with oGVHD had worse vision-specific (NEI VFQ-25: 64.3 ± 20.3 vs. 77.6 ± 19.3, P < 0.001) and cancer-specific (EORTC QLQ-C30: 59.9 ± 20.3 vs. 67.4 ± 17.5, P = 0.03) QOL, as well as impaired cognitive function (72.7 ± 22.1 vs. 82.3 ± 19.0, P = 0.01). The vision-specific QOL was significantly correlated with ICOGCG score (β =  - 1.88, 95%CI: - 3.35 to - 0.41, P = 0.01) and post-alloHCT medical expense (β =  - 5.70, 95%CI: - 10.35 to - 1.05, P = 0.02), while cancer-specific QOL was strikingly correlated with post-alloHCT medical expense (β =  - 9.91, 95%CI: - 14.43 to - 5.39, P < 0.001), frequency of ophthalmic medication (β =  - 0.93, 95%CI: - 1.64 to - 0.21, P = 0.01), education (β =  - 6.97, 95%CI: - 13.31 to - 0.62, P = 0.03), and peripheral blood stem cell use (β =  - 6.42, 95%CI: - 12.59 to - 0.25, P = 0.04).

CONCLUSIONS

Patients with oGVHD experienced significant impairment in both vision-specific and cancer-specific QOL including cognitive function when compared with those without after alloHCT. Multidimensional QOL assessment should be included in the long-term alloHCT survivorship care.

Psychometric evaluation of the academic involution scale for college students in China: An application of Rasch analysis

Recent academic attention on educational involution in China underpins the need for a valid and reliable instrument to precisely measure college students' academic involution behaviors. Seeing the scarcity of a proper instrument, the current study attempted to analyze the item-level psychometric properties of the newly developed Academic Involution Scale for College Students (AISCS) in China by using a Rasch model. A total of 637 college students in a public university in northern China participated in the study. Data were examined with respect to unidimensionality, rating scale functioning, item fit statistics, item polarity, item- and person-level reliability and separation, item hierarchy and invariance across educational background with Winsteps. The results show that AISCS was a single unidimensional construct with good psychometric properties. Although two items demonstrated differential item functioning, it is plausible given the differences between assessment methods for undergraduates and postgraduates. Limitations and future research directions with regard to sample selection, inclusion of more validity evidence and adding prospective additional academic involution were discussed.

Catquest-9SF questionnaire: Validation in a Greek-speaking population using Rasch analysis

PURPOSE

The Catquest-9SF questionnaire is a tool measuring visual disability and vision-related limitation in patients' daily activities. The primary objective of this study was the validation of Catquest-9SF in a Greek-speaking cataract population.

METHODS

The questionnaire was translated into Greek and translated back into English. A pre-final Greek version was formed and tested by 10 Greek-English bilingual participants and by the translation team, and the final version was produced. Patients scheduled for cataract surgery completed the questionnaire preoperatively and postoperatively. Rasch analysis was performed for the assessment of the Catquest-9SF psychometric properties, including response category ordering, item fit statistics, principal components analysis, precision, differential item functioning and targeting for preoperative and postoperative data collectively.

RESULTS

A total of 100 (55 men, 45 women, mean age = 71.94±6.63) cataract patients completed the Greek version of Catquest-9SF questionnaire preoperatively and postoperatively. Rasch analysis showed a significant improvement in the median person Rasch score from -1.49 preoperatively to -4.71 logits postoperatively, while the effect size was 1.3. Unidimensionality was confirmed since infit and outfit mean square values varied between 0.66 and 1.37. Rasch analysis showed good precision and separation ability (Person Separation Index of 3.28, and Person Reliability of 0.92). Four response categories were found for all items. The item-person means difference was -1.83 logits. The difference between preoperative and postoperative Catquest-9SF logit score was positively correlated with preoperative Catquest-9SF logit score (coeff. = 0.798, p<0.0001) and negatively correlated with postoperative spherical equivalent (coeff. = -0.825, p = 0.011).

CONCLUSION

The Greek version of Catquest-9SF proved to be reliable, valid, unidimensional and responsive to changes after cataract surgery presenting good psychometric properties for cataract patients. Some postoperative mistargeting was found indicating that the tasks were easily performed by respondents after cataract surgery.

TRIAL REGISTRATION

NCT05323526 -retrospectively registered.

The Vision Correction Questionnaire: an electronic patient-reported outcome measure for refractive surgery

PURPOSE

To develop a psychometrically robust electronic patient reported outcome measure (ePROM) for refractive surgery.

SETTING

Moorfields Eye Hospital, London, United Kingdom.

DESIGN

Questionnaire development study.

METHODS

Items were derived in 6 domains (spectacle dependence, visual quality, eye comfort, functional freedom, emotional wellbeing, and satisfaction with treatment) from existing Rasch adjusted instruments, patient and surgeon feedback, and refinement in semistructured interviews before administration to a field test cohort (n = 360) of patients undergoing routine refractive surgery. Spectacle dependence and satisfaction with treatment items were used to provide descriptive statistical information only. Contemporary criteria for item reduction and Rasch modeling were applied to the remaining domains. The finalized questionnaire was then administered to a second patient cohort (n = 120) before and after surgery to assess sensitivity to change.

RESULTS

A 5-item scale derived for emotional wellbeing was unidimensional and a good fit to the Rasch model with ordered category response profiles, adequate precision (person separation 2.22 logits, reliability coefficient 0.83), and no misfitting items. Mean logit scores were 0.91 higher after treatment (effect size 1.26) suggesting a positive impact on emotional wellbeing. Functional scales could not be derived for visual quality, eye comfort, or functional freedom. Single-item ratings for visual quality and eye comfort were retained in our final 11-item questionnaire.

CONCLUSIONS

This short ePROM should integrate well with routine clinical care and clinical trials in refractive surgery. The Rasch adjusted emotional wellbeing scale may help quantify the way patients feel about refractive surgery, with the remaining items providing useful descriptive information.

The effect of COVID-19 pandemic and wearing face masks on ophthalmology practice: What is known so far? A narrative review

Face masks, along with other preventive measures, can help slow the spread of COVID-19. Despite the positive effect of the mask in combating the virus, it has some negative effects on the human body that must be followed up on and reduced. In this study, we discuss the impact of wearing face masks on the eye and the common issues associated with using them. The literature search was conducted using electronic databases such as PubMed and Google Scholar. Only articles published in English were included. A total of 39 relevant articles were deemed eligible. After the duplicate articles were removed, the titles and abstracts of 20 papers underwent full-text screening. The review comprised both prospective and retrospective investigations, case reports, and a series of reporting ocular symptoms following the use of face masks. The COVID-19 pandemic affected ophthalmology practices in managing patients. New factors must be considered, especially when dealing with anti-VEGF injections, such as the risk of endophthalmitis, tests and symptoms of patients with glaucoma, and the emerging symptoms associated with the COVID-19 vaccination. The use of face masks and breathing aids seemed to influence the tear film.

Spanish Cross-Cultural Adaptation, Rasch Analysis and Validation of the Ocular Comfort Index (OCI) Questionnaire

The Ocular Comfort Index (OCI) assesses ocular surface irritation and grades the severity of dry eye disease. This study sought to adapt the OCI questionnaire into Spanish, and then to assess the psychometric performance and validity of the new adapted version (OCI-versión española, OCI_VE). The questionnaire was translated, back translated, and then cross-culturally adapted for use with Spanish-speaking individuals. The OCI_VE was completed by 450 participants, including 53 subjects that were diagnosed with dry eye disease. Through a Rasch analysis, the psychometric properties of item fit, targeting, person separation, reliability, and differential item functioning (DIF) were assessed. To test the convergent validity, we examined the correlation between the OCI_VE and the Computer Vision Symptom Scale (CVSS17). Validity was tested in a subgroup of participants with and without dry eye, and test-retest repeatability was determined in a subset of 151 individuals. We also compared, via DIF, the performance of the OCI_VE with that of the original OCI. Our Rasch analysis revealed a good model fit, high accuracy, good targeting, unidimensionality, and no DIF according to gender. The validity and repeatability were good. The OCI_VE shows comparable psychometric properties to the original English version, making it a valid tool for measuring dry eye symptoms in Spanish adults.

Evaluating validity and reliability of the Arabic-version low-vision quality-of-life questionnaire

Low-vision quality-of-life questionnaire (LVQOL) has not been developed in the Arabic language, and none has been translated into Arabic. This study would demonstrate the effectiveness of the translated questionnaire. The English LVQOL was translated into Arabic (ARB-LVQOL) through five stages. A total of 52 low vision and 30 normally sighted individuals participated in this study. The internal consistency reliability, item-total correlation reliability, construct validity, convergent validity, discriminative validity, and respondent burden of the ARB-LVQOL were calculated. The translation team recommended that the ARB-LVQOL replicated the meaning of the LVQOL. The cultural differences were also noted during the translation process. Cronbach’s coefficient was α = 0.90 in both low vision (LV) and simulated groups. The item-total correlation ranged from 0.50 to 0.70 in both groups. The intra-class correlation coefficient indicated good test–retest reliability (LV group, ranged 0.82–0.93; control group ranged 0.83–0.94). The factor analysis, using varimax rotation, of the ARB-VQOL identified seven factors. A moderate to a strong relationship between the score of each domain with the total index score was observed, indicating an adequate convergent validity. The ARB-LVQOL discriminated between normally sighted and simulated low-vision participants and also to some extent between the simulated and real low-vision individuals. The respondent burden was less than 15 min in most responses. The ARB-LVQOL was found to relate well with patients’ visual functions and some patients’ characteristics, providing further evidence of the validity of ARB-LVQOL. The ARB-LVQOL showed psychometric properties analogous to the English version. The ARB-LVQOL could be used in clinical settings and research in adults with low vision in Arabic populations.

Translation and validation of convergence insufficiency symptom survey to Italian: Psychometric results

PURPOSE

This study aimed to translate the Convergence Insufficiency Symptom Survey (CISS) into the Italian language and assess psychometric properties of the translated questionnaire (CISS_I).

METHODS

The CISS_I was arranged according to guidelines for a comprehensive multistep methodologic process for translating, adapting, and validating psychometric instruments in health care research. The CISS_I questionnaire was administered to 103 volunteers (21.8 ± 2.2 years), students in higher education, at two different times. A complete optometric evaluation was performed including subjective refraction, best corrected visual acuity, near point of convergence, prism fusional ranges to blur, diplopia and recovery, TNO stereo test and prism cover test for measurement of heterophoria.

RESULTS

The performance of the CISS_I in terms of validity showed some points of weakness. Sensitivity was 42%, specificity was 74%, positive predictive value was 27% and negative predictive value was 85%. The area under the ROC curve was 0.672. On the contrary, the results showed good internal consistency of the CISS_I (Cronbach's alpha - α=0.89) and good test-retest reliability (ICC = 0.92). Rasch analysis showed good model fit (all items, except one, with infit and outfit mean square between 0.7 and 1.3), good measurement precision (person separation = 2.66) and good targeting -0,81 logits but also some evidence of multidimensionality.

CONCLUSIONS

The CISS_I showed some point of weakness in terms of validity but also good psychometric properties and has been shown to be applicable to an Italian speaking population to quantify the visual discomfort associated with near vision in higher education students. The results show that high CISS_I score is not necessarily linked to convergence insufficiency, while low scores can exclude the presence of this anomaly. The CISS_I can help in interpreting and monitoring convergence insufficiency symptoms in already identified subjects, but it is not suitable for screening a general population of young adults.

Evaluating patient-reported outcome measures (PROMs) for clinical trials and clinical practice in adult patients with uveitis or scleritis: a systematic review

Patient reported outcome measures (PROMs) capture impact of disease and treatment on quality of life, and have an emerging role in clinical trial outcome measurement. This study included a systematic review and quality appraisal of PROMs developed or validated for use in adults with uveitis or scleritis. We searched MEDLINE, EMBASE, PsycINFO, CINAHL and grey literature sources, to 5 November 2021. We used established quality criteria to grade each PROM instrument in multiple domains from A (high quality) to C (low quality), and assessed content development, validity, reliability and responsiveness. For instruments developed using classic test theory-based psychometric approaches, we assessed acceptability, item targeting and internal consistency. For instruments developed using Item Response Theory (IRT) (e.g. Rasch analysis), we assessed response categories, dimensionality, measurement precision, item fit statistics, differential item functioning and targeting. We identified and appraised four instruments applicable to certain uveitis types, but none for scleritis. Specifically, the National Eye Institute Visual Function Questionnaire-25 (NEI-VFQ), a 3-part PROM for Birdshot retinochoroiditis (Birdshot Disease & Medication Symptoms Questionnaire [BD&MSQ], the quality of life (QoL) impact of Birdshot Chorioretinopathy [QoL BCR], and the QoL impact of BCR medication [QoL Meds], the Kings Sarcoidosis Questionnaire (KSQ), and a PROM for cytomegalovirus retinitis. These instruments had limited coverage for these heterogeneous conditions, with a focus on very rare subtypes. Psychometric appraisal revealed considerable variability between instruments, limited content development, and only one developed using Item Response Theory. In conclusion, there are few validated PROMs for patients with uveitis and none for scleritis, and existing instruments have suboptimal psychometric performance. We articulate why we do not recommend their inclusion as clinical trial outcome measures for drug licensing purposes, and highlight an unmet need for PROMs applicable to uveitis and scleritis.

Validation of the Spanish version of the Low Vision Quality of Life Questionnaire

PURPOSE

To validate the Spanish Low Vision Qualify of Life (SLVQOL) questionnaire, a quality of life instrument specifically designed for patients with visual impairment, and evaluate its psychometric properties.

METHODS

The study included 170 visually impaired patients and 195 healthy subjects. Participants were administered the SLVQOL, the NEI VFQ-25, and the EQ 5D-5L questionnaires. Reliability, test-retest reproducibility, feasibility, and construct validity of the SLVQOL were assessed. The Generalized Partial Credit Model was used to fit the data and the performance of each item was characterized using category response curves and item information.

RESULTS

The reliability of the SLVQOL was 0.981 (95% CI: 0.978-0.985). Test-retest reproducibility was good (ρ=0.864, P<.001). A cut-off point of 105 or 106 was optimal to detect visual impairment, with a sensitivity of 95.4% and a specificity of 91.8%. Construct validity was shown by the corresponding convergence or divergence correlations between the score of the SLVQOL and its dimensions and the overall and partial scores of the NEI VFQ-25 and the EQ 5D-5L. Item response theory analysis showed discrimination and information parameters ranging from 0.539 to 3.063 and from -1.894 to 1.074, respectively.

CONCLUSION

The SLVQOL was able to quantitatively assess and identify differences in the quality of life among patients with visual impairment and normal subjects. The evaluated psychometric properties suggest that this tool has excellent validity, internal consistency, and reproducibility, but may benefit from a reduction of the number of items.

Development and Validation of the Anaphylaxis Quality of Life Scale for Adults

BACKGROUND

Anaphylaxis is a severe and potentially life-threatening allergic reaction that can have a detrimental impact on quality of life (QoL). There are no validated scales to measure the impact of anaphylaxis on QoL of adults.

OBJECTIVE

The aim of this study was to develop and assess the reliability and validity of a QoL scale for adults with anaphylaxis (Anaphylaxis Quality of Life Scale for Adults [A-QoL-Adults]).

METHODS

All participants were recruited from a specialist allergy clinic and had a confirmed diagnosis of anaphylaxis (as per the World Allergy Organization diagnostic criteria) to food, drugs, venom, or latex or had spontaneous anaphylaxis. Interviews were conducted with 13 adults; data were analyzed using thematic analysis to extract items for a QoL scale. A prototype QoL scale was then completed by 115 participants alongside validated scales to measure generic QoL (World Health Organization Quality of Life Scale [Brief Version] [WHOQoL BREF]), anxiety and depression (Hospital Anxiety and Depression Scale [HADS]), and stress (Perceived Stress Scale [PSS]).

RESULTS

The A-QoL-Adults scale has 21 items demonstrating excellent internal reliability (Cronbach α = 0.96). Factor analysis produced 3 subscales: Emotional Impact; Social Impact; and Limitations on Life. Each has excellent internal reliability (0.92, 0.92, and 0.91, respectively). Poorer anaphylaxis-related QoL (total A-QoL-Adults score and subscale scores) correlated significantly with poorer general QoL and greater anxiety, depression, and stress (all P < .01 with medium-to-large effect sizes).

CONCLUSIONS

The A-QoL-Adults scale is a reliable measure of QoL in adults with anaphylaxis and shows good construct validity. It will offer health care professionals a means to further understand the impact of anaphylaxis on adult patients and could help direct and monitor allergy management and the need for further psychological intervention.

Psychometric Evaluation of Glaucoma Quality of Life Item Banks (GlauCAT) and Initial Assessment Using Computerized Adaptive Testing

Purpose

To evaluate the psychometric properties of glaucoma-specific quality of life (QoL) item banks (GlauCAT) and assess their performance using computerized adaptive testing (CAT) simulations.

Methods

In this cross-sectional study, 293 participants with glaucoma (mean age ± SD, 70.7 ± 13.2 years; 45% female) answered 342 items in 12 QoL item banks (IBs): Activity Limitation (AL); Driving (DV); Convenience (CV); Economic (EC); Emotional (EM); General Symptoms (GS); Health Concerns (HC); Lighting (LT); Mobility (MB); Ocular Surface Symptoms (OS); Social (SC); and Visual Symptoms (VS). These IBs were assessed using Rasch analysis, and CAT simulations with 1000 simulated respondents were utilized to determine the average number of items to be administered to achieve moderate and high precision levels.

Results

The AL, DV, EM, HC, LT, MB, EC, OS, SC, and VS IBs required relatively minor amendments to achieve satisfactory psychometric fit. To resolve multidimensionality, we split CV into Treatment Convenience (TCV) and General Convenience (GCV). Due to poor measurement precision, the GS IB was not pursued further. This resulted in 12 total IBs. In CAT simulations, an average of 3.7 and 7.3 items per IB were required to attain measurement at moderate and high precision, respectively.

Conclusions

Following rigorous psychometric assessment, we developed 12 valid glaucoma-specific QoL domains that can obtain highly precise person measure estimates using a small number of items.

Translational Relevance

GlauCAT will enable researchers and clinicians to quickly and comprehensively assess the impact of glaucoma and its associated interventions across a range of QoL domains.

Women's awareness of ovarian cancer risk factors and symptoms in Western Iran in 2020-2021

Objectives

This study aimed to investigate awareness of women living in the western region of Iran about warning signs and risk factors for ovarian cancer.

Methods

This cross-sectional, descriptive-analytical study was conducted in Sanandaj and Kermanshah, Iran, 2020 and 2021. In this study, 1081 women aged 18–70 years were selected as the sample to fill out the electronic version of the Ovarian Cancer Awareness Measure (OCAM) to identify the significant variables of ovarian cancer warning signs and risk factors. The obtained data were statistically analyzed by descriptive statistics and ordinal logistic regression in SPSS 19.

Results

In this study, 60.9% of the participants had medium awareness of the subject. The results indicated that participants with higher educational attainment (P < 0.05) and those with a history of cancer (P < 0.001) showed higher knowledge of cancer. The lowest level of awareness of symptoms was associated with acute symptoms such as dysphagia (swallowing problems) most days, persistent bloating, a sense of abdominal fullness or heaviness, and frequent urination. Moreover, the lowest awareness of risk factors was related to the history of IVF treatments and the application of talcum powder to the genital area.

Conclusion

The study findings showed that women living in the western region of Iran have moderate awareness of ovarian cancer and insufficient knowledge of cancer warning signs; this suggests that it is necessary to train Iranian women to raise awareness of the signs and risk factors for ovarian cancer.

Interviewer Administration Corresponds to Self-Administration of the Vision Impairment in Low Luminance (VILL) Questionnaire

Purpose

To quantify the impact of the mode of administration (MOA) on scores of the Vision Impairment in Low Luminance (VILL) questionnaire.

Methods

The VILL questionnaire was implemented using different MOAs (paper, interview, electronic), in addition to a demographical survey of adult participants recruited at an outpatient eye clinic, with the initial MOA being either paper or interview. Polytomous Rasch models were used to generate person measure scores for the three subscales of the VILL questionnaire (reading, VILL_R; mobility, VILL_M; and emotional, VILL_E). Measures of agreement among the different MOAs were calculated (self-administered paper/interview, self-administered paper/self-administered electronic, and interview/self-administered electronic). An age-matched analysis was performed to control for the impact of the initial MOA, administration interval, visual acuity, and self-reported hearing difficulties.

Results

We included 309 participants (mean age, 63 ± 14 years; 61% female). Intra-class correlation coefficients were 0.930, 0.919, and 0.799 for paper versus interview assessment; 0.951, 0.959, and 0.916 for paper versus electronic; and 0.967, 0.955, and 0.907 for interview versus electronic assessment (VILL_R, VILL_M, and VILL_E, respectively). Mean differences were 0.35, 0.41, and 1.74 logits; 0.32, 0.18, and 0.68 logits; and 0.08, 0.22, and 0.63 logits, respectively. None of the mentioned factors significantly affected the results (corrected P ≥ 0.11).

Conclusions

Paper, interview, and electronic MOAs of the VILL can be considered equivalent. Reporting across the main MOAs of self-administration (paper) and interviewer-administration was unaffected by better eye visual acuity and self-reported hearing difficulties.

Translational Relevance

The results support use of the VILL questionnaire with flexible modes of administration.

Assessment of patient-reported outcome measures used in corneal transplantation: a systematic review

The aim of this study was to review all the articles that have implemented patient-reported outcome measures (PROMs) to evaluate the quality of life (QoL) in corneal transplantation and discuss quality assessments of the PROMs. An extensive literature review was undertaken to identify all the studies that used PROMs to assess the QoL in corneal transplantation. Non-original or review articles, articles on other subject area and articles on cost-effectiveness/utility without PROM data/results were excluded. Each PROM was assessed against the following criteria: content development (item identification and item selection), psychometric properties, validity, reliability, and responsiveness. 425 articles were identified of which 35 articles were included in the final review. PROMs in corneal transplantation were used to (a) evaluate the QoL after surgery, (b) compare the QoL scores between different surgical techniques and (c) determine the relationship between QoL and objective measures such as visual acuity, visual field and stereoacuity. A total of 17 PROMs were used to assess QoL in corneal transplantation. Whilst this search did not produce any PROMs that were specifically designed to assess corneal transplantation, most studies were found to have employed the National Eye Institute Visual Function Questionnaire 25 (NEI VFQ 25). The Visual Function Index 14 (VF 14) performed better in the present quality assessment criteria compared to other PROMs, however, the NEI VFQ 25 and the VF 14 PROMs were not specifically developed for corneal transplantation and therefore the QoL assessment made using these PROMs may be incomplete. As improvements in various forms of lamellar transplantation surgery techniques such as UT-DSAEK and FT-DSAEK have resulted in better visual outcomes, improved graft survival and reduced complications, a corneal transplantation specific PROM will be useful in clinical settings to compare the outcomes of different surgical techniques from the patient perspective.

Use and Perceptions of Advanced Driver Assistance Systems by Older Drivers With and Without Age-Related Macular Degeneration

Purpose

Advanced driver assistance systems (ADAS) have been reported to improve the safety of elderly and normally sighted drivers. The purpose of this study was to assess exposure to, perceived safety of, comfort level with, and interest in using ADAS among drivers with age-related macular degeneration (AMD).

Methods

Current drivers aged 60+ years were recruited at four US sites to complete a survey about ADAS and driving habits. Frequency of use and/or perceptions of eight ADAS were investigated. An avoidance score was generated using questions about difficult driving situations.

Results

The survey was completed by 166 participants (80 with AMD vs. 86 without). Participants with AMD had worse self-rated vision than those without (34% vs. 2% poor or fair rating), and drove fewer weekly miles (median [interquartile range [IQR] 30 [15 to 75] vs. 60 [30 to 121] miles, P = 0.002). Participants with AMD reported more avoidance of difficult driving situations (P < 0.001). There was no difference in the number of ADAS used by AMD status (median [IQR for AMD = 2.5 [1 to 5] vs. 3 [2 to 4] without, P = 0.87). Greater reported number of ADAS used was associated with less avoidance of difficult situations (P = 0.02). The majority perceived improved safety with most ADAS.

Conclusions

Many drivers with AMD utilize common ADAS, which subjectively improve their road safety and may help to reduce self-imposed restrictions for difficult situations and mileage.

Translational Relevance

Drivers with AMD are adopting readily available ADAS, for which they reported potential benefits, such as safety and less restrictive driving.

Development of age appropriate vision function questionnaire for children with visual impairment (CHVI-VFQ)

PURPOSE

To develop a new age-appropriate visual function questionnaire for visually impaired children.

METHODS

The study was conducted in north India in 20,955 (97.3%) children ≤15 years who underwent visual acuity examination. Of these 20,955 children, a total of 722 children were referred with unaided visual acuity less than 6/12 in any eye. Among these referred children, parents in the age group of 5-9 years and children between 10 and 15 years underwent interviews using LV Prasad Functional Visual Questionnaire-20 (LVP FVQ 20) and Indian Visual Functioning Questionnaire-33 (IND VFQ-33). Following this, multiple steps were undertaken that involved expert opinion for the removal of items on basis of zero variance and factor analysis along with calculation of Cronbach's alpha.

RESULTS

: A Cronbach' alpha of 0.834 was calculated for the younger age group and 0.931 for the higher age group of children.

CONCLUSION

: A new robust age-appropriate questionnaire was developed and it was observed that there was a significant change in median score (that was derived for various domains after calculating the median for the items in various domains asked pre- and post-intervention in the form of glasses or surgery) for quality of visual function in the visually impaired children. A significant change in functional vision of visually impaired children (P < 0.005) was observed in both age groups.

The 17-Item Computer Vision Symptom Scale Questionnaire (CVSS17): Translation, Validation and Reliability of the Italian Version

Background. To validate the 17-item Computer Vision Symptom Scale questionnaire (CVSS17) in Italian. Methods. Cross-sectional validation study on video terminal (VDT) users and a reference sample of subjects not working at a VDT (control group), cognitively able to respond to a health status interview. The Italian self-administered version of the CVSS17 questionnaire was administered to all participants. The reliability and validity of the Italian translation of the CVSS17 were tested using standard statistical methods for questionnaire validation. The Rasch analysis was performed as well. Results. A total of 216 subjects were enrolled. Concerning the reliability, the Cronbach’s alpha coefficient was 0.925 (from 0.917 to 0.924), and the test−retest stability was 0.91 (<0.001). Concerning the validity, the control group had significantly better scores, and there were good correlations between responses to the CVSS17 and analogous domains of the GSS. Conclusion. The Italian version of the CVSS17 has shown psychometric properties comparable to those of the Spanish version, having good validity, discriminatory power, internal consistency and reliability. The questionnaire is a specific measure of vision-related quality of life in Italian-speaking VDT workers and can be used both in clinical practice and for research purposes.

Change in rehabilitation needs and activity limitations over time of adults with acquired visual impairment following entry to a low vision rehabilitation service in England

PURPOSE

Longitudinal changes in priority rehabilitation needs, vision-related activity limitation and importance of visual goals were evaluated in a sample of people with a visual impairment over a year following entry to low vision rehabilitation services in England.

METHODS

Participants were adults with newly registered visual impairment within Leicestershire. Priority scores, indicating the level of rehabilitative need, were determined from the importance and difficulty scores of the 48 goals of the Participation and Activity Inventory (PAI). Rasch analysis of the difficulty and importance scores examined activity limitation and importance separately. PAI outcome measures were assessed on entry to rehabilitation services and at 4 and 12 months thereafter.

RESULTS

Forty-eight participants (mean age 74.2, SD 14.1 years) completed three visits. Overall, there was a statistically significant reduction in the perceived need for rehabilitation over time (p < 0.001, η_p ²  = 0.29), driven by reduced perceived difficulty (p < 0.001, η_p ²  = 0.32) but stable importance (p = 0.73) of goals, with most change occurring between baseline and 4 months. PAI goals with greatest rehabilitative need at study entry were reading, mobility and writing, and these remained of highest priority over time. The greatest priority score decrease was for the goal 'Hobbies and crafts'. The largest decrease in importance was for 'Mobility outdoors', whereas 'Relationship with loved ones' increased most.

CONCLUSIONS

Despite a decline in the perceived need for rehabilitation over the study period, there remains a need for continued support and intervention at 12 months following registration with rehabilitation services, particularly for the key goals of reading, writing and mobility. Early identification and support for individuals' important but difficult goals could prevent such goals being relinquished. Goals concerning relationships and communication became more important over time, indicating that re-evaluation of needs at follow-up is necessary to inform ongoing service provision.

Validation of the Symptom Questionnaire for Visual Dysfunctions (SQVD): A Questionnaire to Evaluate Symptoms of any Type of Visual Dysfunctions

Purpose

To assess psychometric properties of the Symptom Questionnaire for Visual Dysfunctions (SQVD) questionnaire, including accuracy, validity, and reliability, in a clinical sample of patients having any type of visual dysfunction.

Methods

A clinical sample of 306 patients self-administered the SQVD. Rasch analysis was performed to analyze the functionality of the response categories, fit statistics, differential item functioning (DIF), person and item reliability, targeting, local dependency, unidimensionality, and transformation table. Accuracy was assessed by means of receiver operating characteristic (ROC) curves, using symptoms reported in each patient's clinical record as the gold standard for classifying patients with and without symptoms. The concurrent validity, known group validity, and test–retest reliability (repeatability, using the intraclass correlation coefficient [ICC]) were also examined.

Results

SQVD showed orderly category responses. The 14 items fit the Rasch model without significant DIF for gender, presbyopia, and dysfunctions. Person and item reliabilities were 0.81 and 0.85, respectively. Targeting was –1.49 logits. Yen's Q3 statistic showed no local dependency. SQVD was unidimensional (first contrast of the residual = 1.852 eigenvalue with a variance explained by measures of 52.23%). The area under the ROC curve was 0.836 (95% confidence interval [CI], 0.792–0.879) with a cutoff of ≥6 showing good accuracy (sensitivity = 0.759; specificity = 0.783). SQVD showed good concurrent and known group validity and high repeatability (ICC, 0.857; 95% CI, 0.710–0.933) when administered twice 1 week apart.

Conclusions

SQVD has shown good psychometric properties. It can be considered an accurate, valid, and reliable questionnaire to detect visual symptoms related to any type of refractive, accommodative, and binocular dysfunction.

Translational Relevance

SQVD may be used for diagnostic purposes, as it can accurately detect symptoms related to any sort of visual dysfunction. It may also be useful to monitor the treatment outcomes of these conditions.

Values of Retinoblastoma Survivors and Parents Regarding Treatment Outcomes: A Qualitative Study

PURPOSE

Retinoblastoma is an aggressive pediatric eye cancer. Patient-reported outcome measures reveal important insights into how patients perceive their own health. Currently, there is no widely used or validated measure for assessment of retinoblastoma outcomes. The purpose of this research was to uncover which treatment outcomes that retinoblastoma survivors and their parents value, to inform the development of a future measure.

METHODS

This qualitative, cross-sectional study included retinoblastoma survivors age 6 years and older and parents of retinoblastoma survivors. Participants who did not demonstrate fluency in English were excluded. Study participants participated in semistructured interviews or focus groups, either in person at The Hospital for Sick Children, Toronto, Canada, or through secure videoconference, between March 3, 2019, and January 25, 2020. Iterative rounds of opening coding, codebook development, and coresearcher analysis were used to identify key emergent themes and subthemes.

RESULTS

Seventeen adults participated in six focus groups. Nine pediatric survivors participated in individual interviews. Four common themes emerged from all participant groups: (1) definition of treatment success, (2) enucleation-acceptance and challenges, (3) treatment outcomes to measure, and (4) need for outcome reporting. An additional, unique theme was identified in all pediatric discussions: worries and coping mechanisms. Treatment outcomes deemed valuable were related to the following domains: psychosocial outcomes, daily functioning, functional vision, retinoblastoma education, cosmetic outcomes, and secondary eye conditions.

CONCLUSION

This study represents the first stage in the development of a retinoblastoma-specific patient-reported outcome measure. The findings reveal insight into what outcomes are valued by survivors after treatment and offer promise to improve outcomes assessment for retinoblastoma.

The integration of mixed methods data to develop the quality of life - aged care consumers (QOL-ACC) instrument

Background

This paper describes the collection and integration of mixed methods data to facilitate the final selection of items for the Quality of Life – Aged Care Consumers (QOL-ACC) instrument. The aim of the wider project is to develop a preference-based quality of life instrument that can be used for quality assessment and economic evaluation. Older people have been involved at every stage of the development of the QOL-ACC to ensure that the final instrument captures their perspectives and preferences.

Methods

Mixed methods data was collected on draft items for the QOL-ACC instrument across six key quality of life dimensions (mobility, pain management, emotional well-being, independence, social connections, and activities). Qualitative face validity data was collected from older people (aged 66 to 100 years) living in the community and in residential aged care via semi-structured interviews (n = 59). Quantitative data was collected from older people (aged 65 to 91 years) receiving aged care services in the community via an online survey (n = 313). A traffic light pictorial approach was adopted as a practical and systematic way to categorise and present data in a meaningful way that was easy for non-academic workshop members to understand and to be able to discuss the relative merits of each draft item.

Results

The traffic light approach supported the involvement of consumer and aged care provider representatives in the selection of the final items. Six items were selected for the QOL-ACC instrument with one item representing each of the six dimensions.

Conclusions

This methodological approach has ensured that the final instrument is psychometrically robust as well as meaningful, relevant and acceptable to aged care consumers and providers.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12877-021-02614-y.