Assessment of patient-reported outcomes in retinal diseases: a systematic review

Perception of patients with retinal pathology on aspects of visual function and their management

BACKGROUND AND OBJECTIVE

Age-related macular degeneration (AMD) and diabetic retinopathy (DR) are highly prevalent.

OBJECTIVE

To explore perceptions of patients with AMD or DR about the impact of the disease and treatment on their daily living activities.

MATERIALS AND METHODS

Semi-structured interviews with a questionnaire developed from validated patient reported outcomes questionnaires. The questionnaire consisted of 19 questions about the disease and 9 about the treatment. The questions (items) were answered on a scale from 1 to 9. In addition, the patient interviewed was invited to make free comments on each question. Nine patients with AMD and 9 with DR were interviewed by videoconference or telephone call. A quantitative analysis of the responses and a qualitative analysis of the comments were carried out.

RESULTS

The most relevant item for patients with AMD or DR is "Recognize people when they are nearby", and "Read text in normal size font in a newspaper or book", followed, in patients with AMD, by "Do things what you would like" and, in patients with DR, "Feeling frustrated by the vision problems." Regarding the treatment, the most relevant aspects for both groups is that the treatment works and receiving appropriate information before and after the treatment. The qualitative comments were focused to the disease, the treatment, and to the role of doctors and the health system.

CONCLUSION

Quantitative responses and free comments can be useful to improve the care of patients with AMD or DR by physicians and the health system.

Quality of life in patients with CRB1-associated retinal dystrophies: A longitudinal study

PURPOSE

To assess the longitudinal vision-related quality of life among patients with CRB1-associated inherited retinal dystrophies.

METHODS

In this longitudinal questionnaire study, the National Eye Institute Visual Function Questionnaire (39 items, NEI VFQ-39) was applied at baseline, two-year follow-up, and 4-year follow-up in patients with pathogenic CRB1 variants. [Correction added on 20 November 2023, after first online publication: The preceding sentence has been updated in this version.] Classical test theory was performed to obtain subdomain scores and in particular 'near activities' and 'total composite' scores. The Rasch analysis based on previous calibrations of the NEI VFQ-25 was applied to create visual functioning and socio-emotional subscales.

RESULTS

In total, 22 patients with a CRB1-associated retinal dystrophy were included, […] with a median age of 25.0 years (interquartile range: 13-31 years) at baseline and mean follow-up of 4.0 ± 0.3 years. [Correction added on 20 November 2023, after first online publication: The preceding sentence has been updated in this version.] A significant decline at 4 years was observed for 'near activities' (51.0 ± 23.8 vs 35.4 ± 14.7, p = 0.004) and 'total composite' (63.0 ± 13.1 vs 52.0 ± 12.1, p = 0.001) subdomain scores. For the Rasch-scaled scores, the 'visual functioning' scale significantly decreased after 2 years (-0.89 logits; p = 0.012), but not at 4-year follow-up (+0.01 logits; p = 0.975). [Correction added on 20 November 2023, after first online publication: In the preceding sentence, "…after 4 years…" has been corrected to "…after 2 years…" in this version.] The 'socio-emotional' scale also showed a significant decline after 2 years (-0.78 logits, p = 0.033) and 4 years (-0.83 logits, p = 0.021).

CONCLUSION

In the absence of an intervention, a decline in vision-related quality of life is present in patients with pathogenic CRB1 variants at 4-year follow-up. Patient-reported outcome measures should be included in future clinical trials, as they can be a potential indicator of disease progression and treatment efficacy.

Development and Validation of the Low Vision Severely Constricted Peripheral Eyesight (LV-SCOPE) Questionnaire

PURPOSE

To develop and validate a novel patient-reported outcome (PRO) measure to assess vision-related functioning in individuals with severe peripheral field loss (PFL).

DESIGN

Prospective outcome measure development/validation study.

METHODS

A 127-item questionnaire was developed based on a prior qualitative interview study. A total of 116 participants with severe PFL due to retinitis pigmentosa (RP) or glaucoma were recruited at the Kellogg Eye Center and completed the Likert-scaled telephone-administered questionnaire. Included participants had a horizontal extent of their visual field <20 degrees (RP) or a mixed or generalized stage 4 to 5 defect using the Enhanced Glaucoma Staging System (glaucoma) in the better seeing eye (or in 1 eye if the fellow eye visual acuity was <20/200). Response data were analyzed using exploratory factor analysis and Rasch modeling. Poorly functioning items were eliminated, confirmatory factor analysis was used to ensure scale unidimensionality, and the model was refit to produce the final instrument.

RESULTS

The final Low Vision Severely Constricted Peripheral Eyesight (LV-SCOPE) Questionnaire contains 53 items across 6 domains: mobility, object localization, object recognition, reading, social functioning, and technology. There were 74 items removed because of high missingness, poor factor loadings, low internal consistency, high local dependency, low item information, item redundancy, or differential item functioning. Using Rasch item calibrations, person ability scores could be calculated for each of the 6 unidimensional LV-SCOPE domains with good test-retest stability.

CONCLUSIONS

The LV-SCOPE Questionnaire provides a valid and reliable measure of vision-related functioning across 6 key domains relevant to individuals with severe PFL. Findings support the clinical utility of this psychometrically valid instrument.

Patient-Reported Outcome Measure Use in Guidelines Published by the American Academy of Ophthalmology: A Review

TOPIC

We reviewed the use of patient-reported outcome measures (PROMs) in the treatment of ophthalmologic conditions as recommended by the Clinical Practice Guidelines (CPGs) published by the American Academy of Ophthalmology (AAO).

CLINICAL RELEVANCE

Patient-reported outcome measures are standardized instruments that provide information regarding a patient's health status or health-related quality of life. Patient-reported outcome measures are increasingly used to inform study end points in ophthalmology studies. However, the extent to which PROMs are ultimately informing patient management recommendations in ophthalmology as part of CPGs remains an area of evidence gap.

METHODS

We included all CPGs published by the AAO from inception to June 2022. We also included all primary studies and systematic reviews cited in the treatment sections of the CPGs evaluating treatment of an ophthalmic condition. The primary outcome was the frequency of PROMs discussed in CPGs and in cited studies evaluating treatment. Secondary outcomes included frequency of minimal important difference (MID) use to contextualize PROM results and percentage of strong and discretionary recommendations supported by PROMs. We published a study protocol a priori on PROSPERO (CRD42022307427). Reporting followed the Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) guidelines. We assessed risk of bias using the Appraisal of Guidelines, Research and Evaluation II (AGREE II) instrument.

RESULTS

We identified 24 eligible CPGs, providing 2458 cited studies (2191 primary, 267 secondary) evaluating treatment of eye conditions. Ten CPGs (41.7%) reported consideration of PROMs. Of these, 31 of 94 (33%) recommendations were informed by studies evaluating a PROM as an outcome. Across all studies cited in the development of CPGs, 221 (9.0%) used PROMs as a primary or secondary outcome, of which 4 PROM results (1.8%) were interpreted using an empirically determined MID. Overall, the risk of bias was low for all CPGs.

CONCLUSIONS

Overall, outcomes of PROMs are seldom used in ophthalmology CPGs published by the AAO and in cited primary and secondary research on treatments. When PROMs were considered, their interpretation was seldom based on an MID. To improve patient care, guideline developers may consider incorporating PROMs and applicable MIDs to inform key outcomes when formulating treatment recommendations.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Evaluating patient-reported outcome measures (PROMs) for future clinical trials in adult patients with optic neuritis

OBJECTIVE

To search for and critically appraise the psychometric quality of patient-reported outcome measures (PROMs) developed or validated in optic neuritis, in order to support high-quality research and care.

METHODS

We systematically searched MEDLINE(Ovid), Embase(Ovid), PsycINFO(Ovid) and CINAHLPlus(EBSCO), and additional grey literature to November 2021, to identify PROM development or validation studies applicable to optic neuritis associated with any systemic or neurologic disease in adults. We included instruments developed using classic test theory or Rasch analysis approaches. We used established quality criteria to assess content development, validity, reliability, and responsiveness, grading multiple domains from A (high quality) to C (low quality).

RESULTS

From 3142 screened abstracts we identified five PROM instruments potentially applicable to optic neuritis: three differing versions of the National Eye Institute (NEI)-Visual Function Questionnaire (VFQ): the 51-item VFQ; the 25-item VFQ and a 10-item neuro-ophthalmology supplement; and the Impact of Visual Impairment Scale (IVIS), a constituent of the Multiple Sclerosis Quality of Life Inventory (MSQLI) handbook, derived from the Functional Assessment of Multiple Sclerosis (FAMS). Psychometric appraisal revealed the NEI-VFQ-51 and 10-item neuro module had some relevant content development but weak psychometric development, and the FAMS had stronger psychometric development using Rasch Analysis, but was only somewhat relevant to optic neuritis. We identified no content or psychometric development for IVIS.

CONCLUSION

There is unmet need for a PROM with strong content and psychometric development applicable to optic neuritis for use in virtual care pathways and clinical trials to support drug marketing authorisation.

Patient-reported outcomes in patients with vitreous floaters: A systematic literature review

Seeking treatment for bothersome vitreous floaters is patient driven. To measure the impact of floaters and treatment on an individual's quality of life, patient-reported outcome measurements (PROMs) are essential. We review all studies using a PROM for patients with floaters. We evaluated content coverage against quality-of-life domains previously identified in other ophthalmic disorders, and against a qualitative study investigating quality-of-life issues in patients with floaters. We assessed measurement properties of PROMs using an extensive range of psychometric quality criteria. We identified 59 studies using 28 different PROMs. Many PROMs were not specifically developed for patients with floaters. Floater-specific PROMs were mostly based on content validation from an ophthalmologist or researcher perspective; two included a patient perspective. Using the outcomes of the qualitative study, we found that the floater-specific PROMs were narrow in their content coverage, with most items relating to visual symptoms and activity limitations. Testing the psychometric quality of PROMs was rare, and when employed mostly limited to responsiveness and known group validity. The remarkable high number of floater-specific PROMs reveals a need for such measurements in ophthalmology. Unfortunately, reporting on psychometric quality is limited, and content development is most often done without patient involvement.

Current Assistive Devices Usage and Recommendations for a Future Artificial Vision Prosthesis among Patients with Severe Visual Impairment Due to Inherited Retinal Diseases

Patients with inherited retinal diseases (IRDs) utilize various adaptive techniques and devices designed to assist them with activities of daily living (ADLs). The purpose of this study was to assess the assistive devices used by patients with IRDs, the difficulties they face despite these devices, and their recommendations for a future visual prosthesis. In collaboration with blind patients, an online survey was developed and administered to adults with IRDs and visual acuities of 20/400 to no light perception in the better-seeing eye. We analyzed data from 121 survey respondents (aged 18 to >80 years). Five respondents were Argus II prosthesis recipients. The most commonly used aids were cellular phones/tablets for reading (63.6%) as well as a sighted guide (75.0%) and a cane (71.4%) for mobility. Despite current assistive devices, participants reported continued difficulty with ADLs. Improved navigation, reading, and facial recognition were ranked the most desirable features for future visual prostheses. Argus II recipients suggested technology with improved ability to recognize objects and obstacles, detect movement, and cut out busy backgrounds. These insights are valuable in shaping the design of future prosthetic devices tailored to the needs of IRD patients.

A review of patient-reported outcome measures used in uveitis

We review patient-reported outcome measures (PROMs) used to evaluate the quality of life (QoL) in uveitis and provide a quality assessment of the psychometric properties of the PROMs, making it easier to choose the best questionnaire for uveitis. Our review included 158 articles. A total of 98 PROMs were used to measure QoL in uveitis and the National Eye Institute Visual Function Questionnaire 25 (NEI VFQ -25) was the most frequently used PROM in these studies. There were 5 uveitis-specific PROMs, but they were meant for either birdshot choroidopathy or cytomegalovirus retinitis or paediatric uveitis. There are no PROMs developed explicitly for the more common, anterior uveitis, intermediate uveitis, panuveitis, and chronic uveitis. The uveitis-specific PROMs performed better in our quality assessment criteria compared to other PROMs. However, these PROMs were constructed using traditional classical test theory and have not been assessed using the modern family of psychometric assessment methods such as Rasch analysis. As new therapeutic modalities for uveitis such as the new biological agents and steroid implants, continue to evolve, a comprehensive PROM will be increasingly valued in clinical trial settings to compare the effects of treatments from the patient's perspective.

Evaluating patient-reported outcome measures (PROMs) for clinical trials and clinical practice in adult patients with uveitis or scleritis: a systematic review

Patient reported outcome measures (PROMs) capture impact of disease and treatment on quality of life, and have an emerging role in clinical trial outcome measurement. This study included a systematic review and quality appraisal of PROMs developed or validated for use in adults with uveitis or scleritis. We searched MEDLINE, EMBASE, PsycINFO, CINAHL and grey literature sources, to 5 November 2021. We used established quality criteria to grade each PROM instrument in multiple domains from A (high quality) to C (low quality), and assessed content development, validity, reliability and responsiveness. For instruments developed using classic test theory-based psychometric approaches, we assessed acceptability, item targeting and internal consistency. For instruments developed using Item Response Theory (IRT) (e.g. Rasch analysis), we assessed response categories, dimensionality, measurement precision, item fit statistics, differential item functioning and targeting. We identified and appraised four instruments applicable to certain uveitis types, but none for scleritis. Specifically, the National Eye Institute Visual Function Questionnaire-25 (NEI-VFQ), a 3-part PROM for Birdshot retinochoroiditis (Birdshot Disease & Medication Symptoms Questionnaire [BD&MSQ], the quality of life (QoL) impact of Birdshot Chorioretinopathy [QoL BCR], and the QoL impact of BCR medication [QoL Meds], the Kings Sarcoidosis Questionnaire (KSQ), and a PROM for cytomegalovirus retinitis. These instruments had limited coverage for these heterogeneous conditions, with a focus on very rare subtypes. Psychometric appraisal revealed considerable variability between instruments, limited content development, and only one developed using Item Response Theory. In conclusion, there are few validated PROMs for patients with uveitis and none for scleritis, and existing instruments have suboptimal psychometric performance. We articulate why we do not recommend their inclusion as clinical trial outcome measures for drug licensing purposes, and highlight an unmet need for PROMs applicable to uveitis and scleritis.

Capturing the experiences of patients with inherited optic neuropathies: a systematic review of patient-reported outcome measures (PROMs) and qualitative studies

PURPOSE

To identify and comprehensively evaluate studies capturing the experience of individuals affected by an inherited optic neuropathy (ION), focusing on patient-reported outcome measures (PROMs) and qualitative studies where the health status and quality of life (QoL) of these individuals have been explored.

METHODS

Systematic review of five databases using a search strategy combining four concepts: (1) ION; (2) QoL and health status; (3) PROMs; and (4) qualitative research. Studies assessing the impact of ION on any QoL domain using a PROM or qualitative methodology were included and appraised, using criteria based on the COSMIN checklist (for PROM studies) and the CASP checklist (for qualitative studies).

RESULTS

Of 1326 unique articles identified, six studies were included. Five PROMs were identified: Visual Function Index (VF-14); Hospital Anxiety and Depression Scale (HADS); a novel graphical online assessment tool (NGOAT) for reporting emotional response to vision loss; a new PROM informed by the DSM-V Criteria for Major Depressive Disorder; and an interpersonal and career 'impact rating' PROM. The psychometric performance of included PROMs were poorly described. Qualitative studies found that vision loss resulted in psychosocial losses including loss of social and communication skills and loss of independence and freedom. Factors that modified the response to vision loss were also identified.

CONCLUSION

The current PROMs used by individuals with ION have poor content coverage, primarily measuring activity limitation and emotional well-being, and insufficient reporting of psychometric performance. There is a need to develop a PROM for individuals ION to report their experiences of living with their condition.

Patient-Reported Measures of the Effects of Vision Impairments and Low Vision Rehabilitation on Functioning in Daily Life

The quantification of vision impairments dates to the mid-nineteenth century with standardization of visual acuity and visual field measures in the eye clinic. Attempts to quantify the impact of vision impairments on patients' lives did not receive clinical attention until the close of the twentieth century. Although formal psychometric theories and measurement instruments were well developed and commonplace in educational testing, as well as in various areas in psychology and rehabilitation medicine, the late start applying them to clinical vision research created a vacuum that invited poorly developed and poorly functioning instruments and analytic methods. Although this research is still burdened with legacy instruments, mandates by regulatory agencies to include the patients' perspectives and preferences in the evaluation of clinical outcomes have stimulated the development and validation of self-report instruments grounded in modern psychometric theory and methods. Here I review the progress and accomplishments of applying modern psychometrics to clinical vision research. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Assessment of patient-reported outcome measures used in corneal transplantation: a systematic review

The aim of this study was to review all the articles that have implemented patient-reported outcome measures (PROMs) to evaluate the quality of life (QoL) in corneal transplantation and discuss quality assessments of the PROMs. An extensive literature review was undertaken to identify all the studies that used PROMs to assess the QoL in corneal transplantation. Non-original or review articles, articles on other subject area and articles on cost-effectiveness/utility without PROM data/results were excluded. Each PROM was assessed against the following criteria: content development (item identification and item selection), psychometric properties, validity, reliability, and responsiveness. 425 articles were identified of which 35 articles were included in the final review. PROMs in corneal transplantation were used to (a) evaluate the QoL after surgery, (b) compare the QoL scores between different surgical techniques and (c) determine the relationship between QoL and objective measures such as visual acuity, visual field and stereoacuity. A total of 17 PROMs were used to assess QoL in corneal transplantation. Whilst this search did not produce any PROMs that were specifically designed to assess corneal transplantation, most studies were found to have employed the National Eye Institute Visual Function Questionnaire 25 (NEI VFQ 25). The Visual Function Index 14 (VF 14) performed better in the present quality assessment criteria compared to other PROMs, however, the NEI VFQ 25 and the VF 14 PROMs were not specifically developed for corneal transplantation and therefore the QoL assessment made using these PROMs may be incomplete. As improvements in various forms of lamellar transplantation surgery techniques such as UT-DSAEK and FT-DSAEK have resulted in better visual outcomes, improved graft survival and reduced complications, a corneal transplantation specific PROM will be useful in clinical settings to compare the outcomes of different surgical techniques from the patient perspective.

[The Treatment Exit Options for Uveitis (TOFU) Registry: Involving Patients in the Generation of Evidence]

Uveitis comprises a group of rare diseases characterised by intraocular inflammation which may cause vision impairment and blindness and mostly affects people of working age. Non-infectious uveitis involving the posterior pole or the entire eye is often treated with different immunomodulating or disease-modifying anti-rheumatic drugs (DMARDs). However, the evidence on long-term management strategies and reduction/termination of treatment is limited. To help develop treatment exit strategies for patients with quiescent uveitis on long-term DMARD treatment, the Treatment Exit Options for Non-infectious Uveitis registry was initiated by the German ophthalmological society. A key aspect of the registry is active participation of patients (patient-reported outcomes, PROs). In a pilot study involving members of patient organizations, a combination of questionnaires covering vision- and general health-related quality of life, adherence to treatment, productivity and effects of treatment were evaluated. As the pilot study showed coverage of relevant patient-related aspects of the disease and its effect on daily life, the evaluated questionnaires were implemented in the registry's patient module. The registry including the patient module uses the electronic data capture (EDC) software REDCap (Version 9, Vanderbilt University, USA). By involving patients in both conceptualization and ongoing data collection, the TOFU registry emphasizes the patients' perspectives, and the inclusion of patient-relevant evidence for such as the development of guidelines and treatment recommendations is ensured.

Supplemental Scleral Buckle for the Management of Rhegmatogenous Retinal Detachment by Pars Plana Vitrectomy: A Meta-Analysis of Randomized Controlled Trials

OBJECTIVES

The present review aimed to synthesize evidence from randomized controlled trials (RCTs) that compared outcomes of pars plana vitrectomy (PPV) with and without a supplementary scleral buckle (SB) for management of rhegmatogenous retinal detachment (RRD).

METHODS

The authors searched MEDLINE, Embase, and CENTRAL to identify RCTs in English that compared PPV with and without supplemental SB. Risk of bias was assessed according to the Cochrane Risk of Bias 2 tool. We present risk ratios (RRs), mean differences (MDs), and 95% confidence intervals (CIs) estimated using random-effects meta-analyses.

RESULTS

We identified 6 RCTs involving 705 eyes. Primary reattachment (6 studies, 345 eyes PPV, 324 eyes PPV + SB; RR 0.99, 95% CI 0.93-1.06, I2 = 0%, p = 0.78) and final anatomic success rates (4 studies, 272 eyes PPV, 267 eyes PPV + SB; RR 1.00, 95% CI 0.98-1.02, I2 = 0%, p = 0.89) were similar between the 2 groups. Postoperative visual acuity improvement (5 studies, 244 eyes PPV, 222 eyes PPV + SB; MD 6.09 letters, 95% CI -0.47-12.64, I2 = 69%, p = 0.07) and frequency of adverse events (6 studies, 1,294 observations PPV, 1,221 observations PPV + SB; RR 0.76, 95% CI 0.57-1.01, I2 = 25%, p = 0.06) likewise did not differ significantly between the treatment groups.

CONCLUSION

Low-certainty evidence from RCTs did not demonstrate a benefit in placement of a supplemental SB during vitrectomy for management of RRD in the current analysis. Additional high-quality trials are needed to provide more precise estimates of the effect.

An evaluation of instruments measuring behavioural aspects of the nurse-patient relationship

The Fundamentals of Care Framework is an evidence-based, theory-informed framework that conceptualises high-quality fundamental care. The Framework places the nurse-patient relationship at the centre of care provision and outlines the nurse behaviours required for relationship development. Numerous instruments exist to measure behavioural aspects of the nurse-patient relationship; however, the literature offers little guidance on which instruments are psychometrically sound and best measure the core relationship elements of the Fundamentals of Care Framework. This study evaluated the quality of nurse-patient relationship instruments by (1) assessing their content development and measurement properties (e.g. dimensionality, targeting, reliability, validity) and (2) mapping instrument content to the Framework's core relationship elements: trust, focus, anticipate, know, and evaluate. Twenty-seven instruments were evaluated. Findings demonstrated that patients and nurses were rarely involved in item development. Most instruments exhibited poor measurement properties, with only one instrument having complete information on all quality indicators. Instrument content focused primarily on nurses getting to know patients and earning their trust, with only 54, 18, and 1 item(s), respectively, measuring 'focus', 'anticipate' and 'evaluate'. Hence, there does not appear to be a robust instrument measuring behavioural aspects of nurse-patient relationships, nor one capturing the relationship elements of the Fundamentals of Care Framework.

Development of the Vision Impairment in Low Luminance Questionnaire

Purpose

The purpose of this study was to design and evaluate an instrument for assessing vision-related quality of life appropriate for the specific visual impairment characteristic for all stages of age-related macular degeneration (AMD), with a focus on the low luminance deficit in early/intermediate stages.

Methods

A standardized questionnaire was developed in three steps with participants with early, intermediate, and late AMD: (1) based on in-depth interviews (n = 19) and two focus group discussions (n = 5 each), content was developed followed by 2. (2) The questionnaire development using cognitive debriefing interviews (n = 3) and leading to a preliminary version of the questionnaire. (3) This version was then administered to 127 participants with early, intermediate, and late AMD. Psychometric properties, such as response category functioning (floor and ceiling effects) and targeting of item difficulty to patient ability of the pilot Vision Impairment in Low Luminance (VILL) questionnaire were evaluated using Rasch analysis.

Results

The preliminary VILL questionnaire consisted of 68 items with a 5-step response scale. Several items were removed based on floor/ceiling effects or misfit and a final pool of 37 items remained. The response scale was collapsed to four categories as one category was underutilized. The targeting of the instrument was good with minimal difference in person and item means (0.52 logits). Precision was also good with a person separation index of 3.55 and reliability of 0.93. There was evidence of multidimensionality (eigenvalue of the first contrast = 5.95) in the scale, which could be resolved by splitting the items into subscales including a reading, mobility, and emotional well-being subscale.

Conclusions

Individuals with AMD report difficulties with vision-related activities and functioning under visually challenging conditions at all stages of the disease. These aspects were considered when developing the 37-item VILL, which demonstrates promising psychometric characteristics. Further assessments of reliability and validity are warranted.

Translational Relevance

The VILL questionnaire is a new patient-reported outcome (PRO) measure developed for future use in AMD studies.

Beyond visual acuity: Patient-relevant assessment measures of visual function in retinal diseases

PURPOSE

To identify patient-reported outcomes (PROs) and other clinical outcome measures (contrast sensitivity (CS), low-luminance visual acuity (LLVA) and reading acuity or reading speed (RA-RS)), relevant to patients with age-related macular degeneration (AMD) or diabetic retinopathy (DR), which would be recommended for use in clinical practice.

METHODS

The RAND/UCLA Appropriateness Method, based on the synthesis of the scientific evidence and the collective judgment of an expert panel using the two-round Delphi method, was applied. The evidence synthesis was performed by searching for articles on outcome measures for AMD and/or DR published between 2005 and 2018 in English or Spanish. The expert panel consisted of 14 Spanish ophthalmologists, who rated the recommendation degree for each outcome measure on a scale of 1 (extremely irrelevant) to 9 (maximum relevance). The recommended outcome measures were established according to the panel median score and the level of the panelists' agreement.

RESULTS

Through the evidence search, 33 PRO-specific questionnaires (21 for visual function, six for AMD, three for DR, one for AMD and DR) and two treatment satisfaction questionnaires (one on AMD and one on DR) were identified. In addition, 21 methods were found for measuring CS, five for LLVA, and nine for RA-RS. According to the panel ratings, 11 of the 64 outcome measures evaluated for AMD, and seven of the 61 evaluated for DR were recommended.

CONCLUSION

The AMD and DR outcome measures recommended will help ophthalmologists choose the outcome measure most appropriate for their patients. Furthermore, the use of PROs will contribute to shifting clinical practice towards patient-centered medicine.

Content generation for patient-reported outcome measures for retinal degeneration therapeutic trials

PURPOSE

Generate content for a patient-reported outcome (PRO) measure for use in future clinical trials for inherited retinal degenerations.

METHODS

Patients at the University of Michigan Kellogg Eye Center with a clinical diagnosis of inherited retinal degeneration with varying phenotypes were recruited for interviews. First, in-depth interviews were performed to solicit a wide range of patient experiences pertaining to visual function. Coders qualitatively analyzed the transcripts from these interviews using Atlas.ti software (Version 8.1.3 (522)) to draft questionnaire items. Next, the questionnaire was tested and refined based on participant feedback in cognitive interviews and administrator feedback in the pilot survey administration (pilot interviews).

RESULTS

A total of 55 participants with a clinical diagnosis of inherited retinal degeneration were interviewed throughout the three study phases: in-depth interviews (n = 26), cognitive interviews (n = 16), and pilot interviews (n = 13). Coded items were analyzed for frequency of occurrence and related themes, then organized into common domains. Within each domain, PRO items were drafted to address the functional limitations or adaptations experienced by patients.

CONCLUSIONS

Items for a PRO measure have been drafted and evaluated for interpretability in the target inherited retinal degeneration patient population. Content validity for the items was established through a process of in-depth interviews, cognitive interviews, and pilot interviews.

Advancing Clinical Trials for Inherited Retinal Diseases: Recommendations from the Second Monaciano Symposium

Major advances in the study of inherited retinal diseases (IRDs) have placed efforts to develop treatments for these blinding conditions at the forefront of the emerging field of precision medicine. As a result, the growth of clinical trials for IRDs has increased rapidly over the past decade and is expected to further accelerate as more therapeutic possibilities emerge and qualified participants are identified. Although guided by established principles, these specialized trials, requiring analysis of novel outcome measures and endpoints in small patient populations, present multiple challenges relative to study design and ethical considerations. This position paper reviews recent accomplishments and existing challenges in clinical trials for IRDs and presents a set of recommendations aimed at rapidly advancing future progress. The goal is to stimulate discussions among researchers, funding agencies, industry, and policy makers that will further the design, conduct, and analysis of clinical trials needed to accelerate the approval of effective treatments for IRDs, while promoting advocacy and ensuring patient safety.

Association between Patient-Reported Outcomes and Time to Late Age-Related Macular Degeneration in the Laser Intervention in Early Stages of Age-Related Macular Degeneration Study

PURPOSE

To investigate the relationship between patient-reported outcome (PRO) questionnaire responses and time to late age-related macular degeneration (AMD; neovascular AMD [nAMD] or multimodal imaging [MMI]-defined atrophy) among individuals with bilateral large drusen, and the prognostic value of baseline PROs for 36-month AMD status.

DESIGN

Exploratory analyses from a multicenter randomized controlled trial of an AMD intervention (Australian New Zealand Clinical Trials Registry identifier, ACTRN12612000704897).

PARTICIPANTS

Sham treatment group of the Laser Intervention in Early Stages of Age-Related Macular Degeneration (LEAD) Study (n = 141; age, 50-88 years; 77% female).

METHODS

The 28-item Impact of Vision Impairment (IVI-28) and 10-item Night Vision Questionnaire (NVQ-10) were administered at the baseline visit. The PRO scores were derived using rating scale models. Multivariate Cox regression adjusting for demographics and clinical measures of vision (low-luminance visual acuity, low-luminance deficit, and microperimetric sensitivity) from the poorer-performing eye was used to investigate the association between PRO scores and time to late AMD in either eye. Multivariate competing-risk regression was used to estimate cause-specific subhazard ratios for nAMD and atrophy in either eye. Cross-validated logistic lasso models were used to estimate the predicted probability of AMD at 36 months. The area under the receiver operating characteristic curve was assessed to compare prognostic accuracy between models with and without PROs.

MAIN OUTCOME MEASURE

Time until nAMD or atrophy in either eye.

RESULTS

The PRO scores were skewed toward higher functional vision. Higher IVI-28 scores were associated with a lower risk of progression to MMI-defined atrophy (20 events: adjusted hazard ratio, 0.65/logit increase; P = 0.002) but not nAMD (10 events; P = 0.562). Insufficient evidence was found of an association between NVQ-10 score and rate of progression to late AMD (P ≥0.149). Baseline IVI-28 scores were found to contribute to the prognosis of atrophy at the 36-month visit (P = 0.010).

CONCLUSIONS

On average, PROs were associated with an increased risk of progression from intermediate AMD to MMI-defined atrophy. Continuing development of instruments to record PROs in the early stages of AMD have the potential to produce inexpensive and efficient tools to assist in the assessment of disease severity and risk of AMD progression.

Patient-reported outcome measures in inherited retinal degeneration gene therapy trials

Patient-reported outcome (PRO) measures have the potential to uniquely capture patient experience and serve as an outcome measure in inherited retinal degeneration (IRD) gene therapy trials. An IRD-specific patient-reported outcome measure may yield valuable information that has not been obtained from inherited retinal dystrophy gene therapy trials published to-date. Existing PRO measures have inherent limitations for use in IRD gene therapy trials. Developing an applicable patient-reported outcome measure for such trials needs to incorporate patient input from the target population, demonstrate sound psychometric properties, and be made in accordance with U.S. Food and Drug Administration (FDA) guidelines. This review will discuss the currently available PRO instruments, their limitations for IRD therapeutic trials, and suggestions for future PRO development in IRD populations. The PRO instruments highlighted were identified in PubMed search of English-language journals and previously published review articles.

Development and Psychometric Assessment of Novel Item Banks for Hereditary Retinal Diseases

SIGNIFICANCE

This study develops psychometrically valid item banks across 10 areas of quality of life (QoL) specific to people with hereditary retinal diseases, which will enable clinicians and researchers to explore the impact of hereditary retinal diseases across all aspects of QoL.

PURPOSE

The purpose of this study was to assess the psychometric properties of hereditary retinal disease QoL item banks using Rasch analysis and demonstrate the effectiveness of a computerized adaptive testing (CAT) system in obtaining precise measurement of QoL using only a few items.

METHODS

The hereditary retinal disease item banks were answered by 233 participants (median age, 58 years; range, 18 to 94 years; female participants, 59%). The hereditary retinal disease item banks cover 10 QoL domains: activity limitation, mobility, emotional, social, convenience, economic, health concerns, visual symptoms, ocular comfort symptoms, and general symptoms. Rasch analysis assessed the psychometric properties of the 10 item banks and provided item calibrations for the development of CAT. Computerized adaptive testing simulations were performed to calculate the average number of items required to gain precise measurement of each QoL domain.

RESULTS

The convenience, economic, visual symptoms, and the social domains formed unidimensional scales. However, the activity limitation and health concerns domains demonstrated multidimensionality and required major modifications to resolve this, which resulted in four new QoL domains, namely, reading, driving, lighting, and concerns about the disease progression. In total, 10 item banks underwent CAT simulation testing, which indicated that 8 to 12 items were required to gain precise measurement of each QoL domain.

CONCLUSIONS

We have developed 10 psychometrically valid item banks to measure the QoL domains relevant to people with hereditary retinal diseases. On average, only 5 and 10 items were required to gain measurement at moderate and high precision, respectively.

Patient-reported outcome measures in the management of neovascular age-related macular degeneration: a 1-year prospective study

Objective

To prospectively explore the following patient-reported outcome measures (PROMs) in the management of neovascular age-related macular degeneration (nAMD): (1) self-reported visual function, (2) symptom-state, (3) general-health and (4) satisfaction of treatment.

Methods and analysis

Corresponding to the four PROMs, participants responded to the following questionnaires: (1) National Eye Institute Visual-Functioning-Questionnaire (NEI-VFQ-25), (2) Patient-Acceptable-Symptom-Status (PASS 5), (3) EuroQol-Group-Questionnaire (EQ-5D-3L) and (4) Dimensions of Importance in Treatment of nAMD (DITAMD). Data were collected at baseline and after 3, 6 and 12 months of intravitreal antivascular endothelial growth factor treatment. Results were evaluated with t-tests and mixed linear regression analyses.

Results

The study included 197 patients. At baseline NEI-VFQ-25 (79.53±14.52) and EQ-5D (0.74±0.28) had relatively high scores, whereas PASS 5 was below 'acceptable' (3.30±0.80). At 12 months NEI-VFQ-25 and PASS 5 showed significant improvement, whereas EQ-5D and DITAMD remained unchanged. At baseline patients receiving treatment of the better-seeing eye (BSE) (n=52) reported significantly worse NEI-VFQ-25 and PASS 5 than patients for whom treatment only involved the worse-seeing eye (WSE), (n=145). In contrast to BSE patients, there was no improvement of NEI-VFQ-25 for WSE patients at 12 months, despite a significant improvement in best-corrected visual acuity (BCVA). Two independent variables, treatment including the BSE and BCVA for the treated eye, were found to predict both NEI-VFQ-25 and PASS 5.

Conclusion

After 12 months of nAMD treatment, there was a significant improvement in PASS 5 and NEI-VFQ-25, the latter depending on whether therapy included BSE. EQ-5D and DITAMD remained unaltered.

Identification and Evaluation of Items for Vitreoretinal Diseases Quality of Life Item Banks

Purpose: We are developing item banks assessing the impact of retinal and vitreoretinal diseases (excluding age-related macular degeneration, diabetic retinopathy, and retinal detachment, covered elsewhere) on quality of life (QoL) for adults. This study outlines the first two phases of the multi-stage process: content development and item evaluation.Methods: We grouped retinal and vitreoretinal diseases into hereditary and acquired. Development of the item banks involved two phases: item identification and item evaluation. The items were extracted from three sources: (1) 17 pre-existing PRO instruments, (2) 4 qualitative studies and (3) 79 semi-structured interviews. Item evaluation involved three stages namely, binning (grouping) and winnowing (reduction), expert panel opinion and cognitive interviews.Results: The item identification phase yielded 1,217 items. After three sessions of binning and winnowing, items were reduced to a minimally representative set (n = 411) across nine QoL domains namely, activity limitation, emotional, social, health concerns, symptoms, economic, mobility, convenience, and coping. The hereditary group had a total of 345 items and the acquired group had a total of 257 items. After 23 cognitive interviews items were amended for hereditary diseases resulting in a final set of 345 items and 3 items were amended for acquired diseases, resulting in a final set of 254 items. Overall across nine domains 189 items were common to hereditary and acquired retinal and vitreoretinal diseases.Conclusion: As most of the items were unique to hereditary versus acquired retinal and vitreoretinal disease groups separate item banks are required to capture the QoL impacts for hereditary and acquired retinal and vitreoretinal diseases.

Properties of the Impact of Vision Impairment and Night Vision Questionnaires Among People With Intermediate Age-Related Macular Degeneration

PURPOSE

To explore the psychometric properties of the Impact of Vision Impairment (IVI-28) and Night Vision Questionnaires (NVQ-10) among people with intermediate age-related macular degeneration (iAMD).

METHODS

Baseline responses were collected from 288 participants (aged 50-88 years, 74% female) in the Laser intervention in Early stages of Age-related macular Degeneration (LEAD) study in Australia and Northern Ireland. Psychometric properties (discrimination, ordering of thresholds, person separation, item miss-fit, and differential item functioning according to sex) were explored using grouped rating scale and partial credit models. Spearman's correlation was estimated to assess the association with measures of visual function (mean mesopic microperimetric sensitivity, best-corrected visual acuity, low-luminance visual acuity, and low-luminance deficit). The psychometric properties were then explored following recalibration of the instruments.

RESULTS

In this homogenous population, ceiling effects caused by relatively high levels of functional vision were evident for both instruments. The IVI-28 and NVQ-10 displayed suboptimal discrimination between levels of functional vision in iAMD and poor targeting among people with iAMD. The correlation between ability scores and measures of visual function was mild. In general, the NVQ-10 showed superior psychometric properties to the IVI-28 among these participants. No significant improvement in reliability could be gained following recalibration.

CONCLUSIONS

Both instruments were designed for populations with more severe visual loss and poorly discriminate in this cohort of iAMD.

TRANSLATIONAL RELEVANCE

New instruments that can capture the subtle changes in functional vision that occur early in AMD are required to aid evaluation of emerging interventions for iAMD.

Measurement of patient-reported outcomes. 2: Are current measures failing us?

All instruments designed to measure latent (unobservable) variables, such as patient-reported outcomes (PROs), have three major requirements; a coherent construct theory, a specification equation, and the application of an appropriate response model. The theory guides the selection of content for the questionnaire and the specification equation links the construct theory to scores produced with the instrument. For the specification equation to perform this role, the patient-reported outcome measure (PROM) must employ a response model that generates values for its individual items. The most commonly applied response model in PROM development is the Rasch model. To date this level of measurement sophistication has not been achieved in PRO measurement. Consequently, it is not possible to establish a PROM's true construct validity. However, the development of the Lexile Framework for Reading has demonstrated that such objective measurement is possible for latent variables. This article argues that higher quality PROM development is needed if meaningful and valid PRO measurement is to be achieved. It describes the current state of PROM development, shows that published reviews of PROMs adopt inappropriate criteria for judging their quality, and illustrates how the use of traditional PROMs can lead to incorrect (and possibly dangerous) conclusions being drawn about the efficacy of interventions.

Patient-reported outcomes of ocriplasmin for the treatment of vitreomacular traction: a systematic review and synthesis of the literature

Purpose

Vitreomacular traction (VMT) is a disease in which the vitreous exerts abnormally strong traction on the macula, the area of the eye responsible for detailed central vision. If this traction significantly distorts the macula then VMT can lead to troublesome distorted vision (metamorphopsia), sometimes occurring despite relatively preserved visual acuity. Ocriplasmin, administered as a single intravitreal injection, aims to release VMT and improve vision. While the effect of ocriplasmin on traction release and visual acuity is well characterized, the effect of symptoms like metamorphopsia is not.

Methods

A systematic review and synthesis of the literature on patient reported outcomes (PRO) in relation to the use of ocriplasmin for the treatment of VMT was undertaken using MED-LINE and Embase databases, and the Cochrane central register of controlled trials (CENTRAL).

Results

The review identified PRO data from 870 patients across three randomized controlled trials. The most commonly reported PROs were the 25-item National Eye Institute Visual Function Questionnaire (VFQ-25), a broad measure of vision-related quality of life, and Visual Function Response (VFR), an outcome combining quality of life and visual acuity outcomes. Treatment with ocriplasmin produced significant patient benefit vs control (sham or placebo-injection). Ocriplasmin was associated with a higher proportion of patients experiencing a clinically meaningful improvement in visual functioning with a difference of 11.8% for VFQ-25 and 23.2% for VFR responder analyses, respectively.

Conclusion

Patients with VMT have material impairment in visual functioning and quality of life, relative to their reduction in visual acuity. Ocriplasmin results in a significant improvement in visual functioning. Future research could include the development of new PROs specific to VMT.

Ophthalmic Drug Discovery and Development: Regulatory Aspects of Patient Focused Drug Development in Ophthalmology

In 2009, members of the ophthalmic research community held a joint meeting with members of the Food and Drug Administration (FDA) and the National Eye Institute (NEI) to define and describe the types of patient-focused drug development (PFDD) tools used in ophthalmology. Since then numerous reports have been published which indicate that many of the questionnaires used for patient-reported outcomes (PROs) in ophthalmic clinical development lack rigor and reliability according to modern methods. In 2017, the FDA began development of a series of four methodological guidances for sponsors of clinical trials on the significance of PFDD. The new guidances delineate the FDA's thinking and commitments under the Prescription Drug User Fee Act to implement a more structured approach to the assessment of risks and benefits in clinical trials. In these guidances, the FDA provides steps that drug and device manufacturers should follow, not only to obtain, but also to develop reliable and validated tools that measure patients' experience in clinical trials. Subsequent efforts have resulted in the development and validation of PROs specifically for ophthalmology. The purpose of this paper is to assesses the PROs currently used in ophthalmology and to provide practical strategies for incorporating them into clinical trials.

Understanding quality of life impact in people with retinal vein occlusion: a qualitative inquiry

BACKGROUND

Although being the second most common sight-threatening retinal vascular disease after diabetic retinopathy, the patient-centred impact of retinal vein occlusion has not been well studied. This study aims to understand the quality of life issues in people with retinal vein occlusion using a qualitative methodology.

METHODS

In-depth semi-structured interviews were conducted with 17 patients with retinal vein occlusion. All the interviews were digitally recorded and transcribed verbatim. An inductive analytic approach based on the constant comparative method was used for coding, aggregation, and theme development. The qualitative analysis was done using the software NVivo.

RESULTS

Participants had a median age of 73 years (range 34-85 years; females, 71 per cent). Six quality of life themes were identified: concerns about the disease progression and treatment outcome (health concerns), emotional responses to the disease (emotional), experiencing a range of symptoms (symptoms), inability to do things as before (activity limitation), adapting to the visual loss (coping), and inconveniences due to the eye condition (convenience). Participants often felt that lasers and injections did not improve their vision. They feared that their eye condition may come back, or the other eye may be affected. They experienced a range of visual symptoms that affected their day-to-day performance, particularly reading small print, and driving at night. Having multiple treatments and frequent eye appointments were major sources of inconvenience. Patients adopted several coping strategies to manage the stress associated with visual loss.

CONCLUSIONS

This study shows that several aspects of quality of life are compromised in people with retinal vein occlusion. The findings of this study will be used to identify the item content for a vitreoretinal disease-specific quality of life item bank.

The use of patient-reported outcome research in modern ophthalmology: impact on clinical trials and routine clinical practice

This review article considers the rising demand for patient-reported outcome measures (PROMs) in modern ophthalmic research and clinical practice. We review what PROMs are, how they are developed and chosen for use, and how their quality can be critically appraised. We outline the progress made to develop PROMs in each clinical subspecialty. We highlight recent examples of the use of PROMs as secondary outcome measures in randomized controlled clinical trials and consider the impact they have had. With increasing interest in using PROMs as primary outcome measures, particularly where interventions have been found to be of equivalent efficacy by traditional outcome metrics, we highlight the importance of instrument precision in permitting smaller sample sizes to be recruited. Our review finds that while there has been considerable progress in PROM development, particularly in cataract, glaucoma, medical retina, and low vision, there is a paucity of useful tools for less common ophthalmic conditions. Development and validation of item banks, administered using computer adaptive testing, has been proposed as a solution to overcome many of the traditional limitations of PROMs, but further work will be needed to examine their acceptability to patients, clinicians, and investigators.

Development and testing of a patient-derived questionnaire for treatment of neovascular age-related macular degeneration: dimensions of importance in treatment of neovascular age-related macular degeneration

PURPOSE

Studies reporting on patient perspectives during treatment of neovascular age-related macular degeneration (nAMD) are limited. Thus, the aim of this study was to develop and test psychometric performance of a patient-derived questionnaire to capture important experiences during intravitreal treatment.

METHODS

Patients (n = 44) with at least 3-month experience of intravitreal injection treatment for nAMD identified the dimensions of priority and also performed a weighting procedure to develop a score for comparison. The questionnaire comprised two versions: one focusing on the relative importance' of the dimensions and one on the experience of the 'management' during treatment. The questionnaire was then tested for psychometric performance in a longitudinal design in newly diagnosed patients at baseline (n = 197), after three (n = 184) and six (n = 150) months of treatment.

RESULTS

Of the 15 included dimensions, the following were most frequently reported: 'receive treatment to preserve vision', 'information', 'waiting time', 'trust' and 'accommodating staff. The psychometric testing showed moderate reliability (intraclass correlation coefficient: 0.65-0.67) for the two versions and high level of face validity (8.3). The dimensions, 'preserving vision', 'early access to treatment', 'pain relief', 'information about the treatment/diagnosis' and 'visual aids' were consistently reported higher in 'importance' than in 'management', at both 3 and 6 months, indicating a potential for improvement in clinical practice for these dimensions.

CONCLUSION

This study provides a brief patient-derived questionnaire, expressed with a score with good psychometric performance that can be used for monitoring during intravitreal injection treatment of nAMD patients.

Exploring the quality of life issues in people with retinal diseases: a qualitative study

Background

The lack of an appropriate retina-specific patient-reported outcome instrument restricts the understanding of the full impact of hereditary retinal diseases and other less common but potentially blinding acquired retinal diseases such as, vascular occlusions, epiretinal membrane, macular hole, central serous retinopathy and other vitreoretinopathies on quality of life. This study aims to explore the quality of life issues in people with hereditary retinal diseases and acquired retinal diseases to develop disease-specific patient-reported outcome instruments.

Methods

A qualitative research methodology to understand the lived experiences of people with retinal diseases was carried out. Data were collected through semistructured interviews. The coding, aggregation and theme development was carried out using the NVivo −10 software.

Results

Seventy-nine interviews were conducted with participants with hereditary retinal diseases (n = 32; median age = 57 years) and acquired retinal diseases (n = 47; median age = 73 years). We identified nine quality of life themes (domains) relevant to people with retinal diseases. Difficulty in performing important day-to-day activities (activity limitation) was the most prominent quality of life issue in the hereditary retinal diseases group whereas concerns about health, disease outcome and personal safety (health concerns) was the most prominent quality of life issue in the acquired retinal diseases group. Participants with hereditary retinal diseases had more issues with social interaction (social well-being), problems with mobility and orientation (mobility), and effect on work and finance (economic) than participants with acquired retinal diseases. On the contrary, participants with acquired retinal diseases reported more inconveniences (conveniences) than participants with hereditary retinal diseases, which were mostly attributed to treatment. Participants with hereditary retinal diseases were coping better compared to participants with acquired retinal diseases.

Conclusions

Our study found that participants with both hereditary and acquired retinal diseases are living with myriad of disease-specific quality of life issues. Many of these issues are completely different and unique to each disease group. Hence, these group of diseases would need separate patient-reported outcome instruments to capture the disease-specific quality of life impacts.

Electronic supplementary material

The online version of this article (10.1186/s41687-017-0023-4) contains supplementary material, which is available to authorized users.

Seeing through their eyes: lived experiences of people with retinitis pigmentosa

PurposeRetinitis pigmentosa (RP) is the most common retinal degeneration causing blindness. Although their clinical problems are amenable for the clinical diagnosis, their day-to-day problems for having to live with the disease are mostly unexplored. This study aims to explore and understand the issues and impact of people with RP on quality of life (QoL).MethodsA qualitative research methodology to facilitate the understanding of the experiences of people with RP was carried out. Data were collected through audio-recorded semi-structured interviews. Thematic analysis occurred through the process of line-by-line coding, aggregation, and theme development using the NVivo-10 software.ResultsTwenty-three interviews were conducted (mean age=56 years; females, 14). We identified five major QoL themes: (1) struggle to perform important day-to-day tasks; (2) concerns about disease progression, disease outcome and personal safety; (3) facing a lot of emotional and psychological challenges; (4) experiencing a myriad of visual symptoms; and (5) adopting different strategies to cope and manage stressful circumstances. Difficulty in performing important day-to-day tasks was the most prominent QoL issue among these people. Their major concerns were going blind and uncertainties about their future. They face a lot of emotional and psychological challenges to adapt to the physiological stress associated with the progressive vision loss. However, they adopt several coping strategies to manage the stressful circumstances.ConclusionsPeople with RP experience a myriad of QoL issues. Despite all the hardship, they remain optimistic and learn to accept their eye condition and move on in life.