Mapping standard ophthalmic outcome sets to metrics currently reported in eight eye hospitals

Patient-reported Outcomes: the ICHOM Standard Set for Inflammatory Bowel Disease in Real-life Practice Helps Quantify Deficits in Current Care

BACKGROUND

Patient-reported outcome measures [PROMs] are key to documenting outcomes that matter most to patients and are increasingly important to commissioners of health care seeking value. We report the first series of the ICHOM Standard Set for Inflammatory Bowel Disease [IBD].

METHODS

Patients treated for ulcerative colitis [UC] or Crohn's disease [CD] in our centre were offered enrolment into the web-based TrueColours-IBD programme. Through this programme, e-mail prompts linking to validated questionnaires were sent for symptoms, quality of life, and ICHOM IBD outcomes.

RESULTS

The first 1299 consecutive patients enrolled [779 UC, 520 CD] were studied with median 270 days of follow-up (interquartile range [IQR] 116, 504). 671 [52%] were female, mean age 42 years (standard deviation [sd] 16), mean body mass index [BMI] 26 [sd 5.3]. At registration, 483 [37%] were using advanced therapies. Median adherence to fortnightly quality of life reporting and quarterly outcomes was 100% [IQR 48, 100%] and 100% [IQR 75, 100%], respectively. In the previous 12 months, prednisolone use was reported by 229 [29%] patients with UC vs 81 [16%] with CD, p <0.001; 202 [16%] for <3 months; and 108 [8%] for >3 months. An IBD-related intervention was reported by 174 [13%] patients, and 80 [6%] reported an unplanned hospital admission. There were high rates of fatigue [50%] and mood disturbance [23%].

CONCLUSIONS

Outcomes reported by patients illustrate the scale of the therapeutic deficit in current care. Proof of principle is demonstrated that PROM data can be collected continuously with little burden on health care professionals. This may become a metric for quality improvement programmes or to compare outcomes.

Cataract standard set for outcome measures: An Italian tertiary referral centre experience

PURPOSE

Implementation of the International Consortium for Health Outcomes Measurements (ICHOM) standard for cataract surgery into clinical practice at an Italian tertiary referral centre.

METHODS

Prospective, observational, descriptive study consisting of the registry and analysis of cataract surgeries performed during a 6-month enrolment period at the University Eye Clinic of Trieste, Trieste, Italy. Outcomes were recorded and analysed according to the ICHOM Cataract Standard Set version 2.0.1. Records included clinician-reported outcome measures (CROMs) - visual outcome and complications - and patient-reported outcome measures (PROMs) - self-assessed vision with the Catquest-9SF questionnaire. Correlations between PROMs and CROMs were evaluated. A multiple linear regression was used for predicting the change in PROMs with surgery.

RESULTS

A total of 218 eyes (of 218 patients) were analysed. Postoperative corrected distance visual acuity (CDVA) was ⩾0.3 in 89.0% (194/218) of eyes. There was a statistically significant improvement of the post-operative Catquest-9SF global average score. (p < 0.001). The change in the Catquest-9SF score significantly correlated with the change in Item 2 score (related to intermediate vision) (r = 0.634, p < 0.001). A predictive model of the change in the Catquest-9SF score was found (p < 0.001, R2: 0.527) based on preoperative Catquest-9SF total score, presence or not of macular degeneration, presence or not of intraoperative complications, age >75 years old, and preoperative CDVA.

CONCLUSIONS

Cataract surgery improves the functional vision, with some factors limiting the outcomes such as comorbidities. Self-perceived improvement in intermediate vision significantly influenced the improvement in self-assessed vision.

A Scoping Review of Process Indicators for Measuring Quality of Care in Glaucoma

PRCIS

There are no standardized process quality indicators (QIs) in glaucoma care. Although they can be inferred from guidelines and trials, they should be designed and standardized to allow better assessment of the quality of care.

PURPOSE

QIs are crucial for assessing the performance of any health care system. To allow efficiency, effectiveness, and patient-centeredness, there is a need for prompt acquisition of up-to-date information. Among the available QIs, process indicators have the highest sensitivity to frequent changes and could better reflect the implementation outcomes of novel ideas and technology. This study aimed to map the available information regarding process QIs in glaucoma care, identify the current development stage of these indicators, and systematically synthesize them.

MATERIALS AND METHODS

We performed a scoping review of 4 electronic bibliographic databases for studies reporting on process QIs in glaucoma. We retrieved 7502 references and created a domain list reflecting the core idea underlying each indicator.

RESULTS

We summarized information from 18 documents and listed 20 domains. The most mentioned domains were follow-up, optic nerve head assessment, visual field test, and intraocular pressure. Indicators regarding the quality of life assessment, patient assistance, or presence of written protocols were less frequently mentioned.

CONCLUSIONS

There are notable variations among process QIs in glaucoma and significant heterogeneity in their descriptions in published studies. Although novel indicators can be inferred from guidelines and trials, they should be designed and standardized for better assessment of performance in health systems to improve their quality.

Global multi-site, prospective analysis of cataract surgery outcomes following ICHOM standards: the European CAT-Community

PURPOSE

To evaluate in a large sample of patients from 10 different European centers the results of cataract surgery, characterizing the relationship between patient-reported outcomes (PROMs) and clinician-reported outcome measures (CROMs).

METHODS

Prospective non-interventional multicenter observational descriptive study analyzing the clinical outcomes of a total of 3799 cases undergoing cataract surgery (mean age: 72.7 years). In all cases, the cataract surgery standard developed by the International Consortium for Health Outcomes Measurements (ICHOM) was used to register the clinical data. Three-month postoperative visual acuity and refraction data were considered CROMs, whereas Rasch-calibrated item 2 (RCCQ2) and total Catquest-9SF score (CQ) were considered PROMs.

RESULTS

Postoperative corrected distance visual acuity (CDVA) was 0.3 logMAR or better in 88.7% (2505/2823) of eyes. Mean differences between preoperative and postoperative RCCQ2 and CQ scores were -3.09 and -2.39, respectively. Visual function improvement with surgery was reported by 91.5% (2163/2364) of patients. Statistically significant, although weak, correlations of postoperative CDVA with postoperative refraction, PROMs, and complications were found (0.133 ≤ r ≤0.289, p < 0.001). A predictive model (R²: 0.254) of postoperative CDVA considering 10 variables was obtained, including preoperative CDVA, different ocular comorbidities, age, gender and intraoperative complications. Likewise, another predictive model (R²: 0.148) of postoperative CQ considering a total of 14 variables was obtained, including additionally preoperative CQ, target refraction and previous surgeries.

CONCLUSIONS

Cataract surgery provides an improved functional vision in most of patients although this improvement can be limited by ocular comorbidities and complications. The relationship between PROMs and CROMs is multifactorial and complex.

Multi-stakeholder perspectives in defining health services quality indicators and dimensions: a concept mapping based comparison for cataract care between Singapore and The Netherlands

OBJECTIVE

This study aims to advance understanding of globally valid versus country-specific quality dimensions and indicators, as perceived by relevant stakeholders. It specifically addresses patient-level indicators for cataract surgery.

DESIGN

A mixed-methods case study comparing Singapore and The Netherlands SETTING: Singapore (2017-2019) and The Netherlands (2014-2015).

PARTICIPANTS

Stakeholder representatives of cataract care in Singapore and The Netherlands.

INTERVENTION

Based on the previously identified complete set of stakeholders in The Netherlands, we identified stakeholders of cataract care in Singapore. Stakeholder representatives then established a multi-stakeholder perspective on the quality of cataract care using a concept mapping approach. This yielded a multidimensional cluster map based on multivariate statistical analyses. Consensus-based quality dimensions were subsequently defined during a plenary session. Thereafter, Singaporean dimensions were matched with dimensions obtained in The Netherlands to identify commonalities and differences.

MAIN OUTCOME MEASURE

Health-services quality dimensions of cataract care.

RESULTS

19 Singaporean stakeholders representing patients, general practitioners, ophthalmologists, nurses, care providers, researchers and clinical auditors defined health-services quality of cataract care using the following eight dimensions: clinical outcome, patient outcomes, surgical process, surgical safety, patient experience, access, cost and standards of care. Compared with the Dutch results, 61% of the indicators were allocated to dimensions of comparable names and compositions. Considerable differences also existed in the composition of some dimensions and the importance attached to indicators.

CONCLUSIONS AND RELEVANCE

This study on cataract care in Singapore and The Netherlands shows that cataract care quality measurement instruments can share a common international core. At the same time, it emphasises the importance of taking a country-specific multi-stakeholder approach to quality definition and measurement. Complementing an international core set with country-specific measures is required to ensure that the included dimensions and indicators adequately capture the country-specific quality views.

Implementing ICHOM standard set for cataract surgery at IPO-Porto (Portugal): clinical outcomes, quality of life and costs

BACKGROUND

This paper fills a gap in the applied research field, for a local context, by addressing the topics of describing cataract surgery' clinical outcomes; quality of life (QoL); and costs of the patients treated after the implementation of the ICHOM standard set.

METHODS

This is a retrospective observational study using real-world data (RWD). We included all patients subjected to cataract surgery at the Portuguese Institute of oncology - Porto (IPO-Porto), Portugal, after 3 months follow up period completed between 5th June 2017 and 21st May 2018. The following inclusion criteria: corrected visual acuity of ≤ 6/10 or other significant visual disturbance due to lens opacity or the existence of a large anisometropia. A circuit was implemented based on the ICHOM standard for cataract, to measure clinical variables (e.g. visual acuity) and QoL (CATQUEST-9SF) before and after surgery, and cost of treatment. The results were explored by means of a paired-sample t-test, considering normality assumptions.

RESULTS

Data refers to 268 patients (73 P25-P75:32-95 years old), regarding 374 eyes. The cataract surgery had a positive effect on visual acuity (p < 0.001), refraction (right and left cylinder; p < 0.001) and all QoL dimensions. The vast majority of patients, around 98%, reported improvements in QoL. Based on IPO-Porto administrative records, the direct cost of treating cataracts (per eye) is of 500€, representing a total cost of 187,000€ for the number of patients operated herein.

CONCLUSION

This study reports the successful implementation of the ICHOM standard set for cataracts in a Portuguese institution and confirms that cataract surgery provides a rapid visual recovery, with excellent visual outcomes and minimal complications in most patients, while also having a positive impact on patients' quality of life.

A very short version of the Visual Function Questionnaire (VFQ-3oo7) for use as a routinely applied Patient-Reported Outcome Measure

BACKGROUND

Patient-reported outcome measures (PROMs) are valuable supplements in regular care to facilitate routine monitoring of quality of life from the patient's perspective. The 25-item National Eye Institute Visual Function Questionnaire (NEI-VFQ-25) is a widely used PROM in ophthalmology. However, the NEI-VFQ-25 is too time-consuming and cumbersome for routine evaluations in regular care. The aim of this study is to construct a 7-item questionnaire of which only 3 items are presented to the patient, by means of routing. This VFQ 3 out of 7 (VFQ-3oo7) should have a minimal loss of information compared with the NEI-VFQ-25.

METHODS

An historical database including 3293 administrations of the NEI-VFQ-25 was constructed involving patients with retinal detachment, cataract, corneal diseases, glaucoma, macular degeneration, uveal melanoma and a normal population sample. The data were subjected to Rasch analyses, in particular a generalized partial credit model. Items were sorted on the latent trait and divided into seven categories. From each category, the item with the highest discriminative value was selected. Through routing, only three out of the seven remaining questions are used, where the answers navigate patients to a fitting trait level.

RESULTS

A one-dimensional structure was considered fitting. The VFQ-3oo7 showed a small loss of information compared with the total score of the NEI-VFQ-25: correlation 0.927 and a relative precision of 0.868.

CONCLUSION

The very short, but valid, VFQ-3oo7 can be applied to evaluate the patient's perceived vision-related health status in routine evaluations of treatments in regular care, with a small burden for patients.

Validation and application of Catquest-9SF in various populations: A systematic review

Cataract is a common cause of reversible blindness. Visual acuity alone is not enough to assess appropriateness for surgery, prioritization, and outcomes. Catquest-9SF questionnaire evaluates patients' self-assessed visual function as related to daily tasks. We summarize and assess the validity of Catquest-9SF as a patient-reported outcome questionnaire to determine its suitability for clinical use. Thirteen studies with sample sizes ranging 102-10,886 (total n = 15,289) undertaken from 2009 to 2018 were included. Catquest-9SF showed unidimensionality, ordered response thresholds, and acceptable precision in all studies. Nine studies had significant mistargeting (range 0.66 to -2.04); the tasks being easy relative to the respondent ability in most studies. Two studies had misfitting items. We conclude Catquest-9SF is a valid and reliable tool to measure visual function in patients with cataract in various populations. Because results can be population specific, it is recommended that Catquest-9SF be validated in a new population before it is incorporated in routine practice.

Results of the standard set for pulmonary sarcoidosis: feasibility and multicentre outcomes

Our study presents findings on a previously developed standard set of clinical outcome data for pulmonary sarcoidosis patients. We aimed to assess whether changes in outcome varied between the different centres and to evaluate the feasibility of collecting the standard set retrospectively.

This retrospective observational comparative benchmark study included six interstitial lung disease expert centres based in the Netherlands, Belgium, the UK and the USA. The standard set of outcome measures included 1) mortality, 2) changes in pulmonary function (forced vital capacity (FVC), forced expiratory volume in 1 s, diffusing capacity of the lung for carbon monoxide), 3) soluble interleukin-2 receptor (sIL-2R) change, 4) weight changes, 5) quality-of-life (QoL) measures, 6) osteoporosis and 7) clinical outcome status (COS). Data collection was considered feasible if the data were collected in ≥80% of all patients.

509 patients were included in the retrospective cohort. In total six patients died, with a mean survival of 38±23.4 months after the diagnosis. Centres varied in mean baseline FVC, ranging from 110 (95% CI 92–124)% predicted to 99 (95% CI 97–123)% pred. Mean baseline body mass index (BMI) of patients in the different centres varied between 27 (95% CI 23.6–29.4) kg·m⁻² and 31.8 (95% CI 28.1–35.6) kg·m⁻². 310 (60.9%) patients were still on systemic therapy 2 years after the diagnosis. It was feasible to measure mortality, changes in pulmonary function, weight changes and COS. It is not (yet) feasible to retrospectively collect sIL-2R, osteoporosis and QoL data internationally.

This study shows that data collection for the standard set of outcome measures for pulmonary sarcoidosis was feasible for four out of seven outcome measures. Trends in pulmonary function and BMI were similar for different hospitals when comparing different practices.

Clinical outcome data have been used to compare outcomes in pulmonary sarcoidosis patients and improve care delivery. Data collection for the standard set of outcome measures for pulmonary sarcoidosis was feasible for four out of seven outcome measures.http://bit.ly/2F8bQ6s

Deep Anterior Lamellar Keratoplasty for Keratoconus: Multisurgeon Results

PURPOSE

To examine clinical outcomes in deep anterior lamellar keratoplasty (DALK) for keratoconus using contemporary techniques in a multisurgeon public healthcare setting.

DESIGN

Consecutive, retrospective case series.

METHODS

Setting: Moorfields Eye Hospital, London, United Kingdom.

STUDY POPULATION

Consecutive cases of keratoconus treated with non-laser assisted DALK from September 1, 2012, to September 31, 2016.

OBSERVATION PROCEDURE

Data on preoperative status, operative details, intraoperative and postoperative complications, secondary interventions, and visual outcomes were archived for analysis.

MAIN OUTCOME MEASURES

Graft failure rate and percentage of patients with corrected distance visual acuity (CDVA) ≥20/40 within 1 year of surgery and at final review after suture removal.

RESULTS

Three hundred fifty-seven eyes of 338 patients undergoing DALK (91.3% big-bubble technique attempted) were analyzed. A total of 4.2% (95% confidence interval [CI] 2.4%-6.8%) of corneal transplants had failed within the follow-up period (21.8 ± 11.4 months), and 75.9% of eyes had CDVA ≥20/40 within 1 year of surgery, rising to 81% after suture removal. Forty-two primary surgeons (31 trainees) participated. Intraoperative perforation of Descemet membrane occurred in 45.4% of eyes. A total of 24.1% were converted to penetrating keratoplasty (PK) intraoperatively. Conversion to PK increased the risk of transplant rejection (P = .026; odds ratio [OR] 1.94; 95% CI 1.1-3.5) and secondary glaucoma (P = .016; OR 4.0; 95% CI 1.3-12.4). Transplant rejection increased the risk of graft failure both overall (P = .017; OR = 3.9; 95% CI 1.4-11.0) and when cases converted to PK were excluded (P = .028; OR = 3.35; 95% CI 1.1-9.9).

CONCLUSION

DALK for keratoconus achieves early results similar to those published for PK in a multisurgeon setting. Conservative management of intraoperative Descemet membrane perforation, where possible, may be safer than conversion to PK.

The use of patient-reported outcome research in modern ophthalmology: impact on clinical trials and routine clinical practice

This review article considers the rising demand for patient-reported outcome measures (PROMs) in modern ophthalmic research and clinical practice. We review what PROMs are, how they are developed and chosen for use, and how their quality can be critically appraised. We outline the progress made to develop PROMs in each clinical subspecialty. We highlight recent examples of the use of PROMs as secondary outcome measures in randomized controlled clinical trials and consider the impact they have had. With increasing interest in using PROMs as primary outcome measures, particularly where interventions have been found to be of equivalent efficacy by traditional outcome metrics, we highlight the importance of instrument precision in permitting smaller sample sizes to be recruited. Our review finds that while there has been considerable progress in PROM development, particularly in cataract, glaucoma, medical retina, and low vision, there is a paucity of useful tools for less common ophthalmic conditions. Development and validation of item banks, administered using computer adaptive testing, has been proposed as a solution to overcome many of the traditional limitations of PROMs, but further work will be needed to examine their acceptability to patients, clinicians, and investigators.