Patient-reported outcome measures (PROMs) in paediatric ophthalmology: a systematic review

The impact of childhood glaucoma on psychosocial functioning and quality of life: a review of the literature

We present a novel comprehensive literature review of studies of the psychosocial functioning (PF) and quality of life (QoL) of patients with childhood glaucoma and their caregivers. Our findings demonstrate variable study quality and approach, as well as inconsistent results relating to the association of glaucoma-specific factors and sociodemographic variables with measured PF and QoL. Future studies should focus on the development of culturally cognizant and standardized assessment tools, execution of multi-center longitudinal studies with global representation, evaluation of PF and QoL among siblings and childhood glaucoma providers, and implementation of interventions to improve patient and caregiver PF and QoL.

Capturing the experiences of patients with inherited optic neuropathies: a systematic review of patient-reported outcome measures (PROMs) and qualitative studies

PURPOSE

To identify and comprehensively evaluate studies capturing the experience of individuals affected by an inherited optic neuropathy (ION), focusing on patient-reported outcome measures (PROMs) and qualitative studies where the health status and quality of life (QoL) of these individuals have been explored.

METHODS

Systematic review of five databases using a search strategy combining four concepts: (1) ION; (2) QoL and health status; (3) PROMs; and (4) qualitative research. Studies assessing the impact of ION on any QoL domain using a PROM or qualitative methodology were included and appraised, using criteria based on the COSMIN checklist (for PROM studies) and the CASP checklist (for qualitative studies).

RESULTS

Of 1326 unique articles identified, six studies were included. Five PROMs were identified: Visual Function Index (VF-14); Hospital Anxiety and Depression Scale (HADS); a novel graphical online assessment tool (NGOAT) for reporting emotional response to vision loss; a new PROM informed by the DSM-V Criteria for Major Depressive Disorder; and an interpersonal and career 'impact rating' PROM. The psychometric performance of included PROMs were poorly described. Qualitative studies found that vision loss resulted in psychosocial losses including loss of social and communication skills and loss of independence and freedom. Factors that modified the response to vision loss were also identified.

CONCLUSION

The current PROMs used by individuals with ION have poor content coverage, primarily measuring activity limitation and emotional well-being, and insufficient reporting of psychometric performance. There is a need to develop a PROM for individuals ION to report their experiences of living with their condition.

The State of Patient-Reported Outcome Measures for Pediatric Patients with Inherited Retinal Disease

Patient-reported outcome measures (PROMs) are questionnaires that assess health outcomes meaningful to the patient. PROMs have multiple applications, such as supporting clinicians’ decision-making for patient care, understanding the impact of disease on patient functioning, and evaluating the efficacy of therapeutics. Though PROMs were developed for various eye conditions, no PROM was tailored to pediatric patients with inherited retinal disease (IRD). Hence, a literature search was conducted using MEDLINE and Embase to identify PROMs potentially relevant to this patient population. This review evaluated selected pediatric PROMs against the US Food and Drug Administration (FDA) guidelines and found restricted use in the context of IRD. As there is a need for PROMs tailored to pediatric patients with IRD, we provide a perspective on applying the International Society for Pharmacoeconomics and Outcomes Research and FDA standards on the development of PROMs specific to IRD.

Inherited retinal diseases refer to a group of genetic conditions that affect the eye’s light-sensing cells and lead to vision loss. When a patient undergoes an eye assessment, the measures used are technical (e.g., visual acuity, visual field) and do not routinely address the patient’s experience. It is increasingly evident that the technical tools used do not really reflect how patients’ vision affects their daily lives. Questionnaires designed to assess how a condition impacts a daily activity are referred to as patient-reported outcome measures. The perspective of the impact of a condition on daily activities differs between adults and children. These tools are being created to evaluate health outcomes important to the patient on the basis of their condition and age. This is especially important when determining the value of therapies from the patient perspective. To date, no such questionnaire has been designed for pediatric patients with inherited retinal disease, an important cause of blindness. We explored the literature to evaluate existing pediatric vision tools and found that those could not be used to fill this gap. Given that we found a need to develop questionnaires tailored to pediatric patients with IRD, we also provide insight into how such a tool can be created for this population.

Development and Evaluation of the Quality of Life Scale for Children With Visual Impairments in China

BACKGROUND

Visual impairments related to non-correctable vision loss, including blindness and low vision, have been consistently shown to lower a person's health-related quality of life. This study assessed the reliability, validity, and discrimination of the Quality of Life Scale for Children with Visual Impairments (QOLS-CVI) in China.

METHODS

The Pediatric Quality of Life Inventory™ 4.0 and World Health Organization Quality of Life-Disability Scale for physical disability were selected to define conceptual frameworks and item libraries based on relevant existing studies. According to two rounds of expert consultations and group discussions, some items were modified, and the draft scale was developed. Two item selection processes based on classical test theory and item response theory were used to conduct a preliminary survey and a formal survey in special schools in Shanxi and Hebei Provinces. Finally, the reliability and validity of the quality of life scale for visually impaired children in China were verified.

RESULTS

The final QOLS-CVI consisted of 38 items, 10 subdomains, and 6 domains. Reliability was verified by Cronbach's alpha coefficient, split-half reliability, and test-retest reliability (Cronbach's alpha for the full scale, 0.841; split-half reliability, 0.629; and test-retest reliability, 0.888). The validity results showed that the multidimensional scale met expectations: exploratory factor analysis and confirmatory factor analysis indicated good fitting models for children with visual impairments.

CONCLUSIONS

The QOLS-CVI was determined to be reliable and valid and to have strong feasibility and effectiveness. This scale can be used as an evaluation tool to study the QOL and social-participation ability of children with visual impairments.

Translation and cross-cultural adaptation of a Nepali version of the Dutch Participation and Activity Inventory for Children and Youth (PAI - CY) with visual impairment

Background

Visual impairment is an important cause of disability in children. There is a lack of information on rehabilitation needs and low vision support services for children with visual impairment in Nepal. This is a pilot study designed to translate, culturally adapt and pre-test the Dutch version of the Participation and Activity Inventory for Children and Youth (PAI-CY) with visual impairment aged 7–17 years to develop a Nepali version.

Questionnaires (PAI-CY versions for 7–12 and 13–17 years) were translated using standardized methods and were culturally adapted by a panel of experts. They were pretested to evaluate comprehensibility and relevance among six children with visual impairment and blindness. Finally, participants completed a questionnaire evaluation form.

Results

The translation and cultural adaptation process resulted in the adaptation of nine items to make them suitable for Nepali culture. Most children had comprehensibility problems with some specific items because of vocabulary, sentence structure and the composition of items. Most of the children were satisfied with the questionnaires.

Conclusion

The study resulted in the development of a Nepali version of the PAI-CY. We worked with a small group of content experts and a small but representative sample of children which allowed us to use rigorous translation procedures to address language and cultural differences. A population based study has been planned to investigate the psychometric properties of these questionnaires.

Attitudes, experiences, and preferences of ophthalmic professionals regarding routine use of patient-reported outcome measures in clinical practice

BACKGROUND/OBJECTIVES

Routine use of patient-reported outcome measures (PROMs) to assess quality of health care systems is mandated in many countries and has been implemented successfully in many specialities. Ophthalmology currently lags behind. To support and inform future implementation, we investigated paediatric ophthalmic clinicians' experience of, and future training needs for, using child-appropriate vision PROMs and their views about the barriers and enablers to future routine implementation in clinical practice.

METHODS

We conducted a pilot study, using an online survey to elicit the experience, attitudes, training needs and perceptions of barriers and enablers to routine PROMs use of ophthalmic health professionals in the Paediatric Ophthalmology Department at Great Ormond Street Hospital, London. A focus-group was undertaken to discuss survey results and preferences regarding presentation of PROM data. Analysis comprised descriptive statistics, presented alongside complementary qualitative data.

RESULTS

Eighteen clinicians in the department completed the survey. Twenty-seven took part in the focus group. Clinicians had limited experience of using PROMs but high confidence in the potential positive impact on communication with patients, monitoring chronic conditions and clinical decision-making. Clinicians identified operational issues (collection and analysis of data) and impact (interpretation and application of data) as the two key areas for consideration. Training and information requirements before implementation were clearly articulated, alongside the benefits of using digital/electronic data capture ahead of consultations to allow efficiency and automated analysis, and presentation in an appropriate visual format alongside clinical data to ensure meaningful use.

CONCLUSION

The findings of this pilot study of ophthalmic clinicians working in a specialist paediatric ophthalmology department, suggest that ophthalmic clinicians recognise the potential benefits of routine PROMs use in clinical practice. Together with existing literature outside ophthalmology relating to overcoming barriers and exploiting enablers to routine implementation, findings may be applicable in planning routine PROM implementation in paediatric ophthalmology.

Dry eye symptoms in children: can we reliably measure them?

PURPOSE

Many dry eye questionnaires are available, but these may not be suitable for paediatric eye care. The feasibility of use and repeatability of symptom questionnaires administered to children was examined.

METHODS

Participants aged 6-15 years (n = 62; 25M:37F; 40% male) completed six questionnaires twice in random order at a single visit: Symptoms assessment in dry eye (SANDE), ocular surface disease index (OSDI), numerical rating scale (NRS), ocular comfort index (OCI, n = 30), dry eye questionnaire 5 (DEQ-5) and the instant ocular symptoms survey (IOSS). Completion time and need for assistance were recorded and relationships with age examined (Pearson correlation, independent t-test). The number of participants requiring assistance and with which items were compared (linear mixed model, pairwise test). Repeatability (coefficient of repeatability (CoR), limit of agreement, bias) and intraclass correlation coefficient (ICC) were examined.

RESULTS

Completion time was ≤2 min for each individual questionnaire. Younger participants took longer to complete (r = -0.43 to -0.60, p ≤ 0.01), and required more assistance (p ≤ 0.001). Forty-eight participants required assistance with at least one questionnaire. Older children (13-15 years) only required assistance with OSDI (p ≤ 0.004) and NRS (p ≤ 0.003). Participants required more assistance with SANDE, OSDI and NRS than with DEQ-5 and IOSS (p ≤ 0.02) and with gritty (OSDI, 77% of participants; OCI, 100%) and foreign body sensation (NRS, 92%) items. CoR was similar for all questionnaires with no evidence of a learning effect (p > 0.05). ICC was moderate to excellent.

CONCLUSIONS

Dry eye questionnaires can be used reliably in paediatric eye care; more time and assistance may be required for younger children. The DEQ-5 and IOSS are recommended for use in younger age children.

A Patient-reported Outcome Measure of Functional Vision for Children and Young People Aged 8 to 18 Years With Visual Impairment

PURPOSE

To develop age-appropriate extensions of a patient-reported outcome measure for capturing the functional impact of visual impairment on daily activities of children and young people aged 8 up to 18 years.

DESIGN

Questionnaire development and validation study.

METHODS

Pediatric Ophthalmology departments at Great Ormond Street Hospital and Moorfields Eye Hospital, and, in the final study phase, 20 further UK hospitals. Children and young people (aged 6-19 years) with visual impairment (acuity of the logarithm of the minimum angle of resolution (LogMAR) worse than 0.50 in the better eye) due to any cause but without significant non-ophthalmic impairments. We used our prototype FVQ_CYP for 10-15 year olds as the foundation. Twenty-nine semi-structured interviews confirmed relevance of existing, and identified new, age-specific items. Twenty-eight cognitive interviews captured information regarding comprehensibility and format. The FVQ_Child (8-12 years) and FVQ_Young Person (13-18 years) were evaluated with a national sample of 113 children and 96 young people using Rasch analysis.

RESULTS

Issues emerging from interviews with children and young people were largely congruent with those elicited originally with 10-15 year olds. The 28-item FVQ_Child and 38-item FVQ_Young Person versions have goodness-of-fit statistics within the interval 0.5, 1.5 and person separation values of 5.87 and 6.09 respectively. Twenty-four overlapping "core" items enabled their calibration on the same measurement scale. Correlations with acuity (r = 0.47) demonstrated construct validity.

CONCLUSIONS

The FVQ_C and FVQ_Young Person are robust age-appropriate versions of the FVQ_CYP which can be used cross-sectionally or sequentially/longitudinally across the age range of 8 up to 18 years in clinical practice and research.

Patient-reported outcome measures for retinoblastoma: a scoping review

BACKGROUND

Retinoblastoma is a childhood retinal cancer with lifelong consequences such as vision loss and increased risk of second cancer. Patient-reported outcome measures (PROMs) are instruments that measure outcomes related to health directly reported by patients. The purpose of this study was to determine the scope, characteristics and quality of PROMs used in retinoblastoma and related fields of pediatric ophthalmology and pediatric oncology.

METHODS

Databases MEDLINE and Embase were searched for studies in the English language that reported on PROMs used in retinoblastoma, pediatric oncology, or pediatric ophthalmology; grey literature and studies reporting on developmental PROM phases were excluded. PROMs were grouped by the construct measured and domains assessed, and classified as condition-specific or generic. A subsequent search was then conducted in MEDLINE and Embase for studies assessing measurement properties of the identified PROMs. PROMs with associated studies were assessed for their methodologic quality using the COnsensus-based standard for the Selection of health Measurement INstruments (COSMIN) strategy.

RESULTS

Among 110 eligible studies uncovered by the database searches, 143 PROMs were identified: one retinoblastoma-specific, 56 ophthalmology- and 86 oncology-related. The most common construct measured was 'health-related quality of life' and the most common domain assessed was emotional well-being. Of the 143 PROMs, 100 had associated validation studies; the one retinoblastoma-specific PROM was not validated. Quality assessment revealed 34/100 PROMs received a score of sufficient quality in both subcategories of 'overall content validity'; 3/100 received a score of sufficient quality in both subcategories of 'internal structure'; 0/100 received a score of sufficient quality in all three subcategories of 'remaining measurement properties'. The Patient-Reported Outcome Measure Information System (PROMIS) Pediatric Profile-25 was the highest-scoring PROM identified, meeting COSMIN standards for 2/3 measurement property categories (and 5/7 subcategories). Eleven additional PROMs were identified which had sufficient scores in 1/3 measurement property categories (and 5/7 subcategories).

CONCLUSION

The study identified several PROMs from the pediatric ophthalmology and pediatric oncology literature that could be relevant to the retinoblastoma population, but many have limits to their validation. Future development of a retinoblastoma-specific PROM, performed in partnership with retinoblastoma patients to support optimal content validity, could first focus on the selection and definition of the optimal construct to measure, followed potentially by adaptation and further validation of the relevant PROMs with strong methodologic quality identified in this study.

Psychometric evaluation of the Participation and Activity Inventory for Children and Youth (PAI-CY) 0-2 years with visual impairment

Purpose

To identify and monitor the developmental and participation needs of visually impaired (VI) children, the Participation and Activity Inventory for Children and Youth (PAI-CY) has recently been developed involving end-users as stakeholders. The aim was to investigate psychometric properties of the PAI-CY for children between 0 and 2 years.

Methods

Responses from 115 parents were included in item analyses, after which a combination of classical test theory and item response theory (IRT) was used. Internal consistency, known-group validity, and test–retest reliability at item and scale level were investigated.

Results

After deleting four items, the PAI-CY met IRT assumptions, i.e., unidimensionality, local independence, and monotonicity, and satisfactory model fit was obtained. Participants with more severe VI and comorbidity scored significantly worse than those with less severe VI and without comorbidity, supporting known-group validity. Satisfactory internal consistency and test–retest reliability were obtained (Cronbach’s alpha 0.95, kappa 0.60–0.91, ICC 0.920).

Conclusions

The PAI-CY 0–2 years has acceptable psychometric properties and can be used to systematically assess and monitor developmental and participation needs of very young children with VI from parents’ perspectives in low vision practice and research. Confirmation of psychometric properties is necessary, possibly facilitating further item reduction, increased precision, and improved user-friendliness.

An Age- and Stage-Appropriate Patient-Reported Outcome Measure of Vision-Related Quality of Life of Children and Young People with Visual Impairment

PURPOSE

Developmentally sensitive measures of vision-related quality of life (VQoL) are needed to capture age-specific concerns about the impact of living with visual impairment (VI) in children and young people. Our objective was to use our validated VQoL instrument for children and young people 10 to 15 years of age (the VQoL_CYP) as the foundation for development of age-specific extensions.

DESIGN

Questionnaire development.

PARTICIPANTS

A representative sample of children and young people 6 to 19 years of age with VI, defined as visual acuity worse than 0.50 logarithm of the minimum angle of resolution in the better eye. They were recruited from pediatric ophthalmology clinics at Great Ormond Street Hospital and Moorfields Eye Hospital and, in the final phase of the study, from 20 additional United Kingdom hospitals.

METHODS

Standard instrument development processes were followed across 4 phases. Twenty-nine semistructured interviews with children and young people permitted draft age-appropriate extensions. Twenty-eight cognitive interviews informed items and response options. Age-appropriate extensions were prepiloted with 49 participants to ensure feasibility and administered via a postal survey to a national sample of 160 participants for psychometric evaluation using Rasch analysis. Construct validity was evaluated through correlations with the Pediatric Quality of Life Inventory.

MAIN OUTCOME MEASURES

Psychometric indices of validity and reliability of the instrument versions.

RESULTS

Interviews confirmed that the existing VQoL_CYP content and format were relevant across a wider age range. Age-appropriate extensions were drafted for children (8-12 years) and young people (13-17 years). Psychometric item reduction produced 20-item child and 22-item young person versions, each with acceptable fit values, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting, and no notable differential item functioning on items common to both. Construct validity was demonstrated through correlations with health-related quality of life (r = 0.698).

CONCLUSIONS

Using an efficient child- and young person-centered approach, we developed 2 robust, age-appropriate versions of an instrument capturing VQoL that can be used cross-sectionally or sequentially across the age range of 8 to 17 years in research and clinical practice. This approach may be applicable in other rare childhood ophthalmic disorders.

Comparison of the CAT-QoL and PedsQLTM instruments in measuring quality of life in amblyopia treatment: preliminary results

Background/Aims: The Child Amblyopia Treatment Questionnaire (CAT-QoL) is a patient-reported outcome measure (PROM), designed to assess the impact of amblyopia treatment. The aim of this study was to compare the psychometric properties of two PROMs; the CAT-QoL instrument and Pediatric Quality of Life Inventory (PedsQL^TM), a generic pediatric PROM. This work was part of a wider project to develop a condition-specific PROM for children with amblyopia. Methods: Three hundred and forty-two participants were recruited in a UK multi-center study. Quality of life data was collected using the CAT-QoL and the PedsQL^TM instruments. The psychometric performance of the CAT-QoL and PedsQL^TM were examined in terms of acceptability, reliability, and validity. Results: Both instruments demonstrated good reliability (CAT-QoL Cronbach's α = 0.793; PedsQL^TM α = 0.872). The convergent validity of the CAT-QoL and PedsQL^TM instruments was tested by comparing the instruments to each other. There was a moderate correlation between the PedsQL^TM and the CAT-QoL scores, and this relationship was statistically significant (r_s = -0.517, p < .000). No statistical significance was found between the level of amblyopia severity and the mean PedsQL^TM score (p = .420). Conclusion: It was possible to assess the impact of amblyopia treatment using the CAT-QoL and PedsQL^TM instruments. The preliminary findings from this are not conclusive, and it is not possible to advocate the use of one questionnaire over another based upon psychometric performance demonstrated here. This may be due to the sample population, as there were limited numbers of participants with severe amblyopia. Both the CAT-QoL and PedsQL^TM instruments were noted to have some issues with ceiling effects at an individual item level. The CAT-QoL and PedsQL^TM were reliable (as determined by Cronbach's alpha). The PedsQL^TM instrument was not able to discriminate between amblyopia severity groups (discriminant validity). Further research is required to formally assess the psychometric properties of the CAT-QoL questionnaire.

Development of a core outcome set for amblyopia, strabismus and ocular motility disorders: a review to identify outcome measures

BACKGROUND

Core Outcome Sets (COS) are defined as the minimum sets of outcomes that should be measured and reported in all randomised controlled trials to facilitate combination and comparability of research. The aim of this review is to produce an item bank of previously reported outcome measures from published studies in amblyopia, strabismus and ocular motility disorders to initiate the development of COS.

METHODS

A review was conducted to identify articles reporting outcome measures for amblyopia, strabismus and ocular motility disorders. Using systematic methods according to the COMET handbook we searched key electronic bibliographic databases from 1st January 2011 to 27th September 2016 using MESH terms and alternatives indicating the different subtypes of amblyopia, strabismus and ocular motility disorders in relation to treatment outcomes and all synonyms. We included Cochrane reviews, other systematic reviews, controlled trials, non-systematic reviews and retrospective studies. Data was extracted to tabulate demographics of included studies, primary and secondary outcomes, methods of measurement and their time points.

RESULTS

A total of 142 studies were included; 42 in amblyopia, 33 in strabismus, and 68 in ocular motility disorders (one study overlap between amblyopia and strabismus). We identified ten main outcome measure domains for amblyopia, 14 for strabismus, and ten common "visual or motility" outcome measure domains for ocular motility disorders. Within the domains, we found variable nomenclature being used and diversity in methods and timings of measurements.

CONCLUSION

This review highlights discrepancies in outcome measure reporting within published literature for amblyopia, strabismus and ocular motility and it generated an item bank of the most commonly used and reported outcome measures for each of the three conditions from recent literature to start the process of COS development. Consensus among all stakeholders including patients and professionals is recommended to establish a useful COS.

The use of patient-reported outcome research in modern ophthalmology: impact on clinical trials and routine clinical practice

This review article considers the rising demand for patient-reported outcome measures (PROMs) in modern ophthalmic research and clinical practice. We review what PROMs are, how they are developed and chosen for use, and how their quality can be critically appraised. We outline the progress made to develop PROMs in each clinical subspecialty. We highlight recent examples of the use of PROMs as secondary outcome measures in randomized controlled clinical trials and consider the impact they have had. With increasing interest in using PROMs as primary outcome measures, particularly where interventions have been found to be of equivalent efficacy by traditional outcome metrics, we highlight the importance of instrument precision in permitting smaller sample sizes to be recruited. Our review finds that while there has been considerable progress in PROM development, particularly in cataract, glaucoma, medical retina, and low vision, there is a paucity of useful tools for less common ophthalmic conditions. Development and validation of item banks, administered using computer adaptive testing, has been proposed as a solution to overcome many of the traditional limitations of PROMs, but further work will be needed to examine their acceptability to patients, clinicians, and investigators.

Patient-Reported Outcome Measures in Neurosurgery: A Review of the Current Literature

BACKGROUND

Patient-reported outcome measures (PROMs) play an important role in the evaluation of health outcomes, quality of life, and satisfaction, and have been successfully utilized in many areas of clinical medicine and surgical practice. The prevalence of PROMs in neurosurgery is not known.

OBJECTIVE

To review the PROMs that have been utilized in the published neurosurgery literature to date.

METHODS

Articles were searched in MEDLINE, EMBASE, HMIC Health Management Information Consortium, PsycARTICLES, and PsycINFO using search terms related to neurosurgery and PROMs, published from 1806 to August 2016. A total of 268 articles were identified that were stratified by the inclusion and exclusion criteria leading to a total of 137 articles. Twenty-six PROMs, involving both adult and pediatric populations, were identified.

RESULTS

A large number of generic and disease-specific PROMs are used in the neurosurgical literature. Generic PROMs are usually nonspecific measures of health status. Disease-specific PROMs may not address issues relevant to neurosurgical procedures. There are very few neurosurgery-specific PROMs that take into account the impact of a neurosurgical procedure on a specific condition.

CONCLUSION

PROMs that currently feature in the neurosurgical literature may not address the specific outcomes relevant to neurosurgical practice. There is an emergent need for generic and disease-specific PROMs to be validated in neurosurgical patients and neurosurgery-specific PROMs developed to address unmet needs of patients undergoing neurosurgical procedures.

A patient led, international study of long term outcomes of esophageal atresia: EAT 1

INTRODUCTION

Long term outcomes of esophageal atresia (OA) are poorly understood. The Federation of Esophageal Atresia and Tracheo-Esophageal Fistula support groups (EAT), a collaboration of patient support groups aimed to define patient reported long term outcomes and quality of life (QoL) in a large international cohort of OA patients.

METHODS

Questionnaires were designed focusing on patient/parent reported outcomes including surgical history, current symptomatology and quality of life. Members of support groups within EAT were invited to complete questionnaires electronically via SurveyMonkey®.

RESULTS

1100 patients from 25 countries responded to the questionnaire and 928 were analyzed. 80% had type C anatomy, 19% type A and 1% type E. Patient ages were <5 years (42%), 5-10 years (26%), 11-17 years (16%) and 18 years and older (16%). 49% of all patients reported previous dilatations which was similar across age groups. Reflux symptoms affected 58% of patients and persisted into adulthood. Dysphagia also persisted in the adult population with 50% reporting sometimes or often getting food stuck. Reflux was significantly more frequent in 'long gap' versus 'standard gap' patients (p<0.005). Respiratory symptoms and chest infections decreased in frequency with age. In children median SDS for height was -0.41 (IQR -1.4 to 0.67) and that for weight was -0.63 (-1.6 to 0.67). BMI in adults was 21.5. Quality of life was described as significantly affected by OA in 18% of patients while 25% reported no effect on QoL.

CONCLUSIONS

These results highlight the significant long term morbidity suffered by OA patients as children and into adulthood and suggest the need for quality transitional care. The patient designed and reported nature of the study gives a unique perspective to the results and emphasizes the benefits of collaboration.

Are validated patient-reported outcomes used on children in pediatric otolaryngology? A systematic review

OBJECTIVES

Review the pediatric otolaryngology literature to 1) identify studies in which children completed patient-reported outcome (PRO) measures and 2) appraise the psychometric quality and validity of these PROs as they apply to pediatrics.

METHODS

In October 2016, a systematic review was performed by two reviewers on PubMed/MEDLINE and EMBASE for all otolaryngology-related studies that utilized PROs in children. Inclusion criteria included articles that required children (age<18) to complete PROs. Exclusion criteria included validation studies, reviews, and abstracts. Interreviewer agreement was determined using Cohen's kappa. Quality and rigor of validation testing for included PROs was determined using the COnsensus-based Standards for selection of health status Measurement Instruments.

RESULTS

Interrater agreement was very good (κ = 0.91; 95% CI, 0.85-0.98). Out of 316 articles retrieved, 11 met inclusion criteria. Eight PROs were identified. Six PROs were tested for validity and three of these PROs were tested for validity specifically within children. The most frequently utilized PRO was the Pediatric Rhinoconjunctivitis Quality of Life Questionnaire. Two studies (18.2%) utilized PROs within the scope of their validation. Seven studies (63.6%) used PROs outside the scope of their validation. Two studies (18.2%) used non-validated PROs.

CONCLUSIONS

Patient-reported outcomes have become an integral part of research and quality improvement. There is a relative paucity of PROs directed towards children in pediatric otolaryngology and some studies utilized PROs that were not validated or not validated for use in this age group. Future efforts to design and validate more instruments may be warranted.

Cross sectional, qualitative thematic analysis of patient perspectives of disease impact in juvenile idiopathic arthritis-associated uveitis

BACKGROUND

Chronic health conditions in children can have a significant impact on their quality of life. The aim of this study was to explore the subjective experience of children and young people being treated for chronic, non-infectious uveitis associated with a systemic disease such as juvenile idiopathic arthritis.

METHODS

A semi-structured interview was conducted with 10 children and young people aged between 6 and 18 years of age and their parents.

RESULTS

Preliminary thematic analysis indicated that both the treatment and complications of the disorder have a significant impact on the quality of life and emotional well-being of patients, not only in terms of the discomfort experienced but also in perceptions of social isolation, anxiety and sense of injustice.

CONCLUSION

This study shows that themes including "impact on school", "social factors" and "emotional reactions" are important domains influencing health-related quality of life (HRQoL) in children with chronic uveitis. Inclusion of questions relating to these domains should be considered in future uveitis-specific tools examining HRQoL in these patients.

One size doesn't fit all: time to revisit patient-reported outcome measures (PROMs) in paediatric ophthalmology?

The purpose of this article is to summarise methodological challenges and opportunities in the development and application of patient reported outcome measures (PROMs) for the rare and complex population of children with visually impairing disorders. Following a literature review on development and application of PROMs in children in general, including those with disabilities and or/chronic condition, we identified and discuss here 5 key issues that are specific to children with visual impairment: (1) the conflation between theoretically distinct vision-related constructs and outcomes, (2) the importance of developmentally appropriate approaches to design and application of PROMs, (3) feasibility of standard questionnaire formats and administration for children with different levels of visual impairment, (4) feasibility and nature of self-reporting by visually impaired children, and (5) epidemiological, statistical and ethical considerations. There is an established need for vision-specific age-appropriate PROMs for use in paediatric ophthalmology, but there are significant practical and methodological challenges in developing and applying appropriate measures. Further understanding of the characteristics and needs of visually impaired children as questionnaire respondents is necessary for development of quality PROMs and their meaningful application in clinical practice and research.

The impact of the National Institute for Health Research Health Technology Assessment programme, 2003-13: a multimethod evaluation

BACKGROUND

The National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme supports research tailored to the needs of NHS decision-makers, patients and clinicians. This study reviewed the impact of the programme, from 2003 to 2013, on health, clinical practice, health policy, the economy and academia. It also considered how HTA could maintain and increase its impact.

METHODS

Interviews (n = 20): senior stakeholders from academia, policy-making organisations and the HTA programme. Bibliometric analysis: citation analysis of publications arising from HTA programme-funded research. Researchfish survey: electronic survey of all HTA grant holders. Payback case studies (n = 12): in-depth case studies of HTA programme-funded research.

RESULTS

We make the following observations about the impact, and routes to impact, of the HTA programme: it has had an impact on patients, primarily through changes in guidelines, but also directly (e.g. changing clinical practice); it has had an impact on UK health policy, through providing high-quality scientific evidence - its close relationships with the National Institute for Health and Care Excellence (NICE) and the National Screening Committee (NSC) contributed to the observed impact on health policy, although in some instances other organisations may better facilitate impact; HTA research is used outside the UK by other HTA organisations and systematic reviewers - the programme has an impact on HTA practice internationally as a leader in HTA research methods and the funding of HTA research; the work of the programme is of high academic quality - the Health Technology Assessment journal ensures that the vast majority of HTA programme-funded research is published in full, while the HTA programme still encourages publication in other peer-reviewed journals; academics agree that the programme has played an important role in building and retaining HTA research capacity in the UK; the HTA programme has played a role in increasing the focus on effectiveness and cost-effectiveness in medicine - it has also contributed to increasingly positive attitudes towards HTA research both within the research community and the NHS; and the HTA focuses resources on research that is of value to patients and the UK NHS, which would not otherwise be funded (e.g. where there is no commercial incentive to undertake research). The programme should consider the following to maintain and increase its impact: providing targeted support for dissemination, focusing resources when important results are unlikely to be implemented by other stakeholders, particularly when findings challenge vested interests; maintaining close relationships with NICE and the NSC, but also considering other potential users of HTA research; maintaining flexibility and good relationships with researchers, giving particular consideration to the Technology Assessment Report (TAR) programme and the potential for learning between TAR centres; maintaining the academic quality of the work and the focus on NHS need; considering funding research on the short-term costs of the implementation of new health technologies; improving the monitoring and evaluation of whether or not patient and public involvement influences research; improve the transparency of the priority-setting process; and continuing to monitor the impact and value of the programme to inform its future scientific and administrative development.

Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument

Purpose

To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL) instrument for self-reporting by children with visual impairment (VI).

Methods

Participants were a random patient sample of children with VI aged 10–15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV) and generic health-related quality of life (HRQoL) self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients.

Results

Item reduction through piloting (8 items removed for skewness and individual item response pattern) and validation (1 item removed for skewness and 3 for misfit in Rasch) produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity.

Conclusions

Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

The quality of systematic reviews of health-related outcome measurement instruments

BACKGROUND

Systematic reviews of outcome measurement instruments are important tools for the selection of instruments for research and clinical practice. Our aim was to assess the quality of systematic reviews of health-related outcome measurement instruments and to determine whether the quality has improved since our previous study in 2007.

METHODS

A systematic literature search was performed in MEDLINE and EMBASE between July 1, 2013, and June 19, 2014. The quality of the reviews was rated using a study-specific checklist.

RESULTS

A total of 102 reviews were included. In many reviews the search strategy was considered not comprehensive; in only 59 % of the reviews a search was performed in EMBASE and in about half of the reviews there was doubt about the comprehensiveness of the search terms used for type of measurement instruments and measurement properties. In 41 % of the reviews, compared to 30 % in our previous study, the methodological quality of the included studies was assessed. In 58 %, compared to 55 %, the quality of the included instruments was assessed. In 42 %, compared to 7 %, a data synthesis was performed in which the results from multiple studies on the same instrument were somehow combined.

CONCLUSION

Despite a clear improvement in the quality of systematic reviews of outcome measurement instruments in comparison with our previous study in 2007, there is still room for improvement with regard to the search strategy, and especially the quality assessment of the included studies and the included instruments, and the data synthesis.

Whole-population vision screening in children aged 4-5 years to detect amblyopia

Amblyopia is a neurodevelopmental disorder that affects at least 2% of most populations and can lead to permanently reduced vision if not detected and treated within a specific period in childhood. Whole-population screening of children younger than 5 years is applied in many countries. The substantial diversity in existing programmes reflects their heterogeneous implementation in the absence of the complete evidence base that is now a pre-requisite for instituting screening. The functional importance of amblyopia at an individual level is unclear as data are scarce, but in view of the high prevalence the population-level effect might be notable. Screening of all children aged 4-5 years (eg, at school entry) confers most benefit and addresses inequity in access to timely treatment. Screening at younger ages is associated with increased risk of false-positive results, and at older ages with poor outcomes for children with moderate to severe amblyopia. We suggest that the real-life adverse effects of amblyopia should be characterised and screening and diagnosis should be standardised.

A survey of children's reported experience in outpatient pediatric ophthalmology clinics

PURPOSE

Patient-reported experience measures influence contemporary health care. To monitor the experience of children in health care, some inherent difficulties must be overcome. The authors sampled the opinion of children in outpatient pediatric ophthalmology clinics.

METHODS

Questionnaires were designed and distributed to children ages 2 to 16 years in pediatric ophthalmology clinics over three sites.

RESULTS

Ninety-three forms were completed by children ages 2 to 16 years. The average duration of clinic visits was 69 minutes. Children commented that helpful staff improved their experience. Waiting times and boredom were negative issues raised consistently. Children particularly enjoyed visual acuity testing, which they also described as the most challenging aspect of the clinic. On average, patients found eye drops only mildly painful.

CONCLUSIONS

Various areas for service improvement were identified from this study, including the value of keeping children occupied and minimizing waiting times. It was not clear to children which healthcare professionals they were seeing and this was an area of confusion. Adolescent patients felt the clinic was too childish. Sampling children's opinions through questionnaires had some limitations in terms of some inconsistencies of response, incomplete questionnaires, and multiple answers, but overall provided useful information specific to the clinics.