A critical evaluation of the content validity of patient-reported outcome measures assessing health-related quality of life in children with cancer: a systematic review

The active involvement of patients in oncology research

The aim of this review is to provide an overview of the status of patient/public involvement (PPI) in oncology research, including definitions, regulatory aspects, ongoing clinical activities in different countries, achievements and difficulties. The 10-year activities of the Swiss Group for Clinical Cancer Research (SAKK) Patient Advisory Board are described, illustrating challenges faced and solutions in daily practice. Even though clinical data are still limited, it appears PPI has great potential for development in oncology. The drive for precision medicine, activities of patient organizations, pharmaceutical industry interest, and strong support from regulatory agencies, are facilitators to integration of PPI throughout the drug development process. Despite the availability of guidance documents providing recommendations for the implementation of PPI, lack of human and structural resources, training for patients / caregivers and healthcare personnel, and lack of collaboration among stakeholders are some of the main barriers reported. More rigorous reporting of PPI in clinical studies is needed, including the methods to evaluate the impact of PPI and in the representation of patients as partner.

Measurement of compassion fatigue in animal health care professionals: a systematic review of available instruments and their content validity

Introduction

Compassion fatigue (CF) refers to emotional or physical exhaustion and emotional reactions resulting from prolonged exposure to traumatic events, commonly experienced by professionals in caregiving roles. CF is prevalent among healthcare professionals, including those in animal care. Several Patient-Reported Outcome Measures (PROMs) were developed to measure CF, but their psychometric validity was not reviewed systematically. This study aims to identify and review the content validity of CF PROMs used in animal health care professionals.

Methods

Literature was searched in PubMed, PsycINFO, and EMBASE (1973-2023). We included studies conducted in animal health care professionals, using a PROM to measure CF, reporting at least one psychometric property of this PROM, and published as original research. For each identified PROM, additional literature search was conducted to identify PROM development and content validation studies. Three independent reviewers evaluated the content validity of each PROM using COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology and summarized the quality of evidence using a modified GRADE approach. The protocol was registered in PROSPERO (CRD42023433982) and results reported following PRISMA guidelines.

Results

Initially, 1709 studies were identified. After a double screening, 17 eligible studies were included. CF was measured using six different PROMs or their modified versions. Only one PROM specifically targeted animal health care professionals: the ProQOL-5 Veterinary Medicine Version. This and three other original CF PROMs were reviewed. For all PROMs, the quality of content validity was rated as insufficient due to deficiencies in the concept and items elicitation, inadequate target population representation, and inadequate details on cognitive interview procedures. The overall evidence quality was rated as low due to a limited number of PROM validation studies, poor methodological and reporting quality, and indirect result.

Discussion

There is a scarcity of studies examining CF within the target population, and the quality of evidence for content validity of the reviewed PROMs for CF measurement is currently low. CF definition and construct description in PROM development studies suffer from vagueness and seem inadequately reflected by the content of the reviewed PROMs. Further research with a robust methodology seems necessary to address the identified flows.

Systematic review registration

Measurement of compassion fatigue in people working with animals: protocol for a systematic review. PROSPERO 2023 CRD42023433982. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023433982.

Moral distress measurement in animal care workers: a systematic review

OBJECTIVES

The mental health of veterinary and other animal health professionals is significantly impacted by the psychological stressors they encounter, such as euthanasia, witnessing animal suffering and moral distress. Moral distress, initially identified in nursing, arises when individuals are aware of the right action but are hindered by institutional constraints. We aimed to review existing research on moral distress scales among animal care workers by focusing on the identification and psychometric validity of its measurement.

DESIGN

Two-step systematic review. First, we identified all moral distress scales used in animal care research in the eligible original studies. Second, we evaluated their psychometric validity, emphasising content validity, which is a critical aspect of patient-reported outcome measures (PROMs). This evaluation adhered to the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The results were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses.

DATA SOURCES

PubMed, EMBASE and PsycINFO to search for eligible studies published between January 1984 and April 2023.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

We included original (primary) studies that (1) were conducted in animal care workers; (2) describing either the development of a moral distress scale, or validation of a moral distress scale in its original or modified version, to assess at least one of the psychometric properties mentioned in COSMIN guidelines.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers used standardised methods to search, screen and code included studies. We considered the following information relevant for extraction: study reference, name and reference of the moral distress scale used, psychometric properties assessed and methods and results of their assessments. The collected information was then summarised in a narrative synthesis.

RESULTS

The review identified only one PROM specifically adapted for veterinary contexts: the Measure of Moral Distress for Animal Professionals (MMD-AP), derived from the Measure of Moral Distress for Healthcare Professionals (MMD-HP). Both MMD-HP and MMD-AP were evaluated for the quality of development and content validity. The development quality of both measures was deemed doubtful. According to COSMIN, MMD-HP's content validity was rated as sufficient, whereas MMD-AP's was inconsistent. However, the evidence quality for both PROMs was rated low.

CONCLUSION

This is the first systematic review focused on moral distress measurement in animal care workers. It shows that moral distress is rarely measured using standardised and evidence-based methods and that such methods should be developed and validated in the context of animal care.

PROSPERO REGISTRATION NUMBER

CRD42023422259.

Consensus framework for conducting phase I/II clinical trials for children, adolescents, and young adults with pediatric low-grade glioma: Guidelines established by the International Pediatric Low-Grade Glioma Coalition Clinical Trial Working Group

Within the last few decades, we have witnessed tremendous advancements in the study of pediatric low-grade gliomas (pLGG), leading to a much-improved understanding of their molecular underpinnings. Consequently, we have achieved successful milestones in developing and implementing targeted therapeutic agents for treating these tumors. However, the community continues to face many unknowns when it comes to the most effective clinical implementation of these novel targeted inhibitors or combinations thereof. Questions encompassing optimal dosing strategies, treatment duration, methods for assessing clinical efficacy, and the identification of predictive biomarkers remain unresolved. Here, we offer the consensus of the international pLGG coalition (iPLGGc) clinical trial working group on these important topics and comment on clinical trial design and endpoint rationale. Throughout, we seek to standardize the global approach to early clinical trials (phase I and II) for pLGG, leading to more consistently interpretable results as well as enhancing the pace of novel therapy development and encouraging an increased focus on functional endpoints as well and quality of life for children faced with this disease.

Rasch analysis of a patient-reported outcome measure for self-perceived health among psychiatric patients in Denmark

BACKGROUND

Patient-reported outcome measures (PROMs) are valuable and necessary tools for establishing and maintaining patient-centred healthcare. The PRO-Psychiatry initiative was primarily initiated to support the patient's voice in treatment decision-making and secondarily to monitor patient-perceived quality of care. The result of the initiative is a patient-reported instrument developed in collaboration between patients and clinicians. We aimed to validate the PROM developed for measuring self-perceived health among psychiatric patients in North Denmark Region, in terms of internal consistency, criterion validity and responsiveness.

METHOD

Patients in contact with a psychiatric hospital in the North Denmark Region from September 2018 to March 2021 were included in the study. The PROM constitutes a scale of 17 items covering various aspects of self-perceived health including well-being (7 items), lack of well-being (5 items) and social functioning (5 items), where the former domain entails the WHO-5 Well-Being Index. The potential range of the total scale score is 0-85. We applied McDonald's omega, average inter-item correlation (AIIC) and differential item functioning (DIF). In addition, we used mixed effects analyses to estimate temporal correlations. The instrument was compared with self-rated overall mental and psychiatric health.

RESULTS

The patient population consisted of 1132 unique patients and a total of 2476 responses corresponding to one response per patient pathway. McDonald's omega was found to be 0.92 (95% CI 0.92 to 0.93), while the AIIC was found to be 0.42 (95% CI 0.39 to 0.44). For DIF, the largest systematic variation resulted in a maximum difference of 2.3 points on the total score when adjusting for the latent trait and was found when comparing initial measurements with follow-up measurements. The correlation between the total score and the outcomes regarding overall physical and mental health was 0.52 (95% CI 0.48 to 0.56) and 0.74 (95% CI 0.72 to 0.76). Similar correlations were found for the corresponding changes over time.

CONCLUSION

The scale showed high consistency and little systematic variation between the comparison groups. The concurrent correlations and analyses of responsiveness coincided with the prespecified hypotheses. Overall, we deem the Danish PRO-Psychiatry instrument to possess suitable psychometric properties for measuring self-perceived health among a psychiatric population.

Development and psychometric testing of a pediatric chronic graft-versus-host disease symptom scale: protocol for a two-phase, mixed methods study

Background

Chronic graft-versus-host disease (cGVHD) is a debilitating late complication of hematopoietic stem cell transplantation. It is often accompanied by extensive symptom burden. No validated cGVHD patient-reported outcome (PRO) measure exists to evaluate cGVHD symptom bother in children and adolescents younger than 18 years. This paper presents the study protocol for a multi-center, two-phase protocol to develop a psychometrically valid pediatric cGVHD Symptom Scale (PCSS) and a companion caregiver-proxy measure to capture the symptom burden experienced by children with cGVHD. In the first phase of the study, our aim is to evaluate the comprehension, clarity and ease of response of the PCSS through cognitive interviewing and to iteratively refine the measure to optimize content validity. In the second phase of the study, we will quantitatively examine the measurement properties of the PCSS in children and their caregiver-proxies.

Methods and analysis

Eligible participants are children/adolescents ages 5-17 with cGVHD who are receiving systemic immunosuppressive treatment or have recently tapered to discontinuation. In the first phase, we are enrolling 60 child and caregiver-proxy dyads in three child age strata (5-7, 8-12, and 13-17 years old). Semi-scripted cognitive debriefing interviews are conducted to assess comprehension, clarity, and ease of response of each PCSS item with the child alone, and then jointly with the caregiver-proxy to explore discordant ratings. In phase two, an age-stratified cohort of 120 child-caregiver dyads will be enrolled to evaluate test-retest reliability, construct validity, and responsiveness. Anchors for known-groups validity include the PedsQL module and clinical variables, including cGVHD clinician-rated severity scores. In participants ages 13-17, we will also compare responses on the PCSS with those from the Lee cGVHD Symptom Scale, to gauge the youngest age at which adolescent respondents can comprehend this adult measure.

Discussion

This study will yield a well-validated, counterpart measure to the Lee cGVHD Symptom Scale for use in children with cGVHD and their caregiver-proxies. This new patient-reported outcome measure can be integrated into clinical trials and care delivery for pediatric transplant survivors to improve the precision and accuracy with which their cGVHD symptom experience is captured.

Clinical trial registration

www.ClinicalTrials.gov, NCT04044365.

Integration of Daily Patient-Reported Outcome Measures in Pediatric Stem Cell Transplantation

Patients' reports of their health status are increasingly used in hematopoietic stem cell transplantation (SCT) to better understand the negative impact on symptom burden and quality of life. Little is known regarding the implementation in routine clinical care, particularly how it can be used to improve supportive care. We sought to the evaluate feasibility of capturing daily patient-reported outcomes (PROs) in the acute phase of SCT to measure physical and psychosocial symptom burden. In this single-center prospective observational study, we assessed daily PRO from conditioning to neutrophil engraftment in children (age 1 to 18 year) who underwent allogeneic or autologous SCT for malignant and nonmalignant disease. The most common acute adverse effects of chemotherapy (pain, nausea, loss of appetite, sleep disturbance, and physical performance impairment) were reported daily via ePROtect, a web-based program designed to integrate health responses. From February 2021 to March 2023, 20 children undergoing allogeneic (allo-) SCT (n = 11) or autologous (auto-) SCT (n = 9) and their proxies consented to participation, all of whom were included in this analysis. A total of 359 PRO questionnaires were completed, corresponding to a median daily completion rate of 72.7% (interquartile range, 60.4% to 83.6%). After conditioning, pain perception anticipated the rise of infectious parameters and the development of mucositis, thus initiating supportive treatment. Patients reported the strongest symptom burden at a median of 8.5 days post-transplantation. At 4 weeks post-transplantation, baseline values were restored for all symptoms. There were no significant differences between auto-SCT and allo-SCT, except for nausea and loss of appetite after administration of antithymocyte globulin in allo-SCT. This study empirically documents the daily health status of children undergoing SCT and proposes an attractive modus operandi on how continuous feedback on health-related symptoms can be integrated into daily clinical practice.

Including Young Children in the Development and Testing of Patient Reported Outcome (PRO) Instruments: A Scoping Review of Children's Involvement and Qualitative Methods

BACKGROUND

Qualitative research during the development/testing of Patient Reported Outcome Measures (PROMs) is recommended to support content validity. However, it is unclear if and how young children (≤ 7 years) can be involved in this research because of their unique cognitive needs.

OBJECTIVES

Here we investigate the involvement of children (≤ 7 years) in qualitative research for PROM development/testing. This review aimed to identify (1) which stages of qualitative PROM development children ≤ 7 years had been involved in, (2) which subjective health concepts had been explored within qualitative PROM development with this age group, and (3) which qualitative methods had been reported and how these compared with existing methodological recommendations.

METHODS

This scoping review systematically searched three electronic databases (searches re-run prior to final analysis on 29 June 2022) with no date restrictions. Included studies had samples of at least 75% aged ≤ 7 years or reported distinct qualitative methods for children ≤ 7 years in primary qualitative research to support concept elicitation or PROM development/testing. Articles not in English and PROMs that did not enable children ≤ 7 years to self-report were excluded. Data on study type, subjective health and qualitative methods were extracted and synthesised descriptively. Methods were compared with recommendations from guidance.

RESULTS

Of 19 included studies, 15 reported concept elicitation research and 4 reported cognitive interviewing. Most explored quality of life (QoL)/health-related quality of life (HRQoL). Some concept elicitation studies reported that creative/participatory activities had supported children's engagement, but results and reporting detail varied considerably across studies. Cognitive interviewing studies reported less methodological detail and fewer methods adapted for young children compared with concept elicitation studies. They were limited in scope regarding assessments of content validity, mostly focussing on clarity while relevance and comprehensiveness were explored less.

DISCUSSION

Creative/participatory activities may be beneficial in concept elicitation research with children ≤ 7 years, but future research needs to explore what contributes to the success of young children's involvement and how researchers can adopt flexible methods. Cognitive interviews with young children are limited in frequency, scope and reported methodological detail, potentially impacting PROM content validity for this age group. Without detailed reporting, it is not possible to determine the feasibility and usefulness of children's (≤ 7 years) involvement in qualitative research to support PROM development and assessment.