Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation: A systematic review

Quality Appraisal in Systematic Literature Reviews of Studies Eliciting Health State Utility Values: Conceptual Considerations

BACKGROUND

The increasing number of studies that generate health state utility values (HSUVs) and the impact of HSUVs on cost-utility analyses make a robust tailored quality appraisal (QA) tool for systematic reviews of these studies necessary.

OBJECTIVE

This study aimed to address conceptual issues regarding QA in systematic reviews of studies eliciting HSUVs by establishing a consensus on the definitions, dimensions and scope of a QA tool specific to this context.

METHODS

A modified Delphi method was used in this study. An international multidisciplinary panel of seven experts was purposively assembled. The experts engaged in two anonymous online survey rounds. After each round, the experts received structured and controlled feedback on the previous phase. Controlled feedback allowed the experts to re-evaluate and adjust their positions based on collective insights. Following these surveys, a virtual face-to-face meeting was held to resolve outstanding issues. Consensus was defined a priori at all stages of the modified Delphi process.

RESULTS

The response rates to the first-round and second-round questionnaires and the virtual consensus meeting were 100%, 86% and 71%, respectively. The entire process culminated in a consensus on the definitions of scientific quality, QA, the three QA dimensions-reporting, relevance and  methodological quality-and the scope of a QA tool specific to studies that elicit HSUVs.

CONCLUSIONS

Achieving this consensus marks a pivotal step towards developing a QA tool specific to systematic reviews of studies eliciting HSUVs. Future research will build on this foundation, identify QA items, signalling questions and response options, and develop a QA tool specific to studies eliciting HSUVs.

Exploring the Use of Pictorial Approaches in the Development of Paediatric Patient-Reported Outcome Instruments: A Systematic Review

INTRODUCTION

Children may find self-reporting health-related quality of life (HRQoL) using patient-reported outcome measures (PROMs) presented in text-based formats difficult, particularly younger children and children with developmental delays or chronic illness. In such cases, pictorial PROMs (where pictorial representations are used alongside or to replace text) may offer a valid alternative.

AIM

This systematic literature review focused on identifying and describing paediatric PROMs that incorporate pictorial approaches, providing children with more effective means to express their HRQoL.

METHODS

Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed. Seven electronic databases were searched from inception to 1 March 2022. There were no country restrictions applied to the search; all English-language studies were considered for inclusion in the review. Characteristics and development methods of the identified pictorial PROMs were evaluated against context-specific good practice guidelines published by The Professional Society for Health Economics and Outcomes Research (ISPOR).

RESULTS

A total of 22 paediatric pictorial PROMs, comprising 28 unique versions, were identified. These PROMs were predominantly developed in the USA and the UK, targeting children aged 3-18 years. Likert scales with pictorial anchors, particularly happy-sad faces, were commonly used for response options, appearing in 15 (54%) of the PROMs. Various graphic methods, such as happy-sad faces, cartoons, and thermometers, were adapted to specific content domains. These PROMs covered a wide range of domains, including physical and emotional health and social functioning. Emphasis was placed on content validity, including active child participation in developing pictorial elements. Notably, children's participation was sought during the development of the pictorial elements for 13 (46%) of the PROMs. Various development methods were employed, with 43% of paediatric PROMs using literature reviews, 43% using focus groups, and 32% involving expert consultation. Interviews emerged as the primary method, being employed in 61% of the studies. Additionally, three measures specifically addressed cross-cultural considerations.

CONCLUSION

Paediatric pictorial PROMs offer child-friendly tools for assessing HRQoL for application with children who find reading and understanding text-based PROMs challenging. There is some evidence that pictorial PROMs facilitate self-report in this population and improve measurement properties compared to text-only PROMs. Further research is needed to develop, validate, and test paediatric pictorial PROMs, with an emphasis on including children from the inception in the co-design process.

Health-related quality of life and subjective well-being among children aged 9-12 years in Shandong Province, China

PURPOSE

To investigate the health-related quality of life (HRQoL) and subjective well-being (SWB) of children aged 9-12 years in eastern China, and examine concordance within child self-reported and parent proxy-assessed.

METHODS

Data was collected from 9 to 12 years old children (including their parents) in Shandong Province in 2018. Participants self-completed a hard-copy questionnaire including Child Health Utility 9D (CHU9D), Pediatric Quality of Life Inventory (PedsQL)™ 4.0 Short Form 15 Generic Core Scales (hereafter the PedsQL™), Student's Life Satisfaction Scale (SLSS), as well as information on socio-demographic characteristics and self-report health status. Spearman's correlation coefficients and the difference between sub-groups were conducted to assess and compare the agreement on HRQoL and SWB instruments. Exploratory factor analysis (EFA) was used to ascertain the number of unique underlying latent factors that were associated with the items covered by the two generic HRQoL and the SWB instruments. The concordance of child self-reported and parent proxy-assessed was analyzed using weighted kappa coefficient and Bland-Altman plots.

RESULTS

A total of 810 children and 810 parents were invited to participate in the survey. A valid sample of 799 (98.6%) children and 643 (79.4%) parents completed the questionnaire. The child self-reported mean scores were CHU9D = 0.87, PedsQL™ = 83.47, and SLSS = 30.90, respectively. The parent proxy-assessed mean scores were PedsQL™ = 68.61 and SLSS = 31.23, respectively. The child self-reported PedsQL™ was moderately correlated with the CHU9D (r = 0.52). There was a weak correlation between CHU9D and SLSS (r = 0.27). The EFA result found 3 factors whilst seven SLSS items grouped into a standalone factor (factor 3), and the nine dimensions of CHU9D shared two common factors with the PedsQL™ (factor 1 and factor 2). A low level of concordance was observed across all comparisons and in all domains (weighted kappa < 0.20) between parents and their children. Furthermore, a high level of discordance was observed between child self-reported and father proxy-assessed.

CONCLUSIONS

CHU9D and PedsQL™ instruments have a higher agreement in measuring the HRQoL in children. CHU9D/PedsQL™ and SLSS instruments showed a low agreement and EFA result suggested that measuring SWB in children potentially may provide further information, which might be overlooked by using HRQoL instruments exclusively. Concordance of child self-reported and parent proxy-assessed was poor. Overall, mother-child concordance was higher than father-child concordance.

Identifying Relevant Concepts for the Development of a Communicative Participation Item Bank for Children and Adolescents: A Systematic Review of Existing Instruments

PURPOSE

This study aims to systematically identify items that measure communicative participation from measurement instruments that measure (aspects of) communication and/or participation in children and adolescents (5-18 years old) with communication disorders, for developing an item bank.

METHOD

A systematic literature search was performed in MEDLINE and Embase to search for patient-reported outcome measures (PROMs) or parent reports measuring aspects of communication and/or participation in children and adolescents. The individual items of the included measurement instruments were reviewed on whether they measure communicative participation. The items were then classified into one of the International Classification of Functioning, Disability and Health (ICF) for Children and Youth (World Health Organization, 2007) domains of activities and participation.

RESULTS

A total of 29 instruments were found, nine PROMs and 20 parent reports. One hundred forty-five items were identified that measure communicative participation. From these 145 items, 74 were retrieved from PROMs (51%), and 71 were retrieved from parent reports (49%). The majority of items were classified in ICF Domain 7, interpersonal interactions and relationships (73.8%), followed by Domain 8, major life areas (13.8%), and Domain 9, community, social, and civic life (8.3%). Only a few items were found in Domains 5 and 6, and none was found in Domains 1, 2, and 4.

CONCLUSIONS

We identified 145 items potentially useful for developing an item bank addressing communicative participation in children and adolescents with communication disorders. However, item development in collaboration with the target population is needed to ensure that these items fully reflect the construct.

Estimating health state utilities in Duchenne muscular dystrophy using the health utilities index and EQ-5D-5L

BACKGROUND

The progression of Duchenne muscular dystrophy (DMD) is characterized by loss of ambulation, respiratory insufficiency, cardiomyopathy, and early mortality. DMD profoundly impacts health-related quality-of-life (HRQoL). However, few health state utility data exist; published utilities tend to be derived from small samples for a limited number of health states and are often based on caregiver-reported patient health status. This study estimated utility values for varied clinical and functional health states in DMD, based on patient-reported health status.

METHODS

Individuals with DMD in the US aged 12-40 years completed the EQ-5D (5-level) and Health Utilities Index (HUI) preference-based instruments. Based on responses to a clinical questionnaire, participants self-classified into functional health states according to level of lower and upper limb function, use of respiratory support, and presence of cardiomyopathy. Mean [standard deviation (SD)] utility and EQ-5D visual analogue scale (VAS) scores were estimated according to health state; and median (interquartile range) attribute levels calculated to understand which domains of health are most severely affected in DMD.

RESULTS

Of 63 males with DMD, mean (SD) age was 19.8 (6.1) years and 11 (17.5%) were ambulatory. Mean (SD) utility values were 0.92 (0.08; HUI2), 0.84 (0.20; HUI3), and 0.84 (0.13; EQ-5D) for ambulatory patients without cardiomyopathy (n = 10). For non-ambulatory patients with moderately impaired upper limb function, night and daytime ventilation without cardiomyopathy, mean (SD) utilities were 0.49 (0.07) for the HUI2, 0.16 (0.15) for the HUI3 and 025 (0.14) for the EQ-5D. Mean (SD) VAS scores for the same health states were 91 (9) and 83 (21), respectively. In addition to impairments in mobility/ambulation, and self-care, attributes like usual activities and pain also showed notable effects of DMD.

CONCLUSIONS

In DMD, although a relationship between disease progression and HRQoL is observed, there is large variability in utility within functional health states, and across instruments. Utility values for less severe non-ambulatory health states described by level of upper limb function are novel. These utility values, derived based on direct patient feedback rather than from caregiver report, are relevant to individuals of varying functional statuses and augment scarce DMD-specific utility data.

Quality of Life and Audiological Benefits in Pediatric Cochlear Implant Users in Romania: Systematic Review and Cohort Study

Profound sensorineural hearing loss (SNHL) can be successfully treated with a cochlear implant (CI), and treatment is usually accompanied by increased quality of life (QoL). Therefore, the aim of this study was to investigate generic and health-related QoL, as well as the level of audiological outcomes, of CI users, in addition to whether Qol can be restored to the extent of those with normal hearing. Furthermore, different implantation timepoints were compared (early vs. late), and a possible correlation between health and generic QoL questionnaires was investigated. The outcomes from 93 pediatric CI users from Romania were analyzed in the study. Two QoL questionnaires (SSQ12, AQoL-6D), as well as the HSM sentence test and Soundfield measurements, were assessed. The outcomes revealed that the CI users were able to achieve the same QoL as their age- and-gender matched peers with normal hearing, and hearing was restored with good speech comprehension. No significant difference between early- and late-implanted children was detected, although a tendency of a better Word Recognition Score (+10%) in the early-implanted group was discovered. A moderate and significant correlation between the generic and health-related Qol questionnaire was observed. Audiological examinations are still the standard practice by which to measure the benefit of any hearing intervention; nonetheless, generic and health-related QoL should be assessed in order to provide a full picture of a successful and patient-satisfactory cochlear implant procedure.

Psychometric Performance of Generic Childhood Multi-Attribute Utility Instruments in Preterm and Low Birthweight Populations: A Systematic Review

BACKGROUND

Individuals born preterm (gestational age < 37 weeks) and/or at low birthweight (<2500 g) are at increased risk of health impairments from birth to adulthood. This review aimed to evaluate the psychometric performance of generic childhood-specific or childhood-compatible multi-attribute utility instruments (MAUIs) in preterm and/or low birthweight (PLB) populations.

METHODS

Searches covered seven databases, including studies that targeted childhood (aged < 18 years) and/or adult (≥18 years) PLB populations; provided psychometric evidence for generic childhood-specific or compatible MAUI(s) (any language version); and published in English. Eighteen psychometric properties were evaluated using a four-part criteria rating system. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results.

RESULTS

A total of 42 studies were included, generating 178 criteria rating outputs across four MAUIs: 17D, CHSCS-PS, HUI2, and HUI3. Moreover, 64.0% of outputs concerned the HUI3 MAUI, and 38.2% related to known-group validity. There was no evidence for five psychometric properties. Only 6.7% of outputs concerned reliability and proxy-child agreement. No MAUI outperformed others across all properties. The frequently applied HUI2 and HUI3 lacked content validity evidence.

CONCLUSIONS

This psychometric evidence catalogue should inform the selection of MAUI(s) suited to the specific aims of applications targeting PLB populations. Further psychometric research is warranted to address the gaps in psychometric evidence.

Child-Parent Agreement in the Assessment of Health-Related Quality of Life Using the CHU9D and the PedsQLTM

OBJECTIVE

This study examined the inter-rater agreement between child-self and parental proxy health-related quality of life (HRQoL) ratings (overall and domain level) using two different generic child-specific measures, the Child Health Utility 9D (CHU9D) and the Pediatric Quality of Life Inventory (PedsQLTM), in a community-based sample of Australian children. A secondary objective was to investigate the impact of age on child-parent agreement across the dimensions of the two measures.

METHODS

A total of 85 child-parent dyads (children aged 6-12 years) recruited from the community completed the self and proxy versions of the CHU9D and the PedsQLTM, respectively. The inter-rater agreement was estimated using Concordance Correlation Coefficients (CCC) and Gwet's Agreement Coefficient (AC1) for the overall sample and across age-groups.

RESULTS

Agreement was low for overall HRQoL for both the CHU9D (CCC = 0.28) and the PedsQLTM (CCC = 0.39). Across the CHU9D dimensions, agreement was the highest for 'sad' (AC1 = 0.83) and lowest for 'tired' (AC1 = 0.31). The PedsQLTM demonstrated stronger agreement (AC1 = 0.41-0.6) for the physical health dimension but weaker for the psychosocial dimensions (AC1 < 0.4). Except for the 'tired' dimension, agreement was consistent across age-groups with the CHU9D, whilst the PedsQLTM showed poor agreement for most of the psychosocial health items among the older age-groups only (8-10 and 11-12 years).

CONCLUSION

This study highlights that the agreement between child and parent proxy reported HRQoL may be influenced by both the measure used and the age of the child. These findings may have implications for the economic evaluation of healthcare interventions and services in child populations when both child and proxy perspectives are considered in the assessment of child HRQoL.

Psychometric Evaluation of the PedsQL GCS and CHU9D in Australian Children and Adolescents with Common Chronic Health Conditions

BACKGROUND

Generic instruments such as the Pediatric Quality of Life Inventory™ v4.0 Generic Core Scales (PedsQL GCS) and Child Health Utility 9D (CHU9D) are widely used to assess health-related quality of life (HRQOL) of the general childhood population, but there is a paucity of information about their psychometric properties in children with specific health conditions. This study assessed psychometric properties, including acceptability, reliability, validity, and responsiveness, of the PedsQL GCS and the CHU9D in children and adolescents with a range of common chronic health problems.

METHODS

We used data from the Longitudinal Study of Australian Children (LSAC), for children aged 10-17 years with at least one of the following six parent-reported health conditions: asthma, anxiety/depression, attention deficit hyperactivity disorder (ADHD), autism/Asperger's, epilepsy, and type 1 diabetes mellitus. The LSAC used parent proxy-reported PedsQL GCS and child self-reported CHU9D assessments. The performance of each instrument (PedsQL GCS and CHU9D) for each psychometric property (acceptability, reliability, validity, and responsiveness) was assessed against established criteria.

RESULTS

The study sample included 7201 children and adolescents (mean age = 14 years; range 10.1-17.9 years; 49% female) with 15,568 longitudinal observations available for analyses. Across the six health conditions, acceptability of the PedsQL GCS was high, while acceptability for the CHU9D was mixed. Both the PedsQL GCS and CHU9D showed strong internal consistency (Cronbach's alpha range: PedsQL GCS = 0.70-0.95, CHU9D = 0.76-0.84; item-total correlations range: PedsQL GCS = 0.35-0.84, CHU9D = 0.32-0.70). However, convergent validity for both the PedsQL GCS and CHU9D was generally weak (Spearman's correlations ≤ 0.3). Known group validity was strong for the PedsQL GCS (HRQOL differences were detected for children with and without asthma, anxiety/depression, ADHD, autism/Asperger's, and epilepsy). CHU9D was only able to discriminate between children with and without anxiety/depression, ADHD, and autism/Asperger's. The responsiveness of both the PedsQL GCS and CHU9D was variable across the six conditions, and most of the estimated effect sizes were relatively small (< 0.5).

CONCLUSION

This study expands the evidence base of psychometric performance of the PedsQL GCS and CHU9D and can aid in appropriate HRQOL instrument selection for the required context by researchers and clinicians.

Emotional and behavioral problems of pediatric cancer survivors and their siblings: Concordance of child self-report and parent proxy-report

OBJECTIVE

Childhood cancer confronts families with major challenges. The study aimed at developing an empirical and multi-perspective understanding of emotional and behavioral problems of cancer survivors diagnosed with leukemia and brain tumors and their siblings. Further, the concordance between child self-report and parent proxy-report was examined.

METHODS

140 children (72 survivors, 68 siblings) and 309 parents were included in the analysis (respond rate: 34%). Patients, diagnosed with leukemia or brain tumors, and their families were surveyed on average 7.2 months after the end of intensive therapy. Outcomes were assessed using the German SDQ. Results were compared with normative samples. Data were analyzed descriptively, and group differences between survivors, siblings, and a norm sample were determined using one-factor ANOVA followed by pairwise comparisons. The concordance between the parents and children was determined by calculating Cohen's kappa coefficient.

RESULTS

No differences in the self-report of survivors and their siblings were identified. Both groups reported significantly more emotional problems and more prosocial behavior than the normative sample. Although the interrater reliability between parents and children was mostly significant, low concordances were found for emotional problems, prosocial behavior (survivor/parents), and peer relationship problems (siblings/parents).

CONCLUSION

The findings point out the importance of psychosocial services in regular aftercare. These should not only focus on survivors, but additionally address the siblings' needs. The low concordance between the parents' and the children's perspectives on emotional problems, prosocial behavior, and peer relationship problems suggests the inclusion of both perspectives to allow needs-based support.

The Quality of Life of Children Facing Life-Limiting Conditions and That of Their Parents in Belgium: A Cross-Sectional Study

BACKGROUND

Paediatric palliative care (PPC) aims to improve children's quality of life, but this outcome is rarely measured in clinical care. PPC is provided in Belgium through six transmural paediatric liaison teams (PLTs) ensuring continuity of care for children with life-limiting or life-threatening conditions (LLC/LTC). This study aims to measure the quality of life (QoL) of children with LLC/LTC followed-up by PLTs and the QoL of their parents.

METHODS

During interviews, an original socio demographic questionnaire, the Children palliative outcome scale-version 2 (CPOS-2), the Fragebogen für Kinder und Jugendliche zur Erfassung der gesundheitsbezogenen Lebensqualität (KINDL) and the Quality of life in life-threatening Illness-Family caregiver (QOLLTI-F) were filled in by PLT members. Statistics were used to investigate significant differences between scores. Results were discussed and interpreted with six PLTs.

RESULTS

73 children aged 1-18 were included in the study. Especially for items focusing on emotional items, children reported their QoL as higher than their parents did. The QoL scores were not significantly associated with the child's condition's severity.

CONCLUSIONS

This study provides, for the first time, an overview of the QoL of children and parents followed-up by PLTs in Belgium.

Psychometric evaluation of the traditional chinese version of PedsQL™ 3.0 cardiac module scale in adolescents with congenital heart disease: reliability, validity, measurement invariance, and adolescent-parent agreement

BACKGROUND

In recent decades, 95% of children with congenital heart disease (CHD) can survive to adolescence and adulthood. However, adolescents with CHD are prone to poorer health-related quality of life (HRQoL). It is imperative to develop a reliable and valid instrument for health professionals to monitor the HRQoL. This study aims to: (1) evaluate the psychometric properties of the traditional Chinese version of Pediatric Quality of Life™ 3.0 Cardiac Module (PedsQL-CM) and measurement invariance across adolescents with CHD and their parents; and (2) investigate the adolescent-parent agreement in HRQoL.

METHODS

A total of 162 adolescents and 162 parents were recruited. Internal consistency was examined using Cronbach's alpha and McDonald's Omega. The criterion-related validity was evaluated with intercorrelations between the PedsQL-CM and PedsQL™ 4.0 Generic Core (PedsQL-GC) Scale. The construct validity was examined by second-order confirmatory factor analysis (CFA). Measurement invariance was evaluated using the multi-group CFA. The adolescent-parent agreement was analyzed with the intraclass correlation (ICC), paired t-tests, and Bland-Altman plots.

RESULTS

PedsQL-CM showed acceptable internal consistency (self-reports 0.88, proxy-reports 0.91). The intercorrelations were medium to large effect size (self-reports 0.34-0.77, proxy-reports 0.46-0.68). The CFA supported the construct validity (CFI = 0.967, TLI = 0.963, RMSEA = 0.036, 90% CI = 0.026-0.046, SRMR = 0.065). The multi-group CFA proved scalar invariance between self and parent proxy-reports. Parents significantly underestimated their adolescents' HRQoL in cognitive problems (Cohen's d = 0.21) and communication (Cohen's d = 0.23) subscales, while there was a negligible difference in total HRQoL (Cohen's d = 0.16). ICCs were poor to moderate effect size with the highest and lowest agreement in heart problems and treatment subscale (ICC = 0.70) and communication subscale (ICC = 0.27), respectively. The Bland-Altman plots showed lesser variability in the heart problem and treatment subscale and the total scale.

CONCLUSION

The traditional Chinese version of PedsQL-CM has acceptable psychometric properties to measure disease-specific HRQoL in adolescents with CHD. Parents may be proxies for adolescents with CHD to rate total HRQoL. When the patient-reported score is the primary outcome, the proxy-reported score could serve as a secondary outcome for research and clinical evaluation.

Systematic Review of the Psychometric Performance of Generic Childhood Multi-attribute Utility Instruments

BACKGROUND

Childhood multi-attribute utility instruments (MAUIs) can be used to measure health utilities in children (aged ≤ 18 years) for economic evaluation. Systematic review methods can generate a psychometric evidence base that informs their selection for application. Previous reviews focused on limited sets of MAUIs and psychometric properties, and only on evidence from studies that directly aimed to conduct psychometric assessments.

OBJECTIVE

This study aimed to conduct a systematic review of psychometric evidence for generic childhood MAUIs and to meet three objectives: (1) create a comprehensive catalogue of evaluated psychometric evidence; (2) identify psychometric evidence gaps; and (3) summarise the psychometric assessment methods and performance by property.

METHODS

A review protocol was registered with the Prospective Register of Systematic Reviews (PROSPERO; CRD42021295959); reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline. The searches covered seven academic databases, and included studies that provided psychometric evidence for one or more of the following generic childhood MAUIs designed to be accompanied by a preference-based value set (any language version): 16D, 17D, AHUM, AQoL-6D, CH-6D, CHSCS-PS, CHU9D, EQ-5D-Y-3L, EQ-5D-Y-5L, HUI2, HUI3, IQI, QWB, and TANDI; used data derived from general and/or clinical childhood populations and from children and/or proxy respondents; and were published in English. The review included 'direct studies' that aimed to assess psychometric properties and 'indirect studies' that generated psychometric evidence without this explicit aim. Eighteen properties were evaluated using a four-part criteria rating developed from established standards in the literature. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results by property.

RESULTS

Overall, 372 studies were included, generating a catalogue of 2153 criteria rating outputs across 14 instruments covering all properties except predictive validity. The number of outputs varied markedly by instrument and property, ranging from 1 for IQI to 623 for HUI3, and from zero for predictive validity to 500 for known-group validity. The more recently developed instruments targeting preschool children (CHSCS-PS, IQI, TANDI) have greater evidence gaps (lack of any evidence) than longer established instruments such as EQ-5D-Y, HUI2/3, and CHU9D. The gaps were prominent for reliability (test-retest, inter-proxy-rater, inter-modal, internal consistency) and proxy-child agreement. The inclusion of indirect studies (n = 209 studies; n = 900 outputs) increased the number of properties with at least one output of acceptable performance. Common methodological issues in psychometric assessment were identified, e.g., lack of reference measures to help interpret associations and changes. No instrument consistently outperformed others across all properties.

CONCLUSION

This review provides comprehensive evidence on the psychometric performance of generic childhood MAUIs. It assists analysts involved in cost-effectiveness-based evaluation to select instruments based on the application-specific minimum standards of scientific rigour. The identified evidence gaps and methodological issues also motivate and inform future psychometric studies and their methods, particularly those assessing reliability, proxy-child agreement, and MAUIs targeting preschool children.

Assessing Outcomes for Cost-Utility Analysis in Children and Adolescents With Mental Health Problems: Are Multiattribute Utility Instruments Fit for Purpose?

OBJECTIVES

The objective of this study was to compare the concurrent and construct validity, as well as the sensitivity of 5 multiattribute utility instruments (MAUIs), including the Assessment of Quality of Life-6D (AQoL-6D), EQ-5D-Y, Health Utilities Index (HUI)-2 and HUI-3, and the Child Health Utility 9D, 1 generic pediatric quality of life instrument, with 3 routinely collected outcome measures in Australian mental health services (Strengths and Difficulties Questionnaire, Clinical Global Assessment Scale [CGAS] and the Health of the Nation Outcome Scale for Children and Adolescents) in children and adolescents diagnosed of internalizing (eg, anxiety/depression), externalizing (eg, attention deficit hyperactivity disorder/conduct disorders), and trauma/stress related mental disorders.

METHODS

A cross-sectional survey of measures, including demographic and basic treatment information, in children/adolescents recruited via 5 child and youth mental health services in Queensland and Victoria, Australia. Measures were either proxy or self-report completed, the CGAS and the Health of the Nation Outcome Scale for Children and Adolescents were clinician completed.

RESULTS

The sample included 426 participants and had a mean age of 13.7 years (range 7-18 years). Utilities (as calculated from MAUIs) were generally lower in older adolescents and those with internalizing disorders. All MAUIs and self-reported clinical measures significantly correlated with each other (absolute correlation range 0.40-0.90), with the AQoL-6D showing generally higher levels of correlations. Correlations between the MAUIs and clinician/proxy-reported measures were weak, regardless of diagnosis (absolute correlation range 0.09-0.47). Generally, EQ-5D-Y, HUI-2, and AQoL-6D were more sensitive than Child Health Utility 9D and HUI-3 when distinguishing between different severities according to clinician-assessed CGAS (effect size range 0.17-0.84).

CONCLUSIONS

The study showed that the commonly used MAUIs had good concurrent and construct validity compared with routinely used self-complete measures but poor validity when compared with clinician/proxy-completed measures. These findings generally held across different diagnoses.

Comparative evaluation of the health utilities index mark 3 and the short form 6D: evidence from an individual participant data meta-analysis of very preterm and very low birthweight adults

BACKGROUND

The most appropriate preference-based health-related quality of life (HRQoL) instruments for trials or research studies that ascertain the consequences of individuals born very preterm and/or low birthweight (VP/VLBW) are not known. Agreement between the HUI3 and SF-6D multi-attribute utility measures have not been previously investigated for VP/VLBW and normal birthweight or term-born controls. This study examined the agreement between the outputs of the HUI3 and SF-6D measures among adults born VP/VLBW and normal birthweight or term born controls.

METHODS

We used two prospective cohorts of individuals born VP/VLBW and controls contributing to the 'Research on European Children and Adults Born Preterm' (RECAP) consortium which assessed HRQoL using two preference-based measures. The combined dataset of individual participant data (IPD) included 407 adult VP/VLBW survivors and 367 controls, ranging in age from 18 to 26 years. Bland-Altman plots, intra-class correlation coefficients, and generalized linear mixed models in a one-step approach were used to examine agreement between the measures.

RESULTS

There was significant discordance between the HUI3 and SF-6D multi-attribute utility measures in the VP/VLBW sample, controls, and in the combined samples. Agreement between the HUI3 and SF-6D multi-attribute utility measures was weaker in controls compared with VP/VLBW individuals.

CONCLUSIONS AND RELEVANCE

The HUI3 and SF-6D each provide unique information on different aspects of health status across the groups. The HUI3 better captures preterm-related changes to HRQoL in adulthood compared to SF-6D. Studies focused on measuring physical or cognitive aspects of health will likely benefit from using the HUI3 instead of the SF-6D, regardless of gestational age at birth and birthweight status.

Health utility of children with acute lymphoblastic leukemia in China

Background

Acute lymphoblastic leukemia is the most common cancer in children. As the 5-year survival rate has been improved to over 80%, more emphasis is now placed on reducing therapy toxicities and enhancing health-related quality of life (HRQoL) of patients during treatment. Our objective was to measure health utility of pediatric acute lymphoblastic leukemia (pALL) patients in China, examine utility weights of different treatment phases and influencing factors of health utility, as well as identify which aspects of HRQoL were most impaired.

Methods

A cross-sectional study was conducted in Shanghai Children's Medical Center (SCMC) Affiliated to Shanghai Jiao Tong University School of Medicine in China from April to November 2021. Primary caregivers of 247 patients completed the assessment by CHU9D-CHN and health utility scores were computed for all the patients and stratified by treatment phases. Various multivariable models were constructed and the best was chosen to identify independent factors associated with utility scores. Factors affecting the most impaired dimensions were also examined.

Results

The overall mean (SD) health utility score was 0.79 (±0.17) and significantly increased from induction (0.73 [±0.19], P < 0.001) to consolidation (0.74 [±0.18]), and to maintenance (0.82 [±0.16]). After adjusting for potentially influencing factors, utility scores in induction (Beta = -0.086, P = 0.005) and consolidation (Beta = -0.074, P = 0.043) were constantly lower than those during maintenance. In item-level analysis, lower age and induction phase were found to be significantly associated with high severity reported on the "school work/homework" dimension. Additionally, only the induction phase (vs. maintenance, OR = 2.24, P = 0.016) was independently associated with the high severity level reported on the "able to join in activities" dimension.

Conclusions

This is the first study that measured health utility of children with pALL in China. Mean health utility scores increased from induction to maintenance. These provided important utility estimates that help inform future health economic models. The phrasing of "School work/homework" in CHU9D-CHN could be further improved. More efforts are needed to design and implement specific interventions targeting at the dimension "able to join in activities" for enhancing HRQoL of children with pALL in China.

Are We Agreed? Self- Versus Proxy-Reporting of Paediatric Health-Related Quality of Life (HRQoL) Using Generic Preference-Based Measures: A Systematic Review and Meta-Analysis

OBJECTIVE

The aim of this study was to examine the level of agreement between self- and proxy-reporting of health-related quality of life (HRQoL) in children (under 18 years of age) using generic preference-based measures.

METHODS

A systematic review of primary studies that reported agreement statistics for self and proxy assessments of overall and/or dimension-level paediatric HRQoL using generic preference-based measures was conducted. Where available, data on intraclass correlation coefficients (ICCs) were extracted to summarise overall agreement levels, and Cohen's kappa was used to describe agreement across domains. A meta-analysis was also performed to synthesise studies and estimate the level of agreement between self- and proxy-reported paediatric overall and domain-level HRQoL.

RESULTS

Of the 30 studies included, 25 reported inter-rater agreement for overall utilities, while 17 reported domain-specific agreement. Seven generic preference-based measures were identified as having been applied: Health Utilities Index (HUI) Mark 2 and 3, EQ-5D measures, Child Health Utility 9 Dimensions (CHU9D), and the Quality of Well-Being (QWB) scale. A total of 45 dyad samples were included, with a total pooled sample of 3084 children and 3300 proxies. Most of the identified studies reported a poor inter-rater agreement for the overall HRQoL using ICCs. In contrast to more observable HRQoL domains relating to physical health and functioning, the inter-rater agreement was low for psychosocial-related domains, e.g., 'emotion' and 'cognition' attributes of both HUI2 and HUI3, and 'feeling worried, sad, or unhappy' and 'having pain or discomfort' domains of the EQ-5D. Parents demonstrated a higher level of agreement with children relative to health professionals. Child self- and proxy-reports of HRQoL showed lower agreement in cancer-related studies than in non-cancer-related studies. The overall ICC from the meta-analysis was estimated to be 0.49 (95% confidence interval 0.34-0.61) with poor inter-rater agreement.

CONCLUSION

This study provides evidence from a systematic review of studies reporting dyad assessments to demonstrate the discrepancies in inter-rater agreement between child and proxy reporting of overall and domain-level paediatric HRQoL using generic preference-based measures. Further research to drive the inclusion of children in self-reporting their own HRQoL wherever possible and limiting the reliance on proxy reporting of children's HRQoL is warranted.

A Systematic Review of International Guidance for Self-Report and Proxy Completion of Child-Specific Utility Instruments

OBJECTIVES

This study aimed to identify and summarize published guidance and recommendations for child self- and proxy assessment of existing child-specific instruments of health-related quality of life (HRQoL) that are accompanied by utilities.

METHODS

A total of 9 databases plus websites of (1) health technology assessment and health economics outcomes research organizations and (2) instrument developers were systematically searched. Studies were included if they reported guidance for child self- and proxy assessment for child populations (0-18 years old). Three reviewers independently screened titles, abstracts, and full-text reviews against the inclusion criteria. Key features of the guidance identified were summarized.

RESULTS

A total of 19 studies met the inclusion criteria. In general, journal articles provided little guidance on child self- and proxy assessment, with the majority focused on instrument development and psychometric performance more broadly. Instrument developers' websites provided more guidance for child self- and proxy reports with specific guidance found for the EQ-5D-Y and the Pediatric Quality of Life Inventory. This guidance included the minimum age for self-report and mode of administration; recommended proxy types, age range of child for whom proxy report can be completed, and target population; and recall period. Websites of leading organizations provided general guidance on HRQoL evaluation in children but lacked specific guidance about self- and proxy completion.

CONCLUSIONS

EQ-5D-Y and Pediatric Quality of Life Inventory developers' websites provided the most comprehensive guidance for self-report and proxy report of their respective instruments. More evidence is required for developing best practice guidance on why, when, and how to use self- and proxy reports in assessing HRQoL in child populations.

Economic costs and health utility values associated with extremely preterm birth: Evidence from the EPICure2 cohort study

BACKGROUND

Preterm birth is associated with adverse health and developmental sequelae that impose a burden on finite resources and significant challenges for individuals, families and societies.

OBJECTIVES

To estimate economic outcomes at age 11 associated with extremely preterm birth using evidence from a whole population study (EPICure2 study).

METHODS

The study population comprised a sample of children born at ≤26 completed weeks of gestation during 2006 in England (n = 200) and a comparison group of classmates born at term (n = 143). Societal costs were estimated using parent and teacher reports of service utilisation, and valuations of work losses and additional care costs to families. Utility scores for the Health Utilities Index Mark 2 (HUI2) and Mark 3 (HUI3) were generated using UK and Canadian value sets. Generalised linear regression was used to estimate the impact of extremely preterm birth on societal costs and utility scores.

RESULTS

Unadjusted mean societal costs that excluded provision of special educational support in mainstream schools during the 11th year after birth were £6536 for the extremely preterm group and £3275 for their classmates, generating a difference of £3262 (95% confidence interval [CI] £1912, £5543). The mean adjusted cost difference was £2916 (95% CI £1609, £4224), including special educational needs provision in mainstream schools increased the adjusted cost difference to £4772 (95% CI £3166, £6378). Compared with birth at term, extremely preterm birth generated mean-adjusted utility decrements ranging from 0.13 (95% CI 0.09, 0.18) based on the UK HUI2 statistical inference tariff to 0.28 (95% CI 0.18, 0.37) based on the Canadian HUI3 tariff.

CONCLUSIONS

The adverse economic impact of extremely preterm birth persists into late childhood. Further longitudinal studies conducted from multiple perspectives are needed to understand the magnitude, trajectory and underpinning mechanisms of economic outcomes following extremely preterm birth.

A modified video-feedback intervention for carers of foster children aged 6 years and under with reactive attachment disorder: a feasibility study and pilot RCT

BACKGROUND

Looked-after children are at risk of suboptimal attachment patterns and reactive attachment disorder. However, access to interventions varies widely and there are no evidence-based interventions for this disorder.

OBJECTIVES

(1) To adapt an existing video-feedback intervention to meet the specific needs of foster children in the UK with reactive attachment symptoms, (2) to conduct a case series to road-test the treatment manual and study procedures, (3) to conduct a scoping study of the key hurdles in a pilot trial and (4) to conduct a pilot randomised controlled trial of the adapted intervention to determine the feasibility of a future full-scale trial.

DESIGN

This was a mixed-methods study. The adapted treatment manual was developed with expert input and tested on a small case series. Qualitative interviews with key stakeholders were used in the scoping study in preparation for the trial and later with foster carers who received the new intervention. The final stage was a feasibility and pilot randomised controlled trial of the new intervention, compared with usual care. Researchers assessing the outcomes were blinded to group assignment.

SETTING

The study was set in outpatient child and adolescent mental health services and partner social services departments. Sites included urban and rural/semirural areas.

PARTICIPANTS

Participants were foster carers with children aged ≤ 6 years presenting with difficulties in the domain of reactive attachment disorder. Key stakeholders included children's services managers and mental health service practitioners in the scoping study. Foster carers who received the modified intervention participated in qualitative interviews.

INTERVENTION

The video-feedback intervention to promote positive parenting and sensitive discipline is an extensively evaluated and effective treatment approach. This intervention was modified (based on the adapted version for foster care in the Netherlands) to suit the needs of young children with reactive attachment symptoms in foster care in the UK and was delivered to improve the sensitive responding of foster carers, foster carer-child relationships and child outcomes. The modified intervention was delivered in-home by trained mental health professionals over a period of 4-6 months.

MAIN OUTCOME MEASURE

The main outcome was reactive attachment symptom scores on the Disturbances of Attachment Interview.

RESULTS

A series of minor changes to the intervention programme were introduced, which focused on improving its suitability for the UK foster care context. Challenges in recruitment meant that, despite numerous modifications to the protocol and the inclusion of additional sites, only 30 families (target, n = 40) were recruited to the randomised controlled trial (15 allocated to each group). However, most other trial parameters were deemed feasible and acceptable, particularly the high levels of data and treatment completeness. All randomised families were available for baseline analyses, but two in the treatment arm were not available for post-treatment analyses. The revised intervention was positively received by practitioners and foster carers.

LIMITATIONS

Only three-quarters of the target sample size was recruited. Furthermore, the sites' own exclusion of potential participants and the low return rates of screening questionnaires raise the possibility of non-randomness of non-responses.

CONCLUSION

A larger-scale trial may be feasible, but only if recruitment barriers can be overcome. Dedicated resources to support recruitment within local authorities and wider inclusion criteria are recommended. Central resourcing of intervention capacity to supplement NHS staff is also recommended.

TRIAL REGISTRATION

This trial is registered as ISRCTN18374094.

FUNDING

This project was funded by the National Institute for Health and Care Research ( NIHR ) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 35. See the NIHR Journals Library website for further project information.

Preference Elicitation Techniques Used in Valuing Children's Health-Related Quality-of-Life: A Systematic Review

BACKGROUND AND OBJECTIVES

Valuing children's health states for use in economic evaluations is globally relevant and is of particular relevance in jurisdictions where a cost-utility analysis is the preferred form of analysis for decision making. Despite this, the challenges with valuing child health mean that there are many remaining questions for debate about the approach to elicitation of values. The aim of this paper was to identify and describe the methods used to value children's health states and the specific issues that arise in the use of these methods.

METHODS

We conducted a systematic search of electronic databases to identify studies published in English since 1990 that used preference elicitation methods to value child and adolescent (under 18 years of age) health states. Eligibility criteria comprised valuation studies concerning both child-specific patient-reported outcome measures and child health states defined in other ways, and methodological studies of valuation approaches that may or may not have yielded a value set algorithm.

RESULTS

A total of 77 eligible studies were identified from which data on country setting, aims, condition (general population or clinically specific), sample size, age of respondents, the perspective that participants were asked to adopt, source of values (respondents who completed the preference elicitation tasks) and methods questions asked were extracted. Extracted data were classified and evaluated using narrative synthesis methods. The studies were classified into three groups: (1) studies comparing elicitation methods (n = 30); (2) studies comparing perspectives (n = 23); and (3) studies where no comparisons were presented (n = 26); selected studies could fall into more than one group. Overall, the studies varied considerably both in methods used and in reporting. The preference elicitation tasks included time trade-off, standard gamble, visual analogue scaling, rating/ranking, discrete choice experiments, best-worst scaling and willingness to pay elicited through a contingent valuation. Perspectives included adults' considering the health states from their own perspective, adults taking the perspective of a child (own, other, hypothetical) and a child/adolescent taking their own or the perspective of another child. There was some evidence that children gave lower values for comparable health states than did adults that adopted their own perspective or adult/parents that adopted the perspective of children.

CONCLUSIONS

Differences in reporting limited the conclusions that can be formed about which methods are most suitable for eliciting preferences for children's health and the influence of differing perspectives and values. Difficulties encountered in drawing conclusions from the data (such as lack of consensus and poor reporting making it difficult for users to choose and interpret available values) suggest that reporting guidelines are required to improve the consistency and quality of reporting of studies that value children's health using preference-based techniques.

Do we agree or disagree? A systematic review of the application of preference-based instruments in self and proxy reporting of quality of life in older people

PURPOSE

Quality of life is an important person-centred outcome in health and aged care settings. Due to an increasing prevalence of cognitive decline and dementia in ageing populations, a proportion of older people receiving health and aged care services may not be able to reliably assess their own quality of life, highlighting the need for proxy assessment. This systematic review sought to investigate the level of agreement between self and proxy-report of older people's quality of life using established preference-based instruments of quality of life suitable for economic evaluation.

METHODS

A systematic review was conducted following PRISMA guidelines. Eight databases were searched: Web of Science, Scopus, Medline, Econlit, PsychINFO, CINAHL, Ageline and Cochrane Library. Information was extracted on the instruments, population samples (including any cognitive thresholds applied), mean scores, type of proxy, and measures of inter-rater agreement.

RESULTS

A total of 50 studies using eight different preference-based quality of life instruments were identified. Most studies were cross-sectional (72%) with a wide variety of cognitive assessments and thresholds applied to define older participants with cognitive impairment. The most common proxies were family members, mostly spouses. The level of agreement between self and proxy-report was generally poor - irrespective of the instrument applied or type of proxy - with proxy-report generally indicating lower levels of quality of life than self-report. There was some evidence of stronger agreement on more observable quality of life domains e.g., physical health and mobility, relative to less observable domains e.g. emotional well-being. Few studies tracked self and/or proxy-report of quality of life longitudinally.

CONCLUSIONS

More research is needed to develop evidence to inform guidance on self-report versus proxy-report of quality of life for older people receiving health and aged care services. Until then, the collection of both self and proxy reports as complementary measures is indicated.

Cost-effectiveness of a transdiagnostic psychotherapy program for youth with common mental health problems

OBJECTIVES

Our objective was to evaluate the cost-effectiveness of the transdiagnostic psychotherapy program Mind My Mind (MMM) for youth with common mental health problems using a cost-utility analysis (CUA) framework and data from a randomized controlled trial. Furthermore, we analyzed the impact of the choice of informant for both quality-of-life reporting and preference weights on the Incremental Cost-Effectiveness Ratio (ICER).

METHODS

A total of 396 school-aged (6-16 years) youth took part in the 6-month trial carried out in Denmark. CUAs were carried out for the trial period and four one-year extrapolation scenarios. Costs were based on a combination of budget and self-reported costs. Youths and parents were asked to report on the youth's quality-of-life three times during the trial using the Child Health Utility 9D (CHU9D). Parental-reported CHU9D was used in the base case together with preference weights of a youth population. Analyses using self-reported CHU9D and preference weights of an adult population were also carried out.

RESULTS

The analysis of the trial period resulted in an ICER of €170,465. The analyses of the one-year scenarios resulted in ICERs between €23,653 and €50,480. The ICER increased by 24% and 71% compared to the base case when using self-reported CHU9D and adult preference weights, respectively.

CONCLUSION

The MMM intervention has the potential to be cost-effective, but the ICER is dependent on the duration of the treatment effects. Results varied significantly with the choice of informant and the choice of preference weights indicating that both factors should be considered when assessing CUA involving youth.

Measuring health-related quality of life measures in children: lessons from a pilot study

There is a debate in the health outcomes literature regarding who the most appropriate respondent is when assessing children’s health-related quality of life (HRQoL). In some cases, parent-proxy may be the only practical option where children are unable to self-complete an HRQoL questionnaire. However, children’s self-reported values may be preferable because HRQoL is subjective and represents the respondent own perception of health. We collected the youth version of the EQ-5D-3L as part of a feasibility study comparing psychoanalytic child psychotherapy with usual care for children aged 5-11 years with treatment resistant conduct disorders. The questionnaires were completed at baseline and 4-month follow-up by the child via face-to-face researcher administration, and by one parent as a proxy respondent. We present percentages of completion at each time-point and investigate the level of agreement between child and proxy-respondent on the child’s health. About two thirds of children (65.5%) were able to complete the EQ-5D-Y at baseline and 34.4% at follow-up. Children and primary carers were mostly concordant regarding overall child’s health. Parents reported more problems in ‘doing usual activities’ and ‘feeling worried, sad or unhappy’ and fewer problems with ‘pain’ and ‘looking after oneself’ than children did. The reports regarding ‘mobility’ were very similar between children and proxy-respondents. The assessment of quality of life by children using selfreport questionnaires is possible with the help of a face-to-face researcher, providing evidence that children should be asked to self-complete HRQoL questionnaires in trial studies.

Systematic Review of Conceptual, Age, Measurement and Valuation Considerations for Generic Multidimensional Childhood Patient-Reported Outcome Measures

BACKGROUND AND AIMS

Patient-reported outcome measures (PROMs) for children (aged ≤ 18 years) present methodological challenges. PROMs can be categorised by their diverse underlying conceptual bases, including functional, disability and health (FDH) status; quality of life (QoL); and health-related quality of life (HRQoL). Some PROMs are designed to be accompanied by preference weights. PROMs should account for childhood developmental differences by incorporating age-appropriate health/QoL domains, guidance on respondent type(s) and design. This systematic review aims to identify generic multidimensional childhood PROMs and synthesise their characteristics by conceptual basis, target age, measurement considerations, and the preference-based value sets that accompany them.

METHODS

The study protocol was registered in the Prospective Register of Systematic Reviews (CRD42021230833), and reporting followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We conducted systematic database searches for generic multidimensional childhood PROMs covering the period 2012-2020, which we combined with published PROMs identified by an earlier systematic review that covered the period 1992-2011. A second systematic database search identified preference-based value sets for generic multidimensional PROMs. The PROMs were categorised by conceptual basis (FDH status, QoL and HRQoL) and by target age (namely infants and pre-schoolers aged < 5 years, pre-adolescents aged 5-11, adolescents aged 12-18 and multi-age group coverage). Descriptive statistics assessed how PROM characteristics (domain coverage, respondent type and design) varied by conceptual basis and age categories. Involvement of children in PROM development and testing was assessed to understand content validity. Characteristics of value sets available for the childhood generic multidimensional PROMs were identified and compared.

RESULTS

We identified 89 PROMs, including 110 versions: 52 FDH, 29 QoL, 12 HRQoL, nine QoL-FDH and eight HRQoL-FDH measures; 20 targeted infants and pre-schoolers, 29 pre-adolescents, 24 adolescents and 37 for multiple age groups. Domain coverage demonstrated development trajectories from observable FDH aspects in infancy through to personal independence and relationships during adolescence. PROMs targeting younger children relied more on informant report, were shorter and had fewer ordinal scale points. One-third of PROMs were developed following qualitative research or surveys with children or parents for concept elicitation. There were 21 preference-based value sets developed by 19 studies of ten generic multidimensional childhood PROMs: seven were based on adolescents' stated preferences, seven were from adults from the perspective of or on behalf of the child, and seven were from adults adopting an adult's perspective. Diverse preference elicitation methods were used to elicit values. Practices with respect to anchoring values on the utility scale also varied considerably. The range and distribution of values reflect these differences, resulting in value sets with notably different properties.

CONCLUSION

Identification and categorisation of generic multidimensional childhood PROMs and value sets by this review can aid the development, selection and interpretation of appropriate measures for clinical and population research and cost-effectiveness-based decision-making.

Methodological challenges surrounding QALY estimation for paediatric economic evaluation

Cost-utility analysis remains the preferred form of economic evaluation for health technology assessment, pricing and reimbursement authorities in several countries. The results of cost-utility analyses are commonly expressed in terms of incremental cost per quality-adjusted life year (QALY) gained where the QALY combines length of life and health-related quality of life in a single metric. This commentary provides an overview of key methodological challenges surrounding QALY estimation for paediatric economic evaluation. These challenges include issues surrounding the relevant attributes to incorporate into measurement instruments, appropriate respondents for the measurement and valuation tasks, perspectives adopted when completing valuation tasks, potential sources of bias in the description and valuation processes, and the paucity of psychometric evidence for existing measures. In addition, the commentary considers methodological challenges raised by research aimed at assessing whether a QALY gain by a child should be valued equally to a QALY gain by an adult.

Assessing the relative importance of key quality of life dimensions for people with and without a disability: an empirical ranking comparison study

Background

In economic evaluation, the quality of life of people with a disability has traditionally been assessed using preference-based instruments designed to measure and value quality of life. To provide robust measurement of the effectiveness of programs designed to improve the quality of life of people living with a disability, preference-based measures need to be sufficiently sensitive to detect incremental changes in the quality of life dimensions that are most important to people who have a disability. This study sought to explore whether there was a difference in the ranked order of importance of quality of life dimensions between people with a disability and people without a disability.

Methods

An online survey was developed and administered Australia wide. The first sample (n = 410) comprised adults (aged ≥ 18 years) with a disability (n = 208) and family carers of person/s with a disability who were asked to respond on behalf of the person with a disability (n = 202). The second sample included adults without disability (n = 443). Respondents were asked to rank the importance of 12 quality of life dimensions extracted from the content of established preference-based quality of life measures (EQ-5D, AQoL and ASCOT).

Results

People with a disability placed relatively higher importance on broader quality of life dimensions (e.g. Control, Independence, Self-care) relative to health status focused dimensions (e.g. Vision, Hearing, Physical mobility). This distinction was less differentiable for those ‘without a disability’. The biggest differences in ranked importance of dimensions were in: Vision (‘with disability’ = 10th, ‘without disability’ = 4th), Self-care (‘with disability’ = 3rd, ‘without disability’ = 7th) and Mental well-being (‘with disability’ = 6th, ‘without disability’ = 2nd).

Conclusions

The relative importance of quality of life dimensions for people with a disability differs to people without a disability. Quality of life is a key outcome for economic evaluation and for assessing the impact of disability care policy and practice in Australia and internationally. It is important that the effectiveness of interventions is measured and valued in ways which are fully reflective of the quality of life preferences of people with a disability.

International guidelines for self-report and proxy completion of paediatric health-related quality of life measures: a protocol for a systematic review

INTRODUCTION

Measures of health-related quality of life (HRQoL), accompanied by the values (or utilities) required to estimate quality-adjusted life-years, are crucial for determining health benefits within economic evaluation and health technology assessment. Several generic and condition-specific measures or instruments of HRQoL, accompanied by values, currently exist for application with child populations. However, there is a lack of a structured summary of guidelines and recommendations for applying these measures in practice. This protocol describes a systematic review of guidelines and recommendations for child and proxy completion of child-specific measures of HRQoL. The aims of the review are to (1) identify and summarise published guidelines and recommendations for existing child-specific measures of HRQoL, (2) determine whether the identified guidelines and recommendations differ by instrument and child characteristics, (3) identify current gaps in these guidelines and recommendations and (4) identify best practices for child self and proxy assessment in paediatric HRQoL measurement for economic evaluation and health technology assessment.

METHODS AND ANALYSIS

The review will identify, collate and synthesise published guidelines and recommendations for existing child-specific utility measures of HRQoL. Electronic databases to be searched include the Cochrane Library, Medline, Scopus, Web of Science, EconLit, PsycINFO, CINAHL, Embase and Informit. The search will be extended to websites of (1) international organisations for health technology assessment, (2) regulation, health economics and HRQoL outcomes research and (3) instrument developers. Three reviewers will independently screen titles and abstracts against the inclusion criteria. A narrative synthesis will describe the key features of the guidelines identified.

ETHICS AND DISSEMINATION

Ethical approval is not required as the proposed systematic review will not use primary data. A paper of the systematic review will be submitted to a peer-reviewed journal for publication.

PROSPERO REGISTRATION NUMBER

CRD42020207160.

Challenges in developing capability measures for children and young people for use in the economic evaluation of health and care interventions

Methods for measuring outcomes suitable for economic evaluations of health and care interventions have primarily focused on adults. The validity of such methods for children and young people is questionable in areas including the outcome domains measured and how they are measured and valued, with most existing measures narrowly focusing on health. Novel methods for assessing benefits beyond health by focusing on a person's capability have also concentrated on adults to date. This paper aims to set out the rationale for capability measures in children and young people. It argues for the need to expand the evaluative space beyond health functioning towards broader capabilities, with children and young people playing an integral role in capability measure development. Drawing from existing literature, specific challenges related to the identification, measurement, and valuation of capabilities in children and young people are also discussed. Finally, the practical implications for conducting economic evaluation when measuring and valuing capabilities at different stages across the life-course are illustrated. We develop an alternative framework based on conceiving capabilities as evolving across the life-course. This framework may also be helpful in thinking about how to model health outcomes across the life-course.

Quantifying the Burden of Hyperphagia in Prader-Willi Syndrome Using Quality-Adjusted Life-years

BACKGROUND

Prader-Willi syndrome (PWS) is a rare disease associated with cognitive impairment, hypotonia, hyperphagia (an insatiable hunger), and obesity. Therapies that target hyperphagia are in development, but understanding the value of these therapies to inform patient-focused drug development (PFDD) requires valid data on disease burden. We estimated disease burden by measuring and comparing quality-adjusted life-years (QALYs) for 3 PWS health states relevant to current PFDD initiatives.

METHODS

Time trade-off (TTO) and a visual analog scale (VAS) were used to elicit PWS caregivers' values for 3 fixed health states for a standardized patient described with (1) untreated PWS, (2) PWS with controlled obesity, and (3) PWS with controlled obesity and hyperphagia. We excluded participants who left at least 1 TTO or VAS question blank or incomplete (noncompleters) and respondents who reported the same answer for all TTO scenarios (nontraders). The remaining group of respondents (traders) were used for all primary analyses. We assessed validity and bias of QALY estimates by comparing differences in health state valuations, treatment priorities, and characteristics among respondents who did and did not complete the TTO.

RESULTS

A total of 458 respondents completed the survey, including 226 traders, 93 nontraders, and 139 noncompleters. Traders valued untreated PWS at 0.69 QALYs, PWS with controlled obesity at 0.79 QALYs, and controlled hyperphagia/obesity at 0.91 QALY (P < 0.01 for differences among health state values). Reported VAS ratings were similar for traders versus nontraders for untreated PWS (38.64 vs 38.95, P = 0.89) and PWS with controlled obesity (57.36 vs 55.14, P = 0.35) but varied for PWS with controlled obesity and hyperphagia (70.70 vs 64.46, P = 0.02). Exclusion of noncompleters did not introduce obvious bias because traders and noncompleters were similar in treatment priorities and characteristics. The exclusion of nontraders did not meaningfully alter mean or distribution of valuations.

CONCLUSIONS

This study found that avoiding hyperphagia decreases the burden of PWS and that these results are robust, even once imposing strict inclusion criteria. Use of fixed health states to estimate QALYs addresses many of the complexities of measuring disease burden in rare and pediatric conditions, indicating the potential value of this approach to inform premarket decision makers in identifying outcome importance. (Clin Ther. 2021;XX:XXX-XXX) © 2021 Elsevier HS Journals, Inc.

Bilateral Permanent Childhood Hearing Loss and Health-Related Quality of Life in Adolescence

Little is known about the impact of bilateral permanent childhood hearing loss (PCHL) on health-related quality of life (HRQoL). The objective of this study was to describe preference-based and non-preference based HRQoL outcomes in adolescence, from both self and proxy perspectives, amongst participants of the Hearing Outcomes Project. The Health Utilities Index Marks II (HUI2) and III (HUI3) and the PedsQLTM Version 4.0 Generic Core Scales were used to measure HRQoL based on self and parent proxy reports in 114 adolescents aged 13-19 years, 76 with bilateral PCHL and 38 with normal hearing, recruited from a population sample that was followed up from birth to adolescence. Descriptive statistics and multivariable analyses were used to estimate the relationship between severity of PCHL and HRQoL outcomes. PCHL was associated with decrements in mean multi-attribute utility score that varied between 0.078 and 0.148 for the HUI2 (p = 0.001) and between 0.205 and 0.315 for the HUI3 (p < 0.001), dependent upon the national tariff set applied and respondent group. Multivariable analyses revealed that, after controlling for clinical and sociodemographic covariates, mean HUI3 multi-attribute utility scores were significantly lower in adolescents with moderately severe, severe and profound hearing loss than in adolescents with normal hearing. Significant differences in physical functioning, social functioning, psychosocial functioning and total PedsQLTM scores were only observed when assessments by parents were relied upon, but these dissipated in the multivariable analyses. Bilateral PCHL is associated with poorer HRQoL outcomes in adolescence. Further studies conducted are needed to understand the trajectory and underpinning mechanisms of HRQoL outcomes following PCHL.

A comparison of self-reported and proxy-reported health utilities in children: a systematic review and meta-analysis

OBJECTIVE

This study aimed to conduct a systematic review and meta-analysis to compare differences in health utilities (HUs) assessed by self and proxy respondents in children, as well as to evaluate the effects of health conditions, valuation methods, and proxy types on the differences.

METHODS

Eligible studies published in PubMed, Embase, Web of Science, and Cochrane Library up to December 2019 were identified according to PRISMA guidelines. Meta-analyses were performed to calculate the weighted mean differences (WMDs) in HUs between proxy- versus self-reports. Mixed-effects meta-regressions were applied to explore differences in WMDs among each health condition, valuation method and proxy type.

RESULTS

A total of 30 studies were finally included, comprising 211 pairs of HUs assessed by 15,294 children and 16,103 proxies. This study identified 34 health conditions, 10 valuation methods, and 3 proxy types. In general, proxy-reported HUs were significantly different from those assessed by children themselves, while the direction and magnitude of these differences were inconsistent regarding health conditions, valuation methods, and proxy types. Meta-regression demonstrated that WMDs were significantly different in patients with ear diseases relative to the general population; in those measured by EQ-5D, Health utility index 2 (HUI2), and Pediatric asthma health outcome measure relative to Visual analogue scale method; while were not significantly different in individuals adopting clinician-proxy and caregiver-proxy relative to parent-proxy.

CONCLUSION

Divergence existed in HUs between self and proxy-reports. Our findings highlight the importance of selecting appropriate self and/or proxy-reported HUs in health-related quality of life measurement and economic evaluations.

Conservative treatment for uncomplicated appendicitis in children: the CONTRACT feasibility study, including feasibility RCT

BACKGROUND

Although non-operative treatment is known to be effective for the treatment of uncomplicated acute appendicitis in children, randomised trial data comparing important outcomes of non-operative treatment with those of appendicectomy are lacking.

OBJECTIVES

The objectives were to ascertain the feasibility of conducting a multicentre randomised controlled trial comparing the clinical effectiveness and cost-effectiveness of a non-operative treatment pathway with appendicectomy for the treatment of uncomplicated acute appendicitis in children.

DESIGN

This was a mixed-methods study, which included a feasibility randomised controlled trial, embedded and parallel qualitative and survey studies, a parallel health economic feasibility study and the development of a core outcome set.

SETTING

This study was set in three specialist NHS paediatric surgical units in England.

PARTICIPANTS

Children (aged 4-15 years) clinically diagnosed with uncomplicated acute appendicitis participated in the feasibility randomised controlled trial. Children, their families, recruiting clinicians and other health-care professionals involved in caring for children with appendicitis took part in the qualitative study. UK specialist paediatric surgeons took part in the survey. Specialist paediatric surgeons, adult general surgeons who treat children, and children and young people who previously had appendicitis, along with their families, took part in the development of the core outcome set.

INTERVENTIONS

Participants in the feasibility randomised controlled trial were randomised to a non-operative treatment pathway (broad-spectrum antibiotics and active observation) or appendicectomy.

MAIN OUTCOME MEASURES

The primary outcome measure was the proportion of eligible patients recruited to the feasibility trial.

DATA SOURCES

Data were sourced from NHS case notes, questionnaire responses, transcribed audio-recordings of recruitment discussions and qualitative interviews.

RESULTS

Overall, 50% (95% confidence interval 40% to 59%) of 115 eligible patients approached about the trial agreed to participate and were randomised. There was high acceptance of randomisation and good adherence to trial procedures and follow-up (follow-up rates of 89%, 85% and 85% at 6 weeks, 3 months and 6 months, respectively). More participants had perforated appendicitis than had been anticipated. Qualitative work enabled us to communicate about the trial effectively with patients and families, to design and deliver bespoke training to optimise recruitment and to understand how to optimise the design and delivery of a future trial. The health economic study indicated that the main cost drivers are the ward stay cost and the cost of the operation; it has also informed quality-of-life assessment methods for future work. A core outcome set for the treatment of uncomplicated acute appendicitis in children and young people was developed, containing 14 outcomes. There is adequate surgeon interest to justify proceeding to an effectiveness trial, with 51% of those surveyed expressing a willingness to recruit with an unchanged trial protocol.

LIMITATIONS

Because the feasibility randomised controlled trial was performed in only three centres, successful recruitment across a larger number of sites cannot be guaranteed. However, the qualitative work has informed a bespoke training package to facilitate this. Although survey results suggest adequate clinician interest to make a larger trial possible, actual participation may differ, and equipoise may have changed over time.

CONCLUSIONS

A future effectiveness trial is feasible, following limited additional preparation, to establish appropriate outcome measures and case identification. It is recommended to include a limited package of qualitative work to optimise recruitment, in particular at new centres.

FUTURE WORK

Prior to proceeding to an effectiveness trial, there is a need to develop a robust method for distinguishing children with uncomplicated acute appendicitis from those with more advanced appendicitis, and to reach agreement on a primary outcome measure and effect size that is acceptable to all stakeholder groups involved.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN15830435.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 10. See the NIHR Journals Library website for further project information.

Problematic cost-utility analysis of interventions for behavior problems in children and adolescents

Cost–utility analyses are slowly becoming part of randomized control trials evaluating physical and mental health treatments and (preventive) interventions in child and adolescent development. The British National Institute of Health and Care Excellence, for example, insists on the use of gains in Quality Adjusted Life Years (QALYs) to compute the “value for money” of interventions. But what counts as a gain in quality of life? For one of the most widely used instruments, the EuroQol 5 Dimensions scale (EQ‐5D), QALYs are estimated by healthy individuals who provide utility scores for specific health states, assuming that the best life is a life without self‐experienced problems in five domains: mobility, self‐care, usual activities, pain/discomfort, and anxiety/depression. The worst imaginable outcome is defined as “a lot of problems” in each of these five domains. The impact of the individual's problems on the social network is not weighted, and important social–developmental domains (externalizing problems, social competence) are missing. Current cost–utility computations based on EQ‐5D favor physical health over mental health, and they rely on adult weights for child and adolescent quality of life. Thus, a level playing field is absent, and developmental expertise is sorely missing.