The Health Utilities Index 3 invalidated when completed by nurses for pediatric oncology patients

Psychometric Performance of Generic Childhood Multi-Attribute Utility Instruments in Preterm and Low Birthweight Populations: A Systematic Review

BACKGROUND

Individuals born preterm (gestational age < 37 weeks) and/or at low birthweight (<2500 g) are at increased risk of health impairments from birth to adulthood. This review aimed to evaluate the psychometric performance of generic childhood-specific or childhood-compatible multi-attribute utility instruments (MAUIs) in preterm and/or low birthweight (PLB) populations.

METHODS

Searches covered seven databases, including studies that targeted childhood (aged < 18 years) and/or adult (≥18 years) PLB populations; provided psychometric evidence for generic childhood-specific or compatible MAUI(s) (any language version); and published in English. Eighteen psychometric properties were evaluated using a four-part criteria rating system. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results.

RESULTS

A total of 42 studies were included, generating 178 criteria rating outputs across four MAUIs: 17D, CHSCS-PS, HUI2, and HUI3. Moreover, 64.0% of outputs concerned the HUI3 MAUI, and 38.2% related to known-group validity. There was no evidence for five psychometric properties. Only 6.7% of outputs concerned reliability and proxy-child agreement. No MAUI outperformed others across all properties. The frequently applied HUI2 and HUI3 lacked content validity evidence.

CONCLUSIONS

This psychometric evidence catalogue should inform the selection of MAUI(s) suited to the specific aims of applications targeting PLB populations. Further psychometric research is warranted to address the gaps in psychometric evidence.

Systematic Review of the Psychometric Performance of Generic Childhood Multi-attribute Utility Instruments

BACKGROUND

Childhood multi-attribute utility instruments (MAUIs) can be used to measure health utilities in children (aged ≤ 18 years) for economic evaluation. Systematic review methods can generate a psychometric evidence base that informs their selection for application. Previous reviews focused on limited sets of MAUIs and psychometric properties, and only on evidence from studies that directly aimed to conduct psychometric assessments.

OBJECTIVE

This study aimed to conduct a systematic review of psychometric evidence for generic childhood MAUIs and to meet three objectives: (1) create a comprehensive catalogue of evaluated psychometric evidence; (2) identify psychometric evidence gaps; and (3) summarise the psychometric assessment methods and performance by property.

METHODS

A review protocol was registered with the Prospective Register of Systematic Reviews (PROSPERO; CRD42021295959); reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline. The searches covered seven academic databases, and included studies that provided psychometric evidence for one or more of the following generic childhood MAUIs designed to be accompanied by a preference-based value set (any language version): 16D, 17D, AHUM, AQoL-6D, CH-6D, CHSCS-PS, CHU9D, EQ-5D-Y-3L, EQ-5D-Y-5L, HUI2, HUI3, IQI, QWB, and TANDI; used data derived from general and/or clinical childhood populations and from children and/or proxy respondents; and were published in English. The review included 'direct studies' that aimed to assess psychometric properties and 'indirect studies' that generated psychometric evidence without this explicit aim. Eighteen properties were evaluated using a four-part criteria rating developed from established standards in the literature. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results by property.

RESULTS

Overall, 372 studies were included, generating a catalogue of 2153 criteria rating outputs across 14 instruments covering all properties except predictive validity. The number of outputs varied markedly by instrument and property, ranging from 1 for IQI to 623 for HUI3, and from zero for predictive validity to 500 for known-group validity. The more recently developed instruments targeting preschool children (CHSCS-PS, IQI, TANDI) have greater evidence gaps (lack of any evidence) than longer established instruments such as EQ-5D-Y, HUI2/3, and CHU9D. The gaps were prominent for reliability (test-retest, inter-proxy-rater, inter-modal, internal consistency) and proxy-child agreement. The inclusion of indirect studies (n = 209 studies; n = 900 outputs) increased the number of properties with at least one output of acceptable performance. Common methodological issues in psychometric assessment were identified, e.g., lack of reference measures to help interpret associations and changes. No instrument consistently outperformed others across all properties.

CONCLUSION

This review provides comprehensive evidence on the psychometric performance of generic childhood MAUIs. It assists analysts involved in cost-effectiveness-based evaluation to select instruments based on the application-specific minimum standards of scientific rigour. The identified evidence gaps and methodological issues also motivate and inform future psychometric studies and their methods, particularly those assessing reliability, proxy-child agreement, and MAUIs targeting preschool children.

Considering quality of life for children with cancer: a systematic review of patient-reported outcome measures and the development of a conceptual model

OBJECTIVES

An appraisal of pediatric cancer-specific quality-of-life (QOL) instruments revealed a lack of clarity about what constitutes QOL in this population. This study addresses this concern by identifying the concepts that underpin the construct of QOL as determined by a content analysis of all patient-reported outcome (PRO) instruments used in childhood cancer research.

METHODS

A systematic review was performed of key databases (i.e., MEDLINE, CINAHL, PsychINFO) to identify studies of QOL in children with cancer. A content analysis process was used to code and categorize all items from generic and cancer-specified PRO instruments. Our objective was to provide clarification regarding the conceptual underpinnings of these instruments, as well as to help inform the development of theory and contribute to building a conceptual framework of QOL for children with cancer.

RESULTS

A total of 6,013 English language articles were screened, identifying 148 studies. Ten generic and ten cancer-specific PRO instruments provided 957 items. Content analysis led to the identification of four major domains of QOL (physical, psychological, social, and general health), with 11 subdomains covering 98 different concepts. While all instruments reflected items relating to the broader domains of QOL, there was substantial heterogeneity in terms of the content and variability in the distribution of items.

CONCLUSIONS

This systematic review and the proposed model represent a useful starting point in the critical appraisal of the conceptual underpinnings of PRO instruments used in pediatric oncology and contribute to the need to place such tools under a critical, yet reflective and analytical lens.

Health status utilities in pediatrics: a systematic review of acute lymphoblastic leukemia

BACKGROUND

Measuring utilities and health-related quality of life (HRQL) in children is challenging due to their cognitive abilities and changing developmental stages.

PURPOSE

. To identify methodological issues on utility measurements in children, we performed a systematic review on utilities measured with a single instrument, the Health Utilities Index (HUI), in pediatric acute lymphoblastic leukemia (ALL). The secondary goal was to facilitate future cost-utility analyses without the need for time-consuming assessments. Data Sources. PubMed, Embase, Cochrane Library, CINAHL, and PsycINFO were searched from inception to June 2012. Studies had to report on utility scores in pediatric ALL, either on or after treatment, to be included.

RESULTS

. Fifteen studies were included. Most studies had methodological shortcomings, which mainly concerned

STUDY DESIGN

and definition and representativeness of the study group. Utility scores were dependent on treatment variables, and there generally was an improvement in HRQL as treatment or survivorship advanced. In general, proxy-respondents were less reliable for subjective phenomena than for observable conditions. HUI2 and HUI3 scores were not interchangeable. Limitations. Studies may have been missed because no validated search method for utility studies exists, due to language bias or the exclusion of non-peer-reviewed papers.

CONCLUSIONS

. Most studies in this review were methodologically suboptimal. Future developments should focus on including developmentally appropriate items for the whole pediatric age group. Adding disease-specific domains may enhance the sensitivity and responsiveness of instruments. Efforts should be undertaken to elicit valuation of health states from older children and teenagers as much as possible. For now, it remains difficult to make valid and informed decisions on the financing of interventions until health state valuation in children has become more methodologically robust.

Health-related quality of life and utility scores in short-term survivors of pediatric acute lymphoblastic leukemia

Purpose

Increase of survival in pediatric acute lymphoblastic leukemia (ALL) has made outcomes such as health-related quality of life (HRQL) and economic burden more important. To make informed decisions on the use of healthcare resources, costs as well as utilities need to be taken into account. Among the preference-based HRQL instruments, the Health Utilities Index (HUI) is the most employed in pediatric cancer. Information on utility scores during ALL treatment and in long-term survivors is available, but utility scores in short-term survivors are lacking. This study assesses utility scores, health state, and HRQL in short-term (6 months to 4 years) ALL survivors.

Methods

Cross-sectional single-center cohort study of short-term ALL survivors using HUI3 proxy assessments.

Results

Thirty-three survivors (median 1.5 years off treatment) reported 14 unique health states. The majority of survivors (61 %) enjoyed a perfect health, but 21 % had three affected attributes. Overall, HRQL was nonsignificantly lower compared to the norm, although the difference was large and may be clinically relevant. Cognition was significantly impaired (p = 0.03).

Conclusion

Although 61 % of short-term survivors of ALL report no impairment, the health status of the other patients lead to a clinically important impaired HRQL compared to norms. Prospective studies assessing utility scores associated with pediatric ALL should be performed, enabling valid and reliable cost-utility analyses for policy makers to make informed decisions.

A review of health utilities across conditions common in paediatric and adult populations

Background

Cost-utility analyses are commonly used in economic evaluations of interventions or conditions that have an impact on health-related quality of life. However, evaluating utilities in children presents several challenges since young children may not have the cognitive ability to complete measurement tasks and thus utility values must be estimated by proxy assessors. Another solution is to use utilities derived from an adult population. To better inform the future conduct of cost-utility analyses in paediatric populations, we reviewed the published literature reporting utilities among children and adults across selected conditions common to paediatric and adult populations.

Methods

An electronic search of Ovid MEDLINE, EMBASE, and the Cochrane Library up to November 2008 was conducted to identify studies presenting utility values derived from the Health Utilities Index (HUI) or EuroQoL-5Dimensions (EQ-5D) questionnaires or using time trade off (TTO) or standard gamble (SG) techniques in children and/or adult populations from randomized controlled trials, comparative or non-comparative observational studies, or cross-sectional studies. The search was targeted to four chronic diseases/conditions common to both children and adults and known to have a negative impact on health-related quality of life (HRQoL).

Results

After screening 951 citations identified from the literature search, 77 unique studies included in our review evaluated utilities in patients with asthma (n = 25), cancer (n = 23), diabetes mellitus (n = 11), skin diseases (n = 19) or chronic diseases (n = 2), with some studies evaluating multiple conditions. Utility values were estimated using HUI (n = 33), EQ-5D (n = 26), TTO (n = 12), and SG (n = 14), with some studies applying more than one technique to estimate utility values. 21% of studies evaluated utilities in children, of those the majority being in the area of oncology. No utility values for children were reported in skin diseases. Although few studies provided comparative information on utility values between children and adults, results seem to indicate that utilities may be similar in adolescents and young adults with asthma and acne. Differences in results were observed depending on methods and proxies.

Conclusions

This review highlights the need to conduct future research regarding measurement of utilities in children.