Developing adolescent-specific health state values for economic evaluation: an application of profile case best-worst scaling to the Child Health Utility 9D

A school-based intervention (‘Girls Active’) to increase physical activity levels among 11- to 14-year-old girls: cluster RCT

Background

Physical activity (PA) levels among adolescent girls in the UK are low. ‘Girls Active’, developed by the Youth Sport Trust (YST), has been designed to increase girls’ PA levels.

Objective

To understand the effectiveness and cost-effectiveness of the Girls Active programme.

Design

A two-arm cluster randomised controlled trial.

Setting

State secondary schools in the Midlands, UK.

Participants

Girls aged between 11 and 14 years.

Intervention

Girls Active involves teachers reviewing PA, sport and physical education provision, culture and practices in their school; attending training; creating action plans; and effectively working with girls as peer leaders to influence decision-making and to promote PA to their peers. Support from a hub school and the YST is offered.

Main outcome measures

The change in objectively measured moderate to vigorous intensity PA (MVPA) levels at 14 months. Secondary outcomes included changes in overall PA level (mean acceleration), light PA levels, sedentary time, body composition and psychosocial outcomes. Cost-effectiveness and process evaluation (qualitative and quantitative) data were collected.

Results

Twenty schools and 1752 pupils were recruited; 1211 participants provided complete primary outcome data at 14 months. No difference was found in mean MVPA level between groups at 14 months [1.7 minutes/day, 95% confidence interval (CI) –0.8 to 4.3 minutes/day], but there was a small difference in mean MVPA level at 7 months (2.4 minutes/day, 95% CI 0.1 to 4.7 minutes/day). Significant differences between groups were found at 7 months, but not at 14 months, in some of the objective secondary outcomes: overall PA level represented by average acceleration (1.39 mg, 95% CI 0.1 to 2.2 mg), after-school sedentary time (–4.7 minutes/day, 95% CI –8.9 to –0.6 minutes/day), overall light PA level (5.7 minutes/day, 95% CI 1.0 to 10.5 minutes/day) and light PA level on school days (4.5 minutes/day, 95% CI 0.25 to 8.75 minutes/day). Minor, yet statistically significant, differences in psychosocial measures at 7 months were found in favour of control schools. Significant differences in self-esteem and identified motivation in favour of intervention schools were found at 7 and 14 months, respectively. Subgroup analyses showed a significant effect of the intervention for those schools with higher numbers of pupils at 14 months. Girls Active was well received by teachers, and they reported that implemented strategies and activities were having a positive impact in schools. Barriers to implementation progress included lack of time, competing priorities and the programme flexibility. Implementation costs ranged from £2054 (£23/pupil) to £8545 (£95/pupil) per school. No differences were found between groups for health-related quality-of-life scores or frequencies, or for costs associated with general practitioner, school nurse and school counsellor use.

Conclusions

Girls Active may not have had an effect on the random 90 girls per school included in the evaluation. Although we included a diverse sample of schools, the results may not be generalisable to all schools. Girls Active was viewed positively but teachers did not implement as many aspects of the programme as they wanted. The intervention was unlikely to have a wide impact and did not have an impact on MVPA level at 14 months. Capitalising on the opportunities of a flexible programme like this, while also learning from the stated barriers to and challenges of long-term implementation that teachers face, is a priority for research and practice.

Trial registration

Current Controlled Trials ISRCTN10688342.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full inPublic Health Research; Vol. 7, No. 5. See the NIHR Journals Library website for further project information. The YST funded the intervention. This study was undertaken in collaboration with the Leicester Clinical Trials Unit, a UK Clinical Research Collaboration-registered clinical trials unit in receipt of NIHR Clinical Trials Unit support funding. Neither the YST nor the NIHR Clinical Trials Unit had any involvement in the Trial Steering Committee, data analysis, data interpretation, data collection or writing of the report. The University of Leicester authors are supported by the NIHR Leicester–Loughborough Biomedical Research Unit (2012–17), the NIHR Leicester Biomedical Research Centre (2017–22) and the Collaboration for Leadership in Applied Health Research and Care East Midlands. These funders had no involvement in the Trial Steering Committee, the data analysis, data interpretation, data collection or writing of the report.

EQ-5D-Y as a Health-Related Quality of Life Instrument for Children and Adolescents: The Instrument's Characteristics, Development, Current Use, and Challenges of Developing Its Value Set

OBJECTIVES

Interest in the measurement of health-related quality of life (HRQoL) in children and adolescents has been increasing, and appropriate instruments are required for this target group. This article focuses on the EQ-5D-Y instrument, presenting an overview of its characteristics, development, and current use, and includes a discussion of methodological and conceptual issues related to the valuation of child health and the development of an EQ-5D-Y value set.

METHODS

This article brings together the experiences of the research team that developed and validated the EQ-5D-Y, supplemented by information derived from EQ-5D-Y study registrations on the EuroQol Group's website.

RESULTS

EQ-5D-Y is a child-specific and age-appropriate measure of HRQoL. Study registration data show that the instrument's use has steadily increased since its first publication. It has been used in various types of studies and in different disease areas. Currently there is no value set for EQ-5D-Y, and so its use in cost-utility analysis (CUA) is limited. There are methodological and conceptual issues that affect the design of valuation studies for child health. Issues that are discussed include the need for separate value sets for children and adolescents, the choice of appropriate reference samples and valuation techniques, and the framing of the tasks.

CONCLUSIONS

Research on EQ-5D-Y and its use has increased in the last years. Further research is required to clarify methodological issues regarding health state valuation in children and adolescents. This will support the development of a value set for EQ-5D-Y and the use of EQ-5D-Y in CUA.

Valuation of EuroQol Five-Dimensional Questionnaire, Youth Version (EQ-5D-Y) and EuroQol Five-Dimensional Questionnaire, Three-Level Version (EQ-5D-3L) Health States: The Impact of Wording and Perspective

BACKGROUND

Valuations of health states were affected by the wording of the two instruments (EQ-5D-3L and EQ-5D-Y) and by the perspective taken (child or adult).

OBJECTIVES

There is a growing demand for value sets for the EQ-5D-Y (EQ-5D instrument for younger populations). Given the similarities between EQ-5D-Y and EQ-5D-3L, we investigated whether valuations of health states were affected by the differences in wording between the two instruments and by the perspective taken in the valuation exercise (child or adult).

STUDY DESIGN

Respondents were randomly assigned to EQ-5D-3L or EQ-5D-Y (instrument) and further into two groups that either valued health states for an adult or for a 10-year-old child (perspective). The valuation tasks were composite time trade-off (C-TTO) and discrete choice experiments (DCE), including comparisons with death (DCE + death). Members of the adult general population in four countries (Germany, Netherlands, Spain, England) participated in computer-assisted personal interviews.

METHODS

Two-way multivariate analysis of variance (MANOVA) and post hoc tests were used to compare C-TTO responses and chi-square tests were conducted to compare DCE + death valuations.

RESULTS

A significant interaction effect between instrument and perspective for C-TTO responses was found. Significant differences by perspective (adult and child) occurred only for the EQ-5D-3L. Significant differences in values between instruments (EQ-5D-3L and EQ-5D-Y) occurred only for the adult perspective. Both significant results were confirmed by the DCE + death results. When comparing EQ-5D-3L for adult perspective and EQ-5D-Y for child perspective, values were also significantly different.

CONCLUSIONS

The results identified an interaction effect between wording of the instrument and perspective on elicited values, suggesting that current EQ-5D-3L value sets should not be employed to assign values to EQ-5D-Y health states.

A Systematic Review Comparing the Acceptability, Validity and Concordance of Discrete Choice Experiments and Best-Worst Scaling for Eliciting Preferences in Healthcare

OBJECTIVE

The aim of this study was to compare the acceptability, validity and concordance of discrete choice experiment (DCE) and best-worst scaling (BWS) stated preference approaches in health.

METHODS

A systematic search of EMBASE, Medline, AMED, PubMed, CINAHL, Cochrane Library and EconLit databases was undertaken in October to December 2016 without date restriction. Studies were included if they were published in English, presented empirical data related to the administration or findings of traditional format DCE and object-, profile- or multiprofile-case BWS, and were related to health. Study quality was assessed using the PREFS checklist.

RESULTS

Fourteen articles describing 12 studies were included, comparing DCE with profile-case BWS (9 studies), DCE and multiprofile-case BWS (1 study), and profile- and multiprofile-case BWS (2 studies). Although limited and inconsistent, the balance of evidence suggests that preferences derived from DCE and profile-case BWS may not be concordant, regardless of the decision context. Preferences estimated from DCE and multiprofile-case BWS may be concordant (single study). Profile- and multiprofile-case BWS appear more statistically efficient than DCE, but no evidence is available to suggest they have a greater response efficiency. Little evidence suggests superior validity for one format over another. Participant acceptability may favour DCE, which had a lower self-reported task difficulty and was preferred over profile-case BWS in a priority setting but not necessarily in other decision contexts.

CONCLUSION

DCE and profile-case BWS may be of equal validity but give different preference estimates regardless of the health context; thus, they may be measuring different constructs. Therefore, choice between methods is likely to be based on normative considerations related to coherence with theoretical frameworks and on pragmatic considerations related to ease of data collection.

Estimating a Dutch Value Set for the Pediatric Preference-Based CHU9D Using a Discrete Choice Experiment with Duration

OBJECTIVE

This article presents the development of the Dutch value set for the Child Health Utility 9D, a pediatric preference-based measure of quality of life that can be used to generate quality-adjusted life-years.

METHODS

A large online survey was conducted using a discrete choice experiment including a duration attribute with adult members of the Netherlands general population (N = 1276) who were representative in terms of age, gender, marital status, employment, education, and region. Respondents were asked which of two health states they prefer, where each health state was described using the nine dimensions of the Child Health Utility 9D (worried, sad, pain, tired, annoyed, school work/homework, sleep, daily routine, able to join in activities) and duration. The data were modeled using conditional logit with robust standard errors to produce utility values for every health state described by the Child Health Utility 9D.

RESULTS

The majority of the dimension level coefficients were monotonic, leading to a decrease in utility as severity increases. There was, however, evidence of some logical inconsistencies, particularly for the school work/homework dimension. The value set produced was based on the ordered model and ranges from -0.568 for the worst state to 1 for the best state.

CONCLUSION

The valuation of the Child Health Utility 9D using online discrete choice experiment with duration with adult members of the Dutch general population was feasible and produced a valid model for use in cost utility analysis. Normative questions are raised around the valuation of pediatric preference-based measures, including the appropriate perspective for imagining hypothetical pediatric health states.

Population health status based on the EQ-5D-Y-3L among adolescents in Sweden: Results by sociodemographic factors and self-reported comorbidity

Purpose

The EQ-5D-Y-3L is a generic health-related quality of life (HRQoL) measure developed for youth from 8 years old. The aim of this study is to present population health status, based on the EQ-5D-Y-3L, among adolescents in Sweden, by sex, age, self-reported comorbidity and parents’ occupational status.

Methods

Data were obtained from a cross-sectional total survey among students, aged 13–18 years, in a Swedish County year 2014. The survey included EQ-5D-Y-3L, questions regarding self-reported health, disease, functional impairment and mental distress. Parents’ occupational status was used as a proxy for socio-economic status.

Results

A total of 6574 participants answered all the EQ-5D-Y-3L dimensions (mean age was 15.9 years, same proportion of boys and girls). Girls reported more problems than boys in the dimensions ‘doing usual activities’, ‘having pain or discomfort’ and ‘feeling worried, sad or unhappy’, and lower mean VAS score. Respondents with one or both parents unemployed reported more problems with usual activities, pain/discomfort and in the mood dimension than those with both parents employed. Those with comorbidity had in general more problems in all dimensions and lower mean VAS score. The highest impact on VAS score was found for adolescents who reported that they always felt depressed.

Conclusions

Sex, age, self-reported comorbidity and parents’ occupational status were associated with HRQoL determined by the EQ-5D-Y-3L in the general population of adolescents. The ability of EQ-5D-Y-3L to distinguish adolescents’ health status based on these factors confirms the instrument’s usefulness in assessment of HRQoL and as guidance for prioritization.

Electronic supplementary material

The online version of this article (10.1007/s11136-018-1985-2) contains supplementary material, which is available to authorized users.

Utility values for childhood obesity interventions: a systematic review and meta-analysis of the evidence for use in economic evaluation

Rigorous estimates of preference-based utilities are important inputs into economic evaluations of childhood obesity interventions, yet no published review currently exists examining utility by weight status in paediatric populations. A comprehensive systematic literature review and meta-analysis was therefore undertaken, pooling data on preference-based health state utilities by weight status in children using a random-effects model. Tests for heterogeneity were performed, and publication bias was assessed. Of 3,434 potentially relevant studies identified, 11 met our eligibility criteria. Estimates of Cohen's d statistic suggested a small effect of weight status on preference-based utilities. Mean utility values were estimated as 0.85 (95% uncertainty interval [UI] 0.84-0.87), 0.83 (95% UI 0.81-0.85), 0.82 (95% UI 0.79-0.84) and 0.83 (95% UI 0.80-0.86) for healthy weight, overweight, obese and overweight/obese states, respectively. Meta-analysis of studies reporting utility values for both healthy weight and overweight/obese participants found a statistically significant weighted mean difference (0.015, 95% UI 0.003-0.026). A small but statistically significant difference was also estimated between healthy weight and overweight participants (0.011, 95% UI 0.004-0.018). Study findings suggest that paediatric-specific benefits of obesity interventions may not be well reflected by available utility measures, potentially underestimating cost-effectiveness if weight loss in childhood/adolescence improves health or well-being.

Health-related quality of life associated with bullying and aggression: a cross-sectional study in English secondary schools

BACKGROUND

Associations between adolescent health-related quality of life (HRQoL), bullying, and aggression are not well understood. We used baseline data from a large-cluster randomized school trial to study the relationship between HRQoL, bullying experience, and other demographic factors.

METHODS

Cross-sectional self-reported questionnaires collected pre-randomization from the on-going INCLUSIVE trial. The questionnaires were completed in the classroom. The Gatehouse Bullying Scale measured bullying victimization and the Edinburgh Study of Youth Transitions and Crime school misbehavior subscale (ESYTC) measured aggressive behaviors. HRQoL was assessed using the Child Health Utility 9 Dimensions (CHU-9D) and general quality of life using the Pediatric Quality of Life Inventory (PedsQL). Participants were a cohort of year 7 students (age 11-12 years) from 40 state secondary schools in England. Descriptive statistics for the CHU-9D and PedsQL were calculated using standard methods with tests for differences in median scores by sex assessed using quantile regression. Correlation between HRQoL measures was conducted using Spearman's rank correlation coefficients. Predictors of HRQoL were identified using univariate and multiple regressions.

RESULTS

A total of 6667 students filled out the questionnaire. The CHU-9D was correlated with the PedsQL (0.63, p < 0.001). The multivariable regression results suggest that if students were bullied frequently and upset it resulted in a decrement in CHU-9D scores of (-0.108) and fall in PedsQL score of (-16.2). The impact of the antisocial/aggressive behavior on the ESYTC scale resulted in a utility decrement of -0.004 and fall of -.5 on the PedsQL.

CONCLUSIONS

Adolescents' involvement in bullying and aggression is a strong correlate of HRQoL. These data have important implications for the potential cost-effectiveness of reducing bullying and aggression in schools.

Psychometric evaluation of the Chinese version of the Child Health Utility 9D (CHU9D-CHN): a school-based study in China

PURPOSE

The Child Health Utility 9D (CHU9D), a new generic preference-based health-related quality of life (HRQoL) instrument, was developed specifically for the application in cost-effectiveness analyses of treatments and interventions for children and adolescents. The main objective of this study was to examine the psychometric property of the Chinese version of CHU9D (CHU9D-CHN) in a large school-based sample in China.

METHODS

Data were collected using a multi-stage sampling method from third-to-ninth-grade students in Shaanxi Province, China. Participants self-completed a hard-copy questionnaire including the CHU9D-CHN instrument, the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales (PedsQL), information on socio-demographic characteristics and self-reported health status. The psychometric properties of the CHU9D-CHN, including the internal consistency, 2-week test-retest reliability, convergent and known-groups validity were studied.

RESULTS

A total of 1912 students participated in the survey. The CHU9D-CHN internal consistency and test-retest reliability were good to excellent with a Cronbach's alpha of 0.77 and an intra-class correlation coefficient of 0.65, respectively. The CHU9D utility scores moderately correlated with the PedsQL total scores (r = .57, P < .001), demonstrating good convergent validity. Difference of the CHU9D utility scores among the different participants with levels of self-reported general health, health services utilisation and left-behind status demonstrated good construct validity.

CONCLUSION

The findings demonstrated adequate psychometric performance for the CHU9D-CHN. The CHU9D-CHN was a satisfactory, reliable and valid instrument to measure and value HRQoL for children and adolescents in China.

A cluster randomised controlled trial and evaluation and cost-effectiveness analysis of the Roots of Empathy schools-based programme for improving social and emotional well-being outcomes among 8- to 9-year-olds in Northern Ireland

Background

There is growing consensus regarding the importance of attending to children’s social and emotional well-being. There is now a substantial evidence base demonstrating the links between a child’s early social and emotional development and a range of key longer-term education, social and health outcomes. Universal school-based interventions provide a significant opportunity for early intervention in this area and yet the existing evidence base, particularly in relation to their long-term effects, is limited.

Objectives and main outcomes

To determine the effectiveness and cost-effectiveness of Roots of Empathy (ROE), a universal school-based programme that, through attempting to enhance children’s empathy, seeks to achieve the following two main outcomes: improvement in prosocial behaviour and reduction in difficult behaviour.

Design

A cluster randomised controlled trial and an economic evaluation. A total of 74 primary schools were randomly assigned to deliver ROE or to join a waiting list control group. Seven schools withdrew post randomisation and a further two withdrew before the immediate post-test time point. Children (n = 1278) were measured pre test and immediately post test, and then for 3 years following the end of the programme. Data were also collected from teachers and parents.

Setting and participants

The intervention schools delivered ROE to their Year 5 children (aged 8–9 years) as a whole class.

Intervention

ROE is delivered on a whole-class basis for one academic year (October–June). It consists of 27 lessons based around the monthly visit from a baby and parent who are usually recruited from the local community. Children learn about the baby’s growth and development and are encouraged to generalise from this to develop empathy towards others.

Results

Although it was developed in Canada, the programme was very well received by schools, parents and children, and it was delivered effectively with high fidelity. ROE was also found to be effective in achieving small improvements in children’s prosocial behaviour (Hedges’ g = 0.20; p = 0.045) and reductions in their difficult behaviour (Hedges’ g = –0.16; p = 0.060) immediately post test. Although the gains in prosocial behaviour were not sustained after the immediately post-test time point, there was some tentative evidence that the effects associated with reductions in difficult behaviour may have remained up to 36 months from the end of the programme. These positive effects of ROE on children’s behaviour were not found to be associated with improvements in empathy or other social and emotional skills (such as emotional recognition and emotional regulation), on which the trial found no evidence of ROE having an effect. The study also found that ROE was likely to be cost-effective in line with national guidelines.

Conclusions

These findings are consistent with those of other evaluations of ROE and suggest that it is an effective and cost-effective programme that can be delivered appropriately and effectively in regions such as Northern Ireland. A number of issues for further consideration are raised regarding opportunities to enhance the role of parents; how a time-limited programme such as ROE can form part of a wider and progressive curriculum in schools to build on and sustain children’s social and emotional development; and the need to develop a better theory of change for how ROE works.

Trial registration

Current Controlled Trials ISRCTN07540423.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 6, No. 4. See the NIHR Journals Library website for further project information.

Is Best-Worst Scaling Suitable for Health State Valuation? A Comparison with Discrete Choice Experiments

Health utility indices (HUIs) are widely used in economic evaluation. The best-worst scaling (BWS) method is being used to value dimensions of HUIs. However, little is known about the properties of this method. This paper investigates the validity of the BWS method to develop HUI, comparing it to another ordinal valuation method, the discrete choice experiment (DCE). Using a parametric approach, we find a low level of concordance between the two methods, with evidence of preference reversals. BWS responses are subject to decision biases, with significant effects on individuals' preferences. Non parametric tests indicate that BWS data has lower stability, monotonicity and continuity compared to DCE data, suggesting that the BWS provides lower quality data. As a consequence, for both theoretical and technical reasons, practitioners should be cautious both about using the BWS method to measure health-related preferences, and using HUI based on BWS data. Given existing evidence, it seems that the DCE method is a better method, at least because its limitations (and measurement properties) have been extensively researched. Copyright © 2016 John Wiley & Sons, Ltd.

Adolescent values for immunisation programs in Australia: A discrete choice experiment

Objectives

The importance of adolescent engagement in health decisions and public health programs such as immunisation is becoming increasingly recognised. Understanding adolescent preferences and further identifying barriers and facilitators for immunisation acceptance is critical to the success of adolescent immunisation programs. This study applied a discrete choice experiment (DCE) to assess vaccination preferences in adolescents.

Methods

This study was conducted as a cross-sectional, national online survey in Australian adolescents. The DCE survey evaluated adolescent vaccination preferences. Six attributes were assessed including disease severity, target for protection, price, location of vaccination provision, potential side effects and vaccine delivery method. A mixed logit model was used to analyse DCE data.

Results

This survey was conducted between December 2014 and January 2015. Of 800 adolescents aged 15 to 19 years, stronger preferences were observed overall for: vaccination in the case of a life threatening illness (p<0.001), lower price vaccinations (p<0.001), mild but common side effects (p = 0.004), delivery via a skin patch (p<0.001) and being administered by a family practitioner (p<0.001). Participants suggested that they and their families would be willing to pay AU$394.28 (95%CI: AU$348.40 to AU$446.92) more for a vaccine targeting a life threatening illness than a mild-moderate illness, AU$37.94 (95%CI: AU$19.22 to AU$57.39) more for being vaccinated at a family practitioner clinic than a council immunisation clinic, AU$23.01 (95%CI: AU$7.12 to AU$39.24) more for common but mild and resolving side effects compared to rare but serious side effects, and AU$51.80 (95%CI: AU$30.42 to AU$73.70) more for delivery via a skin patch than injection.

Conclusions

Consideration of adolescent preferences may result in improved acceptance of, engagement in and uptake of immunisation programs targeted for this age group.

Choice Blindness and Health-State Choices among Adolescents and Adults

OBJECTIVE

To assess the feasibility and validity of using a discrete choice experiment format to elicit health preferences in adolescents by comparing illogical choices and choice-blindness rates between adults and adolescents; and to explore the relationship between personality traits and health-state choices.

METHODS

A convenience sample of adults and adolescents (12 to 17 y old) were recruited from around Chicago, USA. A personality inventory was administered, followed by pairwise comparisons of 6 health-state scenarios which asked each candidate to select their preferred choice. Health-state descriptions were based on a simplified 3-dimension version of the EQ-5D (mobility, pain, depression, each with 3 levels). For 2 scenarios, the respondent's preferred choice was switched; if the respondent did not notice the switch they were considered "choice blind". Logistic regression evaluated the association of personality, gender, and age with choice blindness and health-state choice.

RESULTS

Ninety-nine respondents were recruited (44% adults). Comparing adolescents to adults, there was no significant difference in the rate of illogical preferences (9% v. 12%) or in preferring dead to the worst health state (56% v. 64%) ( P > 0.05). Choice-blindness rates were significantly higher in adolescents (35%) than adults (9%) ( P < 0.01). The adjusted odds of choice blindness in adolescents was 6.6 (95% CI = 1.8 to 23.8; P = 0.004). Conscientiousness was significantly associated with health-state choice in 3 of the 6 models predicting health-state choice (using P < 0.1 as a threshold).

CONCLUSIONS

The results of this exploratory study suggest it is feasible to conduct choice experiments in adolescents; however, adolescents are significantly more likely to demonstrate choice blindness. Psychological traits may be noteworthy predictors of health-state choices, with conscientiousness independently associated with several health-state choices.

Mapping CHU9D Utility Scores from the PedsQLTM 4.0 SF-15

BACKGROUND

The Pediatric Quality of Life Inventory™ 4.0 Short Form 15 Generic Core Scales (hereafter the PedsQL) and the Child Health Utility-9 Dimensions (CHU9D) are two generic instruments designed to measure health-related quality of life in children and adolescents in the general population and paediatric patient groups living with specific health conditions. Although the PedsQL is widely used among paediatric patient populations, presently it is not possible to directly use the scores from the instrument to calculate quality-adjusted life-years (QALYs) for application in economic evaluation because it produces summary scores which are not preference-based.

OBJECTIVE

This paper examines different econometric mapping techniques for estimating CHU9D utility scores from the PedsQL for the purpose of calculating QALYs for cost-utility analysis.

METHODS

The PedsQL and the CHU9D were completed by a community sample of 755 Australian adolescents aged 15-17 years. Seven regression models were estimated: ordinary least squares estimator, generalised linear model, robust MM estimator, multivariate factorial polynomial estimator, beta-binomial estimator, finite mixture model and multinomial logistic model. The mean absolute error (MAE) and the mean squared error (MSE) were used to assess predictive ability of the models.

RESULTS

The MM estimator with stepwise-selected PedsQL dimension scores as explanatory variables had the best predictive accuracy using MAE and the equivalent beta-binomial model had the best predictive accuracy using MSE.

CONCLUSIONS

Our mapping algorithm facilitates the estimation of health-state utilities for use within economic evaluations where only PedsQL data is available and is suitable for use in community-based adolescents aged 15-17 years. Applicability of the algorithm in younger populations should be assessed in further research.

Experimental measurement of preferences in health and healthcare using best-worst scaling: an overview

Best-worst scaling (BWS), also known as maximum-difference scaling, is a multiattribute approach to measuring preferences. BWS aims at the analysis of preferences regarding a set of attributes, their levels or alternatives. It is a stated-preference method based on the assumption that respondents are capable of making judgments regarding the best and the worst (or the most and least important, respectively) out of three or more elements of a choice-set. As is true of discrete choice experiments (DCE) generally, BWS avoids the known weaknesses of rating and ranking scales while holding the promise of generating additional information by making respondents choose twice, namely the best as well as the worst criteria. A systematic literature review found 53 BWS applications in health and healthcare. This article expounds possibilities of application, the underlying theoretical concepts and the implementation of BWS in its three variants: 'object case', 'profile case', 'multiprofile case'. This paper contains a survey of BWS methods and revolves around study design, experimental design, and data analysis. Moreover the article discusses the strengths and weaknesses of the three types of BWS distinguished and offered an outlook. A companion paper focuses on special issues of theory and statistical inference confronting BWS in preference measurement.

Using Best-Worst Scaling to Investigate Preferences in Health Care

INTRODUCTION

Best-worst scaling (BWS) is becoming increasingly popular to elicit preferences in health care. However, little is known about current practice and trends in the use of BWS in health care. This study aimed to identify, review and critically appraise BWS in health care, and to identify trends over time in key aspects of BWS.

METHODS

A systematic review was conducted, using Medline (via Pubmed) and EMBASE to identify all English-language BWS studies published up until April 2016. Using a predefined extraction form, two reviewers independently selected articles and critically appraised the study quality, using the Purpose, Respondents, Explanation, Findings, Significance (PREFS) checklist. Trends over time periods (≤2010, 2011, 2012, 2013, 2014 and 2015) were assessed further.

RESULTS

A total of 62 BWS studies were identified, of which 26 were BWS object case studies, 29 were BWS profile case studies and seven were BWS multi-profile case studies. About two thirds of the studies were performed in the last 2 years. Decreasing sample sizes and decreasing numbers of factors in BWS object case studies, as well as use of less complicated analytical methods, were observed in recent studies. The quality of the BWS studies was generally acceptable according to the PREFS checklist, except that most studies did not indicate whether the responders were similar to the non-responders.

CONCLUSION

Use of BWS object case and BWS profile case has drastically increased in health care, especially in the last 2 years. In contrast with previous discrete-choice experiment reviews, there is increasing use of less sophisticated analytical methods.

Reliability, Validity, and Feasibility of Direct Elicitation of Children's Preferences for Health States

BACKGROUND

Children's preferences for health states represent an important perspective when comparing the value of alternative health care interventions related to pediatric medicine, and are fundamental to comparative effectiveness research. However, there is debate over whether these preference data can be collected and used.

PURPOSE

The purpose of this study was to establish psychometric properties of eliciting preferences for health states from children using direct methods.

DATA SOURCES

Ovid Medline, PsycINFO, Scopus, EconLit.

STUDY SELECTION

English studies, published after 1990, were identified using Medical Subject Headings or keywords. Results were reviewed to confirm that the study was based on: 1) a sample of children, and 2) preferences for health states.

DATA EXTRACTION

Standardized data collection forms were used to record the preference elicitation method used, and any reported evidence regarding the validity, reliability, or feasibility of the method.

DATA SYNTHESIS

Twenty-six studies were ultimately included in the analysis. The standard gamble and time tradeoff were the most commonly reported direct preference elicitation methods. Seven studies reported validity, four reported reliability, and nine reported feasibility. Of the validity reports, construct validity was assessed most often. Reliability reports typically involved interclass correlation coefficient. For feasibility, four studies reported completion rates.

LIMITATIONS

The search was limited to four databases and restricted to English studies published after 1990. Only evidence available in published studies were considered; measurement properties may have been tested in pilot or pre-studies but were not published, and are not included in this review.

CONCLUSION

The few studies found through this systematic review demonstrate that there is little empirical evidence on which to judge the use of direct preference elicitation methods with children regarding health states.

Does one size fit all? Assessing the preferences of older and younger people for attributes of quality of life

PURPOSE

To systematically compare, via ranking and best worst tasks, the relative importance of key dimensions of quality of life for younger and older people.

METHODS

A web-based survey was developed for administration to two Australia-wide community-based samples comprising younger people aged 18-64 years and older people aged 65 years and above. Respondents were asked to rank 12 quality of life dimensions. Respondents also completed a successive best worst task using the same 12 quality of life dimensions.

RESULTS

The relative importance of the quality of life dimensions differed for younger and older person samples. For older people, the ability to be independent and to have control over their daily lives were particularly important for their overall quality of life whereas for younger people, mental health was considered most important.

CONCLUSIONS

Many interventions accessed by older people in geriatric medicine and aged care sectors have a broader impact upon quality of life beyond health status. The findings from this study indicate that a focus on broader aspects of quality of life may also be consistent with the preferences of older people themselves as to what constitutes quality of life from their perspective.

Variation in Treatment Priorities for Chronic Hepatitis C: A Latent Class Analysis

BACKGROUND

Data describing patients' priorities, or main concerns, are essential to inform important decisions in healthcare, including treatment planning, diagnostic testing, and the development of programs to improve access and delivery of care. To date, the majority of studies performed does not account for variability in patients' priorities, and as a consequence may not effectively inform end users. The objective of this study was to examine the value of segmentation analysis as a method to illustrate variability in priorities for treatment of chronic hepatitis C (HCV).

METHODS

We elicited patients' main concerns when considering antiviral therapy for HCV using a Best-Worst Scaling experiment (Case 1) with ten objects. Latent class analysis was used to estimate part-worth utilities and the probability that each respondent belongs to each segment.

RESULTS

In the aggregate, subjects (N = 162) had three main concerns: (1) not being cured; (2) experiencing a lot of side effects; and (3) developing viral resistance to therapy. Segmentation into two groups demonstrated that both groups prioritized the likelihood of cure and coping with side effects, but that only one group (n = 78) was concerned about developing viral resistance to therapy, while subjects in the second group (n = 84) prioritized being able to keep up with their responsibilities. Further segmentation revealed distinct clusters of patients with unique priorities.

CONCLUSIONS

Patients' priorities vary significantly. Preference studies should consider including methods to determine whether distinct clusters of priorities and/or concerns exist in order to accurately inform end users' decision making.

Paving the way for the use of the SDQ in economic evaluations of school-based population health interventions: an empirical analysis of the external validity of SDQ mapping algorithms to the CHU9D in an educational setting

PURPOSE

The Strengths and Difficulties Questionnaire (SDQ) is a behavioural screening tool for children. The SDQ is increasingly used as the primary outcome measure in population health interventions involving children, but it is not preference based; therefore, its role in allocative economic evaluation is limited. The Child Health Utility 9D (CHU9D) is a generic preference-based health-related quality of-life measure. This study investigates the applicability of the SDQ outcome measure for use in economic evaluations and examines its relationship with the CHU9D by testing previously published mapping algorithms. The aim of the paper is to explore the feasibility of using the SDQ within economic evaluations of school-based population health interventions.

METHODS

Data were available from children participating in a cluster randomised controlled trial of the school-based roots of empathy programme in Northern Ireland. Utility was calculated using the original and alternative CHU9D tariffs along with two SDQ mapping algorithms. t tests were performed for pairwise differences in utility values from the preference-based tariffs and mapping algorithms.

RESULTS

Mean (standard deviation) SDQ total difficulties and prosocial scores were 12 (3.2) and 8.3 (2.1). Utility values obtained from the original tariff, alternative tariff, and mapping algorithms using five and three SDQ subscales were 0.84 (0.11), 0.80 (0.13), 0.84 (0.05), and 0.83 (0.04), respectively. Each method for calculating utility produced statistically significantly different values except the original tariff and five SDQ subscale algorithm.

CONCLUSION

Initial evidence suggests the SDQ and CHU9D are related in some of their measurement properties. The mapping algorithm using five SDQ subscales was found to be optimal in predicting mean child health utility. Future research valuing changes in the SDQ scores would contribute to this research.

Nothing About Us Without Us? A Comparison of Adolescent and Adult Health-State Values for the Child Health Utility-9D Using Profile Case Best-Worst Scaling

The main objective of this study was to compare and contrast adolescent and adult values for the Child Health Utility-9D (CHU9D), a new generic preference-based measure of health-related quality of life designed for application in the economic evaluation of treatment and preventive programmes for children and adolescents. Previous studies have indicated that there may be systematic differences in adolescent and adult values for identical health states. An online survey including a series of best-worst scaling discrete choice experiment questions for health states defined by the CHU9D was administered to two general population samples comprising adults and adolescents, respectively. The results highlight potentially important age-related differences in the values attached to CHU9D dimensions. Adults, in general, placed less weight upon impairments in mental health (worried, sad, annoyed) and more weight upon moderate to severe levels of pain relative to adolescents. The source of values (adults or adolescents) has important implications for economic evaluation and may impact significantly upon healthcare policy.

Valuing the Child Health Utility 9D: Using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm

In contrast to the recent proliferation of studies incorporating ordinal methods to generate health state values from adults, to date relatively few studies have utilised ordinal methods to generate health state values from adolescents. This paper reports upon a study to apply profile case best worst scaling methods to derive a new adolescent specific scoring algorithm for the Child Health Utility 9D (CHU9D), a generic preference based instrument that has been specifically designed for the estimation of quality adjusted life years for the economic evaluation of health care treatment and preventive programs targeted at young people. A survey was developed for administration in an on-line format in which consenting community based Australian adolescents aged 11-17 years (N = 1982) indicated the best and worst features of a series of 10 health states derived from the CHU9D descriptive system. The data were analyzed using latent class conditional logit models to estimate values (part worth utilities) for each level of the nine attributes relating to the CHU9D. A marginal utility matrix was then estimated to generate an adolescent-specific scoring algorithm on the full health = 1 and dead = 0 scale required for the calculation of QALYs. It was evident that different decision processes were being used in the best and worst choices. Whilst respondents appeared readily able to choose 'best' attribute levels for the CHU9D health states, a large amount of random variability and indeed different decision rules were evident for the choice of 'worst' attribute levels, to the extent that the best and worst data should not be pooled from the statistical perspective. The optimal adolescent-specific scoring algorithm was therefore derived using data obtained from the best choices only. The study provides important insights into the use of profile case best worst scaling methods to generate health state values with adolescent populations.

Important features of home-based support services for older Australians and their informal carers

In Australia, newly initiated, publicly subsidised 'Home-Care Packages' designed to assist older people (≥ 65 years of age) living in their own home must now be offered on a 'consumer-directed care' (CDC) basis by service providers. However, CDC models have largely developed in the absence of evidence on users' views and preferences. The aim of this study was to determine what features (attributes) of consumer-directed, home-based support services are important to older people and their informal carers to inform the design of a discrete choice experiment (DCE). Semi-structured, face-to-face interviews were conducted in December 2012-November 2013 with 17 older people receiving home-based support services and 10 informal carers from 5 providers located in South Australia and New South Wales. Salient service characteristics important to participants were determined using thematic and constant comparative analysis and formulated into attributes and attribute levels for presentation within a DCE. Initially, eight broad themes were identified: information and knowledge, choice and control, self-managed continuum, effective co-ordination, effective communication, responsiveness and flexibility, continuity and planning. Attributes were formulated for the DCE by combining overlapping themes such as effective communication and co-ordination, and the self-managed continuum and planning into single attributes. Six salient service features that characterise consumer preferences for the provision of home-based support service models were identified: choice of provider, choice of support worker, flexibility in care activities provided, contact with the service co-ordinator, managing the budget and saving unspent funds. Best practice indicates that qualitative research with individuals who represent the population of interest should guide attribute selection for a DCE and this is the first study to employ such methods in aged care service provision. Further development of services could incorporate methods of consumer engagement such as DCEs which facilitate the identification and quantification of users' views and preferences on alternative models of delivery.

Valuing Child Health Utility 9D Health States with Young Adults: Insights from a Time Trade Off Study

OBJECTIVES

In contrast to the proliferation of studies incorporating health state values from adults of all ages, relatively few studies have reported upon the application of the time trade off (TTO) approach to generate health state values from populations of younger adults. This study sought to employ a conventional TTO approach to obtain values for a selection of Child Health Utility 9D (CHU9D) health states from a sample of young adults aged 18-29 years and to compare with the values generated from application of the original UK adult standard gamble scoring algorithm and the Australian adolescent scoring algorithm.

METHODS

A convenience sample of Flinders University undergraduate students aged 18-29 years were invited to participate in an interviewer administered conventional TTO task to value a series of five CHU9D health impairment states using the widely used variant developed by the York EQ-5D team.

RESULTS

A total of 152 students within the target age range were approached to participate in the study of whom n = 38 consented to participate, giving an overall participation rate of 25%. With the exception of one health state, the mean TTO values were consistently lower than those generated from application of the original scoring algorithm for the CHU9D elicited with adults of all ages. A significant proportion of participants (n = 17, 45%) considered the most severe CHU9D (PITS) state to be worse than death.

CONCLUSIONS

This study adds to a growing body of evidence indicating that the values attached to identical health states are typically lower for younger people in comparison with adults of all ages and dependent upon the elicitation method utilised. The values obtained are applicable for re-scaling raw CHU9D health state values obtained from younger adolescent samples using profile case best-worst scaling.

A Review of the Development and Application of Generic Multi-Attribute Utility Instruments for Paediatric Populations

Multi-attribute utility instruments (MAUIs) are increasingly being used as a means of quantifying utility for the calculation of quality-adjusted life-years within the context of cost utility analysis. Traditionally, MAUIs have been developed and applied in adult populations. However, increasingly, researchers in health economics and other disciplines are recognising the importance of the measurement and valuation of health in both children and adolescents. Presently, there are nine generic MAUIs available internationally that have been used in paediatric populations: the Quality of Well-Being Scale (QWB), the Health Utility Index Mark 2 (HUI2), the HUI3, the Sixteen-dimensional measure of health-related quality of life (HRQoL) (16D), the Seventeen-dimensional measure of HRQoL (17D), the Assessment of Quality of Life 6-Dimension (AQoL-6D) Adolescent, the Child Health Utility 9D (CHU9D), the EQ-5D Youth version (EQ-5D-Y) and the Adolescent Health Utility Measure (AHUM). This paper critically reviews the development and application of the above nine MAUIs and discusses the specific challenges of health utility measurement in children and adolescents. Areas for further research relating to the development and application of generic MAUIs in paediatric populations are highlighted.

Mitii™ ABI: study protocol of a randomised controlled trial of a web-based multi-modal training program for children and adolescents with an Acquired Brain Injury (ABI)

BACKGROUND

Acquired brain injury (ABI) refers to multiple disabilities arising from damage to the brain acquired after birth. Children with an ABI may experience physical, cognitive, social and emotional-behavioural impairments which can impact their ability to participate in activities of daily living (ADL). Recent developments in technology have led to the emergence of internet-delivered therapy programs. "Move it to improve it" (Mitii™) is a web-based multi-modal therapy that comprises upper limb (UL) and cognitive training within the context of meaningful physical activity. The proposed study aims to compare the efficacy of Mitii™ to usual care to improve ADL motor and processing skills, gross motor capacity, UL and executive functioning in a randomised waitlist controlled trial.

METHODS/DESIGN

Sixty independently ambulant children (30 in each group) at least 12 months post ABI will be recruited to participate in this trial. Children will be matched in pairs at baseline and randomly allocated to receive either 20 weeks of Mitii™ training (30 min per day, six days a week, with a potential total dose of 60 h) immediately, or be waitlisted for 20 weeks. Outcomes will be assessed at baseline, immediately post-intervention and at 20 weeks post-intervention. The primary outcomes will be the Assessment of Motor and Process Skills and 30 s repetition maximum of functional strength exercises (sit-to-stand, step-ups and half kneel to stand). Measures of body structure and functions, activity, participation and quality of life will assess the efficacy of Mitii™ across all domains of the International Classification of Functioning, Disability and Health framework. A subset of children will undertake three tesla (3T) magnetic resonance imaging scans to evaluate functional neurovascular changes, structural imaging, diffusion imaging and resting state functional connectivity before and after intervention.

DISCUSSION

Mitii™ provides an alternative approach to deliver intensive therapy for children with an ABI in the convenience of the home environment. If Mitii™ is found to be effective, it may offer an accessible and inexpensive intervention option to increase therapy dose.

TRIAL REGISTRATION

ANZCTR12613000403730.

Measuring Health Utilities in Children and Adolescents: A Systematic Review of the Literature

Background

The objective of this review was to evaluate the use of all direct and indirect methods used to estimate health utilities in both children and adolescents. Utilities measured pre- and post-intervention are combined with the time over which health states are experienced to calculate quality-adjusted life years (QALYs). Cost-utility analyses (CUAs) estimate the cost-effectiveness of health technologies based on their costs and benefits using QALYs as a measure of benefit. The accurate measurement of QALYs is dependent on using appropriate methods to elicit health utilities.

Objective

We sought studies that measured health utilities directly from patients or their proxies. We did not exclude those studies that also included adults in the analysis, but excluded those studies focused only on adults.

Methods and Findings

We evaluated 90 studies from a total of 1,780 selected from the databases. 47 (52%) studies were CUAs incorporated into randomised clinical trials; 23 (26%) were health-state utility assessments; 8 (9%) validated methods and 12 (13%) compared existing or new methods. 22 unique direct or indirect calculation methods were used a total of 137 times. Direct calculation through standard gamble, time trade-off and visual analogue scale was used 32 times. The EuroQol EQ-5D was the most frequently-used single method, selected for 41 studies. 15 of the methods used were generic methods and the remaining 7 were disease-specific. 48 of the 90 studies (53%) used some form of proxy, with 26 (29%) using proxies exclusively to estimate health utilities.

Conclusions

Several child- and adolescent-specific methods are still being developed and validated, leaving many studies using methods that have not been designed or validated for use in children or adolescents. Several studies failed to justify using proxy respondents rather than administering the methods directly to the patients. Only two studies examined missing responses to the methods administered with respect to the patients’ ages.

Factors impacting physicians' decisions to prevent variceal hemorrhage

Background

Reasons underlying the variability of physicians’ preferences for non-selective beta-blockers (BBs) and endoscopic variceal ligation (EVL) to prevent a first variceal bleed have not been empirically studied. Our aims were to examine whether 1) gastroenterologists can be classified into distinct subgroups based on how they prioritize specific treatment attributes and 2) physician characteristics are associated with treatment preference.

Methods

We surveyed physicians to determine their preferred treatment for a standardized patient with large varices and examined the influence of treatment characteristics on physicians’ decision making using best-worst scaling. Latent class analysis was used to examine whether physicians could be classified into groups with similar decision-making styles.

Results

110 physicians were interviewed (participation rate 39%). The majority spent two or more days a week performing endoscopies and had practices comprising less than 25% of patients with liver disease. Latent class analysis demonstrated that physicians could be classified into at least two distinct groups. Most (n = 80, Group 1) were influenced solely by the ability to visually confirm eradication of varices. In contrast, members of Group 2 (n = 30) were influenced by the side effects and mechanism of action of BBs. Group 1 members were more likely to have practices that included fewer patients with liver disease and more likely to choose options including EVL (p = 0.01 for both).

Conclusions

Among physicians, where the majority performs endoscopy on two or more days per week, most prefer prevention strategies which include EVL. This may be due to the strong appeal of being able to visualize eradication of varices.

Patient-Reported Outcome Instruments in Pediatric Deformity Surgery: A Bibliometric Analysis

STUDY DESIGN

Bibliometric analysis.

OBJECTIVES

To identify patient-reported outcomes instruments (PROIs) used in pediatric deformity surgery research over the past decade and their frequency and usage trends.

SUMMARY OF BACKGROUND DATA

The emphasis on PROIs is increasing along with the demand for evidence-based medicine and cost-effectiveness research. Therefore, investigators and PROI consensus writers should be aware of the PROIs used in pediatric deformity and usage trends.

METHODS

Five top orthopedics journals were reviewed from 2004 to 2013 for clinical studies of surgical intervention in pediatric deformity that report PROIs. Publication year, level of evidence (LOE), and PROIs were reported for each article. Mean and range scores for the most frequently used PROIs were analyzed at 2-year follow-up.

RESULTS

A total of 79 studies using PROIs were published in the pediatric deformity literature over the period studied. The researchers identified 21 named PROIs and 6 additional custom questionnaires. The Scoliosis Research Society (SRS)-22 was the most frequently used instrument (32.9%), followed by the SRS-24 (29.1%), Oswestry disability index (17.7%), visual analog scale (12.7%), SRS-30 (10.1%), and Short Form-36 (6.3%). Level of evidence III was most common (39.2%) and 1 LOE I study was identified. Mean preoperative and postoperative SRS instrument scores were 4.0 (95% confidence interval, 3.8-4.1) and 4.5 (95% confidence interval, 4.4-4.6), respectively, in SRS-22r equivalents. No studies met the criteria for mean and range calculation for the other top instruments.

CONCLUSIONS

Scoliosis Research Society instruments are used in 74.7% of pediatric deformity studies reporting PROIs. Therefore, there is a consensus that SRS instruments should be used in pediatric deformity outcome studies; yet, consistent use of the most up-to-date version, the SRS-22r, is still needed. General health questionnaires are currently underused in pediatric deformity research. Version reporting and use of the latest versions of PROIs need to be improved in future studies.

The validity of the Child Health Utility instrument (CHU9D) as a routine outcome measure for use in child and adolescent mental health services

BACKGROUND

Few cost-utility studies of child and adolescent mental health services (CAMHS) use quality adjusted life years (a combination of utility weights and time in health state) as the outcome to enable comparison across disparate programs and modalities. Part of the solution to this problem involves embedding preference-based health-related quality of life (PBHRQOL) utility instruments, which generate utility weights, in clinical practice and research. The Child Health Utility (CHU9D) is a generic PBHRQOL instrument developed specifically for use in young people. The purpose of this study was to assess the suitability of the CHU9D as a routine outcome measure in CAMHS clinical practice.

METHODS

Two hundred caregivers of children receiving community mental health services completed the CHU9D alongside a standardised child and adolescent mental health measure (the Strengths and Difficulties Questionnaire - SDQ) during a telephone interview. We investigated face validity, practicality, internal consistency, and convergent validity of the CHU9D. In addition, we compared the utility weights obtained in this group with utility weights from other studies of child and adolescent mental health populations.

RESULTS

Participants found the CHU9D easy and quick to complete. It demonstrated acceptable internal consistency, and correlated moderately with the SDQ. It was able to discriminate between children in the abnormal range and those in the non-clinical/borderline range as measured by the SDQ. Three CHU9D items without corollaries in the SDQ (sleep, schoolwork, daily routine) were found to be significant predictors of the SDQ total score and may be useful clinical metrics. The mean utility weight of this sample was comparable with clinical subsamples from other CHU9D studies, but was significantly higher than mean utility weights noted in other child and adolescent mental health samples.

CONCLUSIONS

Initial validation suggests further investigation of the CHU9D as a routine outcome measure in CAMHS is warranted. Further investigation should explore test-retest reliability, sensitivity to change, concordance between caregiver and child-completed forms, and the calibration of the utility weights. Differences between utility weights generated by the CHU9D and other utility instruments in this population should be further examined by administering a range of PBHRQOL instruments concurrently in a mental health group.

Comparison of general population, patient, and carer utility values for dementia health states

Utility values to estimate quality-adjusted life years (QALYs) for use in cost-utility analyses are usually elicited from members of the general population. Public attitudes and understanding of dementia in particular may mean that values elicited from the general population may differ from patients and carers for dementia health states. This study examines how the population impacts utility values elicited for dementia health states using interviewer-administered time tradeoff valuation of health states defined by the dementia-specific preference-based measures DEMQOL-U (patient-report) and DEMQOL-Proxy-U (carer-report). Eight DEMQOL-U states were valued by 78 members of the UK general population and 71 patients with dementia of mild severity. Eight DEMQOL-Proxy-U states were valued by 77 members of the UK general population and 71 carers of patients with dementia of mild severity. Random-effects generalized least squares regression estimated the impact of population, dementia health state, and respondent sociodemographic characteristics on elicited values, finding that values for dementia health states differed by population and that the difference varied across dementia health states. Patients with dementia and carers of patients with dementia gave systematically lower values than members of the general population that were not due to differences in the sociodemographic characteristics of the populations. Our results suggest that the population used to produce dementia health state values could impact the results of cost-utility analyses and potentially affect resource allocation decisions; yet, currently, only general population values are available for usage.

From KIDSCREEN-10 to CHU9D: creating a unique mapping algorithm for application in economic evaluation

Background

The KIDSCREEN-10 index and the Child Health Utility 9D (CHU9D) are two recently developed generic instruments for the measurement of health-related quality of life in children and adolescents. Whilst the CHU9D is a preference based instrument developed specifically for application in cost-utility analyses, the KIDSCREEN-10 is not currently suitable for application in this context. This paper provides an algorithm for mapping the KIDSCREEN-10 index onto the CHU9D utility scores.

Methods

A sample of 590 Australian adolescents (aged 11–17) completed both the KIDSCREEN-10 and the CHU9D. Several econometric models were estimated, including ordinary least squares estimator, censored least absolute deviations estimator, robust MM-estimator and generalised linear model, using a range of explanatory variables with KIDSCREEN-10 items scores as key predictors. The predictive performance of each model was judged using mean absolute error (MAE) and root mean squared error (RMSE).

Results

The MM-estimator with stepwise-selected KIDSCREEN-10 items scores as explanatory variables had the best predictive accuracy using MAE, whilst the equivalent ordinary least squares model had the best predictive accuracy using RMSE.

Conclusions

The preferred mapping algorithm (i.e. the MM-estimate with stepwise selected KIDSCREEN-10 item scores as the predictors) can be used to predict CHU9D utility from KIDSCREEN-10 index with a high degree of accuracy. The algorithm may be usefully applied within cost-utility analyses to generate cost per quality adjusted life year estimates where KIDSCREEN-10 data only are available.

A think aloud study comparing the validity and acceptability of discrete choice and best worst scaling methods

Objectives

This study provides insights into the validity and acceptability of Discrete Choice Experiment (DCE) and profile-case Best Worst Scaling (BWS) methods for eliciting preferences for health care in a priority-setting context.

Methods

An adult sample (N = 24) undertook a traditional DCE and a BWS choice task as part of a wider survey on Health Technology Assessment decision criteria. A ‘think aloud’ protocol was applied, whereby participants verbalized their thinking while making choices. Internal validity and acceptability were assessed through a thematic analysis of the decision-making process emerging from the qualitative data and a repeated choice task.

Results

A thematic analysis of the decision-making process demonstrated clear evidence of ‘trading’ between multiple attribute/levels for the DCE, and to a lesser extent for the BWS task. Limited evidence consistent with a sequential decision-making model was observed for the BWS task. For the BWS task, some participants found choosing the worst attribute/level conceptually challenging. A desire to provide a complete ranking from best to worst was observed. The majority (18,75%) of participants indicated a preference for DCE, as they felt this enabled comparison of alternative full profiles. Those preferring BWS were averse to choosing an undesirable characteristic that was part of a ‘package’, or perceived BWS to be less ethically conflicting or burdensome. In a repeated choice task, more participants were consistent for the DCE (22,92%) than BWS (10,42%) (p = 0.002).

Conclusions

This study supports the validity and acceptability of the traditional DCE format. Findings relating to the application of BWS profile methods are less definitive. Research avenues to further clarify the comparative merits of these preference elicitation methods are identified.

Australian Public Preferences for the Funding of New Health Technologies

Background. Ethical, economic, political, and legitimacy arguments support the consideration of public preferences in health technology decision making. The objective was to assess public preferences for funding new health technologies and to compare a profile case best-worst scaling (BWS) and traditional discrete choice experiment (DCE) method. Methods. An online survey consisting of a DCE and BWS task was completed by 930 adults recruited via an Internet panel. Respondents traded between 7 technology attributes. Participation quotas broadly reflected the population of Queensland, Australia, by gender and age. Choice data were analyzed using a generalized multinomial logit model. Results. The findings from both the BWS and DCE were generally consistent in that respondents exhibited stronger preferences for technologies offering prevention or early diagnosis over other benefit types. Respondents also prioritized technologies that benefit younger people, larger numbers of people, those in rural areas, or indigenous Australians; that provide value for money; that have no available alternative; or that upgrade an existing technology. However, the relative preference weights and consequent preference orderings differed between the DCE and BWS models. Further, poor correlation between the DCE and BWS weights was observed. While only a minority of respondents reported difficulty completing either task (22.2% DCE, 31.9% BWS), the majority (72.6%) preferred the DCE over BWS task. Conclusions. This study provides reassurance that many criteria routinely used for technology decision making are considered to be relevant by the public. The findings clearly indicate the perceived importance of prevention and early diagnosis. The dissimilarity observed between DCE and profile case BWS weights is contrary to the findings of previous comparisons and raises uncertainty regarding the comparative merits of these stated preference methods in a priority-setting context.

BMI, health behaviors, and quality of life in children and adolescents: a school-based study

OBJECTIVE

To explore the relationship between weight status (BMI) and health-related quality of life in children and adolescents through application of the Child Health Utility 9D, a new generic preference-based instrument.

METHODS

Data were collected from primary and high school students in rural and metropolitan regions of South Australia. Consenting participants (2588 in grades 4-6 and 765 in grades 9-10) were weighed and measured and categorized as underweight, healthy weight, overweight, or obese according to International Obesity Taskforce BMI cutoff points (primary outcome). Participants also completed a questionnaire including the Child Health Utility 9D and standardized measures of physical activity, sedentary behavior, sleep patterns, and eating behavior (secondary outcomes). Descriptive and multivariate linear regression analyses were undertaken to calculate mean utility differences.

RESULTS

In comparison with healthy-weight primary school students, adjusted mean utilities were lower for overweight (-0.016, P = .02) or obese (-0.039, P = .001) students. For high school students, the adjusted mean utilities were also lower for overweight and obese students but were nonsignificant (-0.018, P > .10). Physical activity, sedentary behavior, sleep patterns, and eating behavior were all found to be significantly associated with utilities.

CONCLUSIONS

Irrespective of BMI, young people engaging in more physical activities or less sedentary behavior, and having healthier sleep patterns or eating behavior exhibited higher utilities. Associations between utilities and sleep patterns or eating behavior were stronger than the associations with BMI. Future economic evaluations for obesity interventions should more formally investigate the relationship between changes over time in weight status and health-related quality of life for children and adolescents.

Measuring and valuing health-related quality of life among children and adolescents in mainland China--a pilot study

Background

The Child Health Utility 9D (CHU9D), a new generic preference-based health-related quality of life (HRQoL) instrument, has been validated for use in young people in both the UK and Australia. The main objectives of this study were to examine the feasibility of using a Chinese version of the CHU9D (CHU9D-CHN) to assess HRQoL and to investigate the association of physical activity, homework hours and sleep duration with HRQoL in children and adolescents in Mainland China.

Methods

Data were collected using a multi-stage sampling method from grades 4–12 students in May 2013 in Nanjing, China. Consenting participants (N = 815) completed a self-administered questionnaire including the CHU9D-CHN instrument and information on physical activity, homework and sleep duration, self-reported health status, and socio-demographic characteristics. Descriptive and multivariate linear regression analyses were undertaken. CHU9D-CHN utility scores were generated by employing two scoring algorithms currently available for the instrument, the first derived from UK adults utilising the standard gamble (SG) valuation method and the second derived from Australian adolescents utilising the best-worst scaling (BWS) method.

Results

It was found that CHU9D utility scores discriminated well in relation to self-reported health status and that better health status was significantly associated with higher utility scores regardless of which scoring algorithm was employed (both p<0.001). The adjusted mean utilities were significantly higher for physically active than inactive students (0.023 by SG, 0.029 by BWS scoring methods, p<0.05). An additional hour of doing homework and sleep duration were, separately, associated with mean utilities of −0.019 and 0.032 based on SG, and −0.021 and 0.040 according to BWS scoring algorithms (p<0.01).

Conclusion

The CHU9D-CHN shows promise for measuring and valuing the HRQoL of children and adolescents in China. Levels of self-reported physical activity, homework and sleep time were important influencers of utility scores.

Valuing SF-6D Health States Using a Discrete Choice Experiment

BACKGROUND

SF-6D utility weights are conventionally produced using a standard gamble (SG). SG-derived weights consistently demonstrate a floor effect not observed with other elicitation techniques. Recent advances in discrete choice methods have allowed estimation of utility weights. The objective was to produce Australian utility weights for the SF-6D and to explore the application of discrete choice experiment (DCE) methods in this context. We hypothesized that weights derived using this method would reflect the largely monotonic construction of the SF-6D.

METHODS

We designed an online DCE and administered it to an Australia-representative online panel (n = 1017). A range of specifications investigating nonlinear preferences with respect to additional life expectancy were estimated using a random-effects probit model. The preferred model was then used to estimate a preference index such that full health and death were valued at 1 and 0, respectively, to provide an algorithm for Australian cost-utility analyses.

RESULTS

Physical functioning, pain, mental health, and vitality were the largest drivers of utility weights. Combining levels to remove illogical orderings did not lead to a poorer model fit. Relative to international SG-derived weights, the range of utility weights was larger with 5% of health states valued below zero.

CONCLUSION

s. DCEs can be used to investigate preferences for health profiles and to estimate utility weights for multi-attribute utility instruments. Australian cost-utility analyses can now use domestic SF-6D weights. The comparability of DCE results to those using other elicitation methods for estimating utility weights for quality-adjusted life-year calculations should be further investigated.

Pediatric patient-reported outcome instruments for research to support medical product labeling: report of the ISPOR PRO good research practices for the assessment of children and adolescents task force

BACKGROUND

Patient-reported outcome (PRO) instruments for children and adolescents are often included in clinical trials with the intention of collecting data to support claims in a medical product label.

OBJECTIVE

The purpose of the current task force report is to recommend good practices for pediatric PRO research that is conducted to inform regulatory decision making and support claims made in medical product labeling. The recommendations are based on the consensus of an interdisciplinary group of researchers who were assembled for a task force associated with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). In those areas in which supporting evidence is limited or in which general principles may not apply to every situation, this task force report identifies factors to consider when making decisions about the design and use of pediatric PRO instruments, while highlighting issues that require further research.

GOOD RESEARCH PRACTICES

Five good research practices are discussed: 1) Consider developmental differences and determine age-based criteria for PRO administration: Four age groups are discussed on the basis of previous research (<5 years old, 5-7 years, 8-11 years, and 12-18 years). These age groups are recommended as a starting point when making decisions, but they will not fit all PRO instruments or the developmental stage of every child. Specific age ranges should be determined individually for each population and PRO instrument. 2) Establish content validity of pediatric PRO instruments: This section discusses the advantages of using children as content experts, as well as strategies for concept elicitation and cognitive interviews with children. 3) Determine whether an informant-reported outcome instrument is necessary: The distinction between two types of informant-reported measures (proxy vs. observational) is discussed, and recommendations are provided. 4) Ensure that the instrument is designed and formatted appropriately for the target age group. Factors to consider include health-related vocabulary, reading level, response scales, recall period, length of instrument, pictorial representations, formatting details, administration approaches, and electronic data collection (ePRO). 5) Consider cross-cultural issues.

CONCLUSIONS

Additional research is needed to provide methodological guidance for future studies, especially for studies involving young children and parents' observational reports. As PRO data are increasingly used to support pediatric labeling claims, there will be more information regarding the standards by which these instruments will be judged. The use of PRO instruments in clinical trials and regulatory submissions will help ensure that children's experience of disease and treatment are accurately represented and considered in regulatory decisions.

Risk factors for impaired quality of life and psychosocial adjustment after pediatric heart, kidney, and liver transplantation

Few studies compare HRQOL and PSA in children who have undergone different types of solid organ Tx. In this cross-sectional study, HRQOL and PSA were assessed in 74 Tx patients (16 heart, 44 kidney, 14 liver) at a mean age of 11.5 (range 6.3-16.7), 7.2 yr post-Tx (range 1.0-15.0). HRQOL was self-assessed using standardized health utility questionnaires (15D-17D). The patients' PSA was evaluated using the Child Behavior Checklist for parents, Youth Self-Report for patients aged 11-16 yr, and Teacher Report Form. Outcomes did not differ significantly between Tx groups. Preadolescents (8-11 yr) reported poorer HRQOL compared with same-age peers (p = 0.020). In contrast, adolescents reported similar HRQOL and PSA compared to the general population. Proxy-reports revealed more PSA problems compared with age expectations (p < 0.01), mainly in internalizing behavior (p < 0.01). Lower HRQOL was associated with shorter follow-up time since Tx, congenital disease, and a psychiatric or neurological diagnosis. PSA problems were associated with family-related variables, neurological diagnosis, shorter follow-up time, and in teacher-reports longer disease duration before Tx. Different pediatric Tx groups have similar outcome. Neurological comorbidity and shorter follow-up time are important risk factors, but the impact of family-related variables on PSA indicate the need of family interventions.