1
|
Pilz MJ, Seyringer S, Hallsson LR, Bottomley A, Jansen F, King MT, Norman R, Rutten MJ, Verdonck-de Leeuw IM, Siersema PD, Gamper EM. The EORTC QLU-C10D is a valid cancer-specific preference-based measure for cost-utility and health technology assessment in the Netherlands. THE EUROPEAN JOURNAL OF HEALTH ECONOMICS : HEPAC : HEALTH ECONOMICS IN PREVENTION AND CARE 2024; 25:1539-1555. [PMID: 38483665 PMCID: PMC11512862 DOI: 10.1007/s10198-024-01670-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 01/10/2024] [Indexed: 08/03/2024]
Abstract
BACKGROUND Cost-utility analysis typically relies on preference-based measures (PBMs). While generic PBMs are widely used, disease-specific PBMs can capture aspects relevant for certain patient populations. Here the EORTC QLU-C10D, a cancer-specific PBM based on the QLQ-C30, is validated using Dutch trial data with the EQ-5D-3L as a generic comparator measure. METHODS We retrospectively analysed data from four Dutch randomised controlled trials (RCTs) comprising the EORTC QLQ-C30 and the EQ-5D-3L. Respective Dutch value sets were applied. Correlations between the instruments were calculated for domains and index scores. Bland-Altman plots and intra-class correlations (ICC) displayed agreement between the measures. Independent and paired t-tests, effect sizes and relative validity indices were used to determine the instruments' performance in detecting clinically known-group differences and health changes over time. RESULTS We analysed data from 602 cancer patients from four different trials. In overall, the EORTC QLU-C10D showed good relative validity with the EQ-5D-3L as a comparator (correlations of index scores r = 0.53-0.75, ICCs 0.686-0.808, conceptually similar domains showed higher correlations than dissimilar domains). Most importantly, it detected 63% of expected clinical group differences and 50% of changes over time in patients undergoing treatment. Both instruments showed poor performance in survivors. Detection rate and measurement efficiency were clearly higher for the QLU-C10D than for the EQ-5D-3L. CONCLUSIONS The Dutch EORTC QLU-C10D showed good comparative validity in patients undergoing treatment. Our results underline the benefit that can be achieved by using a cancer-specific PBM for generating health utilities for cancer patients from a measurement perspective.
Collapse
Affiliation(s)
- Micha J Pilz
- University Hospital of Psychiatry II, Medical University Innsbruck, Innsbruck, Austria
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL - University for Health Sciences and Technology, Hall, I.T., Austria
| | - Simon Seyringer
- Department of Nuclear Medicine, Medical University of Innsbruck, 6020, Innsbruck, Austria
| | - Lára R Hallsson
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL - University for Health Sciences and Technology, Hall, I.T., Austria
| | - Andrew Bottomley
- Quality of Life Department, European Organisation for Research and Treatment of Cancer, Brussels, Belgium
| | - Femke Jansen
- Department Otolaryngology-Head and Neck Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Treatment and Quality of Life, Amsterdam, The Netherlands
- Department Clinical, Neuro and Developmental Psychology, Vrije Universiteit Amsterdam, Van Der Boechorststraat 7-9, Amsterdam, The Netherlands
| | - Madeleine T King
- School of Psychology, University of Sydney, New South Wales, Australia
| | - Richard Norman
- School of Population Health, Curtin University, Perth, WA, Australia
| | - Marianne J Rutten
- Center of Gynaecologic Oncology Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - Irma M Verdonck-de Leeuw
- Department Otolaryngology-Head and Neck Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Treatment and Quality of Life, Amsterdam, The Netherlands
- Department Clinical, Neuro and Developmental Psychology, Vrije Universiteit Amsterdam, Van Der Boechorststraat 7-9, Amsterdam, The Netherlands
- Amsterdam Public Health, Mental Health, Amsterdam, The Netherlands
| | - Peter D Siersema
- Department of Gastroenterology and Hepatology, Radboud University Medical Center, Nijmegen, The Netherlands
- Department of Gastroenterology and Hepatology, Erasmus MC/University Medical Center, Rotterdam, The Netherlands
| | - Eva Maria Gamper
- University Hospital of Psychiatry II, Medical University Innsbruck, Innsbruck, Austria.
- Department of Nuclear Medicine, Medical University of Innsbruck, 6020, Innsbruck, Austria.
| |
Collapse
|
2
|
Rohde G, Lehmann J, Pilz MJ, Rojas-Concha L, Holzner B, King MT, Norman R, Kemmler G. Norwegian and Swedish value sets for the EORTC QLU-C10D utility instrument. Qual Life Res 2024:10.1007/s11136-024-03824-8. [PMID: 39499479 DOI: 10.1007/s11136-024-03824-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/26/2024] [Indexed: 11/07/2024]
Abstract
PURPOSE This study aimed to develop utility weights for the European Organization for Research and Treatment of Cancer (EORTC) QLU-C10D, a cancer-specific utility instrument, tailored to the Norwegian and Swedish populations. The utility weights are intended for use in the specific welfare contexts of Norway and Sweden to support more precise healthcare decision-making in cancer treatment and care. METHODS This cross-sectional study included 1019 Norwegian and 1048 Swedish participants representative in age and gender of the two general populations. Participants completed a discrete choice experiment involving 960 choice sets, each consisting of two EORTC QLU-C10D health states described by the instrument's domains and the duration of each state. Utility weights were calculated using generalized estimation equation models, and non-monotonic levels were merged to ensure consistent valuation. RESULTS In the Norwegian participants, the largest utility decrements were seen for the domain of physical functioning (decrement of - 0.263 for highest level "very much"), followed by pain (decrement - 0.205 for level "very much") and role functioning (- 0.139). Among the cancer-specific domains, nausea had the largest utility decrement (- 0.124). In the Swedish participants, the largest utility decrements were also observed for physical functioning (- 0.207 for the response "very much"), followed by pain (- 0.139), role functioning (- 0.133), and nausea (- 0.119). Emotional functioning also exhibited a sizable utility decrement (- 0.115). CONCLUSION This study provides the first set of utility weights for the EORTC QLU-C10D specific to Norway and Sweden, reflecting the unique health preferences of these populations. The generated utility decrements can inform cost-utility analyses and optimize resource allocation in cancer care within the Norwegian and Swedish healthcare systems.
Collapse
Affiliation(s)
- Gudrun Rohde
- Department of Health and Nursing, University of Agder, Kristiansand, Norway.
- Department of Clinical Research, Sorlandet Hospital, Kristiansand, Norway.
- Division of Psychiatry, Marie Curie Palliative Care Research Department, University College London, London, UK.
- Faculty of Health and Sport Sciences, University of Agder, Box 522, 4602, Kristiansand, Norway.
| | - Jens Lehmann
- University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
| | - Micha J Pilz
- University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
| | - Leslye Rojas-Concha
- Palliative Care Research Unit, Department of Geriatrics and Palliative Medicine GP, Bispebjerg & Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark
| | - Bernhard Holzner
- University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
| | - Madeleine T King
- School of Psychology, University of Sydney, Sydney, NSW, Australia
| | - Richard Norman
- School of Public Health, Curtin University, Perth, WA, Australia
| | - Georg Kemmler
- University Hospital of Psychiatry I, Medical University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
3
|
Cao Y, Li H, Cheng LJ, King MT, Kemmler G, Cella D, Yu H, Huang W, Luo N. A comparison of measurement properties between EORTC QLU-C10D and FACT-8D in patients with hematological malignances. HEALTH ECONOMICS REVIEW 2024; 14:79. [PMID: 39352657 PMCID: PMC11445936 DOI: 10.1186/s13561-024-00560-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Accepted: 09/17/2024] [Indexed: 10/04/2024]
Abstract
OBJECTIVE To perform a comparison of the measurement properties of two cancer-specific Multi-Attribute Utility Instruments (MAUIs), EORTC QLU-C10D and FACT-8D, in Chinese patients with hematologic malignancies (HM). METHODS We conducted a longitudinal study on patients with HM in China, using QLU-C10D and FACT-8D at baseline and follow-up (3-4 months from baseline). We assessed: (i) convergent validity using Spearman's rank correlation test (r) with EQ-5D-5L; (ii) clinical-groups validity by differentiating cancer stages, overall health assessment (OHA), Eastern Cancer Oncology Group (ECOG) performance status, and mental health status. We also examined clinical validity with effect size (ES) and relative efficiency (RE); (iii) responsiveness to changes in patient self-perception using receiver operating characteristics (ROC) curves and area under the curves (AUC); and (iv) agreement using intraclass correlation coefficients (ICC) and visualized with Bland-Altman plot. RESULTS Among the 308 patients with HM at baseline, 131 completed the follow-up survey. Agreement between the two measures was high (ICC = 0.76). Both measures were highly correlated with EQ-5D-5 L and significantly differentiated (p < 0.001) among groups categorized by cancer stage, OHA performance status, and mental health. ESs for QLU-C10D were numerically higher for cancer stage, OHA, and performance status (ES = 0.53-1.49), whereas ES was higher for FACT-8D and mental health status (ES = 1.35). Responsiveness was higher for QLU-C10D (AUC = 0.84) compared to FACT-8D (AUC = 0.78). CONCLUSION Both QLU-C10D and FACT-8D are valid cancer-specific MAUIs for evaluating patients with HM. However, scholars should consider their slight differences in focus when choosing between the two measures.
Collapse
Affiliation(s)
- Yiyin Cao
- School of Health Management, Harbin Medical University, Harbin, 150081, China
| | - Haofei Li
- School of Health Management, Harbin Medical University, Harbin, 150081, China
| | - Ling Jie Cheng
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| | - Madeleine T King
- School of Psychology, University of Sydney, Sydney, 2006, Australia
| | - Georg Kemmler
- Department of Psychiatry and Psychotherapy, Innsbruck Medical University, Innsbruck, Austria
| | - David Cella
- Feinberg School of Medicine, Northwestern University, Chicago, 60601, USA
| | - Hongjuan Yu
- Department of Hematology, The First Affiliated Hospital of Harbin Medical University, Harbin, China.
| | - Weidong Huang
- School of Health Management, Harbin Medical University, Harbin, 150081, China.
| | - Nan Luo
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| |
Collapse
|
4
|
Gandhi M, Kanesvaran R, Rashid MFBH, Chong DQ, Chay WY, Tan RLY, Norman R, King MT, Luo N. Valuation of the EORTC Quality of Life Utility Core 10 Dimensions (QLU-C10D) in a Multi-ethnic Asian Setting: How Does Having Cancer Matter? PHARMACOECONOMICS 2024:10.1007/s40273-024-01432-5. [PMID: 39325297 DOI: 10.1007/s40273-024-01432-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/22/2024] [Indexed: 09/27/2024]
Abstract
OBJECTIVES The aim of the study was to develop and compare utility value sets for the EORTC QLU-C10D, a cancer-specific utility instrument based on the EORTC QLQ-C30, using the preferences of the general public and cancer patients in Singapore, and to assess their measurement properties. METHODS A total of 600 individuals from the general public were recruited using a multi-stage random sampling, along with 626 cancer patients with clinically confirmed diagnoses from outpatient clinics of the largest tertiary cancer hospital. Each participant valued 16 pairs of EORTC QLU-C10D health states using a discrete choice experiment (DCE). Conditional logit models were used to analyze the DCE responses of the general public and cancer patients separately. Utility values were assessed for known-group validity and responsiveness in the cancer patients by comparing mean values across subgroups of patients and calculating standardized response means using longitudinal EORTC QLQ-C30 data, respectively. RESULTS Physical functioning and pain had the most impact on utility for both cancer patients and general public groups. Worst health state utility values were -0.821 and -0.463 for the general public and cancer patients, respectively. Cancer patients' values were lower for mild-to-moderate health states but higher for moderately-to-highly impaired states compared with the general public's values. Both value sets discriminated between patients with differing characteristics and responded equally well to improved health status, but the cancer patients' value set was slightly more responsive to deteriorated health. CONCLUSIONS EORTC QLU-C10D value sets based on the preferences of the Singaporean general public and cancer patients exhibited differences in values but similar psychometric properties.
Collapse
Affiliation(s)
- Mihir Gandhi
- Biostatistics, Singapore Clinical Research Institute, Consortium for Clinical Research and Innovation Singapore, Singapore, Singapore.
- Centre for Quantitative Medicine and Lien Centre for Palliative Care, Duke-NUS Medical School, Singapore, Singapore.
- Tampere Center for Child, Adolescent, and Maternal Health Research: Global Health Group, Tampere University, Tampere, Finland.
| | - Ravindran Kanesvaran
- Division of Medical Oncology, National Cancer Centre Singapore, Singapore, Singapore
| | | | - Dawn Qingqing Chong
- Division of Medical Oncology, National Cancer Centre Singapore, Singapore, Singapore
| | - Wen-Yee Chay
- Division of Medical Oncology, National Cancer Centre Singapore, Singapore, Singapore
| | - Rachel Lee-Yin Tan
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| | - Richard Norman
- School of Population Health, Curtin University, Perth, Australia
| | - Madeleine T King
- School of Psychology, The University of Sydney, Sydney, Australia
| | - Nan Luo
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| |
Collapse
|
5
|
Sampaio F, Langegård U, de Alva PM, Flores S, Nystrand C, Fransson P, Ohlsson-Nevo E, Kristensen I, Sjövall K, Feldman I, Ahlberg K. Cost-effectiveness of proton beam therapy vs. conventional radiotherapy for patients with brain tumors in Sweden: results from a non-randomized prospective multicenter study. COST EFFECTIVENESS AND RESOURCE ALLOCATION 2024; 22:66. [PMID: 39272105 PMCID: PMC11396687 DOI: 10.1186/s12962-024-00577-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Accepted: 09/06/2024] [Indexed: 09/15/2024] Open
Abstract
BACKGROUND This study assessed the cost-effectiveness of proton beam therapy (PBT) compared to conventional radiotherapy (CRT) for treating patients with brain tumors in Sweden. METHODS Data from a longitudinal non-randomized study performed between 2015 and 2020 was used, and included adult patients with brain tumors, followed during treatment and through a one-year follow-up. Clinical and demographic data were sourced from the longitudinal study and linked to Swedish national registers to get information on healthcare resource use. A cost-utility framework was used to evaluate the cost-effectiveness of PBT vs. CRT. Patients in PBT group (n = 310) were matched with patients in CRT group (n = 40) on relevant observables using propensity score matching with replacement. Costs were estimated from a healthcare perspective and included costs related to inpatient and specialized outpatient care, and prescribed medications. The health outcome was quality-adjusted life-years (QALYs), derived from the EORTC-QLQ-C30. Generalized linear models (GLM) and two-part models were used to estimate differences in costs and QALYs. RESULTS PBT yielded higher total costs, 14,639 US$, than CRT, 13,308 US$, with a difference of 1,372 US$ (95% CI, -4,914-7,659) over a 58 weeks' time horizon. Further, PBT resulted in non-significantly lower QALYs, 0.746 compared to CRT, 0.774, with a difference of -0.049 (95% CI, -0.195-0.097). The probability of PBT being cost-effective was < 30% at any willingness to pay. CONCLUSIONS These results suggest that PBT cannot be considered a cost-effective treatment for brain tumours, compared to CRT. TRIAL REGISTRATION Not applicable.
Collapse
Affiliation(s)
- Filipa Sampaio
- Department of Public Health and Caring Sciences (IFV), Uppsala University, BMC, Husargatan 3, Uppsala, 751 22, Sweden.
| | - Ulrica Langegård
- Institute of Health and Care Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Department of Oncology, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Patricio Martínez de Alva
- Department of Public Health and Caring Sciences (IFV), Uppsala University, BMC, Husargatan 3, Uppsala, 751 22, Sweden
| | - Sergio Flores
- Department of Public Health and Caring Sciences (IFV), Uppsala University, BMC, Husargatan 3, Uppsala, 751 22, Sweden
| | - Camilla Nystrand
- Department of Public Health and Caring Sciences (IFV), Uppsala University, BMC, Husargatan 3, Uppsala, 751 22, Sweden
| | - Per Fransson
- Department of Nursing, Umeå University, Umeå, Sweden
| | - Emma Ohlsson-Nevo
- University Health Care Research Center, Faculty of Medicine and Health, Örebro University, Örebro, Sweden
| | - Ingrid Kristensen
- Department of Hematology, Oncology and Radiation Physics, Lund University Hospital, Lund, Sweden
- Department of Clinical Sciences, Oncology and Pathology, Lund University, Lund, Sweden
| | - Katarina Sjövall
- Faculty of Health Sciences, Kristianstad University, Kristianstad, Sweden
| | - Inna Feldman
- Department of Public Health and Caring Sciences (IFV), Uppsala University, BMC, Husargatan 3, Uppsala, 751 22, Sweden
| | - Karin Ahlberg
- Institute of Health and Care Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| |
Collapse
|
6
|
Cao Y, Xu J, Norman R, King MT, Kemmler G, Huang W, Luo N. Chinese utility weights for the EORTC cancer-specific utility instrument QLU-C10D. Qual Life Res 2024:10.1007/s11136-024-03776-z. [PMID: 39269580 DOI: 10.1007/s11136-024-03776-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/24/2024] [Indexed: 09/15/2024]
Abstract
OBJECTIVE The aim of this study is to provide Chinese utility weights for the European Organization for Research and Treatment of Cancer Quality of Life Utility Measure-Core 10 Dimensions (EORTC QLU-C10D) which is a preference-based cancer-specific utility instrument derived from the EORTC QLQ-C30. METHODS We conducted an online survey of the general population in China, with quota sampling for age and gender. Each respondent was asked to complete a discrete choice experimental survey consisting of 16 randomly selected choice sets. The conditional logit model and mixed logit model were used to analyze respondents' preferences, and the goodness of fit of the model was tested. RESULTS A total of 2003 respondents were included in the analysis. Utility decrements within dimensions were typically monotonic. Monotonic inconsistency issues in the Fatigue, Sleep, and Nausea dimensions were normalized by monotonicity correction. Physical functioning, Pain, and Role functioning were associated with the greatest utility weights, with the smallest decrements being in Bowel problems and Emotional functioning. The utility value for the worst health state was 0.083, i.e. slightly higher than being dead. CONCLUSIONS This study provides the first China-specific set of value for the QLU-C10D based on societal preferences of the Chinese adult general population. The value set can be used as a cancer-specific scoring system for economic evaluations of new oncology therapies and technologies in China.
Collapse
Affiliation(s)
- Yiyin Cao
- School of Health Management, Harbin Medical University, Harbin, China
| | - Juan Xu
- School of Health Management, Harbin Medical University, Harbin, China
- Shenzhen Center, Cancer Hospital Chinese Academy of Medical Sciences, Shenzhen, China
| | - Richard Norman
- School of Public Health, Curtin University, Perth, Australia
| | - Madeleine T King
- Faculty of Science, School of Psychology, University of Sydney, Sydney, Australia
| | - Georg Kemmler
- Department of Psychiatry 1, Innsbruck Medical University, Innsbruck, Austria
| | - Weidong Huang
- School of Health Management, Harbin Medical University, Harbin, China.
| | - Nan Luo
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| |
Collapse
|
7
|
Ng CA, De Abreu Lourenco R, Viney R, Norman R, King MT, Kim N, Mulhern B. Valuing quality of life for economic evaluations in cancer: navigating multiple methods. Expert Rev Pharmacoecon Outcomes Res 2024:1-14. [PMID: 39158365 DOI: 10.1080/14737167.2024.2393332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2024] [Revised: 08/08/2024] [Accepted: 08/13/2024] [Indexed: 08/20/2024]
Abstract
INTRODUCTION Utility values offer a quantitative means to evaluate the impact of novel cancer treatments on patients' quality of life (QoL). However, the multiple methods available for valuing QoL present challenges in selecting the most appropriate method across different contexts. AREAS COVERED This review provides cancer clinicians and researchers with an overview of methods to value QoL for economic evaluations, including standalone and derived preference-based measures (PBMs) and direct preference elicitation methods. Recent developments are described, including the comparative performance of cancer-specific PBMs versus generic PBMs, measurement of outcomes beyond health-related QoL, and increased use of discrete choice experiments to elicit preferences. Recommendations and considerations are provided to guide the choice of method for cancer research. EXPERT OPINION We foresee continued adoption of the QLU-C10D and FACT-8D in cancer clinical trials given the extensive use of the EORTC QLQ-C30 and FACT-G in cancer research. While these cancer-specific PBMs offer the convenience of eliciting utility values without needing a standalone PBM, researchers should consider potential limitations if they intend to substitute them for generic PBMs. As the field advances, there is a greater need for consensus on the approach to selection and integration of various methods in cancer clinical trials.
Collapse
Affiliation(s)
- Carrie-Anne Ng
- Centre for Health Economics Research and Evaluation, Faculty of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Richard De Abreu Lourenco
- Centre for Health Economics Research and Evaluation, Faculty of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Rosalie Viney
- Centre for Health Economics Research and Evaluation, Faculty of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Richard Norman
- School of Population Health, Curtin University, Perth, Western Australia, Australia
| | - Madeleine T King
- School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| | - Nancy Kim
- Centre for Health Economics Research and Evaluation, Faculty of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Brendan Mulhern
- Centre for Health Economics Research and Evaluation, Faculty of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
8
|
Xu RH, Wong ELY, Luo N, Norman R, Lehmann J, Holzner B, King MT, Kemmler G. The EORTC QLU-C10D: the Hong Kong valuation study. THE EUROPEAN JOURNAL OF HEALTH ECONOMICS : HEPAC : HEALTH ECONOMICS IN PREVENTION AND CARE 2024; 25:889-901. [PMID: 37768519 DOI: 10.1007/s10198-023-01632-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
OBJECTIVE The EORTC QLU-C10D is a new preference-based measure derived from the EORTC QLQ-C30. Country-specific value sets are required to support the cost-utility analysis of cancer-related interventions. This study aimed to generate an EORTC QLU-C10 value set for Hong Kong (HK). METHODS A HK online panel was quota-sampled to achieve an adult general population sample representative by sex and age. Participants were invited to complete an online discrete choice experiment survey. Each participant was asked to complete 16 choice-pairs, randomly assigned from a total of 960 choice-pairs, each comprising two QLU-C10D health states and a duration attribute. Conditional and mixed logistic regression analyses were used to analyse the data. RESULTS The analysis included data from 1041 respondents who had successfully completed the online survey. The distribution of sex did not differ from that of the general population, but a significant difference was found among age groups. A weighting analysis for non-representative variable (age) was used. Utility decrements were generally monotonic, with the largest decrements for physical functioning (- 0.308), role functioning (- 0.165), and pain (- 0.161). The mean QLU-C10D utility score of the participants was 0.804 (median = 0.838, worst to best = - 0.169 to 1). The value of the worst health state was - 0.223, which was sufficiently lower than 0 (being dead). CONCLUSIONS This study established HK utility weights for the QLU-C10D, which can facilitate cost-utility analyses across cancer-related health programmes and technologies.
Collapse
Affiliation(s)
- Richard Huan Xu
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hung Hom, Hong Kong SAR, China.
- JC School of Public Health and Primary Care, The Chinese University of Hong Kong, Sha Tin, Hong Kong SAR, China.
| | - Eliza Lai-Yi Wong
- JC School of Public Health and Primary Care, The Chinese University of Hong Kong, Sha Tin, Hong Kong SAR, China
| | - Nan Luo
- Saw Swee Hock School of Public Health, The National University of Singapore, Singapore, Singapore
| | - Richard Norman
- School of Public Health, Curtin University, Perth, WA, Australia
| | - Jens Lehmann
- Division of Psychiatry II, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Bernhard Holzner
- Division of Psychiatry II, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Madeleine T King
- School of Psychology, University of Sydney, Sydney, NSW, Australia
| | - Georg Kemmler
- Division of Psychiatry I, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
9
|
Shiroiwa T, King MT, Norman R, Müller F, Campbell R, Kemmler G, Murata T, Shimozuma K, Fukuda T. Japanese value set for the EORTC QLU-C10D: A multi-attribute utility instrument based on the EORTC QLQ-C30 cancer-specific quality-of-life questionnaire. Qual Life Res 2024; 33:1865-1879. [PMID: 38724771 PMCID: PMC11176232 DOI: 10.1007/s11136-024-03655-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/18/2024] [Indexed: 06/14/2024]
Abstract
PURPOSE This study aimed to develop a Japanese value set for the EORTC QLU-C10D, a multi-attribute utility measure derived from the cancer-specific health-related quality-of-life (HRQL) questionnaire, the EORTC QLQ-C30. The QLU-C10D contains ten HRQL dimensions: physical, role, social and emotional functioning, pain, fatigue, sleep, appetite, nausea, and bowel problems. METHODS Quota sampling of a Japanese online panel was used to achieve representativeness of the Japanese general population by sex and age (≥ 18 years). The valuation method was an online discrete choice experiment. Each participant considered 16 choice pairs, randomly assigned from 960 choice pairs. Each pair included two QLU-C10D health states and life expectancy. Data were analyzed using conditional logistic regression, parameterized to fit the quality-adjusted life-year framework. Preference weights were calculated as the ratio of each dimension-level coefficient to the coefficient for life expectancy. RESULTS A total of 2809 eligible panel members consented, 2662/2809 (95%) completed at least one choice pair, and 2435/2662 (91%) completed all choice pairs. Within dimensions, preference weights were generally monotonic. Physical functioning, role functioning, and pain were associated with the largest utility weights. Intermediate utility weights were associated with social functioning and nausea; the remaining symptoms and emotional functioning were associated with smaller utility decrements. The value of the worst health state was - 0.221, lower than that seen in most other existing QLU-C10D country-specific value sets. CONCLUSIONS The Japan-specific QLU-C10D value set is suitable for evaluating the cost and utility of oncology treatments for Japanese health technology assessment and decision-making.
Collapse
Affiliation(s)
- T Shiroiwa
- Center for Outcomes Research and Economic Evaluation for Health (C2H), National Institute of Public Health, Wako, Saitama, Japan.
| | - M T King
- Faculty of Science, School of Psychology, University of Sydney, Sydney, NSW, Australia
- European Organisation for Research and Treatment of Cancer Quality of Life Group, Brussels, Belgium
| | - R Norman
- School of Population Health, Curtin University, Perth, WA, Australia
| | - F Müller
- Medical Psychology, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, Netherlands
- Amsterdam Public Health, Global Health, Amsterdam, Netherlands
| | - R Campbell
- Faculty of Science, School of Psychology, University of Sydney, Sydney, NSW, Australia
| | - G Kemmler
- European Organisation for Research and Treatment of Cancer Quality of Life Group, Brussels, Belgium
- Department of Psychiatry, Psychotherapy and Psychosomatics I, Medical University of Innsbruck, Innsbruck, Austria
| | - T Murata
- Crecon Medical Assessment Co., Ltd, Tokyo, Japan
| | - K Shimozuma
- College of Life Sciences, Ritsumeikan University, Kusatsu, Japan
| | - T Fukuda
- Center for Outcomes Research and Economic Evaluation for Health (C2H), National Institute of Public Health, Wako, Saitama, Japan
| |
Collapse
|
10
|
Pilz MJ, Seyringer S, Al-Naesan I, King MT, Bottomley A, Norman R, Schlosser L, Hell T, Gamper EM. Cancer-Specific Health Utilities: Evaluation of Core Measurement Properties of the EORTC QLU-C10D in Lung Cancer Patients-Data from Four Multicentre LUX-Lung Trials, Applying Six Country Tariffs. PHARMACOECONOMICS - OPEN 2024; 8:627-640. [PMID: 38696019 PMCID: PMC11252099 DOI: 10.1007/s41669-024-00484-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/11/2024] [Indexed: 05/15/2024]
Abstract
BACKGROUND Cost-utility analysis generally requires valid preference-based measures (PBMs) to assess the utility of patient health. While generic PBMs are widely used, disease-specific PBMs may capture additional aspects of health relevant for certain patient populations. This study investigates the construct and concurrent criterion validity of the cancer-specific European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Utility-Core 10 dimensions (QLU-C10D) in non-small-cell lung cancer patients. METHODS We retrospectively analysed data from four multicentre LUX-Lung trials, all of which had administered the EORTC Quality of Life Questionnaire (QLQ-C30) and the EQ-5D-3L. We applied six country-specific value sets (Australia, Canada, Italy, the Netherlands, Poland, and the United Kingdom) to both instruments. Criterion validity was assessed via correlations between the instruments' utility scores. Correlations of divergent and convergent domains and Bland-Altman plots investigated construct validity. Floor and ceiling effects were assessed. RESULTS The comparison of the EORTC QLU-C10D and EQ-5D-3L produced homogenous results for five of the six country tariffs. High correlations of utilities (r > 0.7) were found for all country tariffs except for the Netherlands. Moderate to high correlations of converging domain pairs (r from 0.472 to 0.718) were found with few exceptions, such as the Social Functioning-Usual Activities domain pair (max. r = 0.376). For all but the Dutch tariff, the EORTC QLU-C10D produced consistently lower utility values compared to the EQ-5D-3L (x̄ difference from - 0.082 to 0.033). Floor and ceiling effects were consistently lower for the EORTC QLU-C10D (max. 4.67% for utilities). CONCLUSIONS The six country tariffs showed good psychometric properties for the EORTC QLU-C10D in lung cancer patients. Criterion and construct validity was established. The QLU-C10D showed superior measurement precision towards the upper and lower end of the scale compared to the EQ-5D-3L, which is important when cost-utility analysis seeks to measure health change across the severity spectrum.
Collapse
Affiliation(s)
- Micha J Pilz
- University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
| | - Simone Seyringer
- Department of Nuclear Medicine, Medical University of Innsbruck, 6020, Innsbruck, Austria
| | - Imad Al-Naesan
- University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
| | - Madeleine T King
- School of Psychology, University of Sydney, Sydney, NSW, Australia
| | - Andrew Bottomley
- Quality of Life Department, European Organisation for Research and Treatment of Cancer, Brussels, Belgium
| | - Richard Norman
- School of Population Health, Curtin University, Perth, WA, Australia
| | - Lisa Schlosser
- Department of Mathematics, University of Innsbruck, Innsbruck, Austria
| | - Tobias Hell
- Department of Mathematics, University of Innsbruck, Innsbruck, Austria
| | - Eva Maria Gamper
- Department of Nuclear Medicine, Medical University of Innsbruck, 6020, Innsbruck, Austria.
| |
Collapse
|
11
|
Tsui TCO, Torres SC, Bielecki JM, Mitsakakis N, Trudeau ME, Bremner KE, Davis AM, Krahn MD. A scoping review to create a framework for the steps in developing condition-specific preference-based instruments de novo or from an existing non-preference-based instrument: use of item response theory or Rasch analysis. Health Qual Life Outcomes 2024; 22:38. [PMID: 38745165 PMCID: PMC11094879 DOI: 10.1186/s12955-024-02253-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Accepted: 04/22/2024] [Indexed: 05/16/2024] Open
Abstract
BACKGROUND There is no widely accepted framework to guide the development of condition-specific preference-based instruments (CSPBIs) that includes both de novo and from existing non-preference-based instruments. The purpose of this study was to address this gap by reviewing the published literature on CSPBIs, with particular attention to the application of item response theory (IRT) and Rasch analysis in their development. METHODS A scoping review of the literature covering the concepts of all phases of CSPBI development and evaluation was performed from MEDLINE, Embase, PsychInfo, CINAHL, and the Cochrane Library, from inception to December 30, 2022. RESULTS The titles and abstracts of 1,967 unique references were reviewed. After retrieving and reviewing 154 full-text articles, data were extracted from 109 articles, representing 41 CSPBIs covering 21 diseases or conditions. The development of CSPBIs was conceptualized as a 15-step framework, covering four phases: 1) develop initial questionnaire items (when no suitable non-preference-based instrument exists), 2) establish the dimensional structure, 3) reduce items per dimension, 4) value and model health state utilities. Thirty-nine instruments used a type of Rasch model and two instruments used IRT models in phase 3. CONCLUSION We present an expanded framework that outlines the development of CSPBIs, both from existing non-preference-based instruments and de novo when no suitable non-preference-based instrument exists, using IRT and Rasch analysis. For items that fit the Rasch model, developers selected one item per dimension and explored item response level reduction. This framework will guide researchers who are developing or assessing CSPBIs.
Collapse
Affiliation(s)
- Teresa C O Tsui
- Toronto Health Economics and Technology Assessment (THETA) Collaborative, University Health Network, Toronto, ON, Canada.
- Canadian Centre for Applied Research in Cancer Control, Toronto, ON, Canada.
- Child Health and Evaluative Sciences, Hospital for Sick Children, Toronto, ON, Canada.
| | - Sofia C Torres
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Centro Hospitalar Universitário Lisboa Norte, Lisboa, Portugal
| | - Joanna M Bielecki
- Toronto Health Economics and Technology Assessment (THETA) Collaborative, University Health Network, Toronto, ON, Canada
| | - Nicholas Mitsakakis
- Toronto Health Economics and Technology Assessment (THETA) Collaborative, University Health Network, Toronto, ON, Canada
- Children's Hospital of Eastern Ontario, Ottawa, ON, Canada
| | - Maureen E Trudeau
- Odette Cancer Centre, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Karen E Bremner
- Toronto Health Economics and Technology Assessment (THETA) Collaborative, University Health Network, Toronto, ON, Canada
| | - Aileen M Davis
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Murray D Krahn
- Toronto Health Economics and Technology Assessment (THETA) Collaborative, University Health Network, Toronto, ON, Canada
| |
Collapse
|
12
|
Lehmann J, Rojas-Concha L, Petersen MA, Holzner B, Norman R, King MT, Kemmler G. Danish value sets for the EORTC QLU-C10D utility instrument. Qual Life Res 2024; 33:831-841. [PMID: 38183563 PMCID: PMC10894119 DOI: 10.1007/s11136-023-03569-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/15/2023] [Indexed: 01/08/2024]
Abstract
PURPOSE In this study, we developed Danish utility weights for the European Organisation for Research and Treatment of Cancer (EORTC) QLU-C10D, a cancer-specific utility instrument based on the EORTC QLQ-C30. METHODS Following a standardized methodology, 1001 adult participants from the Danish general population were quota-sampled and completed a cross-sectional web-based survey and discrete choice experiment (DCE). In the DCE, participants considered 16 choice sets constructed from the key 10 dimensions of the QLU-C10D and chose their preferred health state for each one. Utility weights were calculated using conditional logistic regression with correction for non-monotonicity. RESULTS The sample (n = 1001) was representative of the Danish general population with regard to age and gender. The domains with the largest utility decrements, i.e., the domains with the biggest impact on health utility, were physical functioning (- 0.224), pain (- 0.160), and role functioning (- 0.136). The smallest utility decrements were observed for the domains lack of appetite (- 0.024), sleep disorders (- 0.057), and fatigue (- 0.064). Non-monotonicity of severity levels was observed for the domains sleep disturbances, lack of appetite, and bowel problems. Deviations from monotonicity were not statistically significant. CONCLUSION The EORTC QLU-C10D is a relatively new multi-attribute utility instrument and is a promising cancer-specific health technology assessment candidate measure. The country-specific Danish utility weights from this study can be used for cost-utility analyses in Danish patients and for comparison with other country-specific utility data.
Collapse
Affiliation(s)
- Jens Lehmann
- University Hospital of Psychiatry II, Medical University of Innsbruck, Anichstraße 36, 6020, Innsbruck, Austria.
- University Hospital of Psychiatry I, Medical University of Innsbruck, Innsbruck, Austria.
| | - Leslye Rojas-Concha
- Palliative Care Research Unit, Department of Geriatrics and Palliative Medicine GP, Bispebjerg & Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark
| | - Morten Aagaard Petersen
- Palliative Care Research Unit, Department of Geriatrics and Palliative Medicine GP, Bispebjerg & Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark
| | - Bernhard Holzner
- University Hospital of Psychiatry II, Medical University of Innsbruck, Anichstraße 36, 6020, Innsbruck, Austria
| | - Richard Norman
- School of Public Health, Curtin University, Perth, WA, Australia
| | - Madeleine T King
- School of Psychology, Faculty of Science, University of Sydney, Sydney, NSW, Australia
| | - Georg Kemmler
- University Hospital of Psychiatry I, Medical University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
13
|
Nielsen LK, Schjesvold F, Möller S, Guldbrandsen N, Hansson M, Remes K, Peceliunas V, Abildgaard N, Gregersen H, King MT. Health-related quality of life and quality-adjusted progression free survival for carfilzomib and dexamethasone maintenance following salvage autologous stem-cell transplantation in patients with multiple myeloma: a randomized phase 2 trial by the Nordic Myeloma Study Group. J Patient Rep Outcomes 2024; 8:15. [PMID: 38315268 PMCID: PMC10844184 DOI: 10.1186/s41687-024-00691-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 01/18/2024] [Indexed: 02/07/2024] Open
Abstract
BACKGROUND Decisions regarding maintenance therapy in patients with multiple myeloma should be based on both treatment efficacy and health-related quality of life (HRQL) consequences. In the CARFI trial, patients with first relapse of multiple myeloma underwent salvage autologous stem cell transplantation (salvage ASCT) before randomization to carfilzomib-dexamethasone maintenance therapy (Kd) or observation. The primary clinical endpoint was time to progression, which was extended by 8 months by Kd. The aim of this paper is to present the all HRQL endpoints of the CARFI trial including the HRQL effect of Kd maintenance therapy relative to observation. The primary HRQL endpoint was assessed by EORTC QLQ-C30 Summary score (QLQ-C30-sum) at 8 months follow-up. A key secondary HRQL endpoint was quality-adjusted progression-free-survival (QAPFS). METHODS HRQL was assessed with EORTC QLQ-C30, EORTC QLQ-MY20 and FACT/GOG-Ntx at randomization and every second month during follow-up. HRQL data were analyzed with linear mixed effect models until 8 months follow-up. QAPFS per individual was calculated by multiplying progression-free survival (PFS) by two quality-adjustment metrics, the QLQ-C30-sum and EORTC Quality of Life Utility Measure-Core 10 dimensions (QLU-C10D). The QAPFS per treatment group was estimated with the Kaplan-Meier method. P < 0.05 was used for statistical significance, and a between-group minimal important difference of 10 points was interpreted as clinically relevant for the QLQ-C30-sum. RESULTS 168 patients were randomized. HRQL questionnaire compliance was 93%. For the QLQ-C30-sum, the difference of 4.62 points (95% confidence interval (CI) -8.9: -0.4, p = 0.032) was not clinically relevant. PFS was 19.3 months for the Kd maintenance group and 16.8 months for the observation group; difference = 2.5 months (95% CI 0.5; 4.5). QAPFS based on the QLQ-C30-sum for the Kd maintenance group was 18.0 months (95% CI 16.4; 19.6) and for the observation group 15.0 months (95% CI 13.5; 16.5); difference = 3.0 months (95% CI 0.8-5.3). QAPFS based on the QLU-C10D for the Kd maintenance group was 17.5 months (95% CI 15.9; 19.2) and 14.0 months (95% CI 12.4; 15.5) for the observation group; difference = 3.5 months (95% CI 1.1-5.9). CONCLUSIONS Kd maintenance therapy after salvage ASCT did not adversely affect overall HRQL, but adjustment for HRQL reduced the PFS compared to unadjusted PFS. PFS of maintenance therapy should be quality-adjusted to balance the benefits and HRQL impact.
Collapse
Affiliation(s)
- Lene Kongsgaard Nielsen
- Quality of life Research Center, Department of Hematology, Odense University Hospital, DK-5000, Odense, Denmark.
- Department of Hematology, Gødstrup Hospital, Herning, Denmark.
- Academy of Geriatric Cancer Research, Odense University Hospital, Odense, Denmark.
| | - Fredrik Schjesvold
- Oslo Myeloma Center, Department of Hematology, Oslo University Hospital, Oslo, Norway
- KG Jebsen Center for B cell malignancies, University of Oslo, Oslo, Norway
| | - Sören Möller
- Open Patient data Explorative Network, OPEN, Odense University Hospital, Odense, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| | - Nina Guldbrandsen
- Oslo Myeloma Center, Department of Hematology, Oslo University Hospital, Oslo, Norway
| | - Markus Hansson
- Department of Hematology, Skåne University Hospital, Lund, Sweden
| | - Kari Remes
- Department of Hematology, Turku University Hospital, Turku, Finland
| | - Valdas Peceliunas
- Department of Hematology, Vilnius University Hospital Santaros Klinikos, Vilnius, Lithuania
| | - Niels Abildgaard
- Quality of life Research Center, Department of Hematology, Odense University Hospital, DK-5000, Odense, Denmark
- Academy of Geriatric Cancer Research, Odense University Hospital, Odense, Denmark
- Open Patient data Explorative Network, OPEN, Odense University Hospital, Odense, Denmark
| | - Henrik Gregersen
- Department of Hematology, Aalborg University Hospital, Aalborg, Denmark
| | - Madeleine T King
- Quality of life Research Center, Department of Hematology, Odense University Hospital, DK-5000, Odense, Denmark
- School of Psychology, University of Sydney, Sydney, Australia
| |
Collapse
|
14
|
King MT, Revicki DA, Norman R, Müller F, Viney RC, Pickard AS, Cella D, Shaw JW. United States Value Set for the Functional Assessment of Cancer Therapy-General Eight Dimensions (FACT-8D), a Cancer-Specific Preference-Based Quality of Life Instrument. PHARMACOECONOMICS - OPEN 2024; 8:49-63. [PMID: 38060096 PMCID: PMC10781923 DOI: 10.1007/s41669-023-00448-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/11/2023] [Indexed: 12/08/2023]
Abstract
OBJECTIVES To develop a value set reflecting the United States (US) general population's preferences for health states described by the Functional Assessment of Cancer Therapy (FACT) eight-dimensions preference-based multi-attribute utility instrument (FACT-8D), derived from the FACT-General cancer-specific health-related quality-of-life (HRQL) questionnaire. METHODS A US online panel was quota-sampled to achieve a general population sample representative by sex, age (≥ 18 years), race and ethnicity. A discrete choice experiment (DCE) was used to value health states. The valuation task involved choosing between pairs of health states (choice-sets) described by varying levels of the FACT-8D HRQL dimensions and survival (life-years). The DCE included 100 choice-sets; each respondent was randomly allocated 16 choice-sets. Data were analysed using conditional logit regression parameterized to fit the quality-adjusted life-year framework, weighted for sociodemographic variables that were non-representative of the US general population. Preference weights were calculated as the ratio of HRQL-level coefficients to the survival coefficient. RESULTS 2562 panel members opted in, 2462 (96%) completed at least one choice-set and 2357 (92%) completed 16 choice-sets. Pain and nausea were associated with the largest utility weights, work and sleep had more moderate utility weights, and sadness, worry and support had the smallest utility weights. Within dimensions, more severe HRQL levels were generally associated with larger weights. A preference-weighting algorithm to estimate US utilities from responses to the FACT-General questionnaire was generated. The worst health state's value was -0.33. CONCLUSIONS This value set provides US population utilities for health states defined by the FACT-8D for use in evaluating oncology treatments.
Collapse
Affiliation(s)
- Madeleine T King
- School of Psychology, Faculty of Science, University of Sydney, Sydney, NSW, Australia.
| | - D A Revicki
- Revicki Outcomes Research Consulting, Sarasota, FL, USA
| | - R Norman
- School of Population Health, Curtin University, Perth, WA, Australia
| | - F Müller
- Medical Psychology, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
| | - R C Viney
- Centre for Health Economics Research & Evaluation, Faculty of Health, University of Technology Sydney, Sydney, NSW, Australia
| | - A S Pickard
- Department of Pharmacy Systems, Outcomes and Policy, College of Pharmacy, University of Illinois at Chicago, Chicago, IL, USA
| | - D Cella
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - J W Shaw
- Patient-Reported Outcomes Assessment, Global Health Economics and Outcomes Research, Bristol Myers Squibb, Lawrenceville, NJ, USA
| |
Collapse
|
15
|
Singer S, Bergelt C, Tribius S, Laban S, Busch CJ. [Patient-reported outcomes in head and neck cancer treatment: relevance, challenges, and benefit]. HNO 2023; 71:592-598. [PMID: 37422597 DOI: 10.1007/s00106-023-01325-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/17/2023] [Indexed: 07/10/2023]
Abstract
Next to overall survival, quality of life is becoming more and more pivotal for cancer patients. The various domains of quality of life are complex and have different value to each patient. However, not only patients but also health care professionals, the pharmaceutical industry, and regulatory bodies ask: How can quality of life be reliably ascertained in clinical trials? For this purpose, carefully developed and validated specific questionnaires are needed: the patient-reported outcome measures (PROMs). A key challenge is to define how results based on PROMs can be used for shared decision-making. Next to clinical factors such as health and nutritional status, quality of life acts as a prognostic factor for overall survival in cancer. Thus, it is crucial to take quality of life into account in daily clinical practice.
Collapse
Affiliation(s)
- Susanne Singer
- Abteilung Epidemiologie und Versorgungsforschung, Institut für Medizinische Biometrie, Epidemiologie und Informatik, Universitätsmedizin Mainz, 55101, Mainz, Deutschland.
| | - Corinna Bergelt
- Institut für Medizinische Psychologie, Universitätsmedizin Greifswald, Greifswald, Deutschland
| | - Silke Tribius
- Hermann-Holthusen-Institut für Strahlentherapie, Asklepios-Klinik St. Georg, Hamburg, Deutschland
- Asklepios Tumorzentrum Hamburg, Hamburg, Deutschland
| | - Simon Laban
- Klinik und Poliklinik für Hals‑, Nasen‑, Ohrenheilkunde, Kopf- und Halschirurgie, Universitätsmedizin Ulm, Ulm, Deutschland
| | - Chia-Jung Busch
- Klinik und Poliklinik für Hals‑, Nasen‑, Ohrenheilkunde, Kopf- und Halschirurgie, Universitätsmedizin Greifswald, Greifswald, Deutschland
| |
Collapse
|
16
|
Wang H, Rowen DL, Brazier JE, Jiang L. Discrete Choice Experiments in Health State Valuation: A Systematic Review of Progress and New Trends. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2023; 21:405-418. [PMID: 36997744 PMCID: PMC10062300 DOI: 10.1007/s40258-023-00794-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 02/12/2023] [Indexed: 05/03/2023]
Abstract
BACKGROUND Discrete choice experiments (DCEs) are increasingly used in health state valuation studies. OBJECTIVE This systematic review updates the progress and new findings of DCE studies in the health state valuation, covering the period since the review of June 2018 to November 2022. The review reports the methods that are currently being used in DCE studies to value health and study design characteristics, and, for the first time, reviews DCE health state valuation studies published in the Chinese language. METHODS English language databases PubMed and Cochrane, and Chinese language databases Wanfang and CNKI were searched using the self-developed search terms. Health state valuation or methodology study papers were included if the study used DCE data to generate a value set for a preference-based measure. Key information extracted included DCE study design strategies applied, methods for anchoring the latent coefficient on to a 0-1 QALY scale and data analysis methods. RESULTS Sixty-five studies were included; one Chinese language publication and 64 English language publications. The number of health state valuation studies using DCE has rapidly increased in recent years and these have been conducted in more countries than prior to 2018. Wide usage of DCE with duration attributes, D-efficient design and models accounting for heterogeneity has continued in recent years. Although more methodological consensus has been found than in studies conducted prior to 2018, this consensus may be driven by valuation studies for common measures with an international protocol (the 'model' valuation research). Valuing long measures with well-being attributes attracted attention and more realistic design strategies (e.g., inconstant time preference, efficient design and implausible states design) were identified. However, more qualitative and quantitative methodology study is still necessary to evaluate the effect of those new methods. CONCLUSIONS The use of DCEs in health state valuation continues to grow dramatically and the methodology progress makes the method more reliable and pragmatic. However, study design is driven by international protocols and method selection is not always justified. There is no gold standard for DCE design, presentation format or anchoring method. More qualitative and quantitative methodology study is recommended to evaluate the effect of new methods before researchers make methodology decisions.
Collapse
Affiliation(s)
- Haode Wang
- School of Health and Related Research (ScHARR), University of Sheffield, 30 Regent St, Sheffield City Centre, Sheffield, S1 4DA, UK.
| | - Donna L Rowen
- School of Health and Related Research (ScHARR), University of Sheffield, 30 Regent St, Sheffield City Centre, Sheffield, S1 4DA, UK
| | - John E Brazier
- School of Health and Related Research (ScHARR), University of Sheffield, 30 Regent St, Sheffield City Centre, Sheffield, S1 4DA, UK
| | - Litian Jiang
- Health Policy Research Unit, Shenzhen Health Development Research and Data Management Center, Shenzhen, Guangdong Province, China
| |
Collapse
|
17
|
Pilz MJ, Nolte S, Liegl G, King M, Norman R, McTaggart-Cowan H, Bottomley A, Rose M, Kemmler G, Holzner B, Gamper EM. The European Organisation for Research and Treatment of Cancer Quality of Life Utility-Core 10 Dimensions: Development and Investigation of General Population Utility Norms for Canada, France, Germany, Italy, Poland, and the United Kingdom. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2023; 26:760-767. [PMID: 36572102 DOI: 10.1016/j.jval.2022.12.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 12/11/2022] [Accepted: 12/16/2022] [Indexed: 05/03/2023]
Abstract
OBJECTIVES The European Organisation for Research and Treatment of Cancer Quality of Life Utility-Core 10 Dimensions (EORTC QLU-C10D) is a cancer-specific preference-based measure, providing health utilities for use in economic evaluations derived from the widely used health-related quality of life measure, EORTC QLQ-C30. Several EORTC QLU-C10D country-specific value sets are available. This article aimed to provide EORTC QLU-C10D general population utility norms for Canada, France, Germany, Italy, Poland, and the United Kingdom, to aid interpretability of obtained utilities in these countries. METHODS Data were collected in aforementioned countries via a quota-sampled, cross-sectional online survey (n = 100/age-sex group; N = approximately 1000/country). Participants were asked to complete the EORTC QLQ-C30 and provide sociodemographic data. Country-specific utility norms were calculated using the respective country tariff on the country's EORTC QLQ-C30 data after weighting to achieve population representativeness for age and sex. Norm values are provided as means (SDs) by country, age, and sex groups. Tukey's multiple comparison test investigated mean differences among countries. The impact of country, age, and sex on utility values was investigated with a multiple linear regression model. RESULTS Country-specific mean utilities range from 0.724 (United Kingdom) to 0.843 (Italy). Country-, sex-, and age-specific mean utilities range from 0.664 for 30- to 39-year-old male Canadians to 0.899 for > 70-year-old male Italians. Utilities were lower in females in 4 of 6 countries, and the impact of age differed among countries. Independent of the impact of age and sex, between-country differences were found (P ≤ .05). CONCLUSION Results showed a varying impact of age and sex on EORTC QLU-C10D utilities and significant between-country differences. Using national utility norms and utility decrements is recommended.
Collapse
Affiliation(s)
- Micha Johannes Pilz
- University Hospital of Innsbruck Psychiatry II, Medical University Innsbruck, Innsbruck, Austria
| | - Sandra Nolte
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Psychosomatic Medicine, Berlin, Germany
| | - Gregor Liegl
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Psychosomatic Medicine, Berlin, Germany
| | - Madeleine King
- School of Psychology, University of Sydney, Camperdown, NSW, Australia
| | - Richard Norman
- School of Population Health, Curtin University, Perth, WA, Australia
| | | | - Andrew Bottomley
- European Organisation for Research and Treatment of Cancer, Brussels, Belgium
| | - Matthias Rose
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Psychosomatic Medicine, Berlin, Germany
| | - Georg Kemmler
- Division of Psychiatry I, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Bernhard Holzner
- University Hospital of Innsbruck Psychiatry II, Medical University Innsbruck, Innsbruck, Austria; Division of Psychiatry I, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Eva Maria Gamper
- Department of Nuclear Medicine, Medical University of Innsbruck, Innsbruck, Austria.
| |
Collapse
|
18
|
Schurr T, Loth F, Lidington E, Piccinin C, Arraras JI, Groenvold M, Holzner B, van Leeuwen M, Petersen MA, Schmidt H, Young T, Giesinger JM. Patient-reported outcome measures for physical function in cancer patients: content comparison of the EORTC CAT Core, EORTC QLQ-C30, SF-36, FACT-G, and PROMIS measures using the International Classification of Functioning, Disability and Health. BMC Med Res Methodol 2023; 23:21. [PMID: 36681808 PMCID: PMC9862545 DOI: 10.1186/s12874-022-01826-z] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 12/20/2022] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Patient-reported physical function (PF) is a key endpoint in cancer clinical trials. Using complex statistical methods, common metrics have been developed to compare scores from different patient-reported outcome (PRO) measures, but such methods do not account for possible differences in questionnaire content. Therefore, the aim of our study was a content comparison of frequently used PRO measures for PF in cancer patients. METHODS Relying on the framework of the International Classification of Functioning, Disability and Health (ICF) we categorized the item content of the physical domains of the following measures: EORTC CAT Core, EORTC QLQ-C30, SF-36, PROMIS Cancer Item Bank for Physical Function, PROMIS Short Form for Physical Function 20a, and the FACT-G. Item content was linked to ICF categories by two independent reviewers. RESULTS The 118 items investigated were assigned to 3 components ('d - Activities and Participation', 'b - Body Functions', and 'e - Environmental Factors') and 11 first-level ICF categories. All PF items of the EORTC measures but one were assigned to the first-level ICF categories 'd4 - Mobility' and 'd5 - Self-care', all within the component 'd - Activities and Participation'. The SF-36 additionally included item content related to 'd9 - Community, social and civic life' and the PROMIS Short Form for Physical Function 20a also included content related to 'd6 - domestic life'. The PROMIS Cancer Item Bank (v1.1) covered, in addition, two first-level categories within the component 'b - Body Functions'. The FACT-G Physical Well-being scale was found to be the most diverse scale with item content partly not covered by the ICF framework. DISCUSSION Our results provide information about conceptual differences between common PRO measures for the assessment of PF in cancer patients. Our results complement quantitative information on psychometric characteristics of these measures and provide a better understanding of the possibilities of establishing common metrics.
Collapse
Affiliation(s)
- T Schurr
- Department of Psychiatry, Psychotherapy, Psychosomatics, and Medical Psychology, University Hospital of Psychiatry I, Innsbruck Medical University, Anichstraße 35, A-6020 Innsbruck, Austria
| | - F Loth
- Professorship for Psychological Diagnostics and Intervention Psychology, Faculty of Philosophy and Education, Catholic University of Eichstätt-Ingolstadt, Ostenstraße 25, 85072 Eichstätt, Germany
| | - E Lidington
- Cancer Behavioural Science Unit, King’s College London, Guy’s Hospital, St Thomas Street, London, SE1 9RT UK
| | - C Piccinin
- Quality of Life Department, EORTC, Avenue E. Mounier, 83/11, 1200 Brussels, Belgium
| | - JI Arraras
- Medical Oncology Department, Hospital Universitario de Navarra, C/Irunlarrea 3, S31008 Pamplona, Spain
| | - M Groenvold
- Palliative Care Research Unit, Department of Geriatrics and Palliative Medicine GP, Bispebjerg & Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark
| | - B Holzner
- Department of Psychiatry, Psychotherapy, Psychosomatics, and Medical Psychology, University Hospital of Psychiatry II, Innsbruck Medical University, Anichstraße 35, A-6020 Innsbruck, Austria
| | - M van Leeuwen
- Division of Psychosocial Research & Epidemiology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
| | - MA Petersen
- Palliative Care Research Unit, Department of Geriatrics and Palliative Medicine GP, Bispebjerg & Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark
| | - H Schmidt
- University Clinic and Outpatient Clinic for Radiotherapy and Institute of Health and Nursing Science, Medical Faculty of Martin Luther University Halle-Wittenberg, Halle (Saale), Germany
| | - T Young
- Lynda Jackson Macmillan Centre, Mount Vernon Cancer Centre, Rickmansworth Rd, GB- HA6 2RN Halle (Saale), UK
| | - JM Giesinger
- Department of Psychiatry, Psychotherapy, Psychosomatics, and Medical Psychology, University Hospital of Psychiatry II, Innsbruck Medical University, Anichstraße 35, A-6020 Innsbruck, Austria
| |
Collapse
|
19
|
Pan CW, He JY, Zhu YB, Zhao CH, Luo N, Wang P. Comparison of EQ-5D-5L and EORTC QLU-C10D utilities in gastric cancer patients. THE EUROPEAN JOURNAL OF HEALTH ECONOMICS : HEPAC : HEALTH ECONOMICS IN PREVENTION AND CARE 2022:10.1007/s10198-022-01523-0. [PMID: 36083356 DOI: 10.1007/s10198-022-01523-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Accepted: 08/23/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND To compare measurement properties of the utility scores derived from various country-specific value sets of EQ-5D-5L (5L) and EORTC QLU-C10D (10D) in gastric cancer patient. METHODS The study used cross-sectional data of 243 Chinese gastric cancer patients who completed both 5L and EORTC QLQ-C30. Utility score of QLU-C10D is generated from all the available QLU-C10D value sets currently; the score of 5L is derived from the corresponding 5L value sets for the countries with both the 5L and QLU-C10D value sets and the Chinese 5L value set. Convergent validity was evaluated by testing their correlations with the VAS score. Known-group validity was assessed by comparing the utility scores the patients with different severities. Their relative efficiency (RE) was also compared. RESULTS Correlation coefficient of 5L and QLU-C10D utility scores with VAS ranged from 0.54 to 0.59, and 0.55 to 0.63, respectively. Both the utility scores were in general able to discriminate the patients with different severities; and 5L utility score had higher RE in the majority of known-groups. CONCLUSION EQ-5D-5L and QLU-C10D utility scores were different and, thus, non-swappable. They possess similar convergent validity and known-group validity; while EQ-5D-5L scores may have better discriminative power.
Collapse
Affiliation(s)
- Chen-Wei Pan
- School of Public Health, Medical College of Soochow University, Suzhou, China
| | - Jun-Yi He
- School of Public Health, Fudan University, 130 Dong An Road, Shanghai, 200032, China
- Key Lab of Health Technology Assessment, National Health Commission of the People's Republic of China (Fudan University), Shanghai, China
| | - Yan-Bo Zhu
- Department of Oncology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Chun-Hua Zhao
- Medical Education and Training Department, Gusu School, The Affiliated Suzhou Hospital of Nanjing Medical UniversitySuzhou Municipal HospitalNanjing Medical University, Suzhou, China
| | - Nan Luo
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| | - Pei Wang
- School of Public Health, Fudan University, 130 Dong An Road, Shanghai, 200032, China.
- Key Lab of Health Technology Assessment, National Health Commission of the People's Republic of China (Fudan University), Shanghai, China.
| |
Collapse
|
20
|
McTaggart-Cowan H, King MT, Norman R, Costa DSJ, Pickard AS, Viney R, Peacock SJ. The FACT-8D, a new cancer-specific utility algorithm based on the Functional Assessment of Cancer Therapies-General (FACT-G): a Canadian valuation study. Health Qual Life Outcomes 2022; 20:97. [PMID: 35710417 PMCID: PMC9205108 DOI: 10.1186/s12955-022-02002-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Accepted: 05/06/2022] [Indexed: 11/23/2022] Open
Abstract
Introduction Utility instruments are used to assess patients’ health-related quality of life for cost-utility analysis (CUA). However, for cancer patients, the dimensions of generic utility instruments may not capture all the information relevant to the impact of cancer. Cancer-specific utilities provide a useful alternative. Under the auspices of the Multi-Attribute Utility in Cancer Consortium, a cancer-specific utility algorithm was derived from the FACT-G. The new FACT-8D contains eight dimensions: pain, fatigue, nausea, sleep, work, support from family/friends, sadness, and worry health will get worse. The aim of the study was to obtain a Canadian value set for the FACT-8D.
Methods A discrete choice experiment was administered to a Canadian general population online panel, quota sampled by age, sex, and province/territory of residence. Respondents provided responses to 16 choice sets. Each choice set consisted of two health states described by the FACT-8D dimensions plus an attribute representing survival duration. Sample weights were applied and the responses were analyzed using conditional logistic regression, parameterized to fit the quality-adjusted life year framework. The results were converted into utility weights by evaluating the marginal rate of substitution between each level of each FACT-8D dimension with respect to duration.
Results 2228 individuals were recruited. The analysis dataset included n = 1582 individuals, who completed at least one choice set; of which, n = 1501 completed all choice sets. After constraining to ensure monotonicity in the utility function, the largest decrements were for the highest levels of pain (− 0.38), nausea (− 0.30), and problems doing work (− 0.23). The decrements of the remaining dimensions ranged from − 0.08 to − 0.18 for their highest levels. The utility of the worst possible health state was defined as − 0.65, considerably worse than dead.
Conclusions The largest impacts on utility included three generic dimensions (i.e., pain, support, and work) and nausea, a symptom caused by cancer (e.g., brain tumours, gastrointestinal tumours, malignant bowel obstruction) and by common treatments (e.g., chemotherapy, radiotherapy, opioid analgesics). This may make the FACT-8D more informative for CUA evaluating in many cancer contexts, an assertion that must now be tested empirically in head-to-head comparisons with generic utility measures. Supplementary Information The online version contains supplementary material available at 10.1186/s12955-022-02002-z.
Collapse
Affiliation(s)
- Helen McTaggart-Cowan
- Cancer Control Research, BC Cancer, 675 West 10th Avenue, Vancouver, BC, V5Z 1L3, Canada. .,Faculty of Health Sciences, Simon Fraser University, Burnaby, BC, Canada.
| | | | - Richard Norman
- School of Public Health, Curtin University, Perth, Australia
| | - Daniel S J Costa
- School of Psychology, University of Sydney, Sydney, Australia.,Sydney Medical School, University of Sydney, Sydney, Australia.,Pain Management Research Institute, Royal North Shore Hospital, Sydney, Australia
| | - A Simon Pickard
- Department of Pharmacy Systems, Outcomes, and Policy, University of Illinois at Chicago, Chicago, USA
| | - Rosalie Viney
- Centre for Health Economics Research and Evaluation, University of Technology, Sydney, Australia
| | - Stuart J Peacock
- Cancer Control Research, BC Cancer, 675 West 10th Avenue, Vancouver, BC, V5Z 1L3, Canada.,Faculty of Health Sciences, Simon Fraser University, Burnaby, BC, Canada
| | | |
Collapse
|
21
|
Gamper EM, King MT, Norman R, Loth FLC, Holzner B, Kemmler G. The EORTC QLU-C10D discrete choice experiment for cancer patients: a first step towards patient utility weights. J Patient Rep Outcomes 2022; 6:42. [PMID: 35507194 PMCID: PMC9068836 DOI: 10.1186/s41687-022-00430-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Accepted: 02/21/2022] [Indexed: 11/18/2022] Open
Abstract
Background The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Utility-Core 10 Dimensions (QLU-C10D) is a novel cancer-specific preference-based measure (PBM) for which value sets are being developed for an increasing number of countries. This is done by obtaining health preferences from the respective general population. There is an ongoing discussion if instead patients suffering from the disease in question should be asked for their preferences. We used the QLU-C10D valuation survey, originally designed for use in the general population, in a sample of cancer patients in Austria to assess the methodology’s acceptability and applicability in this target group before obtaining QLU-C10D patient preferences. Methods The core of the QLU-C10D valuation survey is a discrete choice experiment in which respondents are asked to give preferences for certain health states (described by a relatively large number of 10 quality of life domains) and an associated survival time. They therewith are asked to trade off quality of life against life time. As this might be a very burdensome task for cancer patients undergoing treatment, a cognitive interview was conducted in a pilot sample to assess burden and potential additional needs for explanation in order to be able to use the DCE for the development of QLU-C10D patient preferences. In addition, responses to general feedback questions on the survey were compared against responses from a matched control group from the already completed Austrian general population valuation survey. Results We included 48 patients (mean age 59.9 years; 46% female). In the cognitive interview, the majority indicated that their experience with the survey was positive (85%) and overall clarity as good (90%). In response to the general feedback questions, patients rated the presentation of the health states less clear than matched controls (p = 0.008). There was no difference between patients and the general population concerning the difficulty in choosing between the health states (p = 0.344). Conclusion Despite the relatively large number of DCE domains the survey was manageable for patients and allows going on with the QLU-C10D patient valuation study. Supplementary Information The online version contains supplementary material available at 10.1186/s41687-022-00430-5.
Collapse
Affiliation(s)
- Eva-Maria Gamper
- Innsbruck Institute of Patient-Centered Outcome Research (IIPCOR), Dr. Stumpf Straße 47, 6020, Innsbruck, Austria.
| | - Madeleine T King
- School of Psychology, Faculty of Science, University of Sydney, Sydney, NSW, 2006, Australia
| | - Richard Norman
- School of Public Health, Curtin University, Perth, Australia
| | - Fanny L C Loth
- Faculty of Philosophy and Education, Catholic University of Eichstätt-Ingolstadt, Eichtstätt, Germany
| | - Bernhard Holzner
- Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria.,Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatry I, Medical University of Innsbruck, Innsbruck, Austria
| | - Georg Kemmler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatry I, Medical University of Innsbruck, Innsbruck, Austria
| | | |
Collapse
|
22
|
Shah KK, Bennett B, Lenny A, Longworth L, Brazier JE, Oppe M, Pickard AS, Shaw JW. Adapting preference-based utility measures to capture the impact of cancer treatment-related symptoms. THE EUROPEAN JOURNAL OF HEALTH ECONOMICS : HEPAC : HEALTH ECONOMICS IN PREVENTION AND CARE 2021; 22:1301-1309. [PMID: 34142266 PMCID: PMC8526451 DOI: 10.1007/s10198-021-01337-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Accepted: 06/08/2021] [Indexed: 06/12/2023]
Abstract
It is important that patient-reported outcome (PRO) measures used to assess cancer therapies adequately capture the benefits and risks experienced by patients, particularly when adverse event profiles differ across therapies. This study explores the case for augmenting preference-based utility measures to capture the impact of cancer treatment-related symptoms. Additional cancer treatment-related items could be specific (e.g., rash) or global. While specific items are easier to describe and understand, their use may miss rarer symptoms and those that are currently unknown but will arise from future medical advancements. The appropriate number of additional items, the independence of those items, and their impact on the psychometric properties of the core instrument require consideration. Alternatively, a global item could encompass all potential treatment-related symptoms, of any treatments for any disease. However, such an item may not be well understood by general public respondents in valuation exercises. Further challenges include the decision about whether to generate de novo value sets for the modified instrument or to map to existing tariffs. The fluctuating and transient nature of treatment-related symptoms may be inconsistent with the methods used in conventional valuation exercises. Fluctuating symptoms could be missed by sub-optimal measure administration timing. The addition of items also poses double-counting risks. In summary, the addition of treatment-related symptom items could increase the sensitivity of existing utility measures to capture known and unknown treatment effects in oncology, while retaining the core domains. However, more research is needed to investigate the challenges, particularly regarding valuation.
Collapse
Affiliation(s)
- Koonal K Shah
- PHMR, London, UK.
- School of Health and Related Research, University of Sheffield, Sheffield, UK.
| | | | | | | | - John E Brazier
- School of Health and Related Research, University of Sheffield, Sheffield, UK
| | | | | | | |
Collapse
|
23
|
Shaw JW, Bennett B, Trigg A, DeRosa M, Taylor F, Kiff C, Ntais D, Noon K, King MT, Cocks K. A Comparison of Generic and Condition-Specific Preference-Based Measures Using Data From Nivolumab Trials: EQ-5D-3L, Mapping to the EQ-5D-5L, and European Organisation for Research and Treatment of Cancer Quality of Life Utility Measure-Core 10 Dimensions. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:1651-1659. [PMID: 34711366 DOI: 10.1016/j.jval.2021.05.022] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Revised: 04/02/2021] [Accepted: 05/24/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVES There is growing interest in condition-specific preference measures, including the European Organisation for Research and Treatment of Cancer Quality of Life Utility Measure-Core 10 Dimensions (QLU-C10D). This research assessed the implications of using utility indices on the basis of the EQ-5D-3L, a mapping of EQ-5D-3L to the EQ-5D-5L, and the QLU-C10D, and compared their psychometric properties. METHODS Data were taken from 8 phase 3 randomized controlled trials of nivolumab with or without ipilimumab for the treatment of solid tumors. Utilities for progression-related states were calculated using the UK and English value sets and incremental quality-adjusted life-years (QALYs) derived from established UK cost-effectiveness models. The psychometric properties of the utility indices were assessed using pooled trial data. RESULTS Compared with the EQ-5D-3L index, the mapped EQ-5D-5L index yielded an average of 6% more and the QLU-C10D index an average of 2% fewer incremental QALYs for nivolumab versus comparators. All indices could differentiate between groups defined by performance status, cancer stage, or self-reported health status at baseline and detect meaningful changes in performance status, tumor response, health status, and quality of life over approximately 12 weeks of treatment. CONCLUSIONS The lower QALY yield of the QLU-C10D was balanced by evidence of greater validity and responsiveness. Benefits gained from using the QLU-C10D may be apparent when treatments affect targeted symptoms and functional aspects, including sleep, bowel function, appetite, nausea, and fatigue. The observed differences in QALYs may not be sufficiently large to affect health technology assessment decisions.
Collapse
Affiliation(s)
- James W Shaw
- Worldwide Health Economics and Outcomes Research, Bristol Myers Squibb, Princeton, NJ, USA.
| | - Bryan Bennett
- Bristol Myers Squibb Pharmaceuticals Ltd, Uxbridge, England, UK
| | - Andrew Trigg
- Patient-Centered Outcomes, Adelphi Values Ltd, Bollington, England, UK
| | - Michael DeRosa
- Patient-Centered Outcomes, Adelphi Values, Boston, MA, USA
| | - Fiona Taylor
- Patient-Centered Outcomes, Adelphi Values, Boston, MA, USA
| | | | - Dionysios Ntais
- Bristol Myers Squibb Pharmaceuticals Ltd, Uxbridge, England, UK
| | - Katie Noon
- Bristol Myers Squibb Pharmaceuticals Ltd, Uxbridge, England, UK
| | | | - Kim Cocks
- Patient-Centered Outcomes, Adelphi Values Ltd, Bollington, England, UK
| |
Collapse
|
24
|
Finch AP, Gamper E, Norman R, Viney R, Holzner B, King M, Kemmler G. Estimation of an EORTC QLU-C10 Value Set for Spain Using a Discrete Choice Experiment. PHARMACOECONOMICS 2021; 39:1085-1098. [PMID: 34216380 PMCID: PMC8352836 DOI: 10.1007/s40273-021-01058-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/07/2021] [Indexed: 05/11/2023]
Abstract
BACKGROUND The EORTC QLU-C10D is a preference-based measure derived from the EORTC QLQ-C30. For use in economic evaluations, country-specific value sets are needed. This study aimed to generate an EORTC QLU-C10 value set for Spain. METHODS A sample of the Spanish general population completed an online discrete choice experiment. An attribute-balanced incomplete block design was used to select 960 choice tasks, with a total of 1920 health states. Each participant was randomly assigned 16 choice sets without replacement. Data were modelled using generalized estimating equations and mixed logistic regressions. RESULTS A total of 1625 panel members were invited to participate, 1010 of whom were included in the study. Dimension decrements were generally monotonic with larger disutilities at increased severity levels. Dimensions associated with larger decrements were physical functioning and pain, while the dimension with the smallest decrement was sleep disturbances. The PITS state (i.e. worst attainable health) for the Spanish population is - 0.043. CONCLUSIONS This study generated the first Spanish value set for the QLU-C10D. This can facilitate cost-utility analyses when applied to data collected with the EORTC QLQ-C30.
Collapse
Affiliation(s)
- Aureliano Paolo Finch
- Research Centre on Health and Social Care Management (CERGAS), Bocconi University, Via Sarfatti 25, S1 4DT, Milan, Italy.
- Health Values Research and Consultancy, Amsterdam, The Netherlands.
| | - Eva Gamper
- Division of Psychiatry I, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Richard Norman
- School of Public Health, Curtin University, Perth, Australia
| | - Rosalie Viney
- Centre for Health Economics Research and Evaluation (CHERE), UTS Business School, University of Technology Sydney (UTS), Sydney, NSW, Australia
| | - Bernhard Holzner
- Division of Psychiatry I, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
- Division of Psychiatry II, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Madeleine King
- School of Psychology, University of Sydney, Sydney, Australia
| | - Georg Kemmler
- Division of Psychiatry II, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
25
|
King MT, Norman R, Mercieca-Bebber R, Costa DSJ, McTaggart-Cowan H, Peacock S, Janda M, Müller F, Viney R, Pickard AS, Cella D. The Functional Assessment of Cancer Therapy Eight Dimension (FACT-8D), a Multi-Attribute Utility Instrument Derived From the Cancer-Specific FACT-General (FACT-G) Quality of Life Questionnaire: Development and Australian Value Set. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:862-873. [PMID: 34119085 DOI: 10.1016/j.jval.2021.01.007] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2020] [Revised: 12/14/2020] [Accepted: 01/04/2021] [Indexed: 05/19/2023]
Abstract
OBJECTIVES To develop a cancer-specific multi-attribute utility instrument derived from the Functional Assessment of Cancer Therapy - General (FACT-G) health-related quality of life (HRQL) questionnaire. METHODS We derived a descriptive system based on a subset of the 27-item FACT-G. Item selection was informed by psychometric analyses of existing FACT-G data (n = 6912) and by patient input (n = 82). We then conducted an online valuation survey, with participants recruited via an Australian general population online panel. A discrete choice experiment (DCE) was used, with attributes being the HRQL dimensions of the descriptive system and survival duration, and 16 choice-pairs per participant. Utility decrements were estimated with conditional logit and mixed logit modeling. RESULTS Eight HRQL dimensions were included in the descriptive system: pain, fatigue, nausea, sleep, work, social support, sadness, and future health worry; each with 5 levels. Of 1737 panel members who accessed the valuation survey, 1644 (95%) completed 1 or more DCE choice-pairs and were included in analyses. Utility decrements were generally monotonic; within each dimension, poorer HRQL levels generally had larger utility decrements. The largest utility decrements were for the highest levels of pain (-0.40) and nausea (-0.28). The worst health state had a utility of -0.54, considerably worse than dead. CONCLUSIONS A descriptive system and preference-based scoring approach were developed for the FACT-8D, a new cancer-specific multi-attribute utility instrument derived from the FACT-G. The Australian value set is the first of a series of country-specific value sets planned that can facilitate cost-utility analyses based on items from the FACT-G and related FACIT questionnaires containing FACT-G items.
Collapse
Affiliation(s)
- Madeleine T King
- The University of Sydney, Faculty of Science, School of Psychology, Sydney, NSW, Australia.
| | - Richard Norman
- Curtin University - Perth City Campus, and Department of Health Policy and Management, Bentley Campus, Perth, ACT, Australia
| | - Rebecca Mercieca-Bebber
- The University of Sydney, Faculty of Science, School of Psychology, Sydney, NSW, Australia; The University of Sydney, Faculty of Medicine and Health, NHMRC Clinical Trials Centre, Sydney, NSW, Australia
| | - Daniel S J Costa
- The University of Sydney, Faculty of Science, School of Psychology, Sydney, NSW, Australia; Pain Management Research Institute, Saint Leonards, NSW, Australia and The University of Sydney, Sydney Medical School, Sydney, NSW, Australia
| | - Helen McTaggart-Cowan
- Canadian Centre for Applied Research in Cancer Control, Vancouver, BC, Canada and British Columbia Cancer Agency, Vancouver, BC, Canada; Simon Fraser University, Faculty of Health Sciences, Burnaby, BC, Canada
| | - Stuart Peacock
- Canadian Centre for Applied Research in Cancer Control, Vancouver, BC, Canada and British Columbia Cancer Agency, Vancouver, BC, Canada
| | - Monika Janda
- Queensland University of Technology, School of Public Health, Institute of Health and Biomedical Innovation, Brisbane, QLD, Australia
| | - Fabiola Müller
- The University of Sydney, Faculty of Science, School of Psychology, Sydney, NSW, Australia; Amsterdam University Medical Centres, Department of Medical Psychology, Amsterdam Public Health Research Institute, Amsterdam, Noord-Holland, NL
| | - Rosalie Viney
- University of Technology Sydney, Centre for Health Economics Research and Evaluation, Sydney, NSW, Australia
| | - Alan Simon Pickard
- University of Illinois at Chicago, Department of Pharmacy Systems, Outcomes and Policy, Chicago, IL, USA
| | - David Cella
- Northwestern University Feinberg School of Medicine, Department of Medical Social Sciences, Chicago, IL, USA
| |
Collapse
|
26
|
Lehmann J, Holzner B, Giesinger JM, Bottomley A, Ansari S, von Butler L, Kemmler G. Functional health and symptoms in Spain before and during the COVID-19 pandemic. BMC Public Health 2021; 21:837. [PMID: 33933042 PMCID: PMC8087887 DOI: 10.1186/s12889-021-10899-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Accepted: 04/22/2021] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND The impact of the coronavirus disease (COVID-19) pandemic on wellbeing and health has so far been studied using mostly cross-sectional designs. To place recent findings into context, we compared symptoms and functional health status in two independent samples assessed before and during the COVID-19 pandemic. METHODS Participants were recruited via an online panel using quota sampling. We assessed symptoms, functional health, and global quality of life with the EORTC QLQ-C30 in two general population samples in Spain (collected in July 2019 and April 2020). We also assessed several COVID-19 related variables, such as adherence to social distancing. RESULTS Data from N = 1010 participants before the pandemic (mean age 47.1 years, 50.5% female) were compared with data from N = 504 participants during the pandemic (mean age 47.1 years, 50.8% female). Participants during the pandemic (vs. before the pandemic) reported lower role functioning and emotional functioning, as well as less symptom burden. A lower degree of social distancing was associated with better functional health and lower symptom burden. CONCLUSION Our findings indicate an impact of the COVID-19 pandemic on functional health and symptom burden in the Spanish general population. The comparison of before and during the pandemic can be used to benchmark results raised only during the pandemic.
Collapse
Affiliation(s)
- Jens Lehmann
- University Hospital of Psychiatry I, Medical University of Innsbruck, Anichstraße 35, 6020, Innsbruck, Austria.
- University Hospital of Psychiatry II, Medical University of Innsbruck, Anichstraße 35, 6020, Innsbruck, Austria.
| | - Bernhard Holzner
- University Hospital of Psychiatry II, Medical University of Innsbruck, Anichstraße 35, 6020, Innsbruck, Austria
| | - Johannes M Giesinger
- University Hospital of Psychiatry II, Medical University of Innsbruck, Anichstraße 35, 6020, Innsbruck, Austria
| | - Andrew Bottomley
- EORTC Department of Quality of Life, Headquarter, Brussels, Belgium
| | | | | | - Georg Kemmler
- University Hospital of Psychiatry I, Medical University of Innsbruck, Anichstraße 35, 6020, Innsbruck, Austria
| |
Collapse
|
27
|
Nerich V, Gamper EM, Norman R, King M, Holzner B, Viney R, Kemmler G. French Value-Set of the QLU-C10D, a Cancer-Specific Utility Measure Derived from the QLQ-C30. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2021; 19:191-202. [PMID: 32537694 DOI: 10.1007/s40258-020-00598-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
BACKGROUND AND OBJECTIVE The EORTC Quality of Life Utility Measure-Core 10 Dimensions (QLU-C10D) is a new multi-attribute utility instrument derived from the EORTC Quality of Life Questionnaire-Core 30 (QLQ-C30), a widely used cancer-specific quality-of-life questionnaire. It covers ten dimensions: physical, role functioning, social, emotional functioning, pain, fatigue, sleep, appetite, nausea and bowel problems. To allow national health preferences to be reflected, country-specific valuations are being performed through collaboration between the Multi-Attribute Utility Cancer (MAUCa) Consortium and the EORTC. The aim of this study was to determine the utility weights for health states in the French version of the QLU-C10D. METHODS Valuations were run in a web-based setting in a general population sample of 1033 adults. Utilities were elicited using a discrete-choice experiment (DCE). Data were analyzed by conditional logistic regression and mixed logits. RESULTS The sample was representative of the general French population in terms of gender and age. Dimensions with the largest impact on utility weights were, in this order: physical functioning, pain and emotional functioning. The impact on utilities was lower for role functioning, nausea, bowel problems and social functioning. The dimensions of sleep, fatigue and lacking appetite were associated with the smallest utility decrement. CONCLUSION The results of the present study provide utility weights for the QLU-C10D and offer interesting prospects, as some cancer-specific dimensions also received sizeable utility weights (nausea and bowel problems). In fact, the EQ-5D and the HUI 3 are recommended in France and commonly used for cancer-related CUA; however, both these instruments are generic. The availability of a new cancer-specific utility instrument, such as the QLU-C10D, could improve the quality and the pertinence of future CUA in oncology.
Collapse
Affiliation(s)
- Virginie Nerich
- Department of Pharmacy, University Hospital, Boulevard Fleming, 25030, Besancon Cedex, France.
- INSERM, EFS-BFC, UMR1098, University of Franche-Comté, Besançon, France.
| | - Eva Maria Gamper
- Division of Psychiatry II, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Richard Norman
- School of Public Health, Curtin University, Perth, WA, Australia
| | - Madeleine King
- School of Psychology, Faculty of Science, University of Sydney, Sydney, NSW, Australia
- Sydney Medical School, Faculty of Medicine, University of Sydney, Sydney, NSW, Australia
| | - Bernhard Holzner
- Division of Psychiatry II, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| | - Rosalie Viney
- Centre for for Health Economics Research and Evaluation (CHERE), UTS Business School University of Technology Sydney (UTS), Sydney, NSW, Australia
| | - Georg Kemmler
- Division of Psychiatry I, Department of Psychiatry, Psychotherapy and Psychosomatics, Medical University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
28
|
Dutch utility weights for the EORTC cancer-specific utility instrument: the Dutch EORTC QLU-C10D. Qual Life Res 2021; 30:2009-2019. [PMID: 33512653 PMCID: PMC8233279 DOI: 10.1007/s11136-021-02767-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/11/2021] [Indexed: 12/11/2022]
Abstract
Purpose To measure utilities among cancer patients, a cancer-specific utility instrument called the European Organization for Research and Treatment of Cancer (EORTC) QLU-C10D has been developed based on EORTC quality of life core module (QLQ-C30). This study aimed to provide Dutch utility weights for the QLU-C10D. Methods A cross-sectional valuation study was performed in 1017 participants representative in age and gender of the Dutch general population. The valuation method was a discrete choice experiment containing 960 choice sets, i.e. pairs of QLU-C10D health states, each health state described in terms of the 10 QLU-C10D domains and the duration of that health state. Each participant considered 16 choice sets, choosing their preferred health state from each pair. Utility scores were derived using generalized estimation equation models. Non-monotonic levels were combined. Results Utility decrements were generated for all 10 QLU-C10D domains, with largest decrements for pain (− 0.242), physical functioning (− 0.228), and role functioning (− 0.149). Non-monotonic levels of emotional functioning, pain, fatigue, sleep problems, and appetite loss were combined. No decrement in utility was seen in case of a little or quite a bit impairment in emotional functioning or a little pain. The mean QLU-C10D utility score of the participants was 0.85 (median = 0.91, interquartile range = 0.82 to 0.96). Conclusion Dutch utility decrements were generated for the QLU-C10D. These are important for evaluating the cost-utility of new cancer treatments and supportive care interventions. Further insight is warranted into the added value of the QLU-C10D alongside other utility instruments. Supplementary Information The online version contains supplementary material available at 10.1007/s11136-021-02767-8.
Collapse
|
29
|
Abstract
Objective To develop Austrian, Italian, and Polish general population value sets for the EORTC QLU-C10D, a cancer-specific utility instrument based on the EORTC QLQ-C30, and to descriptively compare their index scores for distinct health states. Methods The QLU-C10D descriptive system comprises 10 health attributes and each can take on 4 levels. A standardised and pre-tested methodology has been applied for valuations including a web-based discrete choice experiment (DCE). It was administered in 1000 general population respondents per country recruited via online panels, aiming at representativeness for core socio-demographic variables. Results In all three countries, the attributes with the largest impact on utility were physical functioning, pain, and role functioning. Cancer-specific dimensions with the largest impact were nausea and fatigue or bowel problems. Utility values of the worst health state (i.e. severe problems on all 10 dimension) were -0.111 (Austria), 0.025 (Italy), and 0.048 (Poland). Country-specific utilities differed for a selection of health states across the continuum. Austrian utilities were systematically lower for moderately and severely impaired health states. Conclusion QLU-C10D cancer-specific utilities can now be calculated in three more countries. Differences between countries indicate that careful consideration is required when using non-country-specific value sets in economic evaluations. Electronic supplementary material The online version of this article (10.1007/s11136-020-02536-z) contains supplementary material, which is available to authorized users.
Collapse
|
30
|
van Gelder T, Mulhern B, Schoormans D, Husson O, De Abreu Lourenço R. Assessing health-related quality of life in cancer survivors: factors impacting on EORTC QLU-C10D-derived utility values. Qual Life Res 2020; 29:1483-1494. [DOI: 10.1007/s11136-020-02420-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/06/2020] [Indexed: 11/24/2022]
|