1
|
Kwon J, Smith S, Raghunandan R, Howell M, Huynh E, Kim S, Bentley T, Roberts N, Lancsar E, Howard K, Wong G, Craig J, Petrou S. Systematic Review of the Psychometric Performance of Generic Childhood Multi-attribute Utility Instruments. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2023; 21:559-584. [PMID: 37133712 DOI: 10.1007/s40258-023-00806-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/21/2023] [Indexed: 05/04/2023]
Abstract
BACKGROUND Childhood multi-attribute utility instruments (MAUIs) can be used to measure health utilities in children (aged ≤ 18 years) for economic evaluation. Systematic review methods can generate a psychometric evidence base that informs their selection for application. Previous reviews focused on limited sets of MAUIs and psychometric properties, and only on evidence from studies that directly aimed to conduct psychometric assessments. OBJECTIVE This study aimed to conduct a systematic review of psychometric evidence for generic childhood MAUIs and to meet three objectives: (1) create a comprehensive catalogue of evaluated psychometric evidence; (2) identify psychometric evidence gaps; and (3) summarise the psychometric assessment methods and performance by property. METHODS A review protocol was registered with the Prospective Register of Systematic Reviews (PROSPERO; CRD42021295959); reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline. The searches covered seven academic databases, and included studies that provided psychometric evidence for one or more of the following generic childhood MAUIs designed to be accompanied by a preference-based value set (any language version): 16D, 17D, AHUM, AQoL-6D, CH-6D, CHSCS-PS, CHU9D, EQ-5D-Y-3L, EQ-5D-Y-5L, HUI2, HUI3, IQI, QWB, and TANDI; used data derived from general and/or clinical childhood populations and from children and/or proxy respondents; and were published in English. The review included 'direct studies' that aimed to assess psychometric properties and 'indirect studies' that generated psychometric evidence without this explicit aim. Eighteen properties were evaluated using a four-part criteria rating developed from established standards in the literature. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results by property. RESULTS Overall, 372 studies were included, generating a catalogue of 2153 criteria rating outputs across 14 instruments covering all properties except predictive validity. The number of outputs varied markedly by instrument and property, ranging from 1 for IQI to 623 for HUI3, and from zero for predictive validity to 500 for known-group validity. The more recently developed instruments targeting preschool children (CHSCS-PS, IQI, TANDI) have greater evidence gaps (lack of any evidence) than longer established instruments such as EQ-5D-Y, HUI2/3, and CHU9D. The gaps were prominent for reliability (test-retest, inter-proxy-rater, inter-modal, internal consistency) and proxy-child agreement. The inclusion of indirect studies (n = 209 studies; n = 900 outputs) increased the number of properties with at least one output of acceptable performance. Common methodological issues in psychometric assessment were identified, e.g., lack of reference measures to help interpret associations and changes. No instrument consistently outperformed others across all properties. CONCLUSION This review provides comprehensive evidence on the psychometric performance of generic childhood MAUIs. It assists analysts involved in cost-effectiveness-based evaluation to select instruments based on the application-specific minimum standards of scientific rigour. The identified evidence gaps and methodological issues also motivate and inform future psychometric studies and their methods, particularly those assessing reliability, proxy-child agreement, and MAUIs targeting preschool children.
Collapse
Affiliation(s)
- Joseph Kwon
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sarah Smith
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | | | - Martin Howell
- School of Public Health, University of Sydney, Sydney, NSW, Australia
| | - Elisabeth Huynh
- Department of Health Services Research and Policy, Australian National University, Canberra, ACT, Australia
| | - Sungwook Kim
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Thomas Bentley
- Medical Sciences Division, University of Oxford, Oxford, UK
| | - Nia Roberts
- Bodleian Health Care Libraries, University of Oxford, Oxford, UK
| | - Emily Lancsar
- Department of Health Services Research and Policy, Australian National University, Canberra, ACT, Australia
| | - Kirsten Howard
- School of Public Health, University of Sydney, Sydney, NSW, Australia
| | - Germaine Wong
- School of Public Health, University of Sydney, Sydney, NSW, Australia
| | - Jonathan Craig
- College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| | - Stavros Petrou
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
| |
Collapse
|
2
|
Tan RLY, Soh SZY, Chen LA, Herdman M, Luo N. Psychometric Properties of Generic Preference-Weighted Measures for Children and Adolescents: A Systematic Review. PHARMACOECONOMICS 2023; 41:155-174. [PMID: 36404365 DOI: 10.1007/s40273-022-01205-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/02/2022] [Indexed: 06/16/2023]
Abstract
INTRODUCTION Preference-weighted measures (PWMs)-also referred to as preference-based measures in the literature-of health status/health-related quality of life plays an essential role in estimating quality-adjusted life-years (QALY) for use in economic evaluations of healthcare products and interventions. However, as PWMs are first and foremost intended to accurately reflect respondent health status, they should ideally demonstrate good psychometric properties for the population in question. This study aimed to systematically review published evidence on the measurement properties of commonly used PWMs for children and adolescents. METHODS Three electronic databases (PubMed, Medline, and PsycINFO) were searched for articles assessing the psychometric properties (content validity, construct validity-including convergent validity and known-group validity, test-retest reliability, and responsiveness) of the PWMs of interest (AQoL-6D, CHU9D, HUI2, HUI3, and EQ-5D-Y). The COsensus-based Standards for the selection of health Measurement INstruments methodology (COSMIN) guidelines were used to assess (a) the methodological quality of the studies included and (b) the psychometric performance of the instruments covered. Data were analysed overall as well as by population (country and disease group) and perspective (self-report or proxy-report). The study protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO) database (CRD42021277296). RESULTS In total, 53 articles were included in this systematic review. Health Utilities Index (HUI) was tested only in patient populations, CHU9D was most frequently tested in general population samples, while EQ-5D-Y was tested in both populations. Overall, there was high-quality evidence supporting sufficient construct validity for all instruments except AQoL-6D. Evidence supporting test-retest and responsiveness was scarce. There was high-quality evidence supporting sufficient responsiveness of HUI2 and HUI3, and inconsistent test-retest reliability of CHU9D and EQ-5D-Y. Evidence for content validity was minimal and therefore not extracted and synthesized for any PWMs. CONCLUSION This review provides updated evidence on the measurement properties of existing generic PWMs for children and adolescents. High-quality evidence for all relevant psychometric properties and across a range of populations was not available for any of the instruments included, indicating that further work is needed in this direction. This study has identified some of the most noticeable evidence gaps for each of the individual measures. Users can use this information to guide their decision on the choice of PWM to administer.
Collapse
Affiliation(s)
- Rachel Lee-Yin Tan
- Saw Swee Hock School of Public Health, National University of Singapore, 12 Science Drive 2, #10-01, Singapore, 117549, Singapore
| | - Sonia Zhi Yi Soh
- Saw Swee Hock School of Public Health, National University of Singapore, 12 Science Drive 2, #10-01, Singapore, 117549, Singapore
| | - Le Ann Chen
- Saw Swee Hock School of Public Health, National University of Singapore, 12 Science Drive 2, #10-01, Singapore, 117549, Singapore
| | - Michael Herdman
- Office of Health Economics, 105 Victoria Street, London, SW1E 6QT, UK
| | - Nan Luo
- Saw Swee Hock School of Public Health, National University of Singapore, 12 Science Drive 2, #10-01, Singapore, 117549, Singapore.
| |
Collapse
|
3
|
Al-Aqeel SA, AlAujan SS, Almazrou SH. The Institute for Medical Technology Assessment Productivity Cost Questionnaire (iPCQ) and the Medical Consumption Questionnaire (iMCQ): Translation and Cognitive Debriefing of the Arabic Version. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18147232. [PMID: 34299684 PMCID: PMC8303958 DOI: 10.3390/ijerph18147232] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 07/01/2021] [Accepted: 07/02/2021] [Indexed: 12/28/2022]
Abstract
The aim of this study was to translate the Institute for Medical Technology Assessment Productivity Cost Questionnaire (iPCQ) and the Medical Consumption Questionnaire (iMCQ) from English into Arabic and perform cognitive debriefing in a Saudi Arabian setting. We conducted the translation according to guidelines, including two independent forward translations and a backward translation. Cognitive debriefing was carried out in two stages. First, the pre-final translated versions of the two questionnaires were tested on a group of respondents (n = 5) using face-to-face or telephone interviews. The participants completed a copy of the questionnaires, identified items or questions that were confusing or misunderstood, and then answered a series of open-ended questions about their understanding of each instruction, question and response option. Second, another group of participants (n = 17) completed the questionnaire and circled any word that was confusing or difficult to understand and provided comments on the questionnaires. The Arabic translation and linguistic validation were realized without any major difficulties. The few changes made after cognitive debriefing generally related to changing one word to a more appropriate Arabic word. The final Arabic translation needs to be validated for psychometric properties such as validity and reliability before being recommended for use in future research.
Collapse
|
4
|
Dimentberg E, Cardaillac C, Richard E, Plante AS, Maheux-Lacroix S. Translation and Cultural Validation of the WERF EPHect Endometriosis Patient Questionnaire into Canadian French. JOURNAL OF OBSTETRICS AND GYNAECOLOGY CANADA 2021; 43:817-821. [PMID: 33887447 DOI: 10.1016/j.jogc.2021.03.019] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Revised: 03/26/2021] [Accepted: 03/26/2021] [Indexed: 11/26/2022]
Abstract
OBJECTIVE To produce a culturally validated Canadian French version of the Standard EPHect Endometriosis Patient Questionnaire (EPQ-S) from the World Endometriosis Research Foundation (WERF). METHODS We studied 17 premenopausal women who were seen for pelvic pain symptoms or suspicion of endometriosis at the gynaecology clinic of the CHU de Québec - Université Laval (Québec City, Canada). Participants completed the French language version of the questionnaire at their first visit, and the validation took place about 1 week later. RESULTS All 22 of the invited women agreed to participate, of whom 17 were reached for the validation. The mean age of participants was 38.9 years, and 15 (88%) had a confirmed diagnosis of endometriosis. Fourteen participants (82%) found the questionnaire clear and relevant. The average length of time to complete the questionnaire was 36.25 ± 10.8 minutes. The validation process resulted in the addition of lines at the end of each section to allow space for specific comments and some clarifications with respect to timelines. CONCLUSION This study validated a Canadian French version of the EPHect questionnaire. With such validation studies, differences in language and culture will no longer be a barrier to large national and international studies on endometriosis, leading to high-quality research and breakthroughs for millions of individuals living with this disease.
Collapse
Affiliation(s)
| | - Claire Cardaillac
- Service de Gynécologie-Obstétrique et Médecine de la Reproduction, CHU de Nantes, Nantes, France
| | | | | | - Sarah Maheux-Lacroix
- Department of Obstetrics and Gynecology, CHU de Québec-Université Laval, CHU de Québec-Université Laval Research Center, Québec, QC.
| |
Collapse
|
5
|
Poder TG, Guertin JR, Touré M, Pratte G, Gauvin C, Feeny D, Furlong W, Camden C. Canadian French translation and linguistic validation of the health-related quality of life utility measure for pre-school children. Expert Rev Pharmacoecon Outcomes Res 2021; 21:1195-1201. [PMID: 33625303 DOI: 10.1080/14737167.2021.1895754] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
BACKGROUND There is a need to perform a Canadian French translation and linguistic validation of the health-related quality of life utility measure for pre-school children (HuPS) conceptually equivalent to the original Canadian English version. RESEARCH DESIGN AND METHODS The translation process consisted of forward and back translations. The linguistic validation was performed with the parents of preschool children during face-to-face cognitive debriefing interviews. The whole process was done in accordance with academic standards and the guidance of the Food and Drug Administration (FDA) for patient-reported outcome instruments. RESULTS The results of back translations indicated that 89% of the sentences were identical or almost identical to the original English-language wording. The review of the back translations led to a change in 13 sentences out of 91 from the reconciled forward translation, while the linguistic validation process with 13 parents led to 14 additional changes. Preliminary reliability validation results indicate a Cronbach's alpha of 0.73. CONCLUSION The translation and linguistic testing processes were successful in creating a valid HuPS in Canadian French (HuPS-CF). This translation should be the subject of reliability and validity studies in a wide variety of clinical and general populations before to use in research projects.
Collapse
Affiliation(s)
- Thomas G Poder
- Department de management, evaluation and health policy, School of Public Health, University of Montreal.,Centre de recherche de l'IUSMM, CIUSSS de l'Est-de-l'Île de Montréal, Montreal, QC, Canada
| | - Jason R Guertin
- Department of social and preventive medicine, Faculty of Medicine, Laval University, Quebec, QC, Canada
| | - Moustapha Touré
- Department of economics, School of Management, University of Sherbrooke, Sherbrooke, QC, Canada
| | - Gabrielle Pratte
- School of rehabilitation, Faculty of Medicine and Health Science, University of Sherbrooke, Sherbrooke, QC, Canada
| | - Cheyenne Gauvin
- School of rehabilitation, Faculty of Medicine and Health Science, University of Sherbrooke, Sherbrooke, QC, Canada
| | - David Feeny
- Center for Health Economics and Policy Analysis, McMaster University, Hamilton, ON, Canada
| | - William Furlong
- Center for Health Economics and Policy Analysis, McMaster University, Hamilton, ON, Canada
| | - Chantal Camden
- School of Rehabilitation, University of Sherbrooke, Sherbrooke, QC, Canada
| |
Collapse
|
6
|
Tremblay D, Poder TG, Vasiliadis HM, Touati N, Fortin B, Lévesque L, Longo C. Translation and Cultural Adaptation of the Patient Self-Administered Financial Effects (P-SAFE) Questionnaire to Assess the Financial Burden of Cancer in French-Speaking Patients. Healthcare (Basel) 2020; 8:E366. [PMID: 32992780 PMCID: PMC7712971 DOI: 10.3390/healthcare8040366] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Revised: 09/15/2020] [Accepted: 09/23/2020] [Indexed: 12/23/2022] Open
Abstract
People living with and beyond cancer (PLC) experience financial hardship associated with the disease and its treatment. Research demonstrates that the "economic toxicity" of cancer can cause distress and impair well-being, health-related quality of life and, ultimately, survival. The Patient Self-Administered Financial Effects (P-SAFE) questionnaire was created in Canada and tested in English. The objective of this study is to describe the processes of translation and cultural adaptation of the P-SAFE for use with French speaking PLC in Canada. The Canadian P-SAFE questionnaire was translated from English to French in collaboration with the developer of the initial version, according to the 12-step process recommended by the Patient-Reported Outcome (PRO) Consortium. These steps include forward and backward translation, a multidisciplinary expert committee, and cross-cultural validation using think-aloud, probing techniques, and clarity scoring during cognitive interviewing. Translation and validation of the P-SAFE questionnaire were performed without major difficulties. Minor changes were made to better fit with the vocabulary used in the public healthcare system in Quebec. The mean score for clarity of questions was 6.4 out of a possible 7 (totally clear) Cognitive interviewing revealed that lengthy questionnaire instructions could be confusing. Our team produced a Canadian-French version of the P-SAFE. After minor rewording in the instructions, the P-SAFE questionnaire appears culturally appropriate for use with French-speaking PLC in Canada. Further testing of the French version will require evaluation of psychometric properties of validity and reliability.
Collapse
Affiliation(s)
- Dominique Tremblay
- Centre de Recherche Charles-Le Moyne–Saguenay–Lac-Saint-Jean sur les Innovations en Santé, 150 Place Charles-Le Moyne, Longueuil, QC J4K 0A8, Canada; (H.-M.V.); (B.F.); (L.L.)
- Faculté de Médecine et des Sciences de la Santé, Université de Sherbrooke, Campus de Longueuil, Longueuil, QC J4K 0A8, Canada
| | - Thomas G. Poder
- Département de Gestion, Évaluation et Politique de Santé, École de Santé Publique de l’Université de Montréal (ESPUM), Université de Montréal, Montréal, QC H3N 1X9, Canada;
- Centre de Recherche de l’Institut Universitaire en Santé Mentale de Montréal, CIUSSS de l’Est de l’Île de Montréal, Montréal, QC H1N 3M5, Canada
| | - Helen-Maria Vasiliadis
- Centre de Recherche Charles-Le Moyne–Saguenay–Lac-Saint-Jean sur les Innovations en Santé, 150 Place Charles-Le Moyne, Longueuil, QC J4K 0A8, Canada; (H.-M.V.); (B.F.); (L.L.)
- Faculté de Médecine et des Sciences de la Santé, Université de Sherbrooke, Campus de Longueuil, Longueuil, QC J4K 0A8, Canada
| | - Nassera Touati
- École Nationale D’administration Publique, Montréal, QC H2T 2C8, Canada;
| | - Béatrice Fortin
- Centre de Recherche Charles-Le Moyne–Saguenay–Lac-Saint-Jean sur les Innovations en Santé, 150 Place Charles-Le Moyne, Longueuil, QC J4K 0A8, Canada; (H.-M.V.); (B.F.); (L.L.)
- Faculté de Médecine et des Sciences de la Santé, Université de Sherbrooke, Campus de Longueuil, Longueuil, QC J4K 0A8, Canada
| | - Lise Lévesque
- Centre de Recherche Charles-Le Moyne–Saguenay–Lac-Saint-Jean sur les Innovations en Santé, 150 Place Charles-Le Moyne, Longueuil, QC J4K 0A8, Canada; (H.-M.V.); (B.F.); (L.L.)
- Faculté de Médecine et des Sciences de la Santé, Université de Sherbrooke, Campus de Longueuil, Longueuil, QC J4K 0A8, Canada
| | - Christopher Longo
- DeGroote School of Business, McMaster University, Hamilton, ON L8S 4L8, Canada;
| |
Collapse
|