1
|
Vu M, Degeling K, Westerman D, IJzerman MJ. Scenario analysis and multi-criteria decision analysis to explore alternative reimbursement pathways for whole genome sequencing for blood cancer patients. J Cancer Policy 2024; 41:100501. [PMID: 39142605 DOI: 10.1016/j.jcpo.2024.100501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Revised: 08/07/2024] [Accepted: 08/11/2024] [Indexed: 08/16/2024]
Abstract
BACKGROUND Whole genome sequencing (WGS) has transformative potential for blood cancer management, but reimbursement is hindered by uncertain benefits relative to added costs. This study employed scenario planning and multi-criteria decision analysis (MCDA) to evaluate stakeholders' preferences for alternative reimbursement pathways, informing future health technology assessment (HTA) submission of WGS in blood cancer. METHODS Key factors influencing WGS reimbursement in blood cancers were identified through a literature search. Hypothetical scenarios describing various evidential characteristics of WGS for HTA were developed using the morphological approach. An online survey, incorporating MCDA weights, was designed to gather stakeholder preferences (consumers/patients, clinicians/health professionals, industry representatives, health economists, and HTA committee members) for these scenarios. The survey assessed participants' approval of WGS reimbursement for each scenario, and scenario preferences were determined using the geometric mean method, applying an algorithm to improve reliability and precision by addressing inconsistent responses. RESULTS Nineteen participants provided complete survey responses, primarily clinicians or health professionals (n = 6; 32 %), consumers/patients and industry representatives (both at n = 5; 26 %). "Clinical impact of WGS results on patient care" was the most critical criterion (criteria weight of 0.25), followed by "diagnostic accuracy of WGS" (0.21), "cost-effectiveness of WGS" (0.19), "availability of reimbursed treatment after WGS" (0.16), and "eligibility criteria for reimbursed treatment based on actionable WGS results" and "cost comparison of WGS" (both at 0.09). Participants preferred a scenario with substantial clinical evidence, high access to reimbursed targeted treatment, cost-effectiveness below $50,000 per quality-adjusted life year (QALY) gained, and affordability relative to standard molecular tests. Reimbursement was initially opposed until criteria such as equal cost to standard tests and better treatment accessibility were met. CONCLUSION Payers commonly emphasize acceptable cost-effectiveness, but strong clinical evidence for many variants and comparable costs to standard tests are likely to drive positive reimbursement decisions for WGS.
Collapse
Affiliation(s)
- Martin Vu
- Cancer Health Services Research, Centre for Cancer Research, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia; Cancer Health Services Research, Centre for Health Policy, Melbourne School of Population and Global Health, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia
| | - Koen Degeling
- Cancer Health Services Research, Centre for Cancer Research, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia; Cancer Health Services Research, Centre for Health Policy, Melbourne School of Population and Global Health, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia
| | - David Westerman
- Department of Pathology, Peter MacCallum Cancer Centre, Melbourne, Australia; Sir Peter MacCallum Department of Oncology, The University of Melbourne, Melbourne, Australia; Clinical Haematology, Peter MacCallum Cancer Centre/Royal Melbourne Hospital, Melbourne, Australia
| | - Maarten J IJzerman
- Cancer Health Services Research, Centre for Cancer Research, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia; Cancer Health Services Research, Centre for Health Policy, Melbourne School of Population and Global Health, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia; Erasmus School of Health Policy and Management, Rotterdam, the Netherlands.
| |
Collapse
|
2
|
van der Zee C, Chang-Wolf J, Koopmanschap MA, van Leeuwen R, Wisse RPL. Assessing the Carbon Footprint of Telemedicine: A Systematic Review. Health Serv Insights 2024; 17:11786329241271562. [PMID: 39139395 PMCID: PMC11320403 DOI: 10.1177/11786329241271562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 06/28/2024] [Indexed: 08/15/2024] Open
Abstract
Background Healthcare is responsible for 4% to 10% of carbon emissions worldwide, of which 22% is related to transport. Telemedicine emerged as a potential solution to reduce the footprint, for example, by reducing travel. However, a need to understand which variables to include in carbon footprint estimations in telemedicine limits our understanding of the beneficial impact telemedicine might have on our environment. This paper aims to systematically assess the reported carbon footprint and include variables assessed by the literature, comparing telemedicine with usual care. Methods The systematic review followed the PRISMA guidelines in PubMed, Medline, Embase and Scopus. A quality assessment was performed using a transparency checklist for carbon footprint calculators. Carbon emissions were evaluated based on four categories, including patient travel, and streamlined life cycle assessment (LCA) for assessing included variables relevant to telemedicine. Results We included 33 articles from 1117 records for analysis. The average transparency score was 38% (range 18%-68%). The median roundtrip travel distance for each patient was 131 km (interquartile range [IQR]: 60.8-351), or 25.6 kgCO2 (IQR: 10.6-105.6) emissions. There is high variance among included variables. Saved emissions are structurally underestimated by not including external factors such as a streamlined LCA. Conclusions Telemedicine aids in reducing emissions, with travel distance being the most significant contributor. Additionally, we recommend accounting for the LCA since it highlights important nuances. This review furthers the debate on assessing carbon footprint savings due to telemedicine.
Collapse
Affiliation(s)
- Casper van der Zee
- Ophthalmology Department, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Jennifer Chang-Wolf
- Ophthalmology Department, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Marc A Koopmanschap
- Erasmus School of Health Policy and Management, Erasmus University, Rotterdam, The Netherlands
| | - Redmer van Leeuwen
- Ophthalmology Department, University Medical Center Utrecht, Utrecht, The Netherlands
- Dutch Workgroup of Sustainable Ophthalmology, Utrecht, The Netherlands
| | - Robert PL Wisse
- Ophthalmology Department, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
3
|
Gongora-Salazar P, Perera R, Rivero-Arias O, Tsiachristas A. Unravelling Elements of Value of Healthcare and Assessing their Importance Using Evidence from Two Discrete-Choice Experiments in England. PHARMACOECONOMICS 2024:10.1007/s40273-024-01416-5. [PMID: 39085565 DOI: 10.1007/s40273-024-01416-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 07/07/2024] [Indexed: 08/02/2024]
Abstract
BACKGROUND Health systems are moving towards value-based care, implementing new care models that allegedly aim beyond patient outcomes. Therefore, a policy and academic debate is underway regarding the definition of value in healthcare, the inclusion of costs in value metrics, and the importance of each value element. This study aimed to define healthcare value elements and assess their relative importance (RI) to the public in England. METHOD Using data from 26 semi-structured interviews and a literature review, and applying decision-theory axioms, we selected a comprehensive and applicable set of value-based elements. Their RI was determined using two discrete choice experiments (DCEs) based on Bayesian D-efficient DCE designs, with one DCE incorporating healthcare costs expressed as income tax rise. Respondent preferences were analysed using mixed logit models. RESULTS Six value elements were identified: additional life-years, health-related quality of life, patient experience, target population size, equity, and cost. The DCE surveys were completed by 402 participants. All utility coefficients had the expected signs and were statistically significant (p < 0.05). Additional life-years (25.3%; 95% confidence interval [CI] 22.5-28.6%) and patient experience (25.2%; 95% CI 21.6-28.9%) received the highest RI, followed by target population size (22.4%; 95% CI 19.1-25.6%) and quality of life (17.6%; 95% CI 15.0-20.3%). Equity had the lowest RI (9.6%; 95% CI 6.4-12.1%), decreasing by 8.8 percentage points with cost inclusion. A similar reduction was observed in the RI of quality of life when cost was included. CONCLUSION The public prioritizes value elements not captured by conventional metrics, such as quality-adjusted life-years. Although cost inclusion did not alter the preference ranking, its inclusion in the value metric warrants careful consideration.
Collapse
Affiliation(s)
- Pamela Gongora-Salazar
- Social Protection and Health Division, Inter-American Development Bank, Washington, DC, USA.
- Nuffield Department of Population Health, Health Economics Research Centre (HERC), University of Oxford, Oxford, UK.
| | - Rafael Perera
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Oliver Rivero-Arias
- Nuffield Department of Population Health, Health Economics Research Centre (HERC), University of Oxford, Oxford, UK
- Nuffield Department of Population Health, National Perinatal Epidemiology Unit (NPEU), University of Oxford, Oxford, England, UK
| | - Apostolos Tsiachristas
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
4
|
Khanal S, Nghiem S, Miller M, Scuffham P, Byrnes J. Development of a Prioritization Framework to Aid Healthcare Funding Decision Making in Health Technology Assessment in Australia: Application of Multicriteria Decision Analysis. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2024:S1098-3015(24)02784-0. [PMID: 39094691 DOI: 10.1016/j.jval.2024.07.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 06/18/2024] [Accepted: 07/02/2024] [Indexed: 08/04/2024]
Abstract
OBJECTIVES This study develops a prioritization framework to aid healthcare funding decision making in health technology assessment (HTA) in Australia using a multiple criteria decision analysis (MCDA) approach. METHODS MCDA frameworks for HTAs were reviewed through literature survey to identify the initial criteria and levels within each criterion. Key stakeholders and experts were consulted to confirm these criteria and levels. A conjoint analysis using 1000Minds was undertaken with policy makers from the Department of Health to establish ranking criteria and weighting scores. Monte Carlo simulations were used to examine the sensitivity of findings to factors affecting the ranking and weighting scores. The MCDA was then applied to 6 examples of chronic care models or technologies projects to demonstrate the performance of this approach. RESULTS Five criteria (clinical efficacy/effectiveness, safety and tolerability, severity of the condition, quality/uncertainty, and direct impact on healthcare costs) were consistently ranked highest by healthcare decision makers. Among the criteria, patient-level health outcomes were considered the most important, followed by social and ethical values. The analyses were robust to inform the uncertainty in the parameter. CONCLUSIONS This study has developed an MCDA tool that effectively integrates key priorities for HTA reviews, reflecting the values and preferences of healthcare stakeholders in Australia. Although this tool aims to align the assessment process more closely with health benefits, it also highlights the importance of considering other criteria.
Collapse
Affiliation(s)
- Saval Khanal
- Centre for Applied Health Economics, School of Medicine and Dentistry, Griffith University, Nathan, Queensland, Australia.
| | - Son Nghiem
- Department of Health Economics, Wellbeing and Society, Australian National University, Canberra, Australian Capital Territory, Australia
| | - Mel Miller
- Siggins Miller Consultants, Brisbane, Queensland, Australia
| | - Paul Scuffham
- Centre for Applied Health Economics, School of Medicine and Dentistry, Griffith University, Nathan, Queensland, Australia
| | - Joshua Byrnes
- Centre for Applied Health Economics, School of Medicine and Dentistry, Griffith University, Nathan, Queensland, Australia.
| |
Collapse
|
5
|
Vásquez P, Hall L, Merlo G. Societal Preferences in Health Technology Assessments for Rare Diseases and Orphan Drugs: A Systematic Literature Review of New Analytic Approaches. Value Health Reg Issues 2024; 44:101026. [PMID: 39059264 DOI: 10.1016/j.vhri.2024.101026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 05/24/2024] [Accepted: 06/18/2024] [Indexed: 07/28/2024]
Abstract
OBJECTIVES This systematic literature review aimed to explore experiences worldwide of societal preferences integration into health technology assessments (HTAs) for rare diseases (RDs) and orphan drugs (ODs) through the implementation of multicriteria decision analysis (MCDA), discrete choice experiments (DCEs), and person trade-off (PTO) methods, among others. METHODS A systematic search of the literature was conducted in April 2021 using PubMed, Cochrane, Embase, and Scopus databases. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses approach was used for the review phases. Finally, the Promoting Action on Research Implementation in Health Services framework was used to discuss the implementation of these instruments in the RD context. RESULTS A total of 33 articles met the inclusion criteria. The studies measured societal preferences for RD and OD as part of HTA using MCDA (n = 17), DCE (n = 8), and PTO (n = 4), among other methods (n = 4). These found that patients and clinicians do not prioritize funding based on rarity. The public is willing to allocate funds only if the OD demonstrates effectiveness and improves the quality of life, considering as relevant factors disease severity, unmet health needs, and quality of life. Conversely, HTA agency experts preferred their current approach, placing more weight on cost-effectiveness and evidence quality, even though they expressed concern about the fairness of the drug review process. CONCLUSIONS MCDA, PTO, and DCE are helpful and transparent methods for assessing societal preferences in HTA for RD and OD. However, their methodological limitations, such as arbitrary criteria selection, subjective scoring methods, framing effects, weighting adaptation, and value measurement models, could make implementation challenging.
Collapse
Affiliation(s)
- Paola Vásquez
- Centre for Health Services Research, Faculty of Medicine, The University of Queensland, Brisbane, QLD, Australia.
| | - Lisa Hall
- School of Public Health, Faculty of Medicine, The University of Queensland, Brisbane, QLD, Australia
| | - Gregory Merlo
- Healthcare Improvement Unit, Clinical Excellence Queensland, Queensland Health, Brisbane, QLD, Australia
| |
Collapse
|
6
|
Kirby K, Coggins J, Gibson A, Liddiard C, Moore TH, Savović J, Mitchell K, Thompson A, Benger J, Body R. A multiple criteria decision analysis to establish the use cases and candidate point of care tests to enter into a platform trial of multiple in vitro diagnostic point of care tests in the prehospital environment. NIHR OPEN RESEARCH 2024; 4:29. [PMID: 39145100 PMCID: PMC11320030 DOI: 10.3310/nihropenres.13580.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 07/22/2024] [Indexed: 08/16/2024]
Abstract
Background There are increasing demands on Emergency Medical Services. More efficient treatment pathways are required to support conveyance decision making and patient referral in prehospital care. Point of Care testing is increasingly available and utilised across the NHS to support optimal ways of working. We aimed to design and conduct a Multiple Criteria Decision Analysis to prioritise in vitro point of care tests and use cases for inclusion in a platform trial of in vitro point of care testing in UK Emergency Medical Services. Methods We designed a Multiple Criteria Decision Analysis that included systematic scoping reviews stakeholder recruitment, two stakeholder surveys and two stakeholder workshops to scope the use cases, explore criteria and map use cases, evaluate the criteria and measure the use cases against the criteria. Results We recruited 32 stakeholders. We developed a scoring matrix with 4 criteria for scoring the use cases and 8 criteria for scoring the point of care tests and applied weighting determined from survey results. Use cases were scored by the stakeholders against 4 criteria. The 3 highest scoring use cases were point of care troponin testing in: possible Acute Myocardial Infarction, lactate testing in suspected sepsis and in trauma. We developed the process for scoring the point of care tests to be completed close to a proposed trial to allow for a changes in technology. Conclusions We successfully designed a Multiple Criteria Decision Analysis to identify use cases and candidate tests for inclusion in a future platform trial of in vitro point of care testing in UK Emergency Medical Services. We identified 3 use cases for evaluation in a platform trial of in vitro point of care testing: troponin testing in possible acute myocardial infarction, lactate testing in suspected sepsis and lactate testing to identify occult haemorrhage in trauma.
Collapse
Affiliation(s)
- Kim Kirby
- University of the West of England, Bristol, BS16 ODD, UK
- South Western Ambulance Service NHS Foundation Trust, Exeter, EX2 7HY, UK
| | | | - Andy Gibson
- University of the West of England, Bristol, BS16 ODD, UK
| | - Cathy Liddiard
- University of the West of England, Bristol, BS16 ODD, UK
| | - Theresa H.M. Moore
- The National Institute for Health and Care Research Applied Research Collaboration West, Bristol, BS1 2NT, UK
| | - Jelena Savović
- The National Institute for Health and Care Research Applied Research Collaboration West, Bristol, BS1 2NT, UK
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, England, UK
| | | | | | | | - Richard Body
- University of Manchester, Manchester, M13 9PL, UK
| |
Collapse
|
7
|
Phelps CE. Values Beyond "Health" in Budget-Constrained Healthcare Systems. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2024; 27:830-836. [PMID: 38401798 DOI: 10.1016/j.jval.2024.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 12/17/2023] [Accepted: 02/14/2024] [Indexed: 02/26/2024]
Abstract
OBJECTIVES Most current methods to value healthcare treatments only incorporate measures such as quality-adjusted life-years, combining gains in health-related quality of life and life expectancy in specific ways. Failure of these methods to recognize other dimensions of value has led to calls for methods to include additional values that are associated with the healthcare treatments but not captured directly by quality-adjusted life-years. This article seeks to provide methodologically sound ways to incorporate additional health-related outcomes, focusing on budget-constrained healthcare systems, in which using standard welfare economics methods are often eschewed. METHODS The analysis develops standard extra-welfarist approaches to maximizing aggregate health, subject to fixed-budget constraints, using Lagrange multiplier methods. Then, additional valuable health-related outcomes, eg, reduced caregiver burden, real option value, and market- and non-market productivity are introduced. The article also introduces a social welfare function approach to illuminate how disability, disease severity and other equity-related issues can be incorporated into complete welfare measures. RESULTS Resulting analysis, fully developed in an Appendix in Supplemental Materials found at https://doi.org/10.1016/j.jval.2024.02.005 and summarized in the main text, show that understanding how average and marginal healthcare costs increase with output and how health augments "additional values" provides ways to assess willingness to pay for them in these fixed-budget situations. CONCLUSIONS In budget-constrained healthcare systems, only from actual budget allocations can values both of health itself and "additional values" be inferred. These methods, combined with methodologically sound social welfare functions, demonstrate how to move from "health" to "welfare" in measuring the value of increased healthcare use.
Collapse
Affiliation(s)
- Charles E Phelps
- Department of Economics, University of Rochester, Rochester, NY, USA; Department of Public Health Sciences, University of Rochester, Rochester, NY, USA; Department of Political Science, University of Rochester, Rochester, NY, USA.
| |
Collapse
|
8
|
Dakin H, Tsiachristas A. Rationing in an Era of Multiple Tight Constraints: Is Cost-Utility Analysis Still Fit for Purpose? APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2024; 22:315-329. [PMID: 38329700 PMCID: PMC7615833 DOI: 10.1007/s40258-023-00858-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/14/2023] [Indexed: 02/09/2024]
Abstract
Cost-utility analysis may not be sufficient to support reimbursement decisions when the assessed health intervention requires a large proportion of the healthcare budget or when the monetary healthcare budget is not the only resource constraint. Such cases include joint replacement, coronavirus disease 2019 (COVID-19) interventions and settings where all resources are constrained (e.g. post-COVID-19 or in low/middle-income countries). Using literature on health technology assessment, rationing and reimbursement in healthcare, we identified seven alternative frameworks for simultaneous decisions about (dis)investment and proposed modifications to deal with multiple resource constraints. These frameworks comprised constrained optimisation; cost-effectiveness league table; 'step-in-the-right-direction' approach; heuristics based on effective gradients; weighted cost-effectiveness ratios; multicriteria decision analysis (MCDA); and programme budgeting and marginal analysis (PBMA). We used numerical examples to demonstrate how five of these alternative frameworks would operate. The modified frameworks we propose could be used in local commissioning and/or health technology assessment to supplement standard cost-utility analysis for interventions that have large budget impact and/or are subject to additional constraints.
Collapse
Affiliation(s)
- Helen Dakin
- Health Economics Research Centre, Nuffield Department of Population Health, Old Road Campus, Headington, OX3 7LF, Oxford, UK.
| | - Apostolos Tsiachristas
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
9
|
Su P, Zhi K, Xu H, Xiao J, Liu J, Wang Z, Liu Q, Yu Y, Dang H. The application of multi-criteria decision analysis in evaluating the value of drug-oriented intervention: a literature review. Front Pharmacol 2024; 15:1245825. [PMID: 38720775 PMCID: PMC11076741 DOI: 10.3389/fphar.2024.1245825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 04/10/2024] [Indexed: 05/12/2024] Open
Abstract
Objectives: Multi-Criteria Decision Analysis (MCDA) has gained increasing attention in supporting drug risk-benefit assessment, pricing and reimbursement, as well as optimization of clinical interventions. The objective of this study was to systematically collect and categorize evaluation criteria and techniques of weighting and scoring of MCDA for drug value assessment. Methods: A systematic review of the literature was conducted across seven databases to identify articles utilizing the MCDA frameworks for the evaluation of drug value. Evaluation criteria mentioned in the included studies were extracted and assigned to 5 dimensions including clinical, economic, innovative, societal and humanistic value. A descriptive statistical analysis was performed on the identified drug value evaluation criteria, as well as the weighting and scoring techniques employed. The more a criterion or technique were mentioned in articles, the more important we consider it. Results: Out of the 82 articles included, 111 unique criteria were identified to evaluate the value of drug. Among the 56 unique criteria (448 times) used to measure clinical value, the most frequently mentioned were "comparative safety/tolerability" (58 times), "comparative effectiveness/efficacy" (56 times), "comparative patient-perceived health/patient reported outcomes" (37 times), "disease severity" (34 times), and "unmet needs" (25 times). Regarding economic value measurement, out of the 20 unique criteria (124 times), the most frequently utilized criteria were "cost of intervention" (17 times), "comparative other medical costs" (16 times), and "comparative non-medical costs" (18 times). Out of the 10 criteria (18 times) for assessing innovative value, "a novel pharmacological mechanism" was the most frequently mentioned criterion (5 times). Among the 22 criteria (73 times) used to measure societal value, "system capacity and appropriate use of intervention" was the most frequently cited criterion (14 times). Out of the 3 criteria (15 times) utilized to measure humanistic value, "political/historical/cultural context" was the most frequently mentioned criterion (9 times). Furthermore, 11 scoring and 11 weighting techniques were found from various MCDA frameworks. "Swing weighting" and "a direct rating scale" were the most frequently used techniques in included articles. Conclusion: This study comprehensively presented the current evaluation dimensions, criteria, and techniques for scoring and weighting in drug-oriented MCDA articles. By highlighting the frequently cited evaluation criteria and techniques for scoring and weighting, this analysis will provide a foundation to reasonably select appropriate evaluation criteria and technique in constructing the MCDA framework that aligns with research objectives.
Collapse
Affiliation(s)
- Pengli Su
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Kai Zhi
- China Academy of Chinese Medical Sciences, Beijing, China
| | - Huanhuan Xu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Jing Xiao
- School of Public Health, Nantong University, Nantong, Jiangsu, China
| | - Jun Liu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Zhong Wang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Qiong Liu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yanan Yu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Haixia Dang
- China Academy of Chinese Medical Sciences, Beijing, China
| |
Collapse
|
10
|
Takhar P, Geirnaert M, Gavura S, Beca J, Mercer RE, Denburg A, Muñoz C, Tadrous M, Parmar A, Dionne F, Boehm D, Chambers C, Craig E, Trudeau M, Cheung MC, Houlihan J, McDonald V, Pechlivanoglou P, Taylor M, Wasylenko E, Wranik WD, Chan KKW. Application of Multi-Criteria Decision Analysis (MCDA) to Prioritize Real-World Evidence Studies for Health Technology Management: Outcomes and Lessons Learned by the Canadian Real-World Evidence for Value of Cancer Drugs (CanREValue) Collaboration. Curr Oncol 2024; 31:1876-1898. [PMID: 38668044 PMCID: PMC11049582 DOI: 10.3390/curroncol31040141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 02/09/2024] [Accepted: 03/27/2024] [Indexed: 04/28/2024] Open
Abstract
Multi-criteria decision analysis (MCDA) is a value assessment tool designed to help support complex decision-making by incorporating multiple factors and perspectives in a transparent, structured approach. We developed an MCDA rating tool, consisting of seven criteria evaluating the importance and feasibility of conducting potential real-world evidence (RWE) studies aimed at addressing uncertainties stemming from initial cancer drug funding recommendations. In collaboration with the Canadian Agency for Drugs and Technologies in Health's Provincial Advisory Group, a validation exercise was conducted to further evaluate the application of the rating tool using RWE proposals varying in complexity. Through this exercise, we aimed to gain insight into consensus building and deliberation processes and to identify efficiencies in the application of the rating tool. An experienced facilitator led a multidisciplinary committee, consisting of 11 Canadian experts, through consensus building, deliberation, and prioritization. A total of nine RWE proposals were evaluated and prioritized as low (n = 4), medium (n = 3), or high (n = 2) priority. Through an iterative process, efficiencies and recommendations to improve the rating tool and associated procedures were identified. The refined MCDA rating tool can help decision-makers prioritize important and feasible RWE studies for research and can enable the use of RWE for the life-cycle evaluation of cancer drugs.
Collapse
Affiliation(s)
- Pam Takhar
- Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada; (P.T.); (S.G.); (J.B.); (R.E.M.); (C.M.)
| | | | - Scott Gavura
- Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada; (P.T.); (S.G.); (J.B.); (R.E.M.); (C.M.)
| | - Jaclyn Beca
- Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada; (P.T.); (S.G.); (J.B.); (R.E.M.); (C.M.)
- Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada
| | - Rebecca E. Mercer
- Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada; (P.T.); (S.G.); (J.B.); (R.E.M.); (C.M.)
- Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada
- Evaluative Clinical Services, Sunnybrook Research Institute, Toronto, ON M4N 3M3, Canada;
| | - Avram Denburg
- Division of Haematology/Oncology, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada
| | - Caroline Muñoz
- Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada; (P.T.); (S.G.); (J.B.); (R.E.M.); (C.M.)
- Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada
| | - Mina Tadrous
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, ON M5S 3M2, Canada;
- Women’s College Hospital, Toronto, ON M5S 1B2, Canada
| | - Ambica Parmar
- Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada; (A.P.); (M.T.)
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada
| | | | - Darryl Boehm
- Saskatchewan Cancer Agency, Regina, SK S4W 0G3, Canada;
| | | | - Erica Craig
- New Brunswick Cancer Network, Fredericton, NB E3B 5G8, Canada;
| | - Maureen Trudeau
- Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada; (A.P.); (M.T.)
| | - Matthew C. Cheung
- Evaluative Clinical Services, Sunnybrook Research Institute, Toronto, ON M4N 3M3, Canada;
- Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada; (A.P.); (M.T.)
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada
| | | | - Valerie McDonald
- Independent Patient Representative, Toronto, ON M6G 2V3, Canada;
| | - Petros Pechlivanoglou
- Child Health Evaluative Sciences, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada;
| | | | - Eric Wasylenko
- Department of Oncology, University of Calgary, Calgary, AB T2N 1N4, Canada;
- John Dossetor Health Ethics Centre, University of Alberta, Edmonton, AB T6G 2R7, Canada
| | - Wiesława Dominika Wranik
- Department of Public and International Affairs, Faculty of Management, Dalhousie University, Halifax, NS B3H 4R2, Canada;
- Department of Community Health and Epidemiology, Faculty of Medicine, Dalhousie University, Halifax, NS B3H 4R2, Canada
| | - Kelvin K. W. Chan
- Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada; (P.T.); (S.G.); (J.B.); (R.E.M.); (C.M.)
- Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada
- Evaluative Clinical Services, Sunnybrook Research Institute, Toronto, ON M4N 3M3, Canada;
- Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada; (A.P.); (M.T.)
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada
| |
Collapse
|
11
|
Bayón-Yusta JC, Gutiérrez-Iglesias A, Galnares-Cordero L, Gutiérrez-Ibarluzea I. Synthesis of relevant information around non-core domains to support Multi-Criteria Decision Analysis (MCDA) for decision making. GMS HEALTH INNOVATION AND TECHNOLOGIES 2024; 18:Doc02. [PMID: 38655192 PMCID: PMC11035910 DOI: 10.3205/hta000139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Abstract
Countries fundamentally base macro and micro decision making in the field of health on economic considerations, the budgetary impact of technologies being a major criterion. Nevertheless, the value of the technology of interest and its dimensions are more complex if we seek to take decisions based on the value itself. The use of structured and explicit approaches that require the assessment of multiple criteria that reflect the dimensions of this value may significantly improve the quality of the decision making. Multi-criteria decision analysis (MCDA) is a complementary decision-making tool that is able to systematically incorporate dimensions or domains such as ethical, organisational, legal, environmental and social considerations, as well as costs and benefits of medical interventions, together with the distinct perspectives of the interested parties. The objective of this article is to propose the implementation of analysis of non-core domains, in reports of Health Technology Assessment (HTA) agencies/units. To assess the scientific evidence on MCDA techniques a systematic review was conducted using structured searches in biomedical databases and websites of various HTA organisations. A consensus group was held using the nominal group technique and involving users of healthcare services, providers, managers and academics. Complementary, a survey was sent to HTA agencies to ascertain the degree of implementation of MCDA in their methods. 42 articles reporting the use of non-core criteria for the assessment of health technologies were included in the analysis. From these articles, a total of 216 non-core criteria were retrieved and categorised into domains by the researchers, and of these, 56 were classified as socioeconomic, 59 as organisational, 10 as legal, 8 as environmental and 47 as ethical, while 36 were considered to relate to other domains. The consensus group, based on the 216 non-core criteria obtained from the systematic review, proposed, and defined 26 criteria that participants considered necessary for decision making in healthcare. The consensus group did not consider that any of the domains should be given more weight than others or that any individual criteria should dominate. These approaches can serve as a framework of reference for a well-structured systematic discussion concerning the basis of individual criteria and the evidence supporting them.
Collapse
Affiliation(s)
- Juan Carlos Bayón-Yusta
- Basque Foundation for Health Innovation and Research (BIOEF), Barakaldo, Spain
- Osteba, Basque Office for HTA, Barakaldo, Spain
| | - Asun Gutiérrez-Iglesias
- Osteba, Basque Office for HTA, Barakaldo, Spain
- Ministry for Health, Basque Government, Vitoria-Gasteiz, Spain
| | - Lorea Galnares-Cordero
- Basque Foundation for Health Innovation and Research (BIOEF), Barakaldo, Spain
- Osteba, Basque Office for HTA, Barakaldo, Spain
| | | |
Collapse
|
12
|
Zhang M, Yang Y, Bao Y, Kimber M, Levine M, Xie F. Scoring the Value Assessment Framework for China: A Factorial Survey. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2024; 27:330-339. [PMID: 38135215 DOI: 10.1016/j.jval.2023.12.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 11/09/2023] [Accepted: 12/04/2023] [Indexed: 12/24/2023]
Abstract
OBJECTIVES This study aimed to develop the scoring functions for the recently developed value assessment framework (VAF) for China, which comprises 12 attributes. METHODS We implemented a factorial survey among Chinese healthcare stakeholders from July to September 2022. A total of 240 hypothetical drug value profiles described by the VAF were grouped into 60 blocks and randomly assigned to respondents. Each respondent was assigned with 1 block, each presented in 3 disease scenarios of different levels of severity. For each profile, respondents were asked to assess the drug's value on a scale from 0 (lowest) to 10 (highest) and make 1 of the 3 insurance recommendations: cover, to be negotiated for coverage, or reject. Linear and logistic mixed-effects models were used to develop scoring functions for aggregating the value attributes. RESULTS A total of 365 respondents participated in the survey. 3968 responses from 331 respondents were included in the analysis. Most of the included respondents were under 45 (n = 256, 77.3%), females (n = 208, 62.8%), living in urban areas (n = 296, 89.4%), and with a bachelor's degree or higher (n = 303, 91.5%). Health benefits and safety carried more weights than other attributes in the scoring functions across disease scenarios. The value and probability of entering negotiation or receiving insurance coverage for the attribute profiles for severe/critical disease were higher than for mild/moderate disease. CONCLUSIONS The scoring functions of the VAF can be used to assess the value of a drug and its probability of entering negotiation or receiving insurance coverage in China.
Collapse
Affiliation(s)
- Mengmeng Zhang
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
| | - Yi Yang
- School of Public Health, Fudan University, Shanghai, China; National Health Commission Key Laboratory of Health Technology Assessment, Fudan University, Shanghai, China
| | - Yun Bao
- Institute of Clinical Research and Evidence Based Medicine, Gansu Provincial Hospital, Lanzhou, Gansu, China
| | - Melissa Kimber
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Offord Centre for Child Studies, Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, ON, Canada
| | - Mitchell Levine
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Division of Clinical Pharmacology and Toxicology, Department of Medicine, McMaster University, Hamilton, ON, Canada
| | - Feng Xie
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Centre for Health Economics and Policy Analysis, McMaster University, Hamilton, ON, Canada.
| |
Collapse
|
13
|
Al-Jedai A, Almudaiheem H, Alruthia Y, Althemery A, Alabdulkarim H, Ojeil R, Alrumaih A, AlGhannam S, AlMutairi A, Hasnan Z. A Step Toward the Development of the First National Multi-Criteria Decision Analysis Framework to Support Healthcare Decision Making in Saudi Arabia. Value Health Reg Issues 2024; 41:100-107. [PMID: 38306770 DOI: 10.1016/j.vhri.2023.12.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 12/14/2023] [Accepted: 12/24/2023] [Indexed: 02/04/2024]
Abstract
OBJECTIVES To assess the feasibility of implementing multi-criteria decision analysis (MCDA) and to select the criteria for preparing a national MCDA framework for health technology assessment of orphan drugs in the Kingdom of Saudi Arabia (KSA). METHODS The study was conducted in 3 phases. In phase I, a targeted literature review was performed to gather relevant information on the implementation of MCDA in healthcare decision making. Phase II was a cross-sectional survey, conducted to obtain insights from different stakeholders and key opinion leaders on specific topics from the KSA perspective. Phase III included a round-table discussion involving experts to validate the results obtained in the phase II survey and further elaborate on specific requirements that may be critical for developing the first national MCDA framework in the KSA. RESULTS All the key opinion leaders involved in the study acknowledged the importance of implementing MCDA in the KSA. The Ministry of Health was assigned the responsibility of chairing the MCDA decision process. The experts selected the quantitative, qualitative, and economic criteria to be considered for the MCDA framework. The stakeholders decided to initiate a pilot phase using the deliberative MCDA methodology for the assessment of orphan drugs based on the selected criteria for a period of 1 year and then reevaluate the need to adapt the pragmatic MCDA model. CONCLUSION This article describes the novel initiative that examined the feasibility and process required for the development of the first MCDA framework in the KSA to support healthcare decision making.
Collapse
Affiliation(s)
- Ahmed Al-Jedai
- Therapeutic Affairs for Support Services, Ministry of Health, Riyadh, Kingdom of Saudi Arabia
| | - Hajer Almudaiheem
- Pharmacy and Therapeutic Committee, Ministry of Health, Riyadh, Kingdom of Saudi Arabia
| | - Yazeed Alruthia
- Pharmacoeconomics, College of Pharmacy, King Saud University, Riyadh, Kingdom of Saudi Arabia
| | - Abdullah Althemery
- Pharmacoeconomics, Prince Sattam bin Abdulaziz University, Riyadh, Kingdom of Saudi Arabia
| | - Hana Alabdulkarim
- Drug Policy Center, The Ministry of National Guard Health Affairs, Riyadh, Kingdom of Saudi Arabia
| | - Rita Ojeil
- Market Access & HEOR, Carexso, Dubai, United Arab Emirates.
| | - Ali Alrumaih
- Medical Services Department, Prince Sultan Cardiac Center, Riyadh, Kingdom of Saudi Arabia
| | - Suliman AlGhannam
- Population Health Department, King Abdullah International Medical Research Center, Riyadh, Kingdom of Saudi Arabia
| | | | - Zuhair Hasnan
- Medical Genomics Department, King Faisal Specialist Hospital and Research Centre, Riyadh, Kingdom of Saudi Arabia
| |
Collapse
|
14
|
Pennington B, Al-Janabi H. Modelling Informal Carers' Health-Related Quality of Life: Challenges for Economic Evaluation. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2024; 22:9-16. [PMID: 37948034 PMCID: PMC10761460 DOI: 10.1007/s40258-023-00834-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/10/2023] [Indexed: 11/12/2023]
Abstract
There has been increasing interest in including carers' health-related qualify of life (HRQoL) in decision models, but currently there is no best practice guidance as to how to do so. Models thus far have typically assumed that carers' HRQoL can be predicted from patient health states, as we illustrate with three examples of disease-modifying treatments. However, this approach limits the mechanisms that influence carers' HRQoL solely to patient health and may not accurately reflect carers' outcomes. In this article, we identify and discuss challenges associated with modelling intervention effects on carers' HRQoL: attaching carer utilities to patient disease states, the size of the caring network, aggregation of carer and patient HRQoL, patient death, and modelling longer-term carer HRQoL. We review and critique potential alternatives to modelling carers' HRQoL in decision models: trial-based analyses, qualitative consideration, cost-consequence analysis, and multicriteria decision analysis, noting that each of these also has its own challenges. We provide a framework of issues to consider when modelling carers' HRQoL and suggest how these can be addressed in current practice and future research.
Collapse
Affiliation(s)
- Becky Pennington
- Sheffield Centre for Health and Related Research (SCHARR), School of Medicine and Population Health, University of Sheffield, Sheffield, UK.
| | - Hareth Al-Janabi
- Health Economics Unit, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| |
Collapse
|
15
|
Merlin T, Street J, Carter D, Haji Ali Afzali H. Challenges in the Evaluation of Emerging Highly Specialised Technologies: Is There a Role for Living HTA? APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2023; 21:823-830. [PMID: 37824056 PMCID: PMC10628011 DOI: 10.1007/s40258-023-00835-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/12/2023] [Indexed: 10/13/2023]
Abstract
There is currently deep uncertainty about the clinical benefits and cost effectiveness of highly specialised technologies (HSTs), like gene and cell therapies. These treatments are novel, typically have high upfront costs, the patient populations are small and heterogenous, there is minimal information on their long-term safety and effectiveness, and data are limited and often of poor quality. With the increasing number of these technologies and their high cost burden on governments and health care providers, policy makers are currently walking a decision tightrope. On the one hand, an unfavourable funding decision could potentially limit patient access to life-saving treatments, while on the other, a favourable decision could result in unsustainable budget impacts and perhaps poorer patient health outcomes. Health technology assessment (HTA) is meant to determine the value of a health technology in order to promote an equitable, efficient, and high-quality health system. However, standard HTA processes have failed to mitigate the deep uncertainties associated with these technologies. In this paper, we propose a Living HTA framework to address these challenges. This framework includes a one-off process for making explicit the societal values associated with HSTs. These would inform the decision-making approach, data collection and the development of disease-specific reference models to be used by industry sponsors as the basis for their submissions for public funding. Coverage with an evidence development mechanism is also proposed by which data can be collected in real time to update the reference model on a rolling basis, thereby allowing re-assessment of the clinical and cost effectiveness of individual HSTs. The HTA would be 'live' until the results indicate there is sufficient certainty for the funding decision to be confirmed, the price changed or the funding removed.
Collapse
Affiliation(s)
- Tracy Merlin
- School of Public Health, Adelaide Health Technology Assessment (AHTA), University of Adelaide, Mail Drop DX650545, Adelaide, SA, 5000, Australia.
| | - Jackie Street
- School of Public Health, Adelaide Health Technology Assessment (AHTA), University of Adelaide, Mail Drop DX650545, Adelaide, SA, 5000, Australia
| | - Drew Carter
- School of Public Health, Adelaide Health Technology Assessment (AHTA), University of Adelaide, Mail Drop DX650545, Adelaide, SA, 5000, Australia
| | - Hossein Haji Ali Afzali
- School of Public Health, Adelaide Health Technology Assessment (AHTA), University of Adelaide, Mail Drop DX650545, Adelaide, SA, 5000, Australia
- College of Medicine and Public Health, Flinders University, Bedford Park, Australia
| |
Collapse
|
16
|
Muir JM, Radhakrishnan A, Freitag A, Ozer Stillman I, Sarri G. Reconstructing the value puzzle in health technology assessment: a pragmatic review to determine which modelling methods can account for additional value elements. Front Pharmacol 2023; 14:1197259. [PMID: 37521458 PMCID: PMC10372435 DOI: 10.3389/fphar.2023.1197259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Accepted: 07/05/2023] [Indexed: 08/01/2023] Open
Abstract
Health technology assessment (HTA) has traditionally relied on cost-effectiveness analysis (CEA) as a cornerstone of evaluation of new therapies, assessing the clinical validity and utility, the efficacy, and the cost-effectiveness of new interventions. The current format of cost-effectiveness analysis, however, does not allow for inclusion of more holistic aspects of health and, therefore, value elements for new technologies such as the impact on patients and society beyond its pure clinical and economic value. This study aimed to review the recent modelling attempts to expand the traditional cost-effectiveness analysis approach by incorporating additional elements of value in health technology assessment. A pragmatic literature review was conducted for articles published between 2012 and 2022 reporting cost-effectiveness analysis including value aspects beyond the clinical and cost-effectiveness estimates; searches identified 13 articles that were eligible for inclusion. These expanded modelling approaches mainly focused on integrating the impact of societal values and health equity in cost-effectiveness analysis, both of which were championed as important aspects of health technology assessment that should be incorporated into future technology assessments. The reviewed cost-effectiveness analysis methods included modification of the current cost-effectiveness analysis methodology (distributional cost-effectiveness analysis, augmented cost-effectiveness analysis, extended cost-effectiveness analysis) or the use of multi-criteria decision analysis. Of these approaches, augmented cost-effectiveness analysis appears to have the most potential by expanding traditional aspects of value, as it uses techniques already familiar to health technology assessment agencies but also allows space for incorporation of qualitative aspects of a product's value. This review showcases that methods to unravel additional value elements for technology assessment exist, therefore, patient access to promising technologies can be improved by moving the discussion from "if" to "how" additional value elements can inform decision-making.
Collapse
|
17
|
Gongora-Salazar P, Rocks S, Fahr P, Rivero-Arias O, Tsiachristas A. The Use of Multicriteria Decision Analysis to Support Decision Making in Healthcare: An Updated Systematic Literature Review. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2023; 26:780-790. [PMID: 36436791 DOI: 10.1016/j.jval.2022.11.007] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 10/10/2022] [Accepted: 11/17/2022] [Indexed: 05/03/2023]
Abstract
OBJECTIVES Multicriteria decision analysis (MCDA) is increasingly used for decision making in healthcare. However, its application in different decision-making contexts is still unclear. This study aimed to provide a comprehensive review of MCDA studies performed to inform decisions in healthcare and to summarize its application in different decision contexts. METHODS We updated a systematic review conducted in 2013 by searching Embase, MEDLINE, and Google Scholar for MCDA studies in healthcare, published in English between August 2013 and November 2020. We also expanded the search by reviewing grey literature found via Trip Medical Database and Google, published between January 1990 and November 2020. A comprehensive template was developed to extract information about the decision context, criteria, methods, stakeholders involved, and sensitivity analyses conducted. RESULTS From the 4295 identified studies, 473 studies were eligible for full-text review after assessing titles and abstracts. Of those, 228 studies met the inclusion criteria and underwent data extraction. The use of MCDA continues to grow in healthcare literature, with most of the studies (49%) informing priority-setting decisions. Safety, cost, and quality of care delivery are the most frequently used criteria, although there are considerable differences across decision contexts. Almost half of the MCDA studies used the linear additive model whereas scales and the analytical hierarchy process were the most used techniques for scoring and weighting, respectively. Not all studies report on each one of the MCDA steps, consider axiomatic properties, or justify the methods used. CONCLUSIONS A guide on how to conduct and report MCDA that acknowledges the particularities of the different decision contexts and methods needs to be developed.
Collapse
Affiliation(s)
- Pamela Gongora-Salazar
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, England, UK.
| | | | - Patrick Fahr
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, England, UK
| | - Oliver Rivero-Arias
- National Perinatal Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Oxford, England, UK
| | - Apostolos Tsiachristas
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, England, UK
| |
Collapse
|
18
|
Zhang M, Bao Y, Yang Y, Kimber M, Levine M, Xie F. Identifying Attributes for a Value Assessment Framework in China: A Qualitative Study. PHARMACOECONOMICS 2023; 41:439-455. [PMID: 36729295 PMCID: PMC9893981 DOI: 10.1007/s40273-022-01235-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 12/20/2022] [Indexed: 05/10/2023]
Abstract
BACKGROUND Value assessment frameworks (VAFs) are promising tools for measuring the value of health technologies and informing coverage policymaking; however, most published VAFs were developed for high-income countries. This study aimed to identify value attributes as part of the development of a VAF in China. METHODS We used the qualitative description approach. Specifically, we conducted open-ended semi-structured interviews with Chinese stakeholders, as well as a review and analysis of publicly available government documents related to health technology assessment (HTA) and coverage policies in China. Conventional content analysis and the constant comparison technique were used to generate value attributes. Multiple criteria were used to determine the inclusion of a value attribute, with response levels of included attributes finalized via consensus meetings among the research team. RESULTS Thirty-four stakeholders living or working in China completed the semi-structured interview. These stakeholders included policymakers (n = 4), healthcare providers (n = 8), HTA researchers (n = 6), patients and members of the general public (n = 9), and industry representatives (n = 7). In addition, 16 government documents were included for analysis. Twelve value attributes grouped in eight categories are included in the VAF: (1) severity of disease; (2) health benefit, including survival, clinical outcomes, and patient-reported outcomes; (3) safety; (4) economic impact, including budget impact to payer and patients, and cost effectiveness; (5) innovation; (6) organizational impact; (7) health equity; and (8) quality of evidence. CONCLUSION These 12 value attributes were identified for the development of a VAF to support health technologies' value assessment and coverage policymaking in China.
Collapse
Affiliation(s)
- Mengmeng Zhang
- Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada
| | - Yun Bao
- Institute of Clinical Research and Evidence-Based Medicine, Gansu Provincial Hospital, Lanzhou, Gansu, China
| | - Yi Yang
- Key Lab of Health Technology Assessment, National Health Commission, Fudan University, Shanghai, China
| | - Melissa Kimber
- Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada
- Offord Centre for Child Studies, Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, ON, L8L 0A4, Canada
| | - Mitchell Levine
- Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada
- Division of Clinical Pharmacology and Toxicology, Department of Medicine,, McMaster University, Hamilton, ON, L8N 4A6, Canada
| | - Feng Xie
- Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
- Centre for Health Economics and Policy Analysis (CHEPA), McMaster University, Hamilton, ON, L8S 4K1, Canada.
| |
Collapse
|
19
|
Synnott PG, Voehler D, Enright DE, Kowal S, Ollendorf DA. The Value of New: Consideration of Product Novelty in Health Technology Assessments of Pharmaceuticals. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2023; 21:305-314. [PMID: 36529826 DOI: 10.1007/s40258-022-00779-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/27/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Efforts to understand how treatments affect patients and society have broadened the criteria that health technology assessment (HTA) organizations apply to value assessments. We examined whether HTA agencies in eight countries consider treatment novelty in methods and deliberations. METHODS We defined a novel pharmaceutical product to be one that offers a new approach to treatment (e.g., new mechanism of action), addresses an unmet need (e.g., targets a rare condition without effective treatments), or has a broader impact beyond what is typically measured in an HTA. We reviewed peer-reviewed publications and technical guidance materials from HTA organizations in Australia, Canada, England, France, The Netherlands, Norway, Sweden, and the United States (US). In addition, we explored how HTA organizations integrated novelty considerations into deliberations and recommendations related to two newer therapies-voretigene neparvovec for an inherited retinal disorder and ocrelizumab for multiple sclerosis. RESULTS None of the HTA organizations acknowledge treatment novelty as an explicit value criterion in their assessments of pharmaceutical products. However, drugs that have novel characteristics are given special consideration, particularly when they address an unmet need. Several organizations document a willingness to expend more resources and accept greater evidence uncertainty for such treatments. Qualitative deliberations about the additional unquantified potential benefits of treatment may also influence HTA recommendations. CONCLUSION Major HTA organizations do not recognize novelty as an explicit value criterion, although drugs with novel characteristics may receive special consideration. There is an opportunity for organizations to codify their approach to evaluating novelty in value assessment.
Collapse
Affiliation(s)
- Patricia G Synnott
- Center for the Evaluation of Value and Risk in Health, Tufts Medical Center, 800 Washington Street, #063, Boston, MA, 02111, USA.
| | - Dominic Voehler
- Center for the Evaluation of Value and Risk in Health, Tufts Medical Center, 800 Washington Street, #063, Boston, MA, 02111, USA
| | - Daniel E Enright
- Center for the Evaluation of Value and Risk in Health, Tufts Medical Center, 800 Washington Street, #063, Boston, MA, 02111, USA
| | - Stacey Kowal
- Genentech, Inc, 1 DNA Way, South San Francisco, CA, 94080, USA
| | - Daniel A Ollendorf
- Center for the Evaluation of Value and Risk in Health, Tufts Medical Center, 800 Washington Street, #063, Boston, MA, 02111, USA
| |
Collapse
|
20
|
Ramponi F, Twea P, Chilima B, Nkhoma D, Kazanga Chiumia I, Manthalu G, Mfutso-Bengo J, Revill P, Drummond M, Sculpher M. Assessing the potential of HTA to inform resource allocation decisions in low-income settings: The case of Malawi. Front Public Health 2022; 10:1010702. [PMID: 36388387 PMCID: PMC9650047 DOI: 10.3389/fpubh.2022.1010702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 10/03/2022] [Indexed: 01/27/2023] Open
Abstract
Health technology assessment (HTA) offers a set of analytical tools to support health systems' decisions about resource allocation. Although there is increasing interest in these tools across the world, including in some middle-income countries, they remain rarely used in low-income countries (LICs). In general, the focus of HTA is narrow, mostly limited to assessments of efficacy and cost-effectiveness. However, the principles of HTA can be used to support a broader series of decisions regarding new health technologies. We examine the potential for this broad use of HTA in LICs, with a focus on Malawi. We develop a framework to classify the main decisions on health technologies within health systems. The framework covers decisions on identifying and prioritizing technologies for detailed assessment, deciding whether to adopt an intervention, assessing alternative investments for implementation and scale-up, and undertaking further research activities. We consider the relevance of the framework to policymakers in Malawi and we use two health technologies as examples to investigate the main barriers and enablers to the use of HTA methods. Although the scarcity of local data, expertise, and other resources could risk limiting the operationalisation of HTA in LICs, we argue that even in highly resource constrained health systems, such as in Malawi, the use of HTA to support a broad range of decisions is feasible and desirable.
Collapse
Affiliation(s)
- Francesco Ramponi
- Centre for Health Economics, University of York, Heslington, United Kingdom
- ISGlobal, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain
| | - Pakwanja Twea
- Department of Planning and Policy Development, Ministry of Health Malawi, Lilongwe, Malawi
| | - Benson Chilima
- Public Health Institute, Ministry of Health Malawi, Lilongwe, Malawi
| | - Dominic Nkhoma
- Health Economics and Policy Unit (HEPU), College of Medicine, University of Malawi, Zomba, Malawi
| | - Isabel Kazanga Chiumia
- Health Economics and Policy Unit (HEPU), College of Medicine, University of Malawi, Zomba, Malawi
| | - Gerald Manthalu
- Department of Planning and Policy Development, Ministry of Health Malawi, Lilongwe, Malawi
| | - Joseph Mfutso-Bengo
- Health Economics and Policy Unit (HEPU), College of Medicine, University of Malawi, Zomba, Malawi
| | - Paul Revill
- Centre for Health Economics, University of York, Heslington, United Kingdom
| | - Michael Drummond
- Centre for Health Economics, University of York, Heslington, United Kingdom
| | - Mark Sculpher
- Centre for Health Economics, University of York, Heslington, United Kingdom
| |
Collapse
|
21
|
Hoedemakers M, Tsiachristas A, Rutten-van Mölken M. Moving Beyond Quality-Adjusted Life-Years in Elderly Care: How Can Multicriteria Decision Analysis Complement Cost-Effectiveness Analysis in Local-Level Decision Making. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2022; 25:1717-1725. [PMID: 35623974 DOI: 10.1016/j.jval.2022.04.1728] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 03/21/2022] [Accepted: 04/13/2022] [Indexed: 06/15/2023]
Abstract
OBJECTIVES This study aimed to investigate how multicriteria decision analysis (MCDA) could complement cost-effectiveness analysis (CEA) to support investment decisions in elderly care at local level. METHODS We used an integrated elderly care program in The Netherlands as a case study to demonstrate the application of both methods. In a 12-month quasi-experimental study (n = 384), data on the following outcome measures were collected: quality-adjusted life-years (CEA) and physical functioning, psychological well-being, social relationships and participation, enjoyment of life, resilience, person centeredness, continuity of care, and costs (MCDA). We performed regression analysis on inversed probability weighted data and controlled for potential confounders to obtain a double robust estimate of the outcomes. Probabilistic sensitivity analyses determined uncertainty for both methods. RESULTS The integrated elderly care program was not likely (ie, 36%) to be cost-effective according to the CEA (incremental cost-effectiveness ratios: €88 249 from a societal perspective) using the conventional Dutch willingness-to-pay threshold (ie, €50 000). The MCDA demonstrated that informal caregivers and professionals slightly preferred the intervention over usual care, driven by enjoyment of life and person centeredness. Patients did not prefer either the intervention or usual care, whereas payers and policy makers slightly preferred usual care, mainly due to higher costs of the intervention. CONCLUSIONS MCDA could provide local-level decision makers with a broader measurement of effectiveness by including outcomes beyond health and longevity and the preferences of multiple stakeholders. This additional information could foster the acceptability and implementability of cost-effective innovations in elderly care.
Collapse
Affiliation(s)
- Maaike Hoedemakers
- Erasmus School of Health Policy & Management, Erasmus University Rotterdam, Rotterdam, The Netherlands.
| | - Apostolos Tsiachristas
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, England, UK
| | - Maureen Rutten-van Mölken
- Erasmus School of Health Policy & Management, Erasmus University Rotterdam, Rotterdam, The Netherlands; Institute for Medical Technology Assessment, Erasmus University Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
22
|
Dua S, Sharma MG, Mishra V, Kulkarni SD. Modelling perceived risk in blockchain enabled supply chain utilizing fuzzy-AHP. JOURNAL OF GLOBAL OPERATIONS AND STRATEGIC SOURCING 2022. [DOI: 10.1108/jgoss-06-2021-0046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Purpose
Blockchain has been considered a disrupting technology that can add value in various supply chains differently. The provenance framework matches the four blockchain capabilities of traceability, certifiability, trackability and verifiability to the five generic risks, namely, the financial risk, psychological risk, social risk, physical risk and performance risk. This will help in uncording which specific risk gets mitigated by the use of blockchain in a specific supply chain.
Design/methodology/approach
This study illustrates four supply chains, namely, pharmaceutical industry, fast moving consumer goods industry, precious metal and automotive industry, and maps the risks associated with them to the provenance framework wherein the applicability of blockchain is mapped. Fuzzy analytical hierarchical processing (F-AHP) is used to rank the risks in the supply chain.
Findings
Blockchain capabilities can elevate the provenance knowledge leading to assurance in terms of origin, authenticity, custody and integrity to mitigate the supply chain risks. Present work highlights the thrust areas across various supply chains and identifies the risk priority tasks aligning the contextual supply chain risks. This study has covered five major risk perceptions. This study contributes to the literature on blockchain, customer perceived risk, provenance and supply chain.
Practical implications
This methodology can be adopted to understand and market the application of blockchain in a supply chain. It brings the marketers and marketing perspective to the supply chain. Exhaustive risk perception can be included to get more comprehensive data on mapping the risks along different supply chains. Vertical extensions of this work can be consideration of other supply chains including dairy, fruits and vegetables, electronics and component assemblies to derive the comprehensive framework for mapping risk perceptions and thereby supply chain risk mitigation through blockchain technology.
Originality/value
This linkage between blockchain, perceived risk, applications in the supply chain and a tool to convince the customers about the blockchain applicability has not been discussed in the literature. Adopting the multi-criteria decision-making F-AHP approach, this study attempt to rank the risks and stimulate conversations around a common framework for multiple sectors.
Collapse
|
23
|
Huter K, Krick T, Rothgang H. Health economic evaluation of digital nursing technologies: a review of methodological recommendations. HEALTH ECONOMICS REVIEW 2022; 12:35. [PMID: 35792960 PMCID: PMC9258051 DOI: 10.1186/s13561-022-00378-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Accepted: 05/27/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Health economic evaluation of digital nursing technologies (DNT) is important to provide information that helps avoid undesirable developments and implementations as well as increase the chances of success of developed applications. At the same time, studies and evidence on cost-effectiveness are still very rare in this field. Review studies in related technology areas such as telemedicine frequently criticise the quality and comparability of health economic evaluations conducted in this field. Based on a content analysis of methodological literature on the economic evaluation of innovative (digital) technologies in health and nursing, this article aims to identify specific challenges in this research area and offers recommendations on how to address these challenges to promote more sound health economic evaluations in the future. METHODS A rapid review was conducted, consisting of a systematic search in the Pubmed database as well as Google Scholar. In addition, the literature lists of the analysed texts were scoured for additional texts to be included. Methodological literature, single studies, and reviews were included. A total of 536 studies were screened, of which 29 were included in the full text analysis. RESULTS Based on the systematic content analysis of the studies under consideration, 10 specific methodological challenges are identified, and the methodological recommendations were examined for consideration. A particular focus was given to whether specific methodological approaches might be needed in the context of evaluating the efficiency of DNT. CONCLUSION Many of the challenges identified for the health economic evaluations of digital nursing technologies are comparable to those of other complex health care interventions. The recommendations discussed can help to alleviate those challenges. Future research should focus on alternative approaches to assessing causality in different phases of technology development while maintaining high evidence standards. High-evidence economic assessment of technologies in nursing care should be carried out in routine use, especially if they are intended to be reimbursed by the social insurance.
Collapse
Affiliation(s)
- Kai Huter
- SOCIUM Research Center on Inequality and Social Policy, University of Bremen, Mary-Somerville-Straße 3, 28359, Bremen, Germany
- High-profile Area of Health Sciences, University of Bremen, Bremen, Germany
| | - Tobias Krick
- SOCIUM Research Center on Inequality and Social Policy, University of Bremen, Mary-Somerville-Straße 3, 28359, Bremen, Germany.
- High-profile Area of Health Sciences, University of Bremen, Bremen, Germany.
| | - Heinz Rothgang
- SOCIUM Research Center on Inequality and Social Policy, University of Bremen, Mary-Somerville-Straße 3, 28359, Bremen, Germany
- High-profile Area of Health Sciences, University of Bremen, Bremen, Germany
| |
Collapse
|
24
|
Menzies T, Saint-Hilary G, Mozgunov P. A comparison of various aggregation functions in multi-criteria decision analysis for drug benefit-risk assessment. Stat Methods Med Res 2022; 31:899-916. [PMID: 35044274 PMCID: PMC7612697 DOI: 10.1177/09622802211072512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Multi-criteria decision analysis is a quantitative approach to the drug benefit-risk assessment which allows for consistent comparisons by summarising all benefits and risks in a single score. The multi-criteria decision analysis consists of several components, one of which is the utility (or loss) score function that defines how benefits and risks are aggregated into a single quantity. While a linear utility score is one of the most widely used approach in benefit-risk assessment, it is recognised that it can result in counter-intuitive decisions, for example, recommending a treatment with extremely low benefits or high risks. To overcome this problem, alternative approaches to the scores construction, namely, product, multi-linear and Scale Loss Score models, were suggested. However, to date, the majority of arguments concerning the differences implied by these models are heuristic. In this work, we consider four models to calculate the aggregated utility/loss scores and compared their performance in an extensive simulation study over many different scenarios, and in a case study. It is found that the product and Scale Loss Score models provide more intuitive treatment recommendation decisions in the majority of scenarios compared to the linear and multi-linear models, and are more robust to the correlation in the criteria.
Collapse
Affiliation(s)
- Tom Menzies
- Clinical Trials Research Unit, Leeds Institute of Clinical Trials
Research, University of Leeds, UK
- Department of Mathematics and Statistics, Lancaster University, UK
| | - Gaelle Saint-Hilary
- Department of Biostatistics, Institut de Recherches Internationales
Servier (IRIS), France
- Dipartimento di Scienze Matematiche (DISMA) Giuseppe Luigi Lagrange,
Politecnico di Torino, Italy
| | | |
Collapse
|
25
|
Hoedemakers M, Karimi M, Leijten F, Goossens L, Islam K, Tsiachristas A, Rutten-van Molken M. Value-based person-centred integrated care for frail elderly living at home: a quasi-experimental evaluation using multicriteria decision analysis. BMJ Open 2022; 12:e054672. [PMID: 35437245 PMCID: PMC9016393 DOI: 10.1136/bmjopen-2021-054672] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Abstract
OBJECTIVE To evaluate the value of the person-centred, integrated care programme Care Chain Frail Elderly (CCFE) compared with usual care, using multicriteria decision analysis (MCDA). DESIGN In a 12-month quasi-experimental study, triple-aim outcomes were measured at 0, 6 and 12 months by trained interviewers during home-visits. SETTING Primary care, community-based elderly care. PARTICIPANTS 384 community-dwelling frail elderly were enrolled. The 12-month completion rate was 70% in both groups. Propensity score matching was used to balance age, gender, marital status, living situation, education, smoking status and 3 month costs prior to baseline between the two groups. INTERVENTION The CCFE is an integrated care programme with unique features like the presence of the elderly and informal caregiver at the multidisciplinary team meetings, and a bundled payment. PRIMARY AND SECONDARY OUTCOMES MEASURES The MCDA results in weighted overall value scores that combines the performance on physical functioning, psychological well-being, social relationships and participation, enjoyment of life, resilience, person-centredness, continuity of care and costs, with importance weights of patients, informal caregivers, professionals, payers and policy-makers. RESULTS At 6 months, the overall value scores of CCFE were higher in all stakeholder groups, driven by enjoyment of life (standardised performance scores 0.729 vs 0.685) and person-centredness (0.749 vs 0.663). At 12 months, the overall value scores in both groups were similar from a patient's perspective, slightly higher for CCFE from an informal caregiver's and professional's perspective, and lower for CCFE from a payer's and policy-maker's perspective. The latter was driven by a worse performance on physical functioning (0.682 vs 0.731) and higher costs (€22 816 vs €20 680). CONCLUSIONS The MCDA indicated that the CCFE is the preferred way of delivering care to frail elderly at 6 months. However, at 12 months, MCDA results showed little difference from the perspective of patients, informal caregivers and professionals, while payers and policy-makers seemed to prefer usual care.
Collapse
Affiliation(s)
- Maaike Hoedemakers
- Erasmus School of Health Policy & Management, Erasmus Universiteit Rotterdam, Rotterdam, The Netherlands
| | - Milad Karimi
- Erasmus School of Health Policy & Management, Erasmus Universiteit Rotterdam, Rotterdam, The Netherlands
- OPEN Health, Rotterdam, The Netherlands
| | - Fenna Leijten
- Erasmus School of Health Policy & Management, Erasmus Universiteit Rotterdam, Rotterdam, The Netherlands
- Staff Defence Healthcare Organisation, Ministry of Defence, Utrecht, The Netherlands
| | - Lucas Goossens
- Erasmus School of Health Policy & Management, Erasmus Universiteit Rotterdam, Rotterdam, The Netherlands
| | - Kamrul Islam
- Department of Economics, University of Bergen, Bergen, Norway
- Social Sciences, NORCE Norwegian Research Centre AS, Bergen, Norway
| | | | - Maureen Rutten-van Molken
- Erasmus School of Health Policy & Management, Erasmus Universiteit Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
26
|
Haider MS, Youngkong S, Thavorncharoensap M, Thokala P. Priority setting of vaccine introduction in Bangladesh: a multicriteria decision analysis study. BMJ Open 2022; 12:e054219. [PMID: 35228286 PMCID: PMC8886403 DOI: 10.1136/bmjopen-2021-054219] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 01/27/2022] [Indexed: 11/15/2022] Open
Abstract
OBJECTIVE To prioritise vaccines for introduction in Bangladesh. METHODS Multicriteria decision analysis (MCDA) process was used to prioritise potential vaccines for introduction in Bangladesh. A set of criteria were identified, weighted and assigned scores by relevant stakeholders (n=14) during workshop A. The performance matrix of the data of vaccines against the criteria set was constructed and validated with the experts (n=6) in workshop B. The vaccines were ranked and appraised by another group of stakeholders (n=10) in workshop C, and the final workshop D involved the dissemination of the findings to decision-makers (n=28). RESULTS Five criteria including incidence rate, case fatality rate, vaccine efficacy, size of the population at risk and type of population at risk were used quantitatively to evaluate and to score the vaccines. Two other criteria, cost-effectiveness and outbreak potentiality, were considered qualitatively. On deliberation, the Japanese encephalitis (JE) vaccine was ranked top to be recommended for introduction in Bangladesh. CONCLUSIONS Based on the MCDA results, JE vaccine is planned to be recommended to the decision-makers for introduction into the national vaccine benefit package. The policymakers support the use of systematic evidence-based decision-making processes such as MCDA for vaccine introduction in Bangladesh, and to prioritise health interventions in the country.
Collapse
Affiliation(s)
- Mohammad Sabbir Haider
- Mahidol University Health Technology Assessment (MUHTA) Graduate Program, Mahidol University, Bangkok, Thailand
- Directorate General of Health Services, Government of Bangladesh Ministry of Health and Family Welfare, Dhaka, Bangladesh
| | - Sitaporn Youngkong
- Mahidol University Health Technology Assessment (MUHTA) Graduate Program, Mahidol University, Bangkok, Thailand
- Social and Administrative Pharmacy Division, Department of Pharmacy, Faculty of Pharmacy, Mahidol University, Bangkok, Thailand
| | - Montarat Thavorncharoensap
- Mahidol University Health Technology Assessment (MUHTA) Graduate Program, Mahidol University, Bangkok, Thailand
- Social and Administrative Pharmacy Division, Department of Pharmacy, Faculty of Pharmacy, Mahidol University, Bangkok, Thailand
| | - Praveen Thokala
- Health Economics and Decision Science, School of Health and Related Research (ScHARR), The University of Sheffield, Sheffield, UK
| |
Collapse
|
27
|
Topic selection process in health technology assessment agencies around the world: a systematic review. Int J Technol Assess Health Care 2022; 38:e19. [DOI: 10.1017/s0266462321001690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Abstract
Objective
The purpose of this study was to systematically review the process for topic selection by health technology assessment (HTA) agencies around the world to provide the knowledge base for the improvement of topic selection frameworks in HTA agencies.
Methods
A systematic search was conducted in PubMed and EMBASE to identify papers up to February 2019. Gray literature was identified by screening the Web sites of HTA agencies on the nonprofit member list of the International Network of Agencies for Health Technology Assessment (INAHTA). Data were extracted for each HTA agency and synthesized, with issues including general contextual information about each agency and the process of topic selection.
Results
Out of forty-nine nonprofit members of INAHTA, a total of seventeen HTA agencies with a framework for topic selection were identified from twenty-two included papers/documents. Multiple criteria were used for topic selection in all frameworks and agencies undertook multiple steps, which could include the specification of criteria for topic selection, identification of topics, short listing of potential topics, scoping of potential topics, scoring and ranking of potential topics, and deliberation and decision on final topics for HTA. Shortcomings were found in relation to methods of scoring and ranking as well as lack of monitoring and the evaluation of the process.
Conclusions
Our study provides insights into the current practice of topic selection in HTA agencies. Multiple criteria decision analysis methodology appears highly relevant to these processes. A consensus approach for the development of methods of topic selection would be valuable for the HTA community.
Collapse
|
28
|
Wilson R, Chua J, Pryymachenko Y, Pathak A, Sharma S, Abbott JH. Prioritizing Healthcare Interventions: A Comparison of Multicriteria Decision Analysis and Cost-Effectiveness Analysis. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2022; 25:268-275. [PMID: 35094800 DOI: 10.1016/j.jval.2021.08.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 07/12/2021] [Accepted: 08/23/2021] [Indexed: 06/14/2023]
Abstract
OBJECTIVES To investigate the extent to which stated preferences for treatment criteria elicited using multicriteria decision analysis (MCDA) methods are consistent with the trade-offs (implicitly) applied in cost-effectiveness analysis (CEA), and the impact of any differences on the prioritization of treatments. METHODS We used existing MCDA and CEA models developed to evaluate interventions for knee osteoarthritis in the New Zealand population. We established equivalent input parameters for each model, for the criteria "treatment effectiveness," "cost," "risk of serious harms," and "risk of mild-to-moderate harms" across a comprehensive range of (hypothetical) interventions to produce a complete ranking of interventions from each model. We evaluated the consistency of these rankings between the 2 models and investigated any systematic differences between the (implied) weight placed on each criterion in determining rankings. RESULTS There was an overall moderate-to-strong correlation in intervention rankings between the MCDA and CEA models (Spearman correlation coefficient = 0.51). Nevertheless, there were systematic differences in the evaluation of trade-offs between intervention attributes and the resulting weights placed on each criterion. The CEA model placed lower weights on risks of harm and much greater weight on cost (at all accepted levels of willingness-to-pay per quality-adjusted life-year than did respondents to the MCDA survey. CONCLUSIONS MCDA and CEA approaches to inform intervention prioritization may give systematically different results, even when considering the same criteria and input data. These differences should be considered when designing and interpreting such studies to inform treatment prioritization decisions.
Collapse
Affiliation(s)
- Ross Wilson
- Centre for Musculoskeletal Outcomes Research, Department of Surgical Sciences, University of Otago, Dunedin, New Zealand.
| | - Jason Chua
- Centre for Musculoskeletal Outcomes Research, Department of Surgical Sciences, University of Otago, Dunedin, New Zealand
| | - Yana Pryymachenko
- Centre for Musculoskeletal Outcomes Research, Department of Surgical Sciences, University of Otago, Dunedin, New Zealand
| | - Anupa Pathak
- Centre for Musculoskeletal Outcomes Research, Department of Surgical Sciences, University of Otago, Dunedin, New Zealand
| | - Saurab Sharma
- Centre for Musculoskeletal Outcomes Research, Department of Surgical Sciences, University of Otago, Dunedin, New Zealand; Department of Physiotherapy, Kathmandu University School of Medical Sciences, Dhulikhel, Nepal; School of Medical Sciences, University of New South Wales, Sydney, Australia; Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - J Haxby Abbott
- Centre for Musculoskeletal Outcomes Research, Department of Surgical Sciences, University of Otago, Dunedin, New Zealand
| |
Collapse
|
29
|
Freath LL, Curry AS, Cork DMW, Audhya IF, Gooch KL. QALYs and ambulatory status: societal preferences for healthcare decision making. J Med Econ 2022; 25:888-893. [PMID: 35713217 DOI: 10.1080/13696998.2022.2090152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
BACKGROUND This research aimed to review the theoretical and methodological aspects of the quality-adjusted life year (QALY) which give rise to potential for bias against certain patient populations, including those with problems with walking or an inability to walk (ambulatory disabilities), when health technology assessment decisions rely on QALY gain to show cost-effectiveness. Societal preferences for treating ambulatory versus non-ambulatory patients were also investigated. METHODS We reviewed published literature to identify information on theoretical underpinnings of the QALY, measurement of utilities for QALY assessment, and empirical evidence of societal preferences for the treatment of ambulatory and non-ambulatory patients. RESULTS AND DISCUSSION Health states which represent mobility impairment and the inability to walk receive low valuation from general public preferences. Non-ambulatory patients, for example those with advanced neuromuscular disease, have lower utilities determined by standardized preference-based measurement (PBM) tools. Any treatment that increases survival but could not restore ambulation would result in lower lifetime QALY gains for non-ambulatory versus ambulatory patients. Treatments could therefore potentially be deemed less cost-effective, or not cost-effective at all for this patient population.Empirical research indicates a societal preference for equal treatment of patients regardless of ambulatory status. The main limitation of our review was the non-systematic approach to evidence search and review, however, given the broad scope of content required to meet the aims of the review, we believe that the targeted approach was appropriate. The evidence presented in this article highlights the need for alternatives to strict QALY-based approaches to prevent avoidable health inequities when determining cost-effectiveness of healthcare interventions for non-ambulatory populations against fixed cost-effectiveness thresholds. An alternative metric, the Equal Value of Life Years Gained (evLYG), has been proposed as a supplementary measure for use alongside the QALY for its potential to alleviate bias against disabled patient populations during the assessment of healthcare treatments.
Collapse
Affiliation(s)
- Lorna L Freath
- Animal and Plant Health, Animal and Plant Health Agency, Newcastle upon Tyne, UK
| | - Alistair S Curry
- Genesis Research, West One, Genesis Research LLC, Newcastle upon Tyne, United Kingdom
| | - David M W Cork
- Genesis Research, West One, Genesis Research LLC, Newcastle upon Tyne, United Kingdom
| | - Ivana F Audhya
- Global Market Access, Sarepta Therapeutics Inc, Cambridge, MA, USA
| | | |
Collapse
|
30
|
Campolina AG, Suzumura EA, Hong QN, de Soárez PC. Multicriteria decision analysis in health care decision in oncology: a systematic review. Expert Rev Pharmacoecon Outcomes Res 2021; 22:365-380. [PMID: 34913775 DOI: 10.1080/14737167.2022.2019580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
INTRODUCTION Multicriteria decision analysis (MCDA) has been used to inform health decisions in health technology assessments (HTA) processes. This is particularly important to complex treatment decisions in oncology. AREAS COVERED Five databases (PubMed, EMBASE, LILACS, Web of Science and CRD's NHS Economic Evaluation Database) were searched for studies comparing health technologies in oncology, involving the concept MCDA. The ISPOR MCDA Good Practices Guidelines were used to assess the reporting quality. Study selection, appraisal, and data extraction were performed by two reviewers. Fifteen studies were included. The main decision problem was related to health technology assessment of cancer treatments. Clinicians and public health experts were the most frequent stakeholders. The most frequently included criteria comprised therapeutic benefit, and socio-economic impact. Value measurement approach, direct rating techniques, and additive model for aggregation were used in most studies. Uncertainty analysis revealed the impact of posology and costs on the studies' results. All studies showed some level of overlapping decision criteria. EXPERT OPINION There is considerable diversity of methods in MCDA for healthcare decision-making in oncology. The evidence presented can serve as a resource when considering which stakeholders, criteria, and techniques to include in future MCDA studies in oncology.
Collapse
Affiliation(s)
- Alessandro Gonçalves Campolina
- Departamento de Medicina Preventiva, Faculdade de Medicina Fmusp, Universidade de Sao Paulo, Sao Paulo, Brazil.,Centro de Investigação Translacional Em Oncologia, Instituto Do Cancer Do Estado de Sao Paulo, Faculdade de Medicina Fmusp, Universidade de Sao Paulo, Sao Paulo, Brazil
| | - Erica Aranha Suzumura
- Departamento de Medicina Preventiva, Faculdade de Medicina Fmusp, Universidade de Sao Paulo, Sao Paulo, Brazil
| | - Quan Nha Hong
- EPPI-Centre, UCL Social Research Institute, University College London, London, UK
| | - Patrícia Coelho de Soárez
- Departamento de Medicina Preventiva, Faculdade de Medicina Fmusp, Universidade de Sao Paulo, Sao Paulo, Brazil
| |
Collapse
|
31
|
Application of Multicriteria Decision Analysis to Determine the Value of Prophylaxis Relative to On-Demand Treatment in Hemophilia A and Emicizumab versus Replacement Therapy in the Greek Healthcare Setting. Clin Drug Investig 2021; 42:75-85. [PMID: 34874542 DOI: 10.1007/s40261-021-01108-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/21/2021] [Indexed: 10/19/2022]
Abstract
BACKGROUND AND OBJECTIVE Hemophilia A (HA) is a rare disease that is characterized by congenital underproduction or dysfunction of the endogenous coagulation factor VIII (FVIII). The aim of the present study was to determine the value of prophylaxis versus on-demand treatment strategies for moderate to severe HA (MtSHA) patients and the value of emicizumab in the prophylaxis of MtSHA in Greece, compared with short half-life (SHL) FVIII and extended half-life (EHL) FVIII through multicriteria decision analysis (MCDA). METHODS A literature review was performed to identify a set of criteria relevant to the therapeutic approaches and therapies under investigation. A performance matrix was populated by two literature reviews and meta-analyses. The criteria selected were hierarchically classified by allocating weights on a 0-100 scale. The performances of therapies were scored at the 100-point scale. The value judgments utilized for weighing and scoring were sourced via a survey among independent multidisciplinary system stakeholders. A linear additive value function was used for the calculation of total value estimates. RESULTS The participants ranked 'annual number of bleedings per patient' and 'percentage of target joint bleeds' as the most important criteria, while the least important criterion was the 'annual treatment cost' for both assessments. Based on the weights elicited and the performance in each criterion, the overall value score was higher for prophylaxis treatment (58.27) compared with on-demand treatment (40.13). In the other comparison, the most valued treatment was emicizumab (77.05) followed by EHL FVIII (71.52) and SHL FVIII (19.88). According to the participants, the most important factors for managing MtSHA patients are those related to successful management of bleeding events given their contribution to improved quality of life (QoL) and reduced morbidity. CONCLUSIONS This MCDA has shown that the prophylaxis strategy was perceived as a more valuable option for managing MtSHA patients when compared with the on-demand strategy. Moreover, emicizumab adds higher value and improves patient QoL compared with replacement therapy for MtSHA in Greece. Emicizumab addresses important unmet needs due to its improved efficacy and mode of administration.
Collapse
|
32
|
Vernazza C, Carr K, Holmes R, Wildman J, Gray J, Exley C, Smith R, Donaldson C. Resource Allocation in a National Dental Service Using Program Budgeting Marginal Analysis. JDR Clin Trans Res 2021; 8:23800844211056241. [PMID: 34844457 PMCID: PMC9772892 DOI: 10.1177/23800844211056241] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
INTRODUCTION In any health system, choices must be made about the allocation of resources (budget), which are often scarce. Economics has defined frameworks to aid resource allocation, and program budgeting marginal analysis (PBMA) is one such framework. In principle, patient and public values can be incorporated into these frameworks, using techniques such as willingness to pay (WTP). However, this has not been done before, and few formal resource allocation processes have been undertaken in dentistry. This study aimed to undertake a PBMA with embedded WTP values in a national dental setting. METHODS The PBMA process was undertaken by a panel of participant-researchers representing commissioners, dentists, dental public health staff, and academics. The panel reviewed current allocations and generated a set of weighted criteria to evaluate services against. Services to be considered for removal and investment were determined by the panel and wider discussion and then scored against the criteria. Values from a nationally representative WTP survey of the public contributed to the scores for interventions. Final decisions on removal and investment were taken after panel discussion using individual anonymous electronic voting. RESULTS The PBMA process resulted in recommendations to invest in new program components to improve access to general dentists, care home dentistry, and extra support for dental public health input into local government decisions. Disinvestments were recommended in orthodontics and to remove routine scaling and polishing of teeth. DISCUSSION The PBMA process was successful in raising awareness of resource allocation issues. Implementation of findings will depend on the ability of decision makers to find ways of operationalizing the decisions. The process illustrates practical aspects of the process that future dental PBMAs could learn from. KNOWLEDGE TRANSFER STATEMENT This study illustrates a framework for resource allocation in dental health services and will aid decision makers in implementing their own resource allocation systems.
Collapse
Affiliation(s)
- C.R. Vernazza
- School of Dental Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - K. Carr
- School of Dental Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - R.D. Holmes
- School of Dental Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - J. Wildman
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - J. Gray
- Nursing, Midwifery & Health, Northumbria University, Newcastle-upon-Tyne, UK
| | - C. Exley
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - R.A. Smith
- ScHARR, University of Sheffield, Regent Court, Sheffield, UK
| | - C. Donaldson
- Yunus Centre for Social Business and Health, Glasgow Caledonian University, Glasgow, UK
| |
Collapse
|
33
|
Islam MK, Ruths S, Jansen K, Falck R, Mölken MRV, Askildsen JE. Evaluating an integrated care pathway for frail elderly patients in Norway using multi-criteria decision analysis. BMC Health Serv Res 2021; 21:884. [PMID: 34454494 PMCID: PMC8400755 DOI: 10.1186/s12913-021-06805-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Accepted: 07/20/2021] [Indexed: 11/28/2022] Open
Abstract
Background To provide value-based care for patients with multi-morbidity, innovative integrated care programmes and comprehensive evaluations of such programmes are required. In Norway, a new programme called “Holistic Continuity of Patient Care” (HCPC) addresses the issue of multi-morbidity by providing integrated care within learning networks for frail elderly patients who receive municipal home care services or a short-term stay in a nursing home. This study conducts a multi-criteria decision analysis (MCDA) to evaluate whether the HCPC programme performs better on a large set of outcomes corresponding to the ‘triple aim’ compared to usual care. Methods Prospective longitudinal survey data were collected at baseline and follow-up after 6-months. The assessment of HCPC was implemented by a novel MCDA framework. The relative weights of importance of the outcomes used in the MCDA were obtained from a discrete choice experiment among five different groups of stakeholders. The performance score was estimated using a quasi-experimental design and linear mixed methods. Performance scores were standardized and multiplied by their weights of importance to obtain the overall MCDA value by stakeholder group. Results At baseline in the HCPC and usual care groups, respectively, 120 and 89 patients responded, of whom 87 and 41 responded at follow-up. The average age at baseline was 80.0 years for HCPC and 83.6 for usual care. Matching reduced the standardized differences between the groups for patient background characteristics and outcome variables. The MCDA results indicated that HCPC was preferred to usual care irrespective of stakeholders. The better performance of HCPC was mostly driven by improvements in enjoyment of life, psychological well-being, and social relationships and participation. Results were consistent with sensitivity analyses using Monte Carlo simulation. Conclusion Frail elderly with multi-morbidity represent complex health problems at large costs for society in terms of health- and social care. This study is a novel contribution to assessing and understanding HCPC programme performance respecting the multi-dimensionality of desired outcomes. Integrated care programmes like HCPC may improve well-being of patients, be cost-saving, and contribute to the pursuit of evidence based gradual reforms in the care of frail elderly. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-021-06805-6.
Collapse
Affiliation(s)
- M Kamrul Islam
- Department of Economics, University of Bergen, Postboks 7802, 5020, Bergen, Norway. .,Department of Social Sciences, NORCE Norwegian Research Centre, Bergen, Norway.
| | - Sabine Ruths
- Research Unit for General Practice, NORCE Norwegian Research Centre, Bergen, Norway.,Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway
| | - Kristian Jansen
- Research Unit for General Practice, NORCE Norwegian Research Centre, Bergen, Norway.,Department of Nursing homes, Municipality of Bergen, Bergen, Norway
| | - Runa Falck
- Department of Comparative Politics, University of Bergen, Bergen, Norway
| | | | - Jan Erik Askildsen
- Department of Economics, University of Bergen, Postboks 7802, 5020, Bergen, Norway
| |
Collapse
|
34
|
Heggie R, Boyd K, Wu O. How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review. Health Res Policy Syst 2021; 19:118. [PMID: 34407834 PMCID: PMC8371806 DOI: 10.1186/s12961-021-00766-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 07/26/2021] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVES Health interventions in a clinical setting may be complex. This is particularly true of clinical interventions which require systems reorganization or behavioural change, and/or when implementation involves additional challenges not captured within a clinical trial setting. Medical Research Council guidance on complex interventions highlights the need to consider economic evaluation alongside implementation. However, the extent to which this guidance has been adhered to, and how, is unclear. The failure to incorporate implementation within the evaluation of an intervention may hinder the translation of research findings into routine practice. This will have consequences for patient care. This study examined the methods used to address implementation within health research conducted through funding from the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme. METHODS We conducted a rapid review using a systematic approach. We included all NIHR HTA monographs which contained the word "implementation" within the title or abstract published between 2014 and 2020. We assessed the studies according to existing recommendations for specifying and reporting implementation approaches in research. Additional themes which were not included in the recommendation, but were of particular relevance to our research question, were also identified and summarized in a narrative synthesis. RESULTS The extent to which implementation was formally incorporated, and defined, varied among studies. Methods for examining implementation ranged from single stakeholder engagement events to the more comprehensive process evaluation. There was no obvious pattern as to whether approaches to implementation had evolved over recent years. Approximately 50% (22/42) of studies included an economic evaluation. Of these, two studies included the use of qualitative data obtained within the study to quantitatively inform aspects relating to implementation and economic evaluation in their study. DISCUSSION A variety of approaches were identified for incorporating implementation within an HTA. However, they did not go far enough in terms of incorporating implementation into the actual design and evaluation. To ensure the implementation of clinically effective and cost-effective interventions, we propose that further guidance on how to incorporate implementation within complex interventions is required. Incorporating implementation into economic evaluation provides a step in this direction.
Collapse
Affiliation(s)
- Robert Heggie
- Health Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK.
| | - Kathleen Boyd
- Health Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK
| | - Olivia Wu
- Health Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK
| |
Collapse
|
35
|
Panattoni L, Phelps CE, Lieu TA, Alexeeff S, O'Neill S, Mandelblatt JS, Ramsey SD. Feasibility of Measuring Preferences for Chemotherapy Among Early-Stage Breast Cancer Survivors Using a Direct Rank Ordering Multicriteria Decision Analysis Versus a Time Trade-Off. PATIENT-PATIENT CENTERED OUTCOMES RESEARCH 2021; 13:557-566. [PMID: 32447608 DOI: 10.1007/s40271-020-00423-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
OBJECTIVES Chemotherapy is increasingly a preference-based choice among women diagnosed with early-stage breast cancer. Multicriteria decision analysis (MCDA) is a promising but underutilized method to facilitate shared decision making. We explored the feasibility of conducting an MCDA using direct rank ordering versus a time trade-off (TTO) to assess chemotherapy choice in a large population-based sample. METHODS We surveyed 904 early-stage breast cancer survivors who were within 5 years of diagnosis and reported to the Western Washington State Cancer System and Kaiser Permanente Northern California registries. Direct rank ordering of 11 criteria and TTO surveys were conducted from September 2015 to July 2016; clinical data were obtained from registries or medical records. Multivariable regressions estimated post hoc associations between the MCDA, TTO, and self-reported chemotherapy receipt, considering covariates. RESULTS Survivors ranged in age from 25 to 74 years and 73.9% had stage I tumors. The response rate for the rank ordering was 81.0%; TTO score was 94.2%. A one-standard deviation increase in the difference between the chemotherapy and no chemotherapy MCDA scores was associated with a 75.1% (95% confidence interval 43.9-109.7%; p < 0.001) increase in the adjusted odds of having received chemotherapy; no association was found between the TTO score and chemotherapy receipt. CONCLUSIONS A rank-order-based MCDA was feasible and was associated with chemotherapy choice. Future research should consider developing and testing this MCDA for use in clinical encounters. Additional research is required to develop a TTO-based model and test its properties against a pragmatic MCDA to inform future shared decision-making tools.
Collapse
Affiliation(s)
- Laura Panattoni
- Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, M3-B232, Seattle, WA, 98109, USA
| | | | - Tracy A Lieu
- Division of Research, Kaiser Permanente Northern California, Oakland, CA, USA
| | - Stacey Alexeeff
- Division of Research, Kaiser Permanente Northern California, Oakland, CA, USA
| | - Suzanne O'Neill
- Department of Oncology, Georgetown University Medical Center, Washington, DC, USA.,Georgetown Lombardi Comprehensive Cancer Center, Washington, DC, USA
| | - Jeanne S Mandelblatt
- Department of Oncology, Georgetown University Medical Center, Washington, DC, USA.,Georgetown Lombardi Comprehensive Cancer Center, Washington, DC, USA
| | - Scott D Ramsey
- Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, M3-B232, Seattle, WA, 98109, USA.
| |
Collapse
|
36
|
How to integrate evidence from patient preference studies into health technology assessment: a critical review and recommendations. Int J Technol Assess Health Care 2021; 37:e75. [PMID: 36744660 DOI: 10.1017/s0266462321000490] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Health technology assessment (HTA) agencies vary in their use of quantitative patient preference data (PP) and the extent to which they have formalized this use in their guidelines. Based on the authors' knowledge of the literature, we identified six different PP "use cases" that integrate PP into HTA in five different ways: through endpoint selection, clinical benefit rating, predicting uptake, input into economic evaluation, and a means to weight all HTA criteria. Five types of insight are distinguished across the use cases: understanding what matters to patients, predicting patient choices, estimating the utility generated by treatment benefits, estimating the willingness to pay for treatment benefits, and informing distributional considerations. Summarizing the literature on these use cases, we recommend circumstances in which PP can add value to HTA and the further research and guidance that is required to support the integration of PP in HTA. Where HTA places more emphasis on clinical outcomes, novel endpoints are available; or where there are already many treatment options, PP can add value by helping decision makers to understand what matters to patients. Where uptake is uncertain, PP can be used to estimate uptake probability. Where indication-specific utility functions are required or where existing utility measures fail to capture the value of treatments, PP can be used to generate or supplement existing utility estimates. Where patients are paying out of pocket, PP can be used to estimate willingness to pay.
Collapse
|
37
|
Karimi M, van der Zwaan L, Islam K, van Genabeek J, Mölken MRV. Evaluating Complex Health and Social Care Program Using Multi-Criteria Decision Analysis: A Case Study of "Better Together in Amsterdam North". VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:966-975. [PMID: 34243840 DOI: 10.1016/j.jval.2021.02.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2020] [Revised: 01/04/2021] [Accepted: 02/12/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVES Multi-criteria decision analysis (MCDA) has been recommended to support policy making in healthcare. However, practical applications of MCDA are sparse. One potential use for MCDA is for the evaluation of programs for complex and vulnerable patients. These complex patients benefit from integrated care programs that span healthcare and social care and aim to improve more than just health outcomes. MCDA can evaluate programs that aim to improve broader outcomes because it allows the evaluation of multiple outcomes alongside each other. In this study, we evaluate an innovative integrated care program in the Netherlands using MCDA. METHODS We used an innovative MCDA framework with broad outcomes of health, well-being, and cost to evaluate the Better Together in Amsterdam North (BSiN) program using preferences of patients, partners, providers, payers, and policy makers in the Netherlands. BSiN provides case management support for a period of 6 months. Seven outcomes that previous research has deemed important to complex patients were measured, including physical functioning and social relationships and participation. RESULTS We find that the program improved the overall MCDA score marginally, and, thus, after 6 and after 12 months, BSiN was preferred to usual care by all stakeholders. BSiN was preferred to usual care, mostly owing to improvements in psychological well-being and social relationships and participation. CONCLUSIONS The integrated healthcare and social care program BSiN in the Netherlands was preferred to usual care according to an MCDA evaluation. MCDA seems a useful method to evaluate complex programs with benefits beyond health.
Collapse
Affiliation(s)
- Milad Karimi
- Erasmus School of Health Policy & Management, Erasmus University, Rotterdam, the Netherlands.
| | - Lennart van der Zwaan
- Netherlands Organization for Applied Scientific Research TNO, Unit Healthy Living, Leiden, The Netherlands
| | - Kamrul Islam
- Department of Economics, University of Bergen, Bergen, Norway; NORCE Norwegian Research Centre, Bergen, Norway
| | - Joost van Genabeek
- Netherlands Organization for Applied Scientific Research TNO, Unit Healthy Living, Leiden, The Netherlands
| | - Maureen Rutten-van Mölken
- Erasmus School of Health Policy & Management, Erasmus University, Rotterdam, the Netherlands; Institute for Medical Technology Assessment (iMTA), Erasmus University Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
38
|
Holtorf AP, Kristin E, Assamawakin A, Upakdee N, Indrianti R, Apinchonbancha N. Case studies for implementing MCDA for tender and purchasing decisions in hospitals in Indonesia and Thailand. J Pharm Policy Pract 2021; 14:52. [PMID: 34127071 PMCID: PMC8200782 DOI: 10.1186/s40545-021-00333-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 06/07/2021] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND A multi-criteria decision analysis (MCDA) approach has been suggested for helping purchasers in low- and middle-income countries in an evidence-based assessment of multi-source pharmaceuticals to mitigate potential adverse consequences of price-based decisions on patient access to effective medicines. Six workshops for developing MCDA-instruments for purchasing were conducted in Indonesia, Kazakhstan, Thailand, and Kuwait in 2017-2020. In Indonesia and Thailand, two pilot-initiatives aimed to implement the instruments for hospital drug purchasing decisions. OBJECTIVE By analysing and comparing the experiences and progress from the MCDA-workshops and the two case-examples for hospital implementation in Indonesia and Thailand, we aim to gain insights, which will support future implementation. METHODS The selection of criteria and their average weight were compared quantitatively across the MCDA-instruments developed in all four countries and settings. Implementation experiences from two case-examples were studied, which included (1) testing the instrument across a variety of drugs in seven hospitals in Thailand and (2) implementation in one specialty hospital in Indonesia. Semi-structured interviews were conducted via web-conferences with four diverse stakeholders in the pilot implementation projects in Thailand and Indonesia. The open responses were evaluated through qualitative content analysis and synthesis using grounded theory coding. RESULTS Drivers for implementation were making 'better' decisions, achieving transparency and a rational selection process, reducing drug shortages, and assuring consistent quality. Challenges were seen on the technical level (definition or of criteria, scoring methods, access to data) or change-related challenges (resistance, perception of increased workload, lack of competencies or capabilities, lack of resources). The comparison of the MCDA instruments revealed high similarity, but also clear need for local adaptations in each specific case. CONCLUSION A set a of measures targeting challenges related to utility, methodology, data requirements, capacity building and training as well as the broader societal impact can help to overcome challenges in the implementation. Careful planning of implementation and organizational change is recommended for ensuring commitment and fit to local context and culture. Designing a collaborative change program for each application of MCDA-based purchasing will enable healthcare stakeholders to maximally benefit in terms of quality and effectiveness of care and access for patients.
Collapse
Affiliation(s)
- Anke-Peggy Holtorf
- Health Outcomes Strategies GmbH, Colmarerstr 58, 4055 Basel, Switzerland
- College of Pharmacy, Pharmacotherapy Outcomes Research Center, University of Utah, Salt Lake City, UT USA
| | - Erna Kristin
- Department of Pharmacology Therapy, Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta, Indonesia
| | - Anunchai Assamawakin
- Department of Pharmacology, Faculty of Pharmacy, Mahidol University, 447 Sri-ayuthaya Road, Rajathevi, Bangkok, 10400 Thailand
| | - Nilawan Upakdee
- Faculty of Pharmaceutical Sciences, Naresuan University, Phitsanulok, 65000 Thailand
| | - Rina Indrianti
- PT. Abbott Indonesia, Wisma Pondok Indah 2, Suite 503, Jalan Sultan Iskandar Muda Kav V/ TA., Pondok Indah, Jakarta Selatan, 12310 Indonesia
| | - Napassorn Apinchonbancha
- Abbott Laboratories ltd, No.1, Q House Lumpini, 30th & 33rd Floor, South Sathorn Road, Thungmahamek, Sathorn, Bangkok, 10120 Thailand
| |
Collapse
|
39
|
van den Bogaart EHA, Kroese MEAL, Spreeuwenberg MD, Ruwaard D, Tsiachristas A. Economic Evaluation of New Models of Care: Does the Decision Change Between Cost-Utility Analysis and Multi-Criteria Decision Analysis? VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:795-803. [PMID: 34119077 DOI: 10.1016/j.jval.2021.01.014] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 11/30/2020] [Accepted: 01/14/2021] [Indexed: 06/12/2023]
Abstract
OBJECTIVES To experiment with new approaches of collaboration in healthcare delivery, local authorities implement new models of care. Regarding the local decision context of these models, multi-criteria decision analysis (MCDA) may be of added value to cost-utility analysis (CUA), because it covers a wider range of outcomes. This study compares the 2 methods using a side-by-side application. METHODS A new Dutch model of care, Primary Care Plus (PC+), was used as a case study to compare the results of CUA and MCDA. Data of patients referred to PC+ or care-as-usual were retrieved by questionnaires and administrative databases with a 3-month follow-up. Propensity score matching together with generalized linear regression models was used to reduce confounding. Univariate and probabilistic sensitivity analyses were performed to explore uncertainty in the results. RESULTS Although both methods indicated PC+ as the dominant alternative, complementary differences were observed. MCDA provided additional evidence that PC+ improved access to care (standardized performance score of 0.742 vs 0.670) and that improvement in health-related quality of life was driven by the psychological well-being component (standardized performance score of 0.710 vs 0.704). Furthermore, MCDA estimated the budget required for PC+ to be affordable in addition to preferable (€521.42 per patient). Additionally, MCDA was less sensitive to the utility measures used. CONCLUSIONS MCDA may facilitate an auditable and transparent evaluation of new models of care by providing additional information on a wider range of outcomes and incorporating affordability. However, more effort is needed to increase the usability of MCDA among local decision makers.
Collapse
Affiliation(s)
- Esther H A van den Bogaart
- Department of Health Services Research, Care and Public Health Research Institute (CAPHRI), Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands.
| | - Mariëlle E A L Kroese
- Department of Health Services Research, Care and Public Health Research Institute (CAPHRI), Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands
| | - Marieke D Spreeuwenberg
- Department of Health Services Research, Care and Public Health Research Institute (CAPHRI), Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands; Research Center for Technology in Care, Zuyd University of Applied Sciences, Heerlen, The Netherlands
| | - Dirk Ruwaard
- Department of Health Services Research, Care and Public Health Research Institute (CAPHRI), Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands
| | - Apostolos Tsiachristas
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK
| |
Collapse
|
40
|
Walker S, Fox A, Altunkaya J, Colbourn T, Drummond M, Griffin S, Gutacker N, Revill P, Sculpher M. Program Evaluation of Population- and System-Level Policies: Evidence for Decision Making. Med Decis Making 2021; 42:17-27. [PMID: 34041992 DOI: 10.1177/0272989x211016427] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND Policy evaluations often focus on ex post estimation of causal effects on short-term surrogate outcomes. The value of such information is limited for decision making, as the failure to reflect policy-relevant outcomes and disregard for opportunity costs prohibits the assessment of value for money. Further, these evaluations do not always consider all relevant evidence, other courses of action, or decision uncertainty. METHODS In this article, we explore how policy evaluation could better meet the needs of decision making. We begin by defining the evidence required to inform decision making. We then conduct a literature review of challenges in evaluating policies. Finally, we highlight potential methods available to help address these challenges. RESULTS The evidence required to inform decision making includes the impacts on the policy-relevant outcomes, the costs and associated opportunity costs, and the consequences of uncertainty. Challenges in evaluating health policies are described using 8 categories: 1) valuation space; 2) comparators; 3) time of evaluation; 4) mechanisms of action; 5) effects; 6) resources, constraints, and opportunity costs; 7) fidelity, adaptation, and level of implementation; and 8) generalizability and external validity. Methods from a broad set of disciplines are available to improve policy evaluation, relating to causal inference, decision-analytic modeling, theory of change, realist evaluation, and structured expert elicitation. LIMITATIONS The targeted review may not identify all possible challenges, and the methods covered are not exhaustive. CONCLUSIONS Evaluations should provide appropriate evidence to inform decision making. There are challenges in evaluating policies, but methods from multiple disciplines are available to address these challenges. IMPLICATIONS Evaluators need to carefully consider the decision being informed, the necessary evidence to inform it, and the appropriate methods.[Box: see text].
Collapse
Affiliation(s)
- Simon Walker
- Centre for Health Economics, University of York, York, UK
| | - Aimee Fox
- Adelphi Values, Bollington, Cheshire, UK
| | - James Altunkaya
- Nuffield Department of Population Health, University of Oxford, Oxford, Oxfordshire, UK
| | - Tim Colbourn
- Institute for Global Health, University College London, London, UK
| | - Mike Drummond
- Centre for Health Economics, University of York, York, UK
| | - Susan Griffin
- Centre for Health Economics, University of York, York, UK
| | - Nils Gutacker
- Centre for Health Economics, University of York, York, UK
| | - Paul Revill
- Centre for Health Economics, University of York, York, UK
| | - Mark Sculpher
- Centre for Health Economics, University of York, York, UK
| |
Collapse
|
41
|
Ibarra-Zapata E, Gaytán-Hernández D, Gallegos-García V, González-Acevedo CE, Meza-Menchaca T, Rios-Lugo MJ, Hernández-Mendoza H. Geospatial modelling to estimate the territory at risk of establishment of influenza type A in Mexico - An ecological study. GEOSPATIAL HEALTH 2021; 16. [PMID: 34000788 DOI: 10.4081/gh.2021.956] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Accepted: 03/16/2021] [Indexed: 06/12/2023]
Abstract
The aim of this study was to estimate the territory at risk of establishment of influenza type A (EOITA) in Mexico, using geospatial models. A spatial database of 1973 outbreaks of influenza worldwide was used to develop risk models accounting for natural (natural threat), anthropic (man-made) and environmental (combination of the above) transmission. Then, a virus establishment risk model; an introduction model of influenza A developed in another study; and the three models mentioned were utilized using multi-criteria spatial evaluation supported by geographically weighted regression (GWR), receiver operating characteristic analysis and Moran's I. The results show that environmental risk was concentrated along the Gulf and Pacific coasts, the Yucatan Peninsula and southern Baja California. The identified risk for EOITA in Mexico were: 15.6% and 4.8%, by natural and anthropic risk, respectively, while 18.5% presented simultaneous environmental, natural and anthropic risk. Overall, 28.1% of localities in Mexico presented a High/High risk for the establishment of influenza type A (area under the curve=0.923, P<0.001; GWR, r2=0.840, P<0.001; Moran's I =0.79, P<0.001). Hence, these geospatial models were able to robustly estimate those areas susceptible to EOITA, where the results obtained show the relation between the geographical area and the different effects on health. The information obtained should help devising and directing strategies leading to efficient prevention and sound administration of both human and financial resources.
Collapse
Affiliation(s)
- Enrique Ibarra-Zapata
- Center for Research and Postgraduate Studies, Faculty of Agronomy, Autonomous University of San Luis Potosí, San Luis Potosí, S.L.P..
| | - Darío Gaytán-Hernández
- Faculty of Nursing and Nutrition, Autonomous University of San Luis Potosí, San Luis Potosí, S.L.P..
| | - Verónica Gallegos-García
- Faculty of Nursing and Nutrition, Autonomous University of San Luis Potosí, San Luis Potosí, S.L.P..
| | | | - Thuluz Meza-Menchaca
- Laboratory of Human Genomics, Faculty of Medicine, Veracruzana University, Xalapa, Veracruz.
| | - María Judith Rios-Lugo
- Faculty of Nursing and Nutrition, Autonomous University of San Luis Potosí, San Luis Potosí, S.L.P..
| | - Héctor Hernández-Mendoza
- Desert Zones Research Institute, Autonomous University of San Luis Potosí, San Luis Potosí, S.L.P.; University of Central Mexico, San Luis Potosí, S.L.P..
| |
Collapse
|
42
|
Blonda A, Denier Y, Huys I, Simoens S. How to Value Orphan Drugs? A Review of European Value Assessment Frameworks. Front Pharmacol 2021; 12:631527. [PMID: 34054519 PMCID: PMC8150002 DOI: 10.3389/fphar.2021.631527] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Accepted: 03/16/2021] [Indexed: 11/22/2022] Open
Abstract
Background: Decision-makers have implemented a variety of value assessment frameworks (VAFs) for orphan drugs in European jurisdictions, which has contributed to variations in access for rare disease patients. This review provides an overview of the strengths and limitations of VAFs for the reimbursement of orphan drugs in Europe, and may serve as a guide for decision-makers. Methods: A narrative literature review was conducted using the databases Pubmed, Scopus and Web of Science. Only publications in English were included. Publications known to the authors were added, as well as conference or research papers, or information published on the website of reimbursement and health technology assessment (HTA) agencies. Additionally, publications were included through snowballing or focused searches. Results: Although a VAF that applies a standard economic evaluation treats both orphan drugs and non-orphan drugs equally, its focus on cost-effectiveness discards the impact of disease rarity on data uncertainty, which influences an accurate estimation of an orphan drug’s health benefit in terms of quality-adjusted life-years (QALYs). A VAF that weighs QALYs or applies a variable incremental cost-effectiveness (ICER) threshold, allows the inclusion of value factors beyond the QALY, although their methodologies are flawed. Multi-criteria decision analysis (MCDA) incorporates a flexible set of value factors and involves multiple stakeholders’ perspectives. Nevertheless, its successful implementation relies on decision-makers’ openness toward transparency and a pragmatic approach, while allowing the flexibility for continuous improvement. Conclusion: The frameworks listed above each have multiple strengths and weaknesses. We advocate that decision-makers apply the concept of accountability for reasonableness (A4R) to justify their choice for a specific VAF for orphan drugs and to strive for maximum transparency concerning the decision-making process. Also, in order to manage uncertainty and feasibility of funding, decision-makers may consider using managed-entry agreements rather than implementing a separate VAF for orphan drugs.
Collapse
Affiliation(s)
- Alessandra Blonda
- Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
| | - Yvonne Denier
- Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
| | - Isabelle Huys
- Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
| | - Steven Simoens
- Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
| |
Collapse
|
43
|
McQueen RB, Slejko JF. Toward Modified Impact Inventory Tables to Facilitate Patient-Centered Value Assessment. PHARMACOECONOMICS 2021; 39:379-382. [PMID: 33759080 PMCID: PMC7987510 DOI: 10.1007/s40273-021-01017-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/08/2021] [Indexed: 05/31/2023]
Affiliation(s)
- R Brett McQueen
- Skaggs School of Pharmacy and Pharmaceutical Sciences, Department of Clinical Pharmacy, University of Colorado Anschutz Medical Campus, Mail Stop C238, 12850 E. Montview Blvd., Aurora, CO, 80045, USA.
- University of Maryland School of Pharmacy, Baltimore, MA, USA.
| | - Julia F Slejko
- Skaggs School of Pharmacy and Pharmaceutical Sciences, Department of Clinical Pharmacy, University of Colorado Anschutz Medical Campus, Mail Stop C238, 12850 E. Montview Blvd., Aurora, CO, 80045, USA
- University of Maryland School of Pharmacy, Baltimore, MA, USA
| |
Collapse
|
44
|
Sarri G, Freitag A, Szegvari B, Mountian I, Brixner D, Bertelsen N, Kaló Z, Upadhyaya S. The Role of Patient Experience in the Value Assessment of Complex Technologies - Do HTA Bodies Need to Reconsider How Value is Assessed? Health Policy 2021; 125:593-601. [PMID: 33814201 DOI: 10.1016/j.healthpol.2021.03.006] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 01/29/2021] [Accepted: 03/01/2021] [Indexed: 11/16/2022]
Affiliation(s)
| | | | | | | | | | - Neil Bertelsen
- HTAi Interest Group on Patient & Citizen Involvement; Neil Bertelsen Consulting, Germany
| | - Zoltán Kaló
- Syreon Research Institute, Budapest, Hungary; Center for Health Technology Assessment, Semmelweis University, Budapest, Hungary
| | - Sheela Upadhyaya
- Centre for Health Technology Evaluation, National Institute for Health and Care Excellence
| |
Collapse
|
45
|
Silva HP, Lefebvre AA, Oliveira RR, Lehoux P. Fostering Responsible Innovation in Health: An Evidence-Informed Assessment Tool for Innovation Stakeholders. Int J Health Policy Manag 2021; 10:181-191. [PMID: 32610749 PMCID: PMC8167270 DOI: 10.34172/ijhpm.2020.34] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Accepted: 02/26/2020] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Responsible innovation in health (RIH) emphasizes the importance of developing technologies that are responsive to system-level challenges and support equitable and sustainable healthcare. To help decision-makers identify whether an innovation fulfills RIH requirements, we developed and validated an evidence-informed assessment tool comprised of 4 inclusion and exclusion criteria, 9 assessment attributes and a scoring system. METHODS We conducted an inter-rater reliability assessment to establish the extent to which 2 raters agree when applying the RIH Tool to a diversified sample of health innovations (n=25). Following the Tool's 3-step process, sources of information were collected and cross-checked to ensure their clarity and relevance. Ratings were reported independently in a spreadsheet to generate the study's database. To measure inter-rater reliability, we used: a non-adjusted index (percent agreement), a chance-adjusted index (Gwet's AC) and the Pearson's correlation coefficient. Results of the Tool's application to the whole sample of innovations are summarized through descriptive statistics. RESULTS Our findings show complete agreement for the screening criteria, "almost perfect" agreement for 7 assessment attributes, "substantial" agreement for 2 attributes and "almost perfect" agreement for the RIH overall score. A large portion of the sample obtained high scores for 6 attributes (health relevance, health inequalities, responsiveness, level and intensity of care and frugality) and low scores for 3 attributes (ethical, legal, and social issues [ELSIs], inclusiveness and eco-responsibility). At the rating step, 88% of the innovations had a sufficient number of attributes documented (≥ 7/9), but the assessment was based on sources of moderate to high quality (mean score ≥ 2 points) for 36% of the sample. While "Almost all RIH features" were present for 24% of the innovations (RIH mean score between 4.1-5.0 points), "Many RIH features" were present for 52% of the sample (3.1-4.0 points) and "Few RIH features" were present for 24% of the innovations (2.1-3.0 points). CONCLUSION By confirming key aspects of the RIH Tool's reliability and applicability, our study brings its development to completion. It can be jointly put into action by innovation stakeholders who want to foster innovations with greater social, economic and environmental value.
Collapse
Affiliation(s)
- Hudson P Silva
- Public Health Research Institute, University of Montreal, Montreal, QC, Canada
| | | | - Robson R Oliveira
- Public Health Research Institute, University of Montreal, Montreal, QC, Canada
| | - Pascale Lehoux
- Public Health Research Institute, University of Montreal, Montreal, QC, Canada
| |
Collapse
|
46
|
Multiple criteria decision analysis for medicine reimbursement in the Lebanese context. Int J Technol Assess Health Care 2021. [DOI: 10.1017/s0266462321000398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Abstract
Objective
The objective of this exploratory analysis is to reflect and discuss which criteria of multiple criteria decision analysis (MCDA) would be relevant as part of value determination when appraising healthcare interventions in the Lebanese context.
Methods
A workshop was conducted as part of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Lebanon Chapter and included the two frameworks: Evidence and Value: Impact on Decision Making (EVIDEM) and Advance Value Framework. Thirty-seven participants expressed their individual preferences through a qualitative and a quantitative exercise.
Results
In the qualitative analysis of both frameworks, participants unanimously agreed on the relevance of comparative efficacy, safety, and impact of medical costs. In EVIDEM, disease severity and unmet needs were also considered to be important criteria by more than 90 percent of the participants. In the quantitative analysis of both frameworks, disease severity ranked first (a mean normalized weight of .1 in EVIDEM and .27 in Advance Value Framework), followed by the size of the population (.09), the type of therapeutic benefit at the patient level (.09) and population level (.08), and the efficacy (.07) in EVIDEM. In the Advance Value Framework, the combined unmet need/disease severity criteria were followed by direct and meaningful end points (.15), safety (.12), contraindications (.08), and indirect surrogate end points (.07).
Conclusions
The results were concordant with those reported in countries that have conducted similar surveys such as France, Italy, and Spain. The MCDA methodology could be used as a cornerstone to enhance evidence-based discussions among Lebanese stakeholders involved in evaluation and decision-making purposes.
Collapse
|
47
|
Coyle D, Durand-Zaleski I, Farrington J, Garrison L, Graf von der Schulenburg JM, Greiner W, Longworth L, Meunier A, Moutié AS, Palmer S, Pemberton-Whiteley Z, Ratcliffe M, Shen J, Sproule D, Zhao K, Shah K. HTA methodology and value frameworks for evaluation and policy making for cell and gene therapies. THE EUROPEAN JOURNAL OF HEALTH ECONOMICS : HEPAC : HEALTH ECONOMICS IN PREVENTION AND CARE 2020; 21:1421-1437. [PMID: 32794011 DOI: 10.1007/s10198-020-01212-w] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Accepted: 06/18/2020] [Indexed: 05/05/2023]
Abstract
This last decade has been marked by significant advances in the development of cell and gene (C&G) therapies, such as gene targeting or stem cell-based therapies. C&G therapies offer transformative benefits to patients but present a challenge to current health technology decision-making systems because they are typically reviewed when clinical efficacy data are very limited and when there is uncertainty about the long-term durability of outcomes. These challenges are not unique to C&G therapies, but they face more of these barriers, reflecting the need for adapting existing value assessment frameworks. Still, C&G therapies have the potential to be cost-effective even at very high price points. The impact on healthcare budgets will depend on the success rate of pipeline assets and on the extent to which C&G therapies will expand to wider pathologies beyond rare or ultra-rare diseases. Getting pricing and reimbursement models right is important for incentivising research and development investment while not jeopardising the sustainability of healthcare systems. Payers and manufacturers therefore need to acknowledge each other's constraints-limitations in the evidence generation on the manufacturer side, budget considerations on the payer side-and embrace innovative thinking and approaches to ensure timely delivery of therapies to patients. Several experts in health technology assessment and clinical experts have worked together to produce this publication and identify methodological and policy options to improve the assessment of C&G therapies, and make it happen better, faster and sustainably in the coming years.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | - Stephen Palmer
- Center for Health Economics, University of York, York, UK
| | | | | | | | | | - Kun Zhao
- China National Health Development Research Center, Beijing, China
| | | |
Collapse
|
48
|
Overcoming Challenges with the Adoption of Point-of-Care Testing: From Technology Push and Clinical Needs to Value Propositions. POINT OF CARE 2020; 19:77-83. [PMID: 33364914 DOI: 10.1097/poc.0000000000000209] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Major technical challenges often prevent developers from producing new point-of-care technologies that deliver the required clinical performance in the intended settings of use. But even when devices meet clinical requirements, they can fail to be adopted and successfully implemented. Adoption barriers occur when decision makers do not understand the "value proposition" of new technologies. Current discussions of value in the context of point-of-care testing focus predominantly on the intended use and performance of the device from the manufacturer's point-of-view. However, the perspective of potential adopters in determining whether new devices provide value is also important, as is the opinion of all stakeholders who will be impacted. Incorporating value concepts into decisions made across the full development-to-adoption continuum can increase the likelihood that point-of-care testing will have the desired impact on health care delivery and patient outcomes. This article discusses how various approaches to technology development impact adoption and compares the characteristics of these approaches to emerging value concepts. It also provides an overview of value initiatives and tools that are being developed to support the evaluation of value propositions. These are presented for a range of technology adoption decision contexts, with particular applicability to point-of-care testing. Expanding the focus of research to address gaps in both the creation and evaluation of value propositions is imperative in order for value concepts to positively influence the adoption of point-of-care testing.
Collapse
|
49
|
Jakab I, Németh B, Elezbawy B, Karadayı MA, Tozan H, Aydın S, Shen J, Kaló Z. Potential Criteria for Frameworks to Support the Evaluation of Innovative Medicines in Upper Middle-Income Countries-A Systematic Literature Review on Value Frameworks and Multi-Criteria Decision Analyses. Front Pharmacol 2020; 11:1203. [PMID: 32922287 PMCID: PMC7456841 DOI: 10.3389/fphar.2020.01203] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2020] [Accepted: 07/23/2020] [Indexed: 11/29/2022] Open
Abstract
Background Multicriteria Decision Analysis (MCDA), a formal decision support framework, has been growing in popularity recently in the field of health care. MCDA can support pricing and reimbursement decisions on the macro level, which is of great importance especially in countries with more limited resources. Objectives The aim of this systematic review was to facilitate the development of future MCDA frameworks, by proposing a set of criteria focusing on the purchasing decisions of single-source innovative pharmaceuticals in upper middle-income countries. Methods A systematic literature review was conducted on the decision criteria included in value frameworks (VFs) or MCDA tools. Scopus, Medline, databases of universities, websites of Health Technology Assessment Agencies, and other relevant organizations were included in the search. Double title-abstract screening and double full-text review were conducted, and all extracted data were double-checked. A team of researchers performed the merging and selection process of the extracted criteria. Results A total of 1,878 articles entered the title and abstract screening. From these, 341 were eligible to the full-text review, and 36 were included in the final data extraction phase. From these articles 394 criteria were extracted in total. After deduplication and clustering, 26 different criteria were identified. After the merging and selection process, a set of 16 general criteria was proposed. Conclusion Based on the results of the systematic literature review, a pool of 16 criteria was selected. This can serve as a starting point for constructing MCDA frameworks in upper middle-income countries after careful adaptation to the local context.
Collapse
Affiliation(s)
- Ivett Jakab
- Syreon Research Institute, Budapest, Hungary
| | | | | | | | - Hakan Tozan
- İstanbul Medipol University, İstanbul, Turkey
| | | | - Jie Shen
- Novartis International AG, Basel, Switzerland
| | - Zoltán Kaló
- Syreon Research Institute, Budapest, Hungary.,Center for Health Technology Assessment, Semmelweis University, Budapest, Hungary
| |
Collapse
|
50
|
Angelis A, Thursz M, Ratziu V, O’Brien A, Serfaty L, Canbay A, Schiefke I, Costa JBE, Lecomte P, Kanavos P. Early Health Technology Assessment during Nonalcoholic Steatohepatitis Drug Development: A Two-Round, Cross-Country, Multicriteria Decision Analysis. Med Decis Making 2020; 40:830-845. [PMID: 32845234 PMCID: PMC7457462 DOI: 10.1177/0272989x20940672] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Accepted: 05/13/2020] [Indexed: 12/28/2022]
Abstract
Background. The assessment of value along the clinical development of new biopharmaceutical compounds is a challenging task. Complex and uncertain evidence has to be analyzed, considering a multitude of value preferences from different stakeholders. Objective. To investigate the use of multicriteria decision analysis (MCDA) to support decision making during drug development while considering payer and health technology assessment (HTA) value concerns, by applying the Advance Value Framework in nonalcoholic steatohepatitis (NASH) and testing for the consistency of the results. Design. A multiattribute value theory methodology was applied and 2 rounds of decision conferences (DCs) were organized in 3 countries (England, France, and Germany), with the participation of national key experts and stakeholders using the MACBETH questioning protocol and algorithm. A total of 51 health care professionals, patient advocates, and methodologists, including (ex-) committee members or assessors from national HTA bodies, participated in 6 DCs in the study countries. Target Population. NASH patients in fibrosis stages F2 to 3 were considered. Interventions. The value of a hypothetical product profile was assessed against 3 compounds under development using their phase 2 results. Outcome Measures. DC participants' value preferences were elicited involving criteria selection, options scoring, and criteria weighting. Results. Highly consistent valuation rankings were observed in all DCs, always favoring the same compound. Highly consistent rankings of criteria clusters were observed, favoring therapeutic benefit criteria, followed by safety profile and innovation level criteria. Limitations. There was a lack of comparative treatment effects, early evidence on surrogate endpoints was used, and stakeholder representativeness was limited in some DCs. Conclusions. The use of MCDA is promising in supporting early HTA, illustrating high consistency in results across countries and between study rounds.
Collapse
Affiliation(s)
- Aris Angelis
- Department of Health Policy and LSE Health, London School of Economics and Political Science, London, UK
| | - Mark Thursz
- Imperial College Healthcare NHS Trust and Imperial College London, London, UK
| | - Vlad Ratziu
- Université Pierre et Marie Curie and the Hôpital Pitié Salpêtrière Medical School, Paris, France
| | - Alastair O’Brien
- Royal Free London NHS Foundation Trust and University College London, London, UK
| | - Lawrence Serfaty
- Hautepierre Hospital, University of Strasbourg, Strasbourg, France
| | - Ali Canbay
- Department of Gastroenterology, Hepatology and Infectious Diseases, University Magdeburg, Magdeburg, Germany
| | - Ingolf Schiefke
- Department of Internal Medicine, Ruhr-University Bochum, Bochum, Germany
| | | | | | - Panos Kanavos
- Department of Health Policy and LSE Health, London School of Economics and Political Science, London, UK
| |
Collapse
|