Considering and communicating uncertainty in health technology assessment

Uncertainty in Long-Term Relative Effectiveness of Medicines in Health Technology Assessment

OBJECTIVES

Uncertainty regarding the long-term relative effectiveness is an important factor in health technology assessment (HTA) of medicines. This study investigated how different HTA bodies address this uncertainty in their assessments.

METHODS

A total of 49 HTA reports from 6 national HTA bodies, assessing 9 medicines for spinal muscular atrophy, cystic fibrosis, and hypercholesterolemia, were included. In these reports, 81 relative effectiveness assessments and 45 cost-effectiveness assessments were performed on an indication level. We collected information on included trials, assessment outcomes, uncertainty regarding the long-term effectiveness, proposed managed entry agreements, and reassessments.

RESULTS

Uncertainty regarding the long-term effectiveness was an important consideration in almost all cost-effectiveness assessments (91%) and three-quarters of relative effectiveness assessments (74%), despite differences in methodologies among HTA bodies. There were considerable differences in the amount and type of long-term effectiveness data included by HTA bodies due to timing and inclusion criteria. In total 23 managed entry agreements were proposed of which 14 were linked to uncertainty regarding the long-term effectiveness. In addition, 13 reassessments were performed of which 4 led to an increase in patient access because of more available long-term effectiveness data.

CONCLUSIONS

Uncertainty regarding the long-term effectiveness is an important challenge for HTA bodies. There are large differences in the acceptance of evidence among HTA bodies, which leads to heterogeneity in the inclusion of available long-term effectiveness data for decision making. In cases with large uncertainty regarding the long-term effectiveness, outcome-based agreements and reassessments are used by HTA bodies, but differently between HTA bodies and indications.

It Takes 2 to Tango. Setting Out the Conditions in Which Performance-Based Risk-Sharing Arrangements Work for Both Parties

OBJECTIVES

Faster regulatory approval processes often fail to achieve faster patient access. We seek an approach, using performance-based risk-sharing arrangements, to address uncertainty for payers regarding the relative effectiveness and value for money of products launched through accelerated approval schemes. One important reason for risk sharing is to resolve differences of opinion between innovators and payers about a technology's underlying value. To date, there has been no formal attempt to set out the circumstances in which risk sharing can address these differences.

METHODS

We use a value of information framework to understand what a performance-based risk-sharing arrangements can, in principle, add to a reimbursement scheme, separating payer perspectives on cost-effectiveness and the value of research from those of the innovator. We find 16 scenarios, developing 5 rules to analyze these 16 scenarios, identifying cases in which risk sharing adds value for both parties.

RESULTS

We find that risk sharing provides an improved solution in 9 out of 16 combinations of payer and innovator expectations about treatment outcome and the value of further research. Among our assumptions, who pays for research and scheme administration costs are key.

CONCLUSIONS

Steps should be undertaken to make risk sharing more practical, ensuring that payers consider it an option. This requires additional costs to the health system falling on the innovator in an efficient way that aligns incentives for product development for global markets. Health systems benefits are earlier patient access to cost-effective treatments and payers with higher confidence of not wasting money. Innovators get greater returns while conducting research.

We need to talk about values: a proposed framework for the articulation of normative reasoning in health technology assessment

It is acknowledged that health technology assessment (HTA) is an inherently value-based activity that makes use of normative reasoning alongside empirical evidence. But the language used to conceptualise and articulate HTA's normative aspects is demonstrably unnuanced, imprecise, and inconsistently employed, undermining transparency and preventing proper scrutiny of the rationales on which decisions are based. This paper - developed through a cross-disciplinary collaboration of 24 researchers with expertise in healthcare priority-setting - seeks to address this problem by offering a clear definition of key terms and distinguishing between the types of normative commitment invoked during HTA, thus providing a novel conceptual framework for the articulation of reasoning. Through application to a hypothetical case, it is illustrated how this framework can operate as a practical tool through which HTA practitioners and policymakers can enhance the transparency and coherence of their decision-making, while enabling others to hold them more easily to account. The framework is offered as a starting point for further discussion amongst those with a desire to enhance the legitimacy and fairness of HTA by facilitating practical public reasoning, in which decisions are made on behalf of the public, in public view, through a chain of reasoning that withstands ethical scrutiny.

Navigating the unknown: how to best 'reflect' standard of care in indications without a dedicated treatment pathway in health technology assessment submissions

There is an urgent need for expedited approval and access for new health technologies targeting rare and very rare diseases, some of which are associated with high unmet treatment needs. Once a new technology achieves regulatory approval, the technology needs to be assessed by health technology assessment (HTA) bodies to inform coverage and reimbursement decisions. This assessment quantitatively examines the clinical effectiveness, safety and/or economic impact of the new technology relative to standard of care (SoC) in a specific market. However, in rare and very rare diseases, the patient populations are small and there is often no established treatment pathway available to define 'SoC'. In these situations, several challenges arise to assess the added benefit of a new technology - both clinically and economically - due to lack of established SoC to guide an appropriate comparator selection. These challenges include: How should 'SoC' be defined and characterized in HTA submissions for new technologies aiming to establish new treatment standards? What is usual care without an established clinical pathway? How should the evidence for the comparator 'SoC' (i.e., usual care) arm be collected in situations with low patient representation and, sometimes, limited disease-specific clinical knowledge in certain geographies? This commentary outlines the evidence generation challenges in designing clinical comparative effectiveness for a new technology when there is a lack of established SoC. The commentary also proposes considerations to facilitate the reliable integration of real-world evidence into HTA and decision-making based on the collective experience of the authors.

The value and impact of health technology assessment: discussions and recommendations from the 2023 Health Technology Assessment International Global Policy Forum

Health technology assessment (HTA) programs inform decision making about the value and reimbursement of new and existing health technologies; however, they are under increasing pressure to demonstrate that they are a cost-effective use of finite healthcare resources themselves. The 2023 HTAi Global Policy Forum (GPF) discussed the value and impact of HTA, including how it is assessed and communicated, and how it could be enhanced in the future. This article summarizes the discussions held at the 2023 HTAi GPF, where the challenges and opportunities related to the value and impact of HTA were debated. Core themes and recommendations identified that defining the purpose of value and impact assessment is an essential first step prior to undertaking it, and that it can be done through the use and expansion of existing tools. Further work around aligning HTA programs with underlying societal values is needed to ensure the long-term value and impact of HTA. HTA could also have a role in assessing the efficiency of the wider health system by applying HTA methods or concepts to broader budgetary allocations and organizational aspects of health care. Stakeholders (particularly patients, industry, and clinicians but also payers, wider society, and the media) should ideally be actively engaged when undertaking the value and impact assessment of HTA. More concerted efforts in communicating the role and remit of HTA bodies would also help stakeholders to better understand the value and impact of HTA, which in turn could improve the implementation of HTA recommendations and application to future actions in the lifecycle of technologies.

Mapping the characteristics, concepts and methodologies of matching-adjusted indirect comparison studies assessing pharmacological therapies in oncology: a scoping review protocol

INTRODUCTION

Matching-adjusted indirect comparison (MAIC) studies are a subtype of indirect comparison, which uses propensity score weighting to enhance comparability. This method adjusts aggregated data based on covariables from individual patient data from studies to produce population-adjusted indirect comparisons. Some national Health Technology Assessment agencies have recently received submissions containing MAIC models. However, there can be a lack of confidence in its estimates when they are poorly reported and inconsistent with other techniques. The objective of this study is to map the characteristics, concepts and methodology of MAIC studies used for pharmacological therapies in the field of oncology.

METHODS AND ANALYSIS

A scoping review methodology will be applied following the Joanna Briggs Institute framework and the results will be reported according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses Extension for Scoping Reviews. Studies that used MAIC to compare treatments in oncology conditions will be considered eligible. A systematic search will be conducted in PubMed, Embase and the Cochrane Library. No restriction of location or language will be applied. Study screening will be documented and presented in a Preferred Reporting Items for Systematic reviews and Meta-Analyses flow diagram. Data will be extracted and recorded on a predefined data form and will be presented in a tabular form accompanied by a descriptive summary.

ETHICS AND DISSEMINATION

No ethical approval is required for this study. The results of this scoping review will be disseminated through peer-reviewed publications.

Synergy between health technology assessments and clinical guidelines for multiple sclerosis

Decision-making for reimbursement and clinical guidelines (CGs) serves different purposes although the decision-criteria and required evidence largely overlap. This study aimed to assess similarities and discrepancies between health technology assessment (HTA) reports as compared to CGs for multiple sclerosis (MS) medicines. All HTA reports and corresponding CGs for MS from the UK, France, Germany, the Netherlands, Poland, Sweden, and the European Union were assessed to identify synergies in recommendations for MS medicines (approved 1995-2020). A content analysis of HTA reports and CGs was performed to identify similarities and discrepancies in wording of treatment recommendations across documents. We assessed 132 HTA reports and 9 CGs for 16 MS treatments. Final recommendations for reimbursement and inclusion in CGs were mostly similar (90%), albeit with considerable differences in treatment lines and subindications. Since 2010, HTA reports refer to the use of CGs in 42% (55/132) and to consultations with clinicians in 43% (57/132) of cases. Six of nine CGs referred to HTA reports and two referred to HTA consultations, in one case having a formal relation to the HTA organization. CGs referenced pharmacoeconomic studies (4/9) for costs and cost-effectiveness. To date, not all new HTA recommendations for MS treatments are included in CGs. Some synergy exists between treatment recommendations in HTA reports and CGs, although discrepancies were seen in timelines and in recommended treatment lines and subindications. More stakeholder dialogue and/or consultation of each other's publications may further improve synergy, facilitate transparency, and enhance patient access.

Health technology assessment 2025 and beyond: lifecycle approaches to promote engagement and efficiency in health technology assessment

Lifecycle considerations have always been part of health technology assessment (HTA). However, the concept of taking a fuller, more holistic "lifecycle approach" is gaining interest in the HTA community. The 2022 HTAi Global Policy Forum (GPF) discussed how adopting a lifecycle approach could promote stakeholder engagement and robust evidence generation, and whether it could enhance information sharing and transparency across stakeholder groups. This article summarizes the discussions held at the 2022 HTAi GPF and subsequent HTAi Annual Meeting panel session that debated some of the key challenges and opportunities, with particular focus on the pre- and postmarket and disinvestment phase activities. Core themes and recommendations identified that collaboration and patient involvement are happening but still needs to be strengthened, and moving to disease-based approaches may help, although individual contexts still need to be considered. Appropriately developed and mandated core outcome sets may help with information sharing and efficiency in all lifecycle activities. Further, methods for the appropriate use of big data and digital data collection should be developed and driven by the HTA community. The value of lifecycle activities should be reviewed; in particular, scientific advice appears valuable, but the magnitude of effect is somewhat unknown due to the challenges around the confidential nature of these activities. Not all lifecycle activities can be conducted for every technology, and while there is a move away from disinvestment phase activities, more structured prioritization criteria are required. This article ends with suggested next steps to bring forward some of the priority recommendations.

Considerations for transferability of health technology assessments: a scoping review of tools, methods, and practices

Health technology assessment (HTA) is commonly used to guide evidence-informed decisions to optimize resource use, prioritize policies, and support countries to achieve universal health coverage. Producing HTAs requires time, scientific expertise, and political commitment, but these are not available in all settings - especially in low- and middle-income countries (LMIC) where HTA processes may be less institutionalized. Transferring and adapting existing HTAs to local settings may offer a solution while reducing duplication efforts. This scoping review aims to provide an overview of tools, methods, approaches, and considerations which can aid HTA transfers. We systematically searched (from 2005 to 2020) six databases and, using predefined inclusion criteria, included twenty-two studies. Data extraction followed a structured process, while synthesis was more iterative. We identified a common approach for HTA transfers. It follows the de novo process of undertaking original HTAs, but with additional steps to assess relevance (applicability), quality, and transferability, as well as steps to adapt parameters where necessary. The EUnetHTA Adaptation Toolkit was the only tool that provided guidance for adapting multiple HTA domains. Other tools were specific to systematic reviews (n = 1) or economic evaluations (n = 12), where one provided guidance for systematic reviews of economic evaluations. Eight papers reported transferring an HTA, with only one transferring to an LMIC. Finally, we reported issues that may facilitate or hinder transferability. In conclusion, we identified fourteen transfer approaches in the form of guidance or checklists, but harmonized and pragmatic guidance for HTA transfers to suit settings with limited HTA capacity seems warranted.

Value assessment of medicinal products by the Italian Medicines Agency (AIFA) and French National Authority for Health (HAS): Similarities and discrepancies

The evaluation of pharmaceutical innovation and therapeutic value is an increasingly complex exercise for which different approaches are adopted at the national level, despite the need for standardisation of processes and harmonisation of public health decisions. The objective of our analysis was to compare the approaches of the AIFA (Agenzia Italiana del Farmaco) and the HAS (Haute Autorité de Santé) in assessing the same medicinal products. In Italy, the 1525/2017 AIFA Deliberation introduces a transparent scheme for the evaluation of innovative status (innovative, conditional, not innovative) based on the therapeutic added value (TAV), therapeutic need, and quality of evidence. In contrast, in France, the HAS makes judgements using the effective clinical benefit (Service Médical Rendu) and improvement of effective clinical benefit (Amélioration du Service Médical Rendu, ASMR). This analysis focused on medicinal products evaluated both by the AIFA and by the HAS from July 2017 to September 2021. Similarities between AIFA and HAS evaluations were investigated in terms of the TAV, recognition of innovativeness, and the ASMR. Both total and partial agreements were considered relevant. Therefore, raw agreement, Cohen's kappa (weighted and unweighted), and Bangdiwala's B-statistic were estimated. A total of 102 medicinal products were included in this study. Out of these, 38 (37.2%) were orphan drugs, while 56 (54.9%) had a clinical indication for the treatment of cancer. The AIFA and HAS reached a higher level of agreement on the innovativeness status compared with the TAV. A moderate total agreement emerged in the recognition of innovativeness (k = 0.463, p-value ≤0.0001), and partial agreement was substantial (equal weight k = 0.547, squared k = 0.638), while a lack of agreement resulted in a comparison of the TAV according to the AIFA and the ASMR recognised by the HAS. Indeed, whereas the AIFA determined the TAV to be important, the HAS considered it to be moderate. In addition, whereas the AIFA identified a bias towards a moderate TAV, the HAS identified a bias towards a minor ASMR. A higher level of agreement was reached, both on the TAV and on innovative status, for less critical medical products (non-cancer-related, or non-orphan, or with a standard European Medicines Agency approval). These results underline the importance of implementing European procedures that are more broadly aligned in terms of value definition criteria.