How can a joint European health technology assessment provide an 'additional benefit' over the current standard of national assessments? : Insights generated from a multi-stakeholder survey in hematology/oncology

Transportability of model-based estimands in evidence synthesis

In evidence synthesis, effect modifiers are typically described as variables that induce treatment effect heterogeneity at the individual level, through treatment-covariate interactions in an outcome model parametrized at such level. As such, effect modification is defined with respect to a conditional measure, but marginal effect estimates are required for population-level decisions in health technology assessment. For noncollapsible measures, purely prognostic variables that are not determinants of treatment response at the individual level may modify marginal effects, even where there is individual-level treatment effect homogeneity. With heterogeneity, marginal effects for measures that are not directly collapsible cannot be expressed in terms of marginal covariate moments, and generally depend on the joint distribution of conditional effect measure modifiers and purely prognostic variables. There are implications for recommended practices in evidence synthesis. Unadjusted anchored indirect comparisons can be biased in the absence of individual-level treatment effect heterogeneity, or when marginal covariate moments are balanced across studies. Covariate adjustment may be necessary to account for cross-study imbalances in joint covariate distributions involving purely prognostic variables. In the absence of individual patient data for the target, covariate adjustment approaches are inherently limited in their ability to remove bias for measures that are not directly collapsible. Directly collapsible measures would facilitate the transportability of marginal effects between studies by: (1) reducing dependence on model-based covariate adjustment where there is individual-level treatment effect homogeneity or marginal covariate moments are balanced; and (2) facilitating the selection of baseline covariates for adjustment where there is individual-level treatment effect heterogeneity.

Broad versus narrow research questions in evidence synthesis: A parallel to (and plea for) estimands

There has been a transition from broad to more specific research questions in the practice of network meta-analysis (NMA). Such convergence is also taking place in the context of individual registrational trials, following the recent introduction of the estimand framework, which is impacting the design, data collection strategy, analysis and interpretation of clinical trials. The language of estimands has much to offer to NMA, particularly given the "narrow" perspective of treatments and target populations taken in health technology assessment.

The Role of Medical Societies and the Relevance of Clinical Perspective in the Evolving EU HTA Process: Insights Generated at the 2023 Fall Convention and Survey of the European Access Academy

BACKGROUND

This work aimed to determine the role and action points for the involvement of medical societies in the European Health Technology Assessment (EU HTA) Methods: An online pre-convention survey was developed addressing four areas related to the EU HTA: (i) medical societies' role; (ii) role of clinical guidelines; (iii) interface with the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS); and (iv) approaching 'best-available evidence' (BAE). A descriptive analysis of questionnaire outcomes was conducted to inform the European Access Academy (EAA) Fall Convention 2023. Within the working groups (WGs), action points were identified and prioritised.

RESULTS

A total of 57 experts from 15 countries responded to the survey. The WGs were attended by (i) 11, (ii) 10, (iii) 12, and (iv) 12 experts, respectively, representing a variety of national backgrounds and stakeholder profiles. The most relevant action points identified were as follows: (i) incorporation of clinical context into population, intervention, comparator, outcomes (PICO) schemes, (ii) timely provision of up-to-date therapeutic guidelines, (iii) ensuring the inclusion of MCBS insights into the EU HTA process, and (iv) considering randomized controlled trials (RCTs) as the gold standard and leveraging regulatory insights if development programs only include single-arm trials.

CONCLUSIONS

The involvement of medical societies is a critical success factor for the EU HTA. The identified key action points foster the involvement of patient associations and medical societies.

Opportunities and Challenges in Cross-Country Collaboration: Insights from the Beneluxa Initiative

National pricing and reimbursement agencies face growing challenges with complex health technologies, prompting European policy advancements. Beneluxa is a cross-country collaboration involving Belgium, the Netherlands, Luxemburg, Austria, and Ireland that aims to address sustainable access to medicines. In view of the soon-to-be-implemented EU HTA Regulation, insights and experiences from stakeholders with Beneluxa cross-country collaboration could provide possible transferable learnings. Therefore, this research aims to (i) identify the opportunities and challenges faced by Beneluxa, (ii) gather insights from stakeholders, namely (possible) applicants and policymakers, within and beyond Beneluxa on the initiative and broader cross-country collaboration principles, and (iii) transfer these insights into learnings and recommendations in anticipation of the full implementation of the new HTA Regulation. Fifteen semi-structured interviews were conducted with industry and European HTA/policy stakeholders. The principal challenges discussed by stakeholders encompass hesitancy from the industry toward Beneluxa assessments, which were attributed to procedural and timeline uncertainties, legislative framework ambiguity, and challenges in terms of industry's internal organization. Another challenge highlighted is the resource-intensive nature of the procedure due to diverse approaches among member states. In addition, industry stakeholders mentioned limited communication and procedural complexity. Despite challenges, both stakeholder groups recognized important opportunities for cross-country collaboration. Transferable insights for future cross-country collaboration include transparent communication, clear legislative embedding, internal industry restructuring to facilitate joint HTAs, and member state support for conducting collaborative assessments. The study underscores diverging views among stakeholders on cross-country collaboration's potential to support HTA and the market access of complex health technologies. While acknowledging benefits, there still are challenges, including industry hesitancy, emphasizing the need for transparent communication and clear guidance in the evolving EU HTA landscape.

Navigating the path towards successful implementation of the EU HTA Regulation: key takeaways from the 2023 Spring Convention of the European Access Academy

BACKGROUND

The European Regulation on Health Technology Assessment (EU HTA R), effective since January 2022, aims to harmonize and improve the efficiency of common HTA across Member States (MS), with a phased implementation from January 2025. At "midterms" of the preparation phase for the implementation of the Regulation our aim was to identify and prioritize tangible action points to move forward.

METHODS

During the 2023 Spring Convention of the European Access Academy (EAA), participants from different nationalities and stakeholder backgrounds discussed readiness and remaining challenges for the Regulation's implementation and identified and prioritized action points. For this purpose, participants were assigned to four working groups: (i) Health Policy Challenges, (ii) Stakeholder Readiness, (iii) Approach to Uncertainty and (iv) Challenges regarding Methodology. Top four action points for each working group were identified and subsequently ranked by all participants during the final plenary session.

RESULTS

Overall "readiness" for the Regulation was perceived as neutral. Prioritized action points included the following: Health Policy, i.e. assess adjustability of MS laws and health policy processes; Stakeholders, i.e. capacity building; Uncertainty, i.e. implement HTA guidelines as living documents; Methodology, i.e. clarify the Population, Intervention, Comparator(s), Outcomes (PICO) identification process.

CONCLUSIONS

At "midterms" of the preparation phase, the focus for the months to come is on executing the tangible action points identified at EAA's Spring Convention. All action points centre around three overarching themes: harmonization and standardization, capacity building and collaboration, uncertainty management and robust data. These themes will ultimately determine the success of the EU HTA R in the long run.

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review

BACKGROUND

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking.

OBJECTIVE

This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices.

METHODS

We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites.

RESULTS

A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation).

CONCLUSIONS

The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Implementing the EU HTA regulation: Insights from semi-structured interviews on patient expectations, Belgian and European institutional perspectives, and industry outlooks

Introduction: The goal of the Health Technology Assessment (HTA) Regulation 2021/2282 is to establish a more harmonized HTA framework, fostering member states cooperation and enabling equal patient access to innovative health technologies in Europe. This research aimed to assess the impact of the regulation on national HTAs, the strategic implications for health technology developers, and its influence on price and reimbursement negotiations. Methods: A scoping literature review encompassing peer-reviewed literature as well as grey literature was conducted. Between February and March 2023, semi-structured interviews (n = 20) were performed with stakeholders from Belgian governmental institutions, European institutions, advanced therapy medicinal product developers, academics, and sickness funds. The interviews were analyzed using the framework analysis method. Results: Numerous steps, such as the development of implementing acts and procedural guidelines remain to be taken. At member state level, national/regional HTA bodies and payers must act to adopt the new concepts of Joint Scientific Consultations (JSC) and Joint Clinical Assessments (JCA) within their national legislation, as well as revise their timelines and prepare for interactions at a European level. Compiling a harmonized PICO (Population, Intervention, Comparator, and Outcome), adapting local procedures, and increasing capacity to actively take part in the JSC and JCA are seen as primary barriers by several stakeholders. Training and education will help HTA bodies, payers, and health technology developers to participate in the European processes. Conclusion: While practical and legal challenges were identified, recommendations (such as actively preparing for the upcoming changes and increasing capacity while providing training) were provided to adapt national and European procedures to the needs of the HTA Regulation 2021/2282. The importance of fostering collaborations and aligning local HTA procedures with the new way of working set out by the Regulation was demonstrated with this study.

Impact of Systemic Delays for Patient Access to Oncology Drugs on Clinical, Economic, and Quality of Life Outcomes in Canada: A Call to Action

Canada has one of the most complex and rigorous drug approval and public reimbursement processes and is, unfortunately, one of the countries with the longest delays in drug access. To assess the overall impact of systemic delays in access to cancer therapy, a targeted literature review (TLR) was performed to identify studies associated with the clinical, economic, and quality of life impacts of delayed access to oncology drugs. Using MEDLINE/PubMed databases and snowballing, four unique records met the eligibility criteria. Results revealed that clinical outcomes were the most impacted by systemic delays in access to oncology drugs (e.g., life years lost, overall survival, and progression-free survival). The four articles retrieved by the TLR specifically illustrated that a substantial number of life years could potentially be saved by increasing systemic efficiency regarding the development, approval, and reimbursement processes of new drugs for advanced malignancies. It is imperative that initiatives are put in place to improve the performance and speed of Canadian drug regulatory and health technology assessment (HTA) processes, especially for new cancer therapeutics. The proposed solutions in this paper include better coordination between HTA and Canadian payers to harmonize coverage decisions, international collaborations, information sharing, and national standards for timeliness in oncology drug access.

Pricing and reimbursement mechanisms for advanced therapy medicinal products in 20 countries

Introduction: Advanced Therapy Medicinal Products are a type of therapies that, in some cases, hold great potential for patients without an effective current therapeutic approach but they also present multiple challenges to payers. While there are many theoretical papers on pricing and reimbursement (P&R) options, original empirical research is very scarce. This paper aims to provide a comprehensive international review of regulatory and P&R decisions taken for all ATMPs with centralized European marketing authorization in March 2022. Methods: A survey was distributed in July 2022 to representatives of 46 countries. Results: Responses were received from 20 countries out of 46 (43.5%). 14 countries reimbursed at least one ATMP. Six countries in this survey reimbursed no ATMPs. Conclusion: Access to ATMPs is uneven across the countries included in this study. This arises from regulatory differences, commercial decisions by marketing authorization holders, and the divergent assessment processes and criteria applied by payers. Moving towards greater equality of access will require cooperation between countries and stakeholders, for example, through the WHO Regional Office for Europe's Access to Novel Medicines Platform.

Reimbursement decision-making system in Poland systematically compared to other countries

Introduction: Our objective was to analyze and compare systematically and structurally reimbursement systems in Poland and other countries. Methods: The systems were selected based on recommendations issued by the Polish Agency for Health Technology Assessment and Tariffication (AHTAPol), which explicitly referred to other countries and agencies). Consequently, apart from Poland, the countries included in the analysis were England, Scotland, Wales, Ireland, France, Netherlands, Germany, Norway, Sweden, Canada, Australia and New Zealand. Relevant information and data were collected through a systematic search of PubMed (Medline), Embase and The Cochrane Library as well as competent authority websites and grey literature sources. Results and discussion: In most of the countries, the submission of a reimbursement application is initiated by a pharmaceutical company, and only a few countries allow it before a product is approved for marketing. All of the agencies analyzed are independent and some have regulatory function of reimbursement decision making body. A key criterion differentiating the various agencies in terms of HTA is the cost-effectiveness threshold. Most of the countries have specific mechanisms to improve access to expensive specialty drugs, including cancer drugs and those used for rare diseases. Reimbursement systems often lack consistency in appreciating the same stages, leading to heterogeneous decision-making processes. The analysis of recommendations issued in different countries for the same medicinal product will allow a better understanding of the relations between the reimbursement system, HTA assessment, stakeholders involvement and decision on reimbursement of innovative drugs.

The role of stakeholder involvement in the evolving EU HTA process: Insights generated through the European Access Academy's multi-stakeholder pre-convention questionnaire

Involvement of all relevant stakeholders will be of utmost importance for the success of the developing EU HTA harmonization process. A multi-step procedure was applied to develop a survey across stakeholders/collaborators within the EU HTA framework to assess their current level of involvement, determine their suggested future role, identify challenges to contribution, and highlight efficient ways to fulfilling their role. The 'key' stakeholder groups identified and covered by this research included: patients', clinicians', regulatory, and Health Technology Developer representatives. The survey was circulated to a wide expert audience including all relevant stakeholder groups in order to determine self-perception by the 'key' stakeholders regarding involvement in the HTA process (self-rating), and in a second, slightly modified version of the questionnaire, to determine the perception of 'key' stakeholder involvement by HTA bodies, payers, and policymakers (external rating). Predefined analyses were conducted on the submitted responses. Fifty-four responses were received (patients 9; clinicians: 8; regulators: 4; HTDs 14; HTA bodies: 7; Payers: 5; policymakers 3; others 4). The mean self-perceived involvement score was consistently lower for each of the 'key' stakeholder groups than the respective external ratings. Based on the qualitative insights generated in the survey, a RACI Chart (Responsible/Accountable/Consulted/Informed) was developed for each of the stakeholder groups to determine their roles and involvement in the current EU HTA process. Our findings suggest extensive effort and a distinct research agenda are required to ensure adequate involvement of the key stakeholder groups in the evolving EU HTA process.

The therapeutic value of treatment for multiple sclerosis: analysis of health technology assessments of three European countries

In accordance with European regulation, medicines containing a new active substance to treat neurodegenerative diseases as well as autoimmune and other immune dysfunctions must be approved by the European Medicines Agency (EMA) through the centralized procedure before they can be marketed. However, after EMA approval, each country is responsible for national market access, following the assessment performed by health technology assessment (HTA) bodies with regard to the therapeutic value. This study aims to provide a comparative analysis of HTA recommendations issued by three EU countries (France, Germany, and Italy) for new drugs for multiple sclerosis (MS) following EMA approval. In the reference period, we identified 11 medicines authorized in Europe for MS, including relapsing forms of MS (RMS; n = 4), relapsing-remitting MS (RRMS; n = 6), secondary progressive MS (SPMS; n = 1), and the primary progressive form (PPMS; n = 1). We found no agreement on the therapeutic value (in particular, the "added value" compared to the standard of care) of the selected drugs. Most evaluations resulted in the lowest score ("additional benefit not proven/no clinical improvement"), underlining the need for new molecules with better efficacy and safety profiles for MS, especially for some forms and clinical settings.

Shaping a research agenda to ensure a successful European health technology assessment: insights generated during the inaugural convention of the European access academy

OBJECTIVES

Key challenges for a joint European Health Technology Assessment (HTA) include consolidated approaches towards the choice of adequate comparator(s), selection of endpoints that are relevant to patients with a given disease, dealing with remaining uncertainties as well as transparent and consistent management of related processes. We aimed to further crystallize related core domains within these four areas that warrant further research and scrutiny.

METHODS

Building on the outcomes of a previously conducted questionnaire survey, four key areas, processes, uncertainty, comparator choice and endpoint selection, were identified. At the inaugural convention of the European Access Academy dedicated working groups were established defining and prioritizing core domains for each of the four areas. The working groups consisted of ~ 10 participants each, representing all relevant stakeholder groups (patients/ clinicians/ regulators/ HTA & payers/ academia/ industry). Story books identifying the work assignments were shared in advance. Two leads and one note taker per working group facilitated the process. All rankings were conducted on an ordinal Likert Response Scale scoring from 1 (low priority) to 7 (high priority).

RESULTS

Identified key domains include for processes: i) address (resource-) challenge of multiple PICOs (Patient/ Intervention/ Comparator/ Outcomes), ii) time and capacity challenges, iii) integrating all involved stakeholders, iv) conflicts and aligning between different multi-national stakeholders, v) interaction with health technology developer; for uncertainty: i) early and inclusive collaboration, ii) agreement on feasibility of RCT and acceptance of uncertainty, iii) alignment on closing evidence gaps, iv) capacity gaps; for comparator choice: i) criteria for the choice of comparator in an increasingly fragmented treatment landscape, ii) reasonable number of comparators in PICOs, iii) shape Early Advice so that comparator fulfils both regulatory and HTA needs, iv) acceptability of Indirect Treatment Comparisons (ITC), v) ensure broad stakeholder involvement in comparator selection; for endpoint selection: i) approaching new endpoints; ii) patient preferences on endpoints; iii) position of HTA and other stakeholders; iv) long-term generation and secondary use of data; v) endpoint challenges in RCTs.

CONCLUSIONS

The implementation of a joint European HTA assessment is a unique opportunity for a stronger European Health Union. We identified 19 domains related to the four key areas, processes, uncertainty, comparator choice and endpoint selection that urgently need to be addressed for this regulation to become a success.

Implications of Oncology Trial Design and Uncertainties in Efficacy-Safety Data on Health Technology Assessments

Background: Advances in cancer medicines have resulted in tangible health impacts, but the magnitude of benefits of approved cancer medicines could vary greatly. Health Technology Assessment (HTA) is a multidisciplinary process used to inform resource allocation through a systematic value assessment of health technology. This paper reviews the challenges in conducting HTA for cancer medicines arising from oncology trial designs and uncertainties of safety-efficacy data. Methods: Multiple databases (PubMed, Scopus and Google Scholar) and grey literature (public health agencies and governmental reports) were searched to inform this policy narrative review. Results: A lack of robust efficacy-safety data from clinical trials and other relevant sources of evidence has made HTA for cancer medicines challenging. The approval of cancer medicines through expedited pathways has increased in recent years, in which surrogate endpoints or biomarkers for patient selection have been widely used. Using these surrogate endpoints has created uncertainties in translating surrogate measures into patient-centric clinically (survival and quality of life) and economically (cost-effectiveness and budget impact) meaningful outcomes, with potential effects on diverting scarce health resources to low-value or detrimental interventions. Potential solutions include policy harmonization between regulatory and HTA authorities, commitment to generating robust post-marketing efficacy-safety data, managing uncertainties through risk-sharing agreements, and using value frameworks. Conclusion: A lack of robust efficacy-safety data is a central problem for conducting HTA of cancer medicines, potentially resulting in misinformed resource allocation.