Stakeholders involvement by HTA Organisations: Why is so different?

Public value judgments about the criteria for reimbursement of medicines in South Korea

OBJECTIVES

This study quantified the public value (PV) of the criteria and sub-criteria in the current drug reimbursement systems in South Korea and examined sociodemographic factors that associated with PV.

METHODS

The Analytic Hierarchy Process (AHP) was used to quantify the PVs of criteria and sub-criteria. We developed a questionnaire to generate pairwise comparison matrices among criteria and sub-criteria. From 27 March to 1 April 2023, we recruited 1,000 study participants using a quota sampling method stratified by age, sex, and region based on Korean census data.

RESULTS

The PVs for the criteria were highest for clinical usefulness (28.5%), followed by cost-effectiveness (27.1%), budget impact (24.3%), and reimbursement in other countries (20.1%). The sociodemographic characteristics of the participants had a significant impact on the PVs of the criteria. Willingness to pay additional premiums for national health insurance was negatively associated with PV for clinical usefulness and cost-effectiveness and positively associated with PV for reimbursement in other countries.

CONCLUSIONS

The public prioritized clinical usefulness and cost-effectiveness as the main criteria. However, the PVs of the criteria were divergent and associated with sociodemographic factors. Divergent public interests require an evidence-informed deliberative process for reimbursement decisions.

Stakeholders' Involvement in Health Technology Assessment in Kazakhstan, Poland and Bulgaria

Background

In recent years, involvement of healthcare stakeholders in health technology assessment (HTA) has been discussed as helping the inclusion of social values in the decision-making process. The aim of our research was to identify and compare details from Kazakhstan, Poland and Bulgaria on their stakeholders' involvement in the HTA process. Information was sought on their identification, responsibilities, and regulation.

Methods

We conducted a survey of seven types of stakeholders in the healthcare systems of Kazakhstan, Poland, and Bulgaria. They included patients and the public, providers, purchasers, payers, policy makers, product makers, and principal investigators. They were questioned on their involvement in the HTA process, and on the objectives of their participation.

Results

Levels of involvement of different kinds of stakeholder varied between countries, reflecting political and administrative developments. There was full or partial agreement on the objectives of stakeholder participation. All respondents agreed that representatives of the ministry of health should be involved in selection of stakeholders for HTA.

Conclusion

Progress has been made in the involvement of stakeholders, with interest in further development in all three countries.

Involvement of Patients and Medical Professionals in the Assessment of Relative Effectiveness: A Need for Closer Cooperation

OBJECTIVES

Involvement of patients and medical professionals in assessment of relative effectiveness (relative effectiveness assessment) contributes to an efficient and effective health technology assessment (HTA) process and supports acceptance and implementation of the outcome. This study aimed to analyze stakeholder involvement in assessing relative effectiveness and how the parties involved value this collaboration.

METHODS

This is a document analysis of all drug assessments completed in 2019 (20) by the public HTA agency of The Netherlands, enriched with semistructured interviews with employees of the HTA agency (18) and representatives of patient (5) and medical (11) associations involved in these assessments. Data were analyzed, coded, and categorized.

RESULTS

In almost half of the assessments, there was no coordination with the medical associations at the start of the relative effectiveness assessment and no patient associations involved in this phase. During the assessment procedure, patient and medical associations were always asked to comment on the draft report. Nevertheless, the strict 5-day deadline that the HTA agency uses as a response period often hampered a proper response and involvement. According to interviewees of the HTA agency, this leads to a great diversity in the substantive quality of their input. Patient and medical associations indicated that the HTA agency relies too much on "paper knowledge," which leads to a (perceived) lack of alignment with clinical practice.

CONCLUSIONS

The limited involvement results in a lack of coordination and mutual trust. Optimizing involvement of patients and medical professionals in HTA practice requires effort from all parties involved. Procedural adjustments and better coordination, especially at the start of the assessment, would probably improve cooperation.

Potential Barriers of Patient Involvement in Health Technology Assessment in Central and Eastern European Countries

Patients' perspectives are important to identify preferences, estimate values and appreciate unmet medical needs in the process of research and development and subsequent assessment of new health technologies. Patient and public involvement in health technology assessment (HTA) is essential in understanding and assessing wider implications of coverage and reimbursement decisions for patients, their relatives, caregivers, and the general population. There are two approaches to incorporating the patients' voice in HTA, preferably used in a mix. In the first one, patients, caregivers and/or their representatives directly participate at discussions in different stages of the HTA process, often at the same table with other stakeholders. Secondly, patient involvement activities can be supported by evidence on patient value and experience collected directly from patients, caregivers and/or their representatives often by patient groups Patient involvement practices, however, are limited in Central and Eastern European (CEE) countries without clear methodology or regulatory mechanisms to guide patient involvement in the HTA process. This poses the question of transferability of practices used in other countries, and might call for the development of new CEE-specific guidelines and methods. In this study we aim to map potential barriers of patient involvement in HTA in countries of the CEE region.

The Emerging Social Science Literature on Health Technology Assessment: A Narrative Review

BACKGROUND

Social scientists have paid increasing attention to health technology assessment (HTA). This paper provides an overview of existing social scientific literature on HTA, with a focus on sociology and political science and their subfields.

METHODS

Narrative review of key pieces in English.

RESULTS

Three broad themes recur in the emerging social science literature on HTA: the drivers of the establishment and concrete institutional designs of HTA bodies; the effects of institutionalized HTA on pricing and reimbursement systems and the broader society; and the social and political influences on HTA decisions.

CONCLUSION

Social scientists bring a focus on institutions and social actors involved in HTA, using primarily small-N research designs and qualitative methods. They provide valuable critical perspectives on HTA, at times challenging its otherwise unquestioned assumptions. However, they often leave aside questions important to the HTA practitioner community, including the role of culture and values. Closer collaboration could be beneficial to tackle new relevant questions pertaining to HTA.

Shedding light on the HTA consultancy market: Insights from Poland

Research on health technology assessment (HTA) from a policy perspective typically examines public HTA bodies, with little attention devoted to how manufacturers develop their evidence submissions. Taking Poland as a crucial case, we explored the market of HTA consultancy firms which assist drug manufacturers in developing these submissions, called HTA reports. We reviewed 318 HTA reports from 2012 to 2015, data from the Polish National Company Registry, the content of HTA consulting firms' websites, and appraisal reports developed by the Polish HTA body. We identified HTA consultancy firms which developed 96-98% HTA reports. We found that the transparency of information about the authors of HTA reports provided by the HTA body had improved between 2012 and 2015. Six companies with market shares from 10 to 30% dominated the market. The market size was estimated to be 5-6 million EUR annually. HTA consultancies had a broad service portfolio related to preparation of HTA reports. Over 90% of HTA reports did not meet the official minimum quality requirements, and only half of the resubmissions took into account remarks made by the HTA body. Our study provides insights into the structure, evolution and role of the for-profit HTA consultancy market as a crucial part of the public HTA system. This raises important policy points about transparency and regulation at the intersection of public and private sectors in HTA.

Envisioning and shaping translation of knowledge into action: A comparative case-study of stakeholder engagement in the development of a European tobacco control tool

Stakeholder engagement in health policy research is often said to increase 'research impact', but the active role of stakeholders in creating impact remains underexplored. We explored how stakeholders shaped the translation of health policy research into action. Our comparative case-study tracked a European research project that aimed to transfer an existing tobacco control return on investment tool. That project also aimed to increase its impact by engaging with stakeholders in further developing the tool. We conducted semi-structured interviews, using an actor-scenario mapping approach. Actor-scenarios can be seen as relational descriptions of a future world. We mapped the scenarios by asking stakeholders to describe who and what would play a role in the tool's utilisation. Our results show that stakeholders envisioned disparate futures for the tool. Some scenarios were specific, whereas most were generic projections of abstract potential users and responsibilities. We show how stakeholders mobilised elements of context, such as legislative support and agricultural practice, that would affect the tool's use. We conclude that stakeholders shape knowledge translation processes by continuously putting forth explicit or implicit scenarios about the future. Mapping actor-scenarios may help in aligning knowledge production with utilisation. Insights into potential roles and responsibilities could be fed back in research projects with the aim of increasing the likelihood that the study results may be used.

New model for prioritised adoption and use of hospital medicine in Denmark since 2017: Challenges and perspectives

Technological innovation creates new treatment opportunities, while also putting healthcare budgets under strain. To deal with the rising costs of hospital medicines, the regional governments in Denmark have developed a new model for prioritising the adoption and use of hospital medicine. Marking a shift from previous policies, the new model formalises the evaluation of clinical benefit, adds an assessment of treatment costs and ensures a relatively high degree of direct stakeholder involvement. In international comparison, the new model is ambitious in terms of stakeholder involvement and adherence with principles advocated to ensure procedural justice and fair decision-making processes. However, these procedural innovations have also created new challenges. Notably, the newly formed assessment body, the Danish Medicines Council, is faced with a very high caseload and limited options to prioritise the use of its analytical resources.

Sharing Frailty-related information in perioperative care: an analysis from a temporal perspective

BACKGROUND

Especially patients older than 65 years undergoing surgery are prone to develop frailty-related complications that may go far beyond the index hospitalization (e.g., cognitive impairment following postoperative delirium). However, aging-relevant information are currently not fully integrated into hospitals' perioperative processes.

METHODS

We introduce a temporal perspective, which focuses on the social construction of time, to better understand existing barriers to the exchange of frailty-related data, targeting complexity research. Our chosen context is perioperative care provided by a tertiary hospital in Germany that has implemented a special track for patients over 65 years old undergoing elective surgery. The research followed a participatory modelling approach between domain and modelling experts with the goal of creating a feedback loop model of the relevant system relationships and dynamics.

RESULTS

The results of the study show how disparate temporal regimes, understood as frameworks for organizing actions in the light of time constraints, time pressure, and deadlines, across different clinical, ambulant, and geriatric care sectors create disincentives to cooperate in frailty-related data exchanges. Moreover, we find that shifting baselines, meaning continuous increases in cost and time pressure in individual sectors, may unintentionally reinforce - rather than discourage - disparate temporal regimes.

CONCLUSIONS

Together, these results may (1) help to increase awareness of the importance of frailty-related data exchanges, and (2) impel efforts aiming to transform treatment processes to go beyond sectoral boundaries, taking into account the potential benefits for frail patients arising from integrated care processes using information technology.

Value assessment of disease-modifying therapies for Relapsing-Remitting Multiple Sclerosis: HTA evidence from seven OECD countries

This study systematically compares HTA recommendations on a number of disease-modifying therapies for patients with Relapsing-Remitting Multiple Sclerosis. We analysed publicly available HTA reports for nine medicine-indication pairs across seven OECD countries using a methodological framework enabling systematic analysis of HTA recommendations. The analysis was conducted based on a number of value dimensions, including clinical and economic variables, as well as several other dimensions of value beyond cost-effectiveness. The material was qualitatively and quantitatively coded following the different stages of HTA decision-making process. Fifty-seven medicine-indication pairs were assessed across the study countries. Of those, eight medicine indication-pairs reported diverging HTA recommendations. Although HTA recommendations were based on the same evidence submitted in most cases, significant variations were identified in interpretation and acceptance of evidence resulting in different uncertainties raised and different ways of addressing them. Uncertainties arose both in terms of the clinical and the economic evidence, including the design of key trials or the data quality in economic models. Beyond costs and effects, additional dimensions of value had an impact in the direction of recommendations, however with different magnitude across countries. We show that there is heterogeneity across countries in HTA for evaluating DMTs for RRMS with a lack of standardised methods in evaluating clinical and economic evidence and the use of social value judgments to inform decision-making.

Patient and Public Involvement in the Development of Healthcare Guidance: An Overview of Current Methods and Future Challenges

Clinical guidelines and health technology assessments are valuable instruments to improve the quality of healthcare delivery and aim to integrate the best available evidence with real-world, expert context. The role of patient and public involvement in their development has grown in recent decades, and this article considers the international literature exploring aspects of this participation, including the integration of experiential and scientific knowledge, recruitment strategies, models of involvement, stages of involvement, and methods of evaluation. These developments have been underpinned by the parallel rise of public involvement and evidence-based medicine as important concepts in health policy. Improving the recruitment of guideline group chairs, widening evidence reviews to include patient preference studies, adapting guidance presentation to highlight patient preference points and providing clearer instructions on how patient organisations can submit their intelligence are emerging proposals that may further enhance patient and public involvement in their processes.

INDUSTRY'S EXPERIENCES WITH THE SCIENTIFIC ADVICE OFFERED BY THE FEDERAL JOINT COMMITTEE WITHIN THE EARLY BENEFIT ASSESSMENT OF PHARMACEUTICALS IN GERMANY

OBJECTIVES

Optional scientific advice (SA) for the early benefit assessment of pharmaceuticals is offered by the German decision maker, the Federal Joint Committee (FJC). The aim of this study was to elicit manufacturers' experiences with the SA procedures offered by the FJC to date.

METHODS

A preliminary survey on a small sample size was conducted. Subsequently, a questionnaire comprising eight items, which was developed on the basis of that survey, was used. Data were analyzed using qualitative and quantitative approaches.

RESULTS

The elicitation, including a sample of 25 percent of the completed advice, highlighted the following, regarding the process as well as to the content shortcomings of the SA procedures from an industrial perspective: inconsistencies, FJC's lack of expertise in conducting clinical trials, partially incomplete answers. and a low willingness of the FJC to engage in dialogue with industry were criticized. On the other hand, the majority of respondents expressed a positive attitude concerning unambiguousness, completeness, traceability, discussion atmosphere, and the protocol of the advice. Early SA, before pivotal trials start, showed a significantly higher completeness compared with late SA with respect to endpoints and study duration. Within 4 years the quality of FJC's propositions on some topics improved significantly.

CONCLUSIONS

Only a few statistically significant differences were detectable between early versus late SA. A positive trend in industry's perception of the SA can be observed over time. A more active involvement of additional stakeholders and the incorporation of procedural elements from other healthcare systems could improve the quality of the SA offered by the FJC.

STAKEHOLDER INVOLVEMENT THROUGHOUT HEALTH TECHNOLOGY ASSESSMENT: AN EXAMPLE FROM PALLIATIVE CARE

Objectives: Internationally, funders require stakeholder involvement throughout health technology assessment (HTA). We report successes, challenges, and lessons learned from extensive stakeholder involvement throughout a palliative care case study that demonstrates new concepts and methods for HTA.

Methods: A 5-step “INTEGRATE-HTA Model” developed within the INTEGRATE-HTA project guided the case study. Using convenience or purposive sampling or directly / indirectly identifying and approaching individuals / groups, stakeholders participated in qualitative research or consultation meetings. During scoping, 132 stakeholders, aged ≥ 18 years in seven countries (England, Italy, Germany, The Netherlands, Norway, Lithuania, and Poland), highlighted key issues in palliative care that assisted identification of the intervention and comparator. Subsequently stakeholders in four countries participated in face–face, telephone and / or video Skype meetings to inform evidence collection and / or review assessment results. An applicability assessment to identify contextual and implementation barriers and enablers for the case study findings involved twelve professionals in the three countries. Finally, thirteen stakeholders participated in a mock decision-making meeting in England.

Results: Views about the best methods of stakeholder involvement vary internationally. Stakeholders make valuable contributions in all stages of HTA; assisting decision making about interventions, comparators, research questions; providing evidence and insights into findings, gap analyses and applicability assessments. Key challenges exist regarding inclusivity, time, and resource use.

Conclusion: Stakeholder involvement is feasible and worthwhile throughout HTA, sometimes providing unique insights. Various methods can be used to include stakeholders, although challenges exist. Recognition of stakeholder expertise and further guidance about stakeholder consultation methods is needed.

[A return on investment tool in tobacco control: what do stakeholders think?]

INTRODUCTION

The European EQUIPT study will co-create a return on investment tool in several countries, aiming to provide decision makers with information and justification on the returns that can be generated by investing in tobacco control. This study aimed to identify the needs of potential users in Spain in order to provide information on the transferability of the tool.

METHODS

Telephone interviews with stakeholders were conducted including questions about the implementation of the tool, intended use and tobacco control interventions.

RESULTS

Implementing the tool could provide added value to the information used in decision-making to advocate for cost-effective policies. The main drawback would be the training and time needed to learn how the tool works and for internal calculations.

CONCLUSION

Knowledge and ideas from potential users collected in this study could inform the EQUIPT Tool adaptation. Thus, stakeholders could have an instrument that assists them on making healthcare decisions.

CONSIDERING EQUITY IN HEALTH TECHNOLOGY ASSESSMENT: AN EXPLORATORY ANALYSIS OF AGENCY PRACTICES

Objectives: Equity is one of the founding principles in most healthcare systems. Financial constraints entail an increased risk of exacerbating inequities and a greater need for evidence-based decisions. It is, therefore, both important and timely to enquire how equity can be addressed in health technology assessment (HTA) practice. We aimed to explore related practices from a broad range of HTA agencies, identify exemplary approaches and common concerns, and offer insights for future considerations.

Methods: HTA agencies for which both methodological guides and HTA reports were publicly available were selected from an initial comprehensive pool. Information was extracted on issues ranging from a general commitment to fairness to specific measures targeting both methodological and process-related elements.

Results: Methodological documents and ninety-eight reports from nineteen agencies were analyzed. Our findings indicate that equity was not a standard consideration in HTA report production. The nature of specific approaches and the amount of resources invested into including an equity perspective varied considerably. Specific measures (e.g., appropriate information sources, analytical tools, and schemes) were mentioned by almost half of the agencies analyzed. Albeit sporadic, both horizontal and vertical equity considerations were identified in included HTA reports.

Conclusions: While varying legal contexts and institutional principles can lead to different interpretations of equity at the decision point, a combination of methodological and process-related practices could contribute to more equity-sensitive evaluations, especially in conjunction with enhanced dissemination of existing methodological tools. Networking initiatives on behalf of existing collaborating platforms could play an important role in this direction.

Three worlds of health technology assessment: explaining patterns of diffusion of HTA agencies in Europe

In the past two decades, setting up independent health technology assessment (HTA) agencies has become a popular tool to inform reimbursement decision-making in health care, spreading from Northern European countries across Western Europe but much less so to post-communist countries. Structural political science explanations leave gaps in clarifying this diffusion pattern. This paper proposes a theoretical model focusing on the influence of domestic epistemic communities mitigating policy diffusion. Based on a review of HTA institutions in the EU, it proposes a chronological taxonomy of HTA agencies in Europe (the forerunners, the mainstreamers and the non-adopters) and asks why there is such an important East-West divide. The paper discusses theoretical explanations from different literatures, finding unsatisfactory many traditional political science answers such as the degree of centralization of a country's health system, its financial organization (Bismarckian or Beveridgian), the attitude toward independent regulatory bodies in general, the influence of international actors, or lack of resources. Finally, it suggests cases for empirical testing of the domestic epistemic communities model.

Public engagement in health technology assessment and coverage decisions: a study of experiences in France, Germany, and the United Kingdom

In the United States and internationally, the trend for public engagement in health policy and practice is increasing, particularly regarding health technology assessment (HTA), which informs often controversial coverage decisions. However, there is no consensus about which members of the public should be involved in which processes or what the respective rationales and benefits of public engagement are. This article explores operational processes and underlying rationales of public engagement at HTA agencies in France, Germany, and the United Kingdom. The analysis is based on website information, legal framework documents, published and gray literature, and semistructured, in-depth interviews with top officials at these agencies. Engagement processes differ across agencies, particularly regarding the areas in which the public is involved, which groups of the public are involved, what weight they have in influencing decisions, how they are recruited and supported, and how potential conflicts of interests are addressed. Different emphases on rationales and drivers behind public engagement partly reflect the respective political environments. Interviewees indicated a range of benefits of engagement and factors influencing success or failure. The results highlight the need to be clear about the purpose and conduct of engagement in order to maximize the benefits of this increasingly widespread policy tool.

Diffusion and use of health technology assessment in policy making: what lessons for decentralised healthcare systems?

OBJECTIVE

The Italian National Healthcare System (NHS) is one of the most decentralised systems since the devolution reform approved in 2001. HTA is spreading as an important tool for decision-making processes both at central and local levels. The aims of this study were to review the state of the health technology assessment (HTA) programmes in Italy - with a focus on regional and central initiatives - and to discuss consequences of a multi-level structure of HTA agencies in highly regionalised healthcare systems.

METHODS

Our method combined documentary review with interviews. We reviewed scientific literature about HTA's activities in decentralised systems, legislative and administrative documents from national as well as regional authorities. Semi-structured interviews were conducted with 18 key individuals associated with HTA both at the national and regional levels. Data on HTA programmes implemented or under development in nine regions were collected and analysed according to key principles for the improved conduct of health technology assessments for resource allocation decisions.

RESULTS

HTA is in the early stage of development in Italy, although with great heterogeneity across regions. The National Agency for Health Services has certainly contributed to HTA diffusion through supporting and training activities. However, the multi-level structure of HTA in Italy has not yet provided full coordination and harmonisation of practices and outcomes across the country, with a consequent exacerbate inequality of access to services and technologies.

CONCLUSIONS

There is probably need to rethink the multi-layer organizational framework of HTA in Italy by leveraging on current knowledge and efficient redistribution of activities across regions. We would advise for different jurisdictions playing different roles while achieving similar health outcomes for their patients, rather than jurisdictions aiming at doing exactly the same things resulting in unequal access to healthcare service provision.