Use of Evidence-Informed Deliberative Processes by Health Technology Assessment Agencies Around the Globe

Assessing medical devices: a qualitative study from the validate perspective

OBJECTIVES

Our objective was to explore procedures and methods used at health technology assessment (HTA) agencies for assessing medical devices and the underlying views of HTA practitioners about appropriate methodology to identify challenges in adopting new methodologies for assessing devices. We focused on the role of normative commitments of HTA practitioners in the adoption of new methods.

METHODS

An online survey, including questions on procedures, scoping, and assessments of medical devices, was sent to members of the International Network of Agencies for Health Technology Assessment. Interviews were conducted with survey respondents and HTA practitioners involved in assessments of transcatheter aortic valve implantation to gain an in-depth understanding of choices made and views about assessing medical devices. Survey and interview questions were inspired by the "values in doing assessments of health technologies" approach towards HTA, which states that HTA addresses value-laden questions and information.

RESULTS

The current practice of assessing medical devices at HTA agencies is predominantly based on procedures, methods, and epistemological principles developed for assessments of drugs. Both practical factors (available time, demands of decision-makers, existing legal frameworks, and HTA guidelines), as well as commitments of HTA practitioners to principles of evidence-based medicine, make the adoption of a new methodology difficult.

CONCLUSIONS

There is a broad recognition that assessments of medical devices may need changes in HTA methodology. In order to realize this, the HTA community may require both a discussion on the role, responsibility, and goals of HTA, and resulting changes in institutional context to adopt new methodologies.

Evidence-Informed Oral Health Policy Making: Opportunities and Challenges

Despite a clear need for improvement in oral health systems, progress in oral health systems transformation has been slow. Substantial gaps persist in leveraging evidence and stakeholder values for collective problem solving. To truly enable evidence-informed oral health policy making, substantial "know-how" and "know-do" gaps still need to be overcome. However, there is a unique opportunity for the oral health community to learn and evolve from previous successes and failures in evidence-informed health policy making. As stated by the Global Commission on Evidence to Address Societal Challenges, COVID-19 has created a once-in-a-generation focus on evidence, which has fast-tracked collaboration among decision makers, researchers, and evidence intermediaries. In addition, this has led to a growing recognition of the need to formalize and strengthen evidence-support systems. This article provides an overview of recent advancements in evidence-informed health policy making, including normative goals and a health systems taxonomy, the role of evidence-support and evidence-implementation systems to improve context-specific decision-making processes, the evolution of learning health systems, and the important role of citizen deliberations. The article also highlights opportunities for evidence-informed policy making to drive change in oral health systems. All in all, strengthening capacities for evidence-informed health policy making is critical to enable and enact improvements in oral health systems.

Healthcare priority-setting criteria and social values in Iran: an investigation of local evidence

INTRODUCTION

Integrating social values into health technology assessment processes is an important component of proper healthcare priority setting. This study aims to identify social values related to healthcare priority setting in Iran.

METHOD

A scoping review was conducted on original studies that investigating social values in the healthcare system in Iran. The databases of PubMed, EMBASE, and EBSCO were searched with no restrictions on time and language. The reported criteria were clustered using Sham's framework of social value analysis in health policy.

RESULTS

Twenty-one studies published between 2008 and 2022 met the inclusion criteria. Fourteen of the included studies followed a quantitative approach with different methods to identify criteria, and the remaining seven studies used a qualitative approach. A total of fifty-five criteria were extracted and clustered into necessity, quality, sustainability, and process categories. Only six studies found criteria that were related to processes. Only three studies used public opinions as a source of value identification and eleven studies investigated the weight of criteria. None of the included studies explored the interdependency of the criteria.

CONCLUSION

Evidence suggests that several criteria other than cost per health unit also need to be considered in healthcare priority setting. Previous studies have paid little attention to the social values that underlie priority setting and policy-making processes. To reach consensus on social values related to healthcare priority setting, future researches need to involve broader stakeholders' perspectives as a valuable source of social values in a fair process.

The role of Iran's context for the development of health technology assessment: challenges and solutions

Health technology assessment (HTA) is a comprehensive and structured evaluation that aims to analyze the potential impacts of health technologies, including medical devices, diagnostic tools, pharmaceuticals, and public health interventions. Its purpose is to provide policymakers with evidence-based information to inform decisions related to the utilization and implementation of these technologies. HTA allows for the comparison of various scenarios related to a technology across a wide range of factors. This can aid in the creation of an essential drug list and health benefits package that is tailored to the actual needs of the community within a given healthcare system. In the present paper, we review the role of Iran's context for the development of HTA, in terms of challenges and solutions.

Access to novel drugs and therapeutics for children and youth: Eliciting citizens' values to inform public funding decisions

INTRODUCTION

The unique evidentiary, economic and ethical challenges associated with health technology assessment (HTA) of precision therapies limit access to novel drugs and therapeutics for children and youth, for whom such challenges are amplified. We elicited citizens' perspectives about values-based criteria relevant to the assessment of paediatric precision therapies to inform the development of a child-tailored HTA framework.

METHODS

We held four citizen panels virtually in May-June 2021, informed by a plain-language citizen brief summarizing global and local evidence about the challenges, policy and programmatic options and implementation strategies related to enhancing access to precision therapies for Canadian children and youth. Panellists were recruited through a nationally representative database, medical/patient networks and social media. We inductively coded and thematically analysed panel transcripts to generate themes and identify priority values.

RESULTS

The perspectives of panellists (n = 45) coalesced into four overlapping themes, with attendant subthemes, relevant to a child-tailored HTA framework: (1) Childhood Distinctions: vulnerability, 'fair innings', future potential, family impacts; (2) Voice: agency of children and youth; lived versus no lived experience; (3) One versus Many: disease severity, rarity, equity, unmet need and (4) Health System Governance: funding, implementation inequities, effectiveness and safety. Participants broadly agreed that childhood distinctions, particularly family impacts, justify child-tailored HTA. Dissent arose over whose voice should inform HTA and how such perspectives are best incorporated.

CONCLUSIONS

Citizens can offer unique insights into criteria relevant to the development or revision of HTA frameworks to capture holistic, societally responsive dimensions of value attached to unique contexts or populations, including children. Balancing the hopes and expectations of patients and caregivers for access to expensive but potential life-altering therapies against the opportunity costs borne by encompassing health systems is a fundamental challenge that will require rigorous methods to elicit, weigh and reconcile varied views.

PATIENT OR PUBLIC CONTRIBUTION

A patient advocate served on the steering committee of this study and co-authored this article. Key informants for the Citizen Brief included patient advocates and caregivers; a separate patient advocate reviewed the Brief before dissemination. Qualitative and quantitative data were collected from the general public and caregivers of children, with written consent.

Health technology assessment of diagnostic tests: a state of the art review of methods guidance from international organizations

OBJECTIVES

To identify which international health technology assessment (HTA) agencies are undertaking evaluations of medical tests, summarize commonalities and differences in methodological approach, and highlight examples of good practice.

METHODS

A methodological review incorporating: systematic identification of HTA guidance documents mentioning evaluation of tests; identification of key contributing organizations and abstraction of approaches to all essential HTA steps; summary of similarities and differences between organizations; and identification of important emergent themes which define the current state of the art and frontiers where further development is needed.

RESULTS

Seven key organizations were identified from 216 screened. The main themes were: elucidation of claims of test benefits; attitude to direct and indirect evidence of clinical effectiveness (including evidence linkage); searching; quality assessment; and health economic evaluation. With the exception of dealing with test accuracy data, approaches were largely based on general approaches to HTA with few test-specific modifications. Elucidation of test claims and attitude to direct and indirect evidence are where we identified the biggest dissimilarities in approach.

CONCLUSIONS

There is consensus on some aspects of HTA of tests, such as dealing with test accuracy, and examples of good practice which HTA organizations new to test evaluation can emulate. The focus on test accuracy contrasts with universal acknowledgment that it is not a sufficient evidence base for test evaluation. There are frontiers where methodological development is urgently required, notably integrating direct and indirect evidence and standardizing approaches to evidence linkage.

Toward comprehensive value assessment for Alzheimer's disease innovations

INTRODUCTION

Assessing medical technologies for Alzheimer's disease (AD) creates challenges for current methods of value assessment. New value assessment approaches for AD are also needed.

METHODS

We adapted concepts from health economics to help guide decision makers to more informed decisions about AD therapies and diagnostics.

RESULTS

We propose a value framework based on five categories: perspective, value elements, analysis, reporting, and decision making. AD value assessments should include the perspective of the patient-caregiver dyad. We propose a broader array of value elements than currently used. Analytics and decision methods can synthesize evidence for all elements of value. Decisions should use a "deliberative appraisal" approach informed by the composite evidence and be transparently reported.

DISCUSSION

Using the proposed framework, the value of forthcoming innovations for AD may be more thoroughly assessed for and by all stakeholders. It can guide decision makers to carefully consider all relevant elements of value contributing to more holistic and transparent decision making.

RESEARCH HIGHLIGHTS

Alzheimer's disease challenges common methods of evaluating medical technology. Using current methods, new AD innovations might not be appropriately valued. Poor value assessments will adversely affect patient access to AD innovations. A full AD value framework expands perspective, elements, analysis, decision-making, reporting.

Assessing the potential of HTA to inform resource allocation decisions in low-income settings: The case of Malawi

Health technology assessment (HTA) offers a set of analytical tools to support health systems' decisions about resource allocation. Although there is increasing interest in these tools across the world, including in some middle-income countries, they remain rarely used in low-income countries (LICs). In general, the focus of HTA is narrow, mostly limited to assessments of efficacy and cost-effectiveness. However, the principles of HTA can be used to support a broader series of decisions regarding new health technologies. We examine the potential for this broad use of HTA in LICs, with a focus on Malawi. We develop a framework to classify the main decisions on health technologies within health systems. The framework covers decisions on identifying and prioritizing technologies for detailed assessment, deciding whether to adopt an intervention, assessing alternative investments for implementation and scale-up, and undertaking further research activities. We consider the relevance of the framework to policymakers in Malawi and we use two health technologies as examples to investigate the main barriers and enablers to the use of HTA methods. Although the scarcity of local data, expertise, and other resources could risk limiting the operationalisation of HTA in LICs, we argue that even in highly resource constrained health systems, such as in Malawi, the use of HTA to support a broad range of decisions is feasible and desirable.

Evidence-Informed Deliberative Processes for Legitimate Health Benefit Package Design - Part I: Conceptual Framework

BACKGROUND

Countries around the world are increasingly rethinking the design of their health benefit packages to achieve universal health coverage (UHC). Health technology assessment (HTA) bodies support governments in these decisions, but employ value frameworks that do not sufficiently account for the intrinsically complex and value-laden political reality of benefit package design.

METHODS

Several years ago, evidence-informed deliberative processes (EDPs) were developed to address this issue. An EDP is a practical and stepwise approach for HTA bodies to enhance legitimate health benefit package design based on deliberation between stakeholders to identify, reflect and learn about the meaning and importance of values, and to interpret available evidence on these values. We further developed the conceptual framework and initial 2019 guidance based on academic knowledge exchange, analysing practices of HTA bodies, surveying HTA bodies and experts around the globe, and implementation of EDPs in several countries around the world.

RESULTS

EDPs stem from the general concept of legitimacy, which is translated into four elements - stakeholder involvement ideally operationalised through stakeholder participation with deliberation; evidence-informed evaluation; transparency; and appeal. The 2021 practical guidance distinguishes six practical steps of a HTA process and provides recommendations on how these elements can be implemented in each of these steps.

CONCLUSION

There is an increased attention for legitimacy, deliberative processes for HTA and health benefit package design, but the development of theories and methods for such processes remain behind. The added value of EDPs lies in the operationalisation of the general concept of legitimacy into practical guidance for HTA bodies.

Evidence-Informed Deliberative Processes for Health Benefit Package Design - Part II: A Practical Guide

BACKGROUND

Countries around the world are using health technology assessment (HTA) for health benefit package design. Evidence-informed deliberative processes (EDPs) are a practical and stepwise approach to enhance legitimate health benefit package design based on deliberation between stakeholders to identify, reflect and learn about the meaning and importance of values, informed by evidence on these values. This paper reports on the development of practical guidance on EDPs, while the conceptual framework of EDPs is described in a companion paper.

METHODS

The first guide on EDPs (2019) is further developed based on academic knowledge exchange, surveying 27 HTA bodies and 66 experts around the globe, and the implementation of EDPs in several countries. We present the revised steps of EDPs and how selected HTA bodies (in Australia, Brazil, Canada, France, Germany, Scotland, Thailand and the United Kingdom) organize key issues of legitimacy in their processes. This is based on a review of literature via PubMed and HTA bodies' websites.

RESULTS

HTA bodies around the globe vary considerable in how they address legitimacy (stakeholder involvement ideally through participation with deliberation; evidence-informed evaluation; transparency; and appeal) in their processes. While there is increased attention for improving legitimacy in decision-making processes, we found that the selected HTA bodies are still lacking or just starting to develop activities in this area. We provide recommendations on how HTA bodies can improve on this.

CONCLUSION

The design and implementation of EDPs is in its infancy. We call for a systematic analysis of experiences of a variety of countries, from which general principles on EDPs might subsequently be inferred.

The Use of Evidence-Informed Deliberative Processes for Health Benefit Package Design in Kazakhstan

Kazakhstan strives to obtain Universal Health Coverage (UHC) by using health technology assessment (HTA) for determining their health benefit package. This paper reports on employing evidence-informed deliberative processes (EDPs), a practical and stepwise approach to enhance legitimate health benefit package design in Kazakhstan.

METHODS

The Ministry of Health of Kazakhstan approved the operationalization and application of EDPs during March 2019 and December 2020. We used a combination of desk research, conducting HTA, online surveys as well as a face-to-face workshop in Nur-Sultan, Kazakhstan, and two online workshops to prioritize 25 selected health technologies. During the latter, we tested two alternative approaches to prioritization: quantitative multicriteria decision analysis (MCDA) and the use of decision rules.

RESULTS

For each of the HTA reports, evidence summaries were developed according to the decision criteria (safety, social priority disease, severity of disease, effectiveness, cost-effectiveness, level of evidence, financial risk protection and budget impact). When appraising the evidence, the advisory committee preferred using quantitative MCDA, and only when this would result in any controversy could decision rules be applied.

CONCLUSIONS

Despite several challenges, including a partial disruption because of the COVID-19 pandemic, implementation of the process will likely play a key role in determining an evidence-informed and transparent health benefit package.

Challenges and Opportunities for Deliberative Processes for Healthcare Decision-Making Comment on "Evidence-Informed Deliberative Processes for Health Benefit Package Design - Part II: A Practical Guide"

The second edition of the practical guide for evidence-informed deliberative processes (EDPs) is an important addition to the growing guidance on deliberative processes supporting priority setting in healthcare. While the practical guide draws on an extensive amount of information collected on established and developing processes within a range of countries, EDPs present health technology assessment (HTA) bodies with several challenges. (1) Basing recommendations on current processes that have not been well-evaluated and that have changed over time may lead to weaker legitimacy than desired. (2) The requirement for social learning among stakeholders may require increased resourcing and blur the boundary between moral deliberation and political negotiation. (3) Robust evaluation should be based on an explicit theory of change, and some process outcomes may be poor guides to overall improvement of EDPs. This comment clarifies and reinforces the recommendations provided in the practical guide.

Integrating economic and health evidence to inform Covid-19 policy in low- and middle- income countries

Covid-19 requires policy makers to consider evidence on both population health and economic welfare. Over the last two decades, the field of health economics has developed a range of analytical approaches and contributed to the institutionalisation of processes to employ economic evidence in health policy. We present a discussion outlining how these approaches and processes need to be applied more widely to inform Covid-19 policy; highlighting where they may need to be adapted conceptually and methodologically, and providing examples of work to date. We focus on the evidential and policy needs of low- and middle-income countries; where there is an urgent need for evidence to navigate the policy trade-offs between health and economic well-being posed by the Covid-19 pandemic.

A Conceptual Framework for Life-Cycle Health Technology Assessment

OBJECTIVES

Health technology assessment (HTA) uses evidence appraisal and synthesis with economic evaluation to inform adoption decisions. Standard HTA processes sometimes struggle to (1) support decisions that involve significant uncertainty and (2) encourage continued generation of and adaptation to new evidence. We propose the life-cycle (LC)-HTA framework, addressing these challenges by providing additional tools to decision makers and improving outcomes for all stakeholders.

METHODS

Under the LC-HTA framework, HTA processes align to LC management. LC-HTA introduces changes in HTA methods to minimize analytic time while optimizing decision certainty. Where decision uncertainty exists, we recommend risk-based pricing and research-oriented managed access (ROMA). Contractual procurement agreements define the terms of reassessment and provide additional decision options to HTA agencies. LC-HTA extends value-of-information methods to inform ROMA agreements, leveraging routine, administrative data, and registries to reduce uncertainty.

RESULTS

LC-HTA enables the adoption of high-value high-risk innovations while improving health system sustainability through risk-sharing and reducing uncertainty. Responsiveness to evolving evidence is improved through contractually embedded decision rules to simplify reassessment. ROMA allows conditional adoption to obtain additional information, with confidence that the net value of that adoption decision is positive.

CONCLUSIONS

The LC-HTA framework improves outcomes for patients, sponsors, and payers. Patients benefit through earlier access to new technologies. Payers increase the value of the technologies they invest in and gain mechanisms to review investments. Sponsors benefit through greater certainty in outcomes related to their investment, swifter access to markets, and greater opportunities to demonstrate value.

Systematic literature review on the implicit factors influencing the HTA deliberative process in Europe

Objectives

Deliberative processes in Health Technologies Assessment (HTA) result in recommendations that determine the reimbursement of medicines, diagnostics or devices. These processes are governed by explicit criteria, but are also influenced by implicit factors. The objective of this work was to identify the implicit factors influencing HTA deliberative processes in five European countries (France, Germany, Italy, Spain and the UK).

Methods

A systematic review of literature published between 2009 and 2019 was conducted. The search was performed in Pubmed, The Cochrane Database of Systematic Reviews, Google Scholar and Center for Reviews and Dissemination. The ISPOR database was searched manually.

Results

Out of 100 eligible publications, eight articles were selected for data extraction and analysis. The implicit factors in the HTA deliberative process most frequently mentioned in the identified literature are value judgments, biases, preferences and subjectivity. Five out of the eight articles highlight the need to further improve the transparency of the process, and three provide recommendations on how to address the influence of implicit factors on the HTA deliberative process through a framework.

Conclusion

Even in countries with a long HTA history, evidence on implicit factors is scarce. Some methods have been recommended for addressing these factors. Further research is required to characterize the implicit factors in the HTA deliberative process at a country level and explore potential ways to mitigate the influence of these factors on the HTA deliberative process.

"Ready for the future?" - Status of national and cross-country horizon scanning systems for medicines in European countries

Background: Horizon scanning aims to systematically identify upcoming health technologies and thus allows policy-makers to be better prepared for the entry of new medicines with possibly high price tags into the national health system. The aim of this study is to survey the existence of national and cross-national horizon scanning systems for medicines in European countries.

Methods: Experts working in public authorities (members of the Pharmaceutical Pricing and Reimbursement Information/PPRI network) in the WHO European region participated in surveys in 2014 and 2019 and informed about the status of horizon scanning in their country (response rate: 14 and 44 countries, respectively). Identified advanced horizon scanning systems as of 2019 were further investigated based on a literature review.

Results: In 2019, six countries (Iceland, Italy, the Netherlands, Norway, Sweden, United Kingdom) reported systematic use of horizon scanning for some new medicines, and four countries (Austria, Denmark, France, Ireland) had some horizon scanning activities ongoing. No systematic use of horizon scanning was reported from the remaining 34 countries. The findings of the survey undertaken five years earlier were similar, with even fewer systems in place. A recent development is the establishment of cross-country initiatives of governments that aim, among others, to jointly perform horizon scanning; the International Horizon Scanning Initiative (IHSI) initiated by the Beneluxa collaboration is the most advanced undertaking in this respect. Countries with systematic use tend to have horizon scanning fully integrated in a system for the management of new medicines, and they use horizon scanning outcomes to inform decisions as to whether or not a Health Technology Assessment will be conducted and price negotiations be started. Differences between existing horizon scanning systems mainly concern the timings of scanning and reporting, the sources for the inputs and the accessibility of the findings.

Conclusion: There appears to be a discrepancy between the perceived importance of horizon scanning based on some eye-opening examples in the past and its actual implementation in European health systems. The latter is likely attributable to horizon scanning being resource-intensive. The establishment of new national and international horizon scanning systems offers the opportunity to investigate their impact on sustainable access to affordable medicines from the start.

Deliberative processes in decision making informed by health technology assessment in Latin America

Objective

The objective of Health Technology Assessment International’s 6th Latin America Policy Form, held in 2021, was to explore the implementation of deliberative processes in the framework of health technology assessment (HTA) and how agencies in the region could involve stakeholders in this process.

Methods

This paper is based on a preparatory survey, a background document, and the deliberative work of participants at the virtual Forum conducted in 2021. There were ninety-one participants in the open session and fifty-two in the closed sessions, representing twelve countries and diverse areas of the health sector.

Results

While there are mechanisms in most countries in Latin America to consider stakeholder involvement to some degree, it remains reduced or limited to a consultative role, making true participative involvement rare. There are significant barriers and structural and contextual limitations that have impeded or slowed progress toward deliberative processes. Relatively low levels of institutionalization and knowledge about HTA, as well as the lack of trust among stakeholders are important challenges. This situation has impacted health systems by diminishing the legitimacy of decisions and the very structures and processes of HTA.

Conclusion

The Forum’s broad group of participants identified barriers, facilitators, and recommendations to improve the use of deliberative processes in Latin America to foster improved fairness and reasonableness in HTA and decision making.

Health technology assessment (HTA) in England, France and Germany: what do matched drug pairs tell us about recommendations by national HTA agencies?

Aims: To explore health technology assessment (HTA) outcomes of matched drug pairs by national agencies in Germany (Gemeinsamer Bundesausschuss, GBA), France (Haute Autorité de Santé, HAS) and England and Wales (NICE). Methods: We considered published GBA decisions, HAS reports and NICE guidance from January 2011 to June 2018. HTAs of matched pairs were compared overall, and for non-cancer and cancer drugs separately. We further analyzed the role of additional attributes related to cancer therapies. Results: Matched pairs show higher concordance for GBA/HAS than for GBA/NICE and HAS/NICE. Overall, NICE evaluated technologies more favorably than GBA and HAS. GBA appraisals of cancer drugs, however, tended to be more positive than cancer-related recommendations by NICE and HAS. Conclusion: The findings indicate substantial variations in HTAs, although cancer-related outcomes seem to diverge less than non-cancer results.

Health technology assessment in sub-Saharan Africa: a descriptive analysis and narrative synthesis

Background

Countries in Sub-Saharan Africa (SSA) are moving towards universal health coverage. The process of Health Technology Assessment (HTA) can support decisions relating to benefit package design and service coverage. HTA involves institutional cooperation with agreed methods and procedural standards. We systematically reviewed the literature on policies and capacity building to support HTA institutionalisation in SSA.

Methods

We systematically reviewed the literature by searching major databases (PubMed, Embase, etc.) until June 2019 using terms considering three aspects: HTA; health policy, decision making; and SSA. We quantitatively extracted and descriptively analysed content and conducted a narrative synthesis eliciting themes from the selected literature, which varied in study type and apporach.

Results

Half of the 49 papers identified were primary research studies and mostly qualitative. Five countries were represented in six of ten studies; South Africa, Ghana, Uganda, Cameroon, and Ethiopia. Half of first authors were from SSA. Most informants were policy makers. Five themes emerged: (1) use of HTA; (2) decision-making in HTA; (3) values and criteria for setting priority areas in HTA; (4) involving stakeholders in HTA; and (5) specific examples of progress in HTA in SSA. The first one was the main theme where there was little use of evidence and research in making policy. The awareness of HTA and economic evaluation was low, with inadequate expertise and a lack of local data and tools.

Conclusions

Despite growing interest in HTA in SSA countries, awareness remains low and HTA-related activities are uncoordinated and often disconnected from policy. Further training and skills development are needed, firmly linked to a strategy focusing on strengthening within-country partnerships, particularly among researchers and policy makers. The international community has an important role here by supporting policy- relevant technical assistance, highlighting that sustainable financing demands evidence-based processes for effective resource allocation, and catalysing knowledge-sharing opportunities among countries facing similar challenges.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12962-021-00293-5.

Deliberative Processes by Health Technology Assessment Agencies: A Reflection on Legitimacy, Values and Patient and Public Involvement Comment on "Use of Evidence-informed Deliberative Processes by Health Technology Assessment Agencies Around the Globe"

Legitimacy of deliberation processes leading to recommendations for public financing or clinical practice depends on the data considered, stakeholders involved and the process by which both of these are selected and organised. Oortwijn et al provides an interesting exploration of processes currently in place in health technology assessment (HTA) agencies. However, agencies are struggling with core issues central to their legitimacy that goes beyond the procedural exploration of Oortwijn et al, such as: how processes reflect the mission and values of the agencies? How they ensure that recommendations are fair and reasonable? Which role should be given to public and patient involvement? Do agencies have a positive impact on the healthcare system and the populations served? What are the drivers of their evolution? We concur with Culyer commentary on the need of learning from doing what works best and that a reflection is indeed needed to "enhance the fairness and legitimacy of HTA."

Evidence-Informed Deliberative Processes for HTA Around the Globe: Exploring the Next Frontiers of HTA and Best Practices Comment on "Use of Evidence-informed Deliberative Processes by Health Technology Assessment Agencies Around the Globe"

This comment reflects on an article by Oortwijn, Jansen, and Baltussen about the use and features of 'evidence-informed deliberative processes' (EDPs) among health technology assessment (HTA) agencies around the world and the need for more guidance. First, we highlight procedural aspects that are relevant across key steps of EDP, focusing on conflict of interest, the different roles of stakeholders throughout a HTA and public justification of decisions. Second, we discuss new knowledge and models needed to maximize the value of deliberative processes at the expanding frontiers of HTA, paying special attention to when HTA is applied in primary care, employed for public health interventions, and is produced through international collaboration.

Patients and public are important stakeholders in health technology assessment but the level of involvement is low - a call to action

BACKGROUND

Health technology assessment (HTA) agencies have an important role in the evaluation and approval of new technologies. They determine their value within a health system so to promote equitable, quality care with available healthcare resources. Many HTA agencies have some mechanism for involving patients in their processes, but there is great variability and an absence of comprehensive, robust practices for involvement. The accelerating pace of medical innovation creates a need to improve the depth and breadth of patient involvement in the HTA process.

MAIN BODY

In this 'Call to action', we present ideas from three HTA expert commentaries calling for collaborative learning and to share innovative ideas for changes in HTA. We also draw on examples of HTA agencies creatively pursuing this goal. We propose a 'Call to action' for HTA stakeholders to undertake serious dialogue with patient advocates aimed at creating shared goals. HTA agencies can use these goals to ensure meaningful patient involvement at every step of the HTA process. Five elements are explored. In 'Recognizing the value of shared purpose', we highlight examples of HTA agencies that have patients working in partnership with medical practitioners and HTA staff. Results include improved processes that instil confidence. 'Committing to patient involvement as part of HTA culture' highlights several initiatives aimed at changes in HTA organisational culture to be more inclusive of patients. In 'Aligning patient and HTA goals' we cite work in Belgium and New Zealand which places a greater emphasis on quality of life rather than life expectancy and cost-effectiveness. By 'Integrating patient involvement at every step of the HTA process' patients can make vital contributions at every stage of the HTA process. We provide two examples of where HTA agencies have successfully involved patients early in the process in order to broaden the scope of evaluations. 'Developing a common language and working together' can support transformative dialogue through 'unified language'.

CONCLUSION

The authors of this commentary ask that agencies and stakeholders involved in HTA take up this call to work together for visionary and transformative elevation of the voice of patients in HTA worldwide.

Integrating economic and health evidence to inform Covid-19 policy in low- and middle- income countries

Covid-19 requires policy makers to consider evidence on both population health and economic welfare. Over the last two decades, the field of health economics has developed a range of analytical approaches and contributed to the institutionalisation of processes to employ economic evidence in health policy. We present a discussion outlining how these approaches and processes need to be applied more widely to inform Covid-19 policy; highlighting where they may need to be adapted conceptually and methodologically, and providing examples of work to date. We focus on the evidential and policy needs of low- and middle-income countries; where there is an urgent need for evidence to navigate the policy trade-offs between health and economic well-being posed by the Covid-19 pandemic.

Application of evidence-informed deliberative processes in health technology assessment in low- and middle-income countries

OBJECTIVES

Evidence-informed deliberative processes (EDPs) were introduced to guide health technology assessment (HTA) agencies to improve their processes toward more legitimate decision making. A survey among members of the International Network of Agencies for HTA (INAHTA) showed that EDPs can also be relevant for countries that have not (yet) established such an agency. Therefore, we explored to what extent low- and middle-income countries (LMIC) applied the steps and elements stipulated in the EDP framework and their need for guidance.

METHODS

The survey among INAHTA members was slightly adapted to address LMIC context and sent to 416 experts identified through several HTA sources. The questions focused on contextual factors and the EDP steps (installation of an appraisal committee, selecting technologies and criteria, assessment, appraisal, communication and appeal). Data collection took place between 21 May and 1 September 2019. Descriptive statistics and qualitative analyses were used to summarize the findings.

RESULTS

We received sixty-six meaningful responses from experts in thirty-two LMIC. We found that contextual factors to support HTA development are overall not present or only present to some extent. Respondents indicated that guidance was needed for specific elements related to selecting technologies and criteria, assessment, appraisal, as well as communication and appeal.

CONCLUSIONS

EDPs have the potential to provide steps for improving HTA processes. The results of this study can serve as a baseline measurement for future monitoring and evaluation of EDP application in the responding LMIC. This could support the countries in improving their processes and enhancing legitimate decision making when using HTA.

Use of Evidence-Informed Deliberative Processes - Learning by Doing Comment on "Use of Evidence-informed Deliberative Processes by Health Technology Assessment Agencies Around the Globe"

The article by Oortwijn, Jansen, and Baltussen (OJB) is much more important than it appears because, in the absence of any good general theory of "evidence-informed deliberative processes" (EDP) and limited evidence of how they might be shaped and work in institutionalising health technology assessment (HTA), the best approach seems to be to accumulate the experience of a variety of countries, preferably systematically, from which some general principles might subsequently be inferred. This comment reinforces their arguments and provides a further example.

The new definition of health technology assessment: A milestone in international collaboration

Background

An international joint task group co-led by the International Network of Agencies for Health Technology Assessment (INAHTA) and Health Technology Assessment International (HTAi) has developed a new and internationally accepted definition of HTA.

Methods

The task group, consisting of representatives of leading HTA networks, societies and global organizations, developed guiding principles for the process and followed an established consultation plan with the broader HTA community to develop the definition.

Results

The consensus achieved by the international joint task group brings the collective weight of the participating networks, societies, and organizations behind the new definition.

Conclusion

The new definition of HTA is an historic achievement and it is offered to the current and emerging HTA world as a cornerstone reference for today and into the future.