HTA of medical devices: Challenges and ideas for the future from a European perspective

Domains and Methods of Medical Device Technology Evaluation: A Systematic Review

Objectives

Identify, through a systematic review, the main domains and methods to support health technology assessment of Medical Devices (MD) from the perspective of technological incorporation into healthcare systems.

Methods

Performed structured searches in MEDLINE, Embase, BVS, Cochrane Library, and Web of Science for full studies published between 2017 and May 2023. Selection, extraction, and quality assessment were performed by two blinded reviewers, and discrepancies were resolved by a third reviewer.

Results

A total of 5,790 studies were retrieved, of which 41 were included. We grouped the identified criteria into eight domains for the evaluations.

Conclusion

Overall, studies discuss the need to establish specific methods for conducting HTA in MD. Due to the wide diversity of MD types, a single methodological guideline may not encompass all the specificities and intrinsic characteristics of the plurality of MD. Studies suggest using clustering criteria through technological characterization as a strategy to make the process as standardized as possible.

Pricing, Procurement and Reimbursement Policies for Incentivizing Market Entry of Novel Antibiotics and Diagnostics: Learnings from 10 Countries Globally

BACKGROUND

Fostering market entry of novel antibiotics and enhanced use of diagnostics to improve the quality of antibiotic prescribing are avenues to tackle antimicrobial resistance (AMR), which is a major public health threat. Pricing, procurement and reimbursement policies may work as AMR 'pull incentives' to support these objectives. This paper studies pull incentives in pricing, procurement and reimbursement policies (e.g., additions to, modifications of, and exemptions from standard policies) for novel antibiotics, diagnostics and health products with a similar profile in 10 study countries. It also explores whether incentives for non-AMR health products could be transferred to AMR health products.

METHODS

This research included a review of policies in 10 G20 countries based on literature and unpublished documents, and the production of country fact sheets that were validated by country experts. Initial research was conducted in 2020 and updated in 2023.

RESULTS

Identified pull incentives in pricing policies include free pricing, higher prices at launch and price increases over time, managed-entry agreements, and waiving or reducing mandatory discounts. Incentives in procurement comprise value-based procurement, pooled procurement and models that delink prices from volumes (subscription-based schemes), whereas incentives in reimbursement include lower evidence requirements for inclusion in the reimbursement scheme, accelerated reimbursement processes, separate budgets that offer add-on funding, and adapted prescribing conditions.

CONCLUSIONS

While a few pull incentives have been piloted or implemented for antibiotics in recent years, these mechanisms have been mainly used to incentivize launch of certain non-AMR health products, such as orphan medicines. Given similarities in their product characteristics, transferability of some of these pull incentives appears to be possible; however, it would be essential to conduct impact assessments of these incentives. Trade-offs between incentives to foster market entry and thus potentially improve access and the financial sustainability for payers need to be addressed.

Assessing medical devices: a qualitative study from the validate perspective

OBJECTIVES

Our objective was to explore procedures and methods used at health technology assessment (HTA) agencies for assessing medical devices and the underlying views of HTA practitioners about appropriate methodology to identify challenges in adopting new methodologies for assessing devices. We focused on the role of normative commitments of HTA practitioners in the adoption of new methods.

METHODS

An online survey, including questions on procedures, scoping, and assessments of medical devices, was sent to members of the International Network of Agencies for Health Technology Assessment. Interviews were conducted with survey respondents and HTA practitioners involved in assessments of transcatheter aortic valve implantation to gain an in-depth understanding of choices made and views about assessing medical devices. Survey and interview questions were inspired by the "values in doing assessments of health technologies" approach towards HTA, which states that HTA addresses value-laden questions and information.

RESULTS

The current practice of assessing medical devices at HTA agencies is predominantly based on procedures, methods, and epistemological principles developed for assessments of drugs. Both practical factors (available time, demands of decision-makers, existing legal frameworks, and HTA guidelines), as well as commitments of HTA practitioners to principles of evidence-based medicine, make the adoption of a new methodology difficult.

CONCLUSIONS

There is a broad recognition that assessments of medical devices may need changes in HTA methodology. In order to realize this, the HTA community may require both a discussion on the role, responsibility, and goals of HTA, and resulting changes in institutional context to adopt new methodologies.

Looking at the fringes of MedTech innovation: a mapping review of horizon scanning and foresight methods

OBJECTIVES

Horizon scanning (HS) is a method used to examine signs of change and may be used in foresight practice. HS methods used for the identification of innovative medicinal products cannot be applied in medical technologies (MedTech) due to differences in development and regulatory processes. The aim of this study is to identify HS and other methodologies used for MedTech foresight in support to healthcare decision-making.

METHOD

A mapping review was performed. We searched bibliographical databases including MEDLINE, Embase, Scopus, Web of Science, IEEE Xplore and Compendex Engineering Village and grey literature sources such as Google, CORE database and the International HTA database. Our searches identified 8888 records. After de-duplication, and manual and automated title, abstracts and full-text screening, 49 papers met the inclusion criteria and were data extracted.

RESULTS

Twenty-five single different methods were identified, often used in combination; of these, only three were novel (appearing only once in the literature). Text mining or artificial intelligence solutions appear as early as 2012, often practised in patent and social media sources. The time horizon used in scanning was not often justified. Some studies regarded experts both as a source and as a method. Literature searching remains one of the most used methods for innovation identification. HS methods were vaguely reported, but often involved consulting with experts and stakeholders.

CONCLUSION

Heterogeneous methodologies, sources and time horizons are used for HS and foresight of MedTech innovation with little or no justification provided for their use. This review revealed an array of known methods being used in combination to overcome the limitations posed by single methods. The review also revealed inconsistency in methods reporting, with a lack of any consensus regarding best practice. Greater transparency in methods reporting and consistency in methods use would contribute to increased output quality to support informed timely decision-making.

Development and validation of Medical Device Key Evidence Tool ('MeDKET'): An evidence-based framework to explain success in selected European and US companies

Innovating in Medical Device (MD) industry is challenging. This study aims to develop and validate an evidence-based framework that helps innovators of small and large enterprises (SEs and LEs) assess their readiness for successful MD development and deployment. We conducted a key-informant process (stage 1) where 25 international experts identified a list of emergent Health Technology Assessment (HTA) themes they believed were essential to company success. A sample of 22 European and US selected companies (13 SEs and 9 LEs) then reached a consensus on a list of key themes through a robust Delphi process (stage 2). Finally, we constructed (stage 3) and validated (stage 4) the checklist for SEs and LEs. The checklist for SEs and LEs included 21 and 15 items (i.e., fundamental Yes/No questions) with nine overlapping criteria for both SEs and LEs. In both groups, MD success was driven by three major item categories: (i) R&D assessment strategy; (ii) device-outcome measures; (iii) company profiling. Alongside the retrospective validation study, we collected 40 case studies on MDs (23 successes and 17 failures) across the selected enterprises. The retrospective validation provided the proportion of successful and failed case studies that met the 'MeDKET' criteria. We discovered that early HTA plays a pivotal role in MD industry success with different implications based on enterprise size. This study is the first of its kind to provide a holistic picture of the perceived role of early-stage HTA in MD industry success.

Which value aspects are relevant for the evaluation of medical devices? Exploring stakeholders' views through a Web-Delphi process

BACKGROUND

Implementation and uptake of health technology assessment for evaluating medical devices require including aspects that different stakeholders consider relevant, beyond cost and effectiveness. However, the involvement of stakeholders in sharing their views still needs to be improved.

OBJECTIVE

This article explores the relevance of distinct value aspects for evaluating different types of medical devices according to stakeholders' views.

METHODS

Thirty-four value aspects collected through literature review and expert validation were the input for a 2-round Web-Delphi process. In the Web-Delphi, a panel of participants from five stakeholders' groups (healthcare professionals, buyers and policymakers, academics, industry, and patients and citizens) judged the relevance of each aspect, by assigning a relevance-level ('Critical', 'Fundamental', 'Complementary', or 'Irrelevant'), for two types of medical devices separately: 'Implantable' and 'In vitro tests based on biomarkers'. Opinions were analysed at the panel and group level, and similarities across devices were identified.

RESULTS

One hundred thirty-four participants completed the process. No aspects were considered 'Irrelevant', neither for the panel nor for stakeholder groups, in both types of devices. The panel considered effectiveness and safety-related aspects 'Critical' (e.g., 'Adverse events for the patient'), and costs-related aspects 'Fundamental' (e.g., 'Cost of the medical device'). Several additional aspects not included in existing frameworks' literature, e.g., related to environmental impact and devices' usage by the healthcare professional, were deemed as relevant by the panel. A moderate to substantial agreement across and within groups was observed.

CONCLUSION

Different stakeholders agree on the relevance of including multiple aspects in medical devices' evaluation. This study produces key information to inform the development of frameworks for valuing medical devices, and to guide evidence collection.

Decision-analytic modeling for early health technology assessment of medical devices - a scoping review

Objective

The goal of this review was to identify decision-analytic modeling studies in early health technology assessments (HTA) of high-risk medical devices, published over the last three years, and to provide a systematic overview of model purposes and characteristics. Additionally, the aim was to describe recent developments in modeling techniques.

Methods

For this scoping review, we performed a systematic literature search in PubMed and Embase including studies published in English or German. The search code consisted of terms describing early health technology assessment and terms for decision-analytic models. In abstract and full-text screening, studies were excluded that were not modeling studies for a high-risk medical device or an in-vitro diagnostic test. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was used to report on the search and exclusion of studies. For all included studies, study purpose, framework and model characteristics were extracted and reported in systematic evidence tables and a narrative summary.

Results

Out of 206 identified studies, 19 studies were included in the review. Studies were either conducted for hypothetical devices or for existing devices after they were already available on the market. No study extrapolated technical data from early development stages to estimate potential value of devices in development. All studies except one included cost as an outcome. Two studies were budget impact analyses. Most studies aimed at adoption and reimbursement decisions. The majority of studies were on in-vitro diagnostic tests for personalized and targeted medicine. A timed automata model, to our knowledge a model type new to HTA, was tested by one study. It describes the agents in a clinical pathway in separate models and, by allowing for interaction between the models, can reflect complex individual clinical pathways and dynamic system interactions. Not all sources of uncertainty for in-vitro tests were explicitly modeled. Elicitation of expert knowledge and judgement was used for substitution of missing empirical data. Analysis of uncertainty was the most valuable strength of decision-analytic models in early HTA, but no model applied sensitivity analysis to optimize the test positivity cutoff with regard to the benefit-harm balance or cost-effectiveness. Value-of-information analysis was rarely performed. No information was found on the use of causal inference methods for estimation of effect parameters from observational data.

Conclusion

Our review provides an overview of the purposes and model characteristics of nineteen recent early evaluation studies on medical devices. The review shows the growing importance of personalized interventions and confirms previously published recommendations for careful modeling of uncertainties surrounding diagnostic devices and for increased use of value-of-information analysis. Timed automata may be a model type worth exploring further in HTA. In addition, we recommend to extend the application of sensitivity analysis to optimize positivity criteria for in-vitro tests with regard to benefit-harm or cost-effectiveness. We emphasize the importance of causal inference methods when estimating effect parameters from observational data.

Health technology assessment of medical devices: current landscape, challenges, and a way forward

Background

Health Technology Assessment (HTA) has been widely recognized as informing healthcare decision-making, and interest in HTA of medical devices has been steadily increasing. How does the assessment of medical devices differ from that of drug therapies, and what innovations can be adopted to overcome the inherent challenges in medical device HTA?

Method

HTA Accelerator Database was used to describe the landscape of HTA reports for medical devices from HTA bodies, and a literature search was conducted to understand the growth trend of relevant HTA publications in four case studies. Another literature review was conducted for a narrative synthesis of the characteristic differences and challenges of HTA in medical devices. We further conducted a focused Internet search of guidelines and a narrative review of methodologies specific to the HTA of medical devices.

Main body

The evidence of HTA reports and journal publications on medical devices around the world has been growing. The challenges in assessing medical devices include scarcity of well-designed randomized controlled trials, inconsistent real-world evidence data sources and methods, device-user interaction, short product lifecycles, inexplicit target population, and a lack of direct medical outcomes. Practical solutions in terms of methodological advancement of HTA for medical devices were also discussed in some HTA guidelines and literature.

Conclusion

To better conduct HTA on medical devices, we recommend considering multi-source evidence such as real-world evidence; standardizing HTA processes, methodologies, and criteria; and integrating HTA into decision-making.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12962-022-00389-6.

Implementation of coverage with evidence development schemes for medical devices: A decision tool for late technology adopter countries

Experiences with coverage with evidence development (CED) schemes are fairly limited in Central and Eastern European (CEE) countries, which are usually late adopters of new health technologies. Our aim was to put forward recommendations on how CEE health technology assessment bodies and payer organizations can apply CED to reduce decision uncertainty on reimbursement of medical devices, with a particular focus on transferring the structure and data from CED schemes in early technology adopter countries in Western Europe. Structured interviews on the practices and feasibility of transferring CED schemes were conducted and subsequently, a draft tool for the systematic classification of decision alternatives and recommendations was developed. The decision tool was reviewed in a focus group discussion and validated within a wider group of CEE experts in a virtual workshop. Transferability assessment is needed in case of (1) joint implementation of a CED scheme; (2) transferring the structure of an existing CED scheme to a CEE country; (3) reimbursement decisions that are linked to outcomes of an ongoing CED scheme in another country and (4) real-world evidence transferred from completed CED schemes. Efficient use of available resources may be improved by adequately transferring evidence and policy tools from early technology adopter countries.

An approach to quantify parameter uncertainty in early assessment of novel health technologies

Health economic modeling of novel technology at the early stages of a product lifecycle has been used to identify technologies that are likely to be cost-effective. Such early assessments are challenging due to the potentially limited amount of data. Modelers typically conduct uncertainty analyses to evaluate their effect on decision-relevant outcomes. Current approaches, however, are limited in their scope of application and imposes an unverifiable assumption, that is, uncertainty can be precisely represented by a probability distribution. In the absence of reliable data, an approach that uses the fewest number of assumptions is desirable. This study introduces a generalized approach for quantifying parameter uncertainty, that is, probability bound analysis (PBA), that does not require a precise specification of a probability distribution in the context of early-stage health economic modeling. We introduce the concept of a probability box (p-box) as a measure of uncertainty without necessitating a precise probability distribution. We provide formulas for a p-box given data on summary statistics of a parameter. We describe an approach to propagate p-boxes into a model and provide step-by-step guidance on how to implement PBA. We conduct a case and examine the differences between the status-quo and PBA approaches and their potential implications on decision-making.

Real-world evidence in health technology assessment of high-risk medical devices: Fit for purpose?

Health technology assessment (HTA) of medical devices (MDs) increasingly rely on real-world evidence (RWE). The aim of this study was to evaluate the type and the quality of the evidence used to assess the (cost-)effectiveness of high risk MDs (Class III) by HTA agencies in Europe (four European HTA agencies and EUnetHTA), with particular focus on RWE. Data were extracted from HTA reports on the type of evidence demonstrating (cost-)effectiveness, and the quality of observational studies of comparative effectiveness using the Good Research for Comparative Effectiveness principles. 25 HTA reports were included that incorporated 28 observational studies of comparative effectiveness. Half of the studies (46%) took important confounding and/or effect modifying variables into account in the design and/or analyses. The most common way of including confounders and/or effect modifiers was through multivariable regression analysis. Other methods, such as propensity score matching, were rarely employed. Furthermore, meaningful analyses to test key assumptions were largely omitted. Resulting recommendations from HTA agencies on MDs is therefore (partially) based on evidence which is riddled with uncertainty. Considering the increasing importance of RWE it is important that the quality of observational studies of comparative effectiveness are systematically assessed when used in decision-making.

Implications of Oncology Trial Design and Uncertainties in Efficacy-Safety Data on Health Technology Assessments

Background: Advances in cancer medicines have resulted in tangible health impacts, but the magnitude of benefits of approved cancer medicines could vary greatly. Health Technology Assessment (HTA) is a multidisciplinary process used to inform resource allocation through a systematic value assessment of health technology. This paper reviews the challenges in conducting HTA for cancer medicines arising from oncology trial designs and uncertainties of safety-efficacy data. Methods: Multiple databases (PubMed, Scopus and Google Scholar) and grey literature (public health agencies and governmental reports) were searched to inform this policy narrative review. Results: A lack of robust efficacy-safety data from clinical trials and other relevant sources of evidence has made HTA for cancer medicines challenging. The approval of cancer medicines through expedited pathways has increased in recent years, in which surrogate endpoints or biomarkers for patient selection have been widely used. Using these surrogate endpoints has created uncertainties in translating surrogate measures into patient-centric clinically (survival and quality of life) and economically (cost-effectiveness and budget impact) meaningful outcomes, with potential effects on diverting scarce health resources to low-value or detrimental interventions. Potential solutions include policy harmonization between regulatory and HTA authorities, commitment to generating robust post-marketing efficacy-safety data, managing uncertainties through risk-sharing agreements, and using value frameworks. Conclusion: A lack of robust efficacy-safety data is a central problem for conducting HTA of cancer medicines, potentially resulting in misinformed resource allocation.

Evidence-based funding of new imaging applications and technologies by Medicare in Australia: How it happens and how it can be improved

BACKGROUND

The Medical Services Advisory Committee (MSAC) is responsible for the assessment of medical imaging tests proposed for public funding. A number of factors related to the clinical or cost effectiveness of an imaging service may impact on the funding decision.

OBJECTIVE

To determine what evidentiary and economic factors impact most on MSAC recommendations for the funding of imaging tests.

METHODS

Information was extracted on health technology assessments (HTAs) of medical imaging tests published on the MSAC website, with a funding decision between 2006 to July 2021. Imaging tests with diagnostic, staging or screening indications were eligible. Data were extracted in test-indication pairs and included data on evidence quality, quantity, consistency of findings, cost-effectiveness and financial impact. Multivariate logistic regression analysis was performed with adjustments for clustered data.

RESULTS

Overall, 42 imaging test applications to MSAC were included, representing 91 clinical indications. Most were diagnostic tests. The most common evidentiary concerns reported by MSAC were limited evidence (36%), low quality evidence (26%), and applicability of the data (22%). The reference standard for diagnostic accuracy was imperfect or not appropriate in 25% of the indications. In regression analyses, uncertainty about cost-effectiveness of an imaging service predicted most negative funding decisions.

CONCLUSIONS

The single biggest contributor to a negative funding decision by MSAC was uncertainty about the cost-effectiveness of the imaging service. This was likely driven by uncertainty regarding the impact on patient health. HTAs that are able to demonstrate the clinical utility of a new imaging service are more likely to publicly funded.

Broadening the application of health technology assessment in the Netherlands: a worthwhile destination but not an easy ride?

Currently, reimbursement decisions based on health technology assessments (HTA) in the Netherlands mostly concern outpatient pharmaceuticals. The Dutch government aspires to broaden the systematic application of full HTA towards other types of health care in order to optimise the content of the basic benefit package. This paper identifies important challenges for broadening the scope of full HTA to other types of health care. Based on a description of the Dutch reimbursement decision-making process, five important characteristics of outpatient pharmaceuticals were identified, which are all relevant to the successful application of HTA: (i) closed reimbursement system, (ii) absence of alternative policy measures, (iii) existence of marketing authorisation, (iv) identifiable and accountable counterparty, and (v) product characteristics. For a selection of other types of health care, which may be subject to HTA more frequently in the future, deviations from these characteristics of outpatient pharmaceuticals are discussed. The implications of such deviations for performing HTA and the decision-making process are highlighted. It is concluded that broadening the application of HTA will require policy makers to meet both important policy-related and methodological challenges. These challenges differ per health care domain, which may inform policy makers which expansions of the current use of HTA are most feasible.

Establishing a national HTA program for medical devices in Italy: Overhauling a fragmented system to ensure value and equal access to new medical technologies

Differing contexts have greatly influenced HTA development in various countries, with considerable effort recently made by international HTA networks (e.g., EUnetHTA) and the European Union (EU) to make HTA a more coherent, equal, and efficient process. Medical devices (MDs) present particular challenges for HTA because of frequent, rapid innovation, outcomes influenced by end-user competence, dynamic pricing and often low-quality scientific evidence. Our objective is to describe the development, structure and governance of a National HTA Program for MDs (PNHTADM) in Italy, a highly participatory, stakeholder-engaged, evidence-based process to reform a fragmented system of appraisal and approval. Based largely on EUnetHTA methods, the resulting process delineates a standardized system for proposing MDs by any stakeholders, accrediting HTA producers, setting criteria for prioritization and appraisals, and innovatively linking recommendations with coverage, reimbursement and procurement of MDs. Expected benefits include reduced disparities in pricing and reimbursement policies and improved access to new technologies across 21 regional healthcare systems in Italy's decentralized, universal system, complete with provisions to require additional evidence collection and centrally monitor diffusion. Though devised for Italy, the design, resources and underlying analysis provide a framework for other nations seeking to consolidate HTA initiatives, particularly in light of new EU regulation.

Rapid point-of-care testing for COVID-19: quality of supportive information for lateral flow serology assays

OBJECTIVE

There is a lack of evidence addressing several important human factors questions pertaining to the quality of supportive information provided by commercial manufacturers that can affect the adoption and use of lateral flow serology assays in practice. We aimed to: (1) identify and assess the quality of information that commercial manufacturers provided for their point-of-care tests (POCTs) and (2) examine the implications of these findings on real-world settings.

DESIGN

We used a content analysis methodology in two stages to systematically, code and analyse textual data from documents of commercial manufacturers. A deductive approach was applied using a coding guide based on the validated Point-of-Care Key Evidence Tool (POCKET) multidimensional checklist. An inductive approach was used to identify new patterns or themes generated from our textual analysis.

SETTING

Publicly available supportive information documents by commercial manufacturers for lateral flow serology, were identified and gathered from online searches.

PARTICIPANTS

Supportive information documents retrieved from online searches over 3 months (March 2020 to June 2020).

RESULTS

A total of 79 POCTs were identified that met the study inclusion criteria. Using the POCKET coding guide, we found that the quality of information varied significantly between the manufacturers and was often lacking in detail. Our inductive approach further examined these topics and found that several statements were vague and that significant variations in the level of details existed between manufacturers.

CONCLUSIONS

This study revealed significant concerns surrounding the supportive information reported by manufacturers for lateral flow serology assays. Information transparency was poor and human factor issues were not properly addressed to mitigate the risk of improper device use, although it should be noted that the results of our study are limited by the data that manufactures were prepared to disclose. Overall, commercial manufacturers should improve the quality and value of information presented in their supporting documentation.

The case for an academic discipline of medical device science

Medical devices are a very important but largely under-recognized and fragmented component of healthcare.The limited regulation of the past and the lack of systematic rigorous evaluation of devices leading to numerous high-profile failures will now be replaced by stricter legal requirements and more transparent evaluation processes.This constitutes an unprecedented opportunity, but it also uncovers urgent needs in landscaping, methodology development, and independent comprehensive assessment of device risks and benefits for individual patients and society, especially in the context of increasingly complex devices.We argue that an academic discipline of 'medical device science' is well placed to lead and coordinate the efforts necessary to achieve much needed improvement in the medical device sector.Orthopaedics and traumatology could contribute and benefit considerably as one of the medical specialties with the highest use of medical devices. Cite this article: EFORT Open Rev 2021;6:160-163. DOI: 10.1302/2058-5241.6.200094.

Health Technology Assessment and Health Care Reimbursement in the European Union: Permissive Dissensus and the Limits of Harmonization through the Backdoor

Member states have consistently limited the European Union's competences in the area of health care reimbursement. Despite these efforts, there has been a slow but steady tendency toward harmonization of a key tool in reimbursement decision-making: health technology assessment (HTA), a multidisciplinary evaluation of "value for money" of medicines, devices, diagnostics, and interventions, which provides expert advice for reimbursement decisions. This article examines the origins of this paradoxical appetite for harmonization as well as of the dissensus that has, at the moment, somewhat stalled further integration in HTA. It finds that the prointegration neofunctionalist "permissive dissensus" is still present in decision making on HTA but potentially offset by dissensus or outright opposition from key actors, including member states and the medical device industry. These actors are able to decipher the potential consequences of highly technical issues, such as HTA, for national systems of social protection. Despite that, they have little interest in politicizing the issue, potentially opening the door to integrative policy solutions in the future.

Quo Vadis HTA for Medical Devices in Central and Eastern Europe? Recommendations to Address Methodological Challenges

Objectives: Methodological challenges in the evaluation of medical devices (MDs) may be different for early and late technology adopter countries, as well as the potential health technology assessment (HTA) solutions to tackle them. This study aims to provide guidance to Central and Eastern European (CEE) countries on how to address key challenges of HTA for MDs with special focus on the transferability of scientific evidence.

Methods: As part of the COMED Horizon 2020 project, a comprehensive list of issues related to MD HTA were identified based on a targeted literature review. Health technology assessment issues which pose a greater challenge or require different solutions in late technology adopter countries were selected. Draught recommendations to address these issues were developed and discussed in a focus group. The recommendations were then validated with a wider group of experts, including HTA and reimbursement decision makers from CEE countries in May and June 2020.

Results: A consolidated list of 11 recommendations were developed in 3 major areas: (1) clinical value assessment, focusing on the use of joint EU work, relying on real-world evidence, use of coverage with evidence development schemes, transferring evidence from foreign countries and addressing the challenges of learning curve and centre effect; (2) economic value assessment, covering cost calculation of complex medical devices and transferability of economic evaluations of MDs; (3) HTA processes, related to the frequent product modifications and various indications of MDs.

Conclusions: Central and Eastern European countries with limited resources for conducting HTA, can benefit from HTA methods and evidence generated in early technology adopter countries. Considering the appropriate reuse of international HTA materials, late technology adopter countries can still implement HTA, even for MDs, which have a more limited evidence base compared with pharmaceuticals.

A Digital Innovation for the Personalized Management of Adherence: Analysis of Strengths, Weaknesses, Opportunities, and Threats

Introduction: Personalized medicine and management of adherence are potential solutions for the suboptimal use of medicines. Digital medication management innovations currently under development combine both aspects. This research aims to investigate facilitators for and barriers to the translation of digital innovations for personalized medicine and adherence management into clinical practice from the policymaker and regulator perspective.

Methods: A mixed-method study was used combining a scoping review to identify main interests, semi-structured interviews (n = 5) with representatives of European health policymaking and regulatory organizations, and a supplementary literature review to investigate key subthemes. The SWOT analysis was used for the qualitative analysis.

Results: The literature reviews and the qualitative interviews suggested that digital solutions can facilitate the personalized management of medications and improve quality and safety, especially as the openness for digital health solutions is increasing. Digital solutions may, on the other hand, add complexity to the treatment, which can be perceived as a potential barrier for their uptake. As more multidisciplinary and participative structures are emerging, digital solutions can promote the implementation of new services. Nevertheless, change progresses slowly in the task-oriented structures of health systems. Integration of digital solutions depends on all stakeholders' willingness and abilities to co-create this change. Patients have different capabilities to self-manage their medical conditions and use digital solutions. Personalization of digital health solutions and integration in existing service structures are crucial to ensure equality among population segments. Developments in the digital infrastructure, although they are partly slow and not well-aligned, enable the implementation of innovations in clinical practice leading to further advances in data generation and usage for future innovations.

Discussion: This study suggests that digital solutions have the potential to facilitate high-quality medication management and improve adherence to medications, enable new service structures, and are essential to drive further innovations in health care. Nevertheless, increasing the self-responsibility of patients can have undesirable effects on health outcomes, especially within vulnerable population segments. Digital health solutions can be an opportunity to optimize the use of medicines and thus their efficiency. Well-conceived development and implementation processes are needed to also realize improvements in equality and solidarity within health systems.

Usability Assessment of an Innovative Device in Infusion Therapy: A Mix-Method Approach Study

Background: Flushing a venous access device is an important procedure to maintain their patency and prevent malfunctioning and complications. An innovative double-chamber syringe was developed, allowing for the assessment of catheter patency, drug delivery and final flush. This study aims to assess the usability of this new device, considering three development stages (concept, semi-functional prototype, functional prototype). Methods: An iterative methodology based on a mix-method design (qualitative and quantitative) enabled the assessment of the devices’ usability by their primary end-users. A usability questionnaire was developed and applied, along with focus groups and individual interviews to nurses. Results: The usability questionnaire integrated 42 items focused on four dimensions (usefulness; ease of use; ease of learning; satisfaction and intention to use). The initial psychometric findings indicate a good internal consistency and the conceptual relevance of the items. The scores seem to be sensitive to the usability evaluation of the medical devices in different stages of product development (with lower values on functional prototype evaluation), and related to nurses’ perceptions about functional and ergonomic characteristics. Conclusions: Quantitative and qualitative data provided a comprehensive overview of the double-chamber syringes’ usability from the nurses’ point of view, informing us of features that must be addressed.

Artificial Intelligence and Health Technology Assessment: Anticipating a New Level of Complexity

Artificial intelligence (AI) is seen as a strategic lever to improve access, quality, and efficiency of care and services and to build learning and value-based health systems. Many studies have examined the technical performance of AI within an experimental context. These studies provide limited insights into the issues that its use in a real-world context of care and services raises. To help decision makers address these issues in a systemic and holistic manner, this viewpoint paper relies on the health technology assessment core model to contrast the expectations of the health sector toward the use of AI with the risks that should be mitigated for its responsible deployment. The analysis adopts the perspective of payers (ie, health system organizations and agencies) because of their central role in regulating, financing, and reimbursing novel technologies. This paper suggests that AI-based systems should be seen as a health system transformation lever, rather than a discrete set of technological devices. Their use could bring significant changes and impacts at several levels: technological, clinical, human and cognitive (patient and clinician), professional and organizational, economic, legal, and ethical. The assessment of AI's value proposition should thus go beyond technical performance and cost logic by performing a holistic analysis of its value in a real-world context of care and services. To guide AI development, generate knowledge, and draw lessons that can be translated into action, the right political, regulatory, organizational, clinical, and technological conditions for innovation should be created as a first step.

Sousa L, Marques IA, Costa P, Cortez S, Carneiro F, Cruz A, Salgueiro-Oliveira A. Development of an innovative double-chamber syringe for intravenous therapeutics and flushing: Nurses' involvement through a human-centred approach

BACKGROUND

In nursing practice, flushing the catheters pre and post-drug administration is considered an important clinical procedure to prevent complications, and requires the use of several syringes to comply with international standards of care. We envisioned an innovative double-chamber syringe that enables the filling and administration of both solutions. Following current international recommendations, the development of new medical devices should integrate Health Technology Assessment. The Human-centred design is usually used for that assessment purposes, as a method that actively include end-users in the devices development process.

METHOD

Application of the Human-Centred Design through the involvement of nurses in the initial stages of the device development in order to accomplish the initial stages of Technology Readiness Level. A multi-method approach was used, including literature/guidelines review, focus groups with end-users and expert panels.

RESULTS

The involvement of nurses enabled the definition of user requirements and contexts of use, as well as the evaluation of design solutions and prototypes in order to accomplish with usability and ergonomic features of the medical device.

CONCLUSIONS

Significant contributions were made regarding the final design solution of this innovative double-chamber syringe.

The Emerging Social Science Literature on Health Technology Assessment: A Narrative Review

BACKGROUND

Social scientists have paid increasing attention to health technology assessment (HTA). This paper provides an overview of existing social scientific literature on HTA, with a focus on sociology and political science and their subfields.

METHODS

Narrative review of key pieces in English.

RESULTS

Three broad themes recur in the emerging social science literature on HTA: the drivers of the establishment and concrete institutional designs of HTA bodies; the effects of institutionalized HTA on pricing and reimbursement systems and the broader society; and the social and political influences on HTA decisions.

CONCLUSION

Social scientists bring a focus on institutions and social actors involved in HTA, using primarily small-N research designs and qualitative methods. They provide valuable critical perspectives on HTA, at times challenging its otherwise unquestioned assumptions. However, they often leave aside questions important to the HTA practitioner community, including the role of culture and values. Closer collaboration could be beneficial to tackle new relevant questions pertaining to HTA.

Formal Implementation of Cost-Effectiveness Evaluations in Japan: A Unique Health Technology Assessment System

In April 2019, Japan formally introduced health technology assessment (HTA) and, more specifically, a cost-effectiveness analysis, to inform healthcare decision making, mainly when it comes to the pricing of new technologies. This article provides an overview of this new policy, which was implemented formally after a pilot program. In the fiscal year (FY) 2012, discussions on cost-effectiveness assessments were initiated in Japan. After 7 years of deliberations, a cost-effectiveness assessment was implemented formally in April 2019. In Japan, the cost-effectiveness analysis has been used to inform price adjustments of healthcare technologies, although it has not yet been used for decision making on insurance coverage. Selection criteria were established because not all drugs and medical devices could be evaluated owing to a shortage of experts. Exclusion criteria have also been applied to prevent access restriction. The scope of the evaluation's price adjustment target is limited to part of the product price. If the cost per quality-adjusted life-year (QALY) threshold falls below ¥5 million per QALY, the price adjustment rate changes stepwise according to the cost per QALY. In addition to price reduction, a price-raising scheme has also been implemented for scenarios where products are evaluated to be highly cost-effective and innovative. This article describes the first formally implemented HTA system in Japan. Although it is too early to make any conclusions about its effect, the Japan-specific context makes this system unique. To fully understand the opportunities and challenges of the new system, it is vital that Japan accumulates experience with this system and develops human resources in health economic evaluation.

Barriers and facilitators of patient access to medical devices in Europe: A systematic literature review

A large number of medical devices (MDs) is available in Europe. Procedures for market approval and reimbursement have been adopted over recent years to promote accelerating patient access to innovative MDs. However, there remains uncertainty and non-transparency regarding these procedures. We provide a structured overview of market approval and reimbursement procedures and practices regarding access to MDs in the EU. Market approval procedures were found to be uniformly described. Data on reimbursement procedures and practices was both heterogeneous and incomplete. Time to MD access was mainly determined by reimbursement procedures. The influence of the patient on time to access was not reported. Prescription practices varied among device types. Barriers to and facilitators of early patient access that set the agenda for policy implications were also analyzed. Barriers were caused by unclear European legislation, complex market approval procedures, lack of data collection, inconsistency in evidence requirements between countries, regional reimbursement and provision, and factors influencing physicians' prescription including the device costs, waiting times and hospital-physician relationships. Facilitators were: available evidence that meets country-specific requirements for reimbursement, diagnosis-related groups, additional payments and research programs. Further research needs to focus on creating a complete overview of reimbursement procedures and practices by extracting further information from sources such as grey literature and interviews with professionals, and defining clear criteria to objectify time to access.

Registry stakeholders

Clinical registries are health information systems, which have the mission to collect multidimensional real-world data over the long term, and to generate relevant information and actionable knowledge to address current serious healthcare problems.

This article provides an overview of clinical registries and their relevant stakeholders, focussing on registry structure and functioning, each stakeholder’s specific interests, and on their involvement in the registry’s information input and output.

Stakeholders of clinical registries include the patients, healthcare providers (professionals and facilities), financiers (government, insurance companies), public health and regulatory agencies, industry, the research community and the media.

The article discusses (1) challenges in stakeholder interaction and how to strengthen the central role of the patient, (2) the importance of adding cost reporting to enable informed value choices, and (3) the need for proof of clinical and public health utility of registries.

In its best form, a registry is a mission-driven, independent stakeholder–registry team collaboration that enables rapid, transparent and open-access knowledge generation and dissemination.

Cite this article: EFORT Open Rev 2019;4 DOI: 10.1302/2058-5241.4.180077

Application of the HTA Core Model for complex evaluation of the effectiveness and quality of Radium-223 treatment in patients with metastatic castration resistant prostate cancer

BACKGROUND

Health technology assessment (HTA) is currently one of the major challenges in assessing medical innovations and healthcare systems. In Europe, the European Network for Health Technology Assessment (EUnetHTA) has been aspiring to develop and implement standards for international sharing of HTA results and studies. Slovakia and many other EU countries do not have an established HTA system yet. This paper is focused on an exact description of the EUnetHTA Core Model individual domains applied to the process of selecting patients in the terminal stage of prostate cancer for Radium-223 treatment under particular conditions of the Institute of Nuclear and Molecular Medicine (INMM) in Košice, Slovakia.

RESULTS

We produced the first pilot HTA report using the HTA Core Model in Slovakia. The main objective was to collect all relevant information on the particular technology, and provide its summary to the interested stakeholders on one spot. Rather than applying detailed individual items, i.e. assessment elements and assessment element cards, we concentrated on the content of individual domains and tried to fill them with the best country, facility and intervention related data. The dataset consisted of 52 patients that finished the treatment in the period 2015-2017. The patients were carefully selected according to the Radium-223 producer's criteria. Only 33 patients received the full therapy consisting of six applications; their average survival was 10.5 months from the application of the last dose.

CONCLUSIONS

Based on the results of our analyzes, we recommended several changes to the INMM processes and patient follow-up checks during the treatment process in order to make the therapy more effective. The greatest benefit is expected after the implementation of a ⁶⁸Ge/⁶⁸Ga generator in 2018, as the selection of patients suitable for the Radium-223 treatment will improve. We showed that the HTA Core Model can be implemented in Slovakia, even under conditions of no formal HTA support or institutionalization.

Testing a new taxonomic model for the assessment of medical devices: Is it plausible and applicable? Insights from HTA reports and interviews with HTA institutions in Europe

OBJECTIVE

Medical devices (MDs) encompass a broad and heterogeneous range of technologies. While practices vary considerably across countries, MDs often find application in patient care with little or no evaluation of their effectiveness and safety following market approval. A recently proposed taxonomy of MDs considered devices from the viewpoint of Health Technology Assessment (HTA). The aim of the work presented here was to test its plausibility and applicability by considering real-world HTA practices.

METHODS

HTA reports on MDs from European institutions were collected in a systematic manner and the evaluated devices and/or related procedures were matched to a position on the taxonomy. Following this, representatives from 16 European HTA institutions were asked about the usefulness of the taxonomy in semi-structured interviews.

RESULTS

1237 HTA reports (2004-2015) from 33 European institutions were included in the sample. The majority of reports was on technologies from the taxonomic positions initially estimated as having high relevance. Most of the experts interviewed stated that they found the taxonomy useful, particularly regarding its potential to aid in selecting technologies for assessment and to highlight potential methodological particularities per taxonomic position.

CONCLUSIONS

Overall, the distribution of identified reports on the matrix confirmed that the initial estimation of the relevance and necessity of HTA provided in the taxonomic model is plausible. In addition, interviews with representatives of European HTA institutions showed that the taxonomy could be useful.

ANALYSIS OF DUPLICATION AND TIMING OF HEALTH TECHNOLOGY ASSESSMENTS ON MEDICAL DEVICES IN EUROPE

OBJECTIVES

Strengthening efforts toward better collaboration plays a pivotal role in the assessment of medical devices to reduce overlap and save resources. This study explored the level of duplication in health technology assessments (HTA) of medical devices in Europe and their respective timing in order to identify areas for better collaboration.

METHODS

An analysis of European HTA reports of medical devices regarding overlaps in topics and timing in relation to market authorization was performed. We conducted a systematic search in the ADVANCE, Centre for Reviews and Dissemination, Syngerus, and POP databases, complemented by hand searching, to identify HTA reports published between 01/2003 and 07/2016 for a preselected cohort group of ten technologies. We analyzed the number of annual assessments per technology and evaluated activity patterns and timing in undertaking the HTA of the different institutes in Europe.

RESULTS

The results revealed the amount of duplication in the European HTA production: the number of reports per technology ranged from minimum seven to maximum twenty-two over a time-span of 13.5 years. HTA institutes perform assessments at a similar time range within 5 to 10 years following market authorization. The timing of the initial assessment in relation to the granting of the CE-mark varies according to the particular technology.

CONCLUSION

The findings suggest that efficient collaboration may help to save scarce resources and time of HTA institutes in Europe. Efficient collaboration as such needs to shift the focus beyond the time span of 1 year, and build on each's others work from previous assessments.

Scientific Evidence in Health Technology Assessment Reports: An In-Depth Analysis of European Assessments on High-Risk Medical Devices

BACKGROUND

The aim of this study was to examine the scientific evidence on clinical effectiveness and safety used in health technology assessments (HTAs) of high-risk medical devices (MDs) in Europe.

METHODS

We applied a systematic approach to identify European institutions involved in HTA and to select reports assessing MDs considered high-risk according to the definition in the new German health care regulation §137h. Reports published between 2010 and 2015 were considered in our subsequent analysis. We used a structured tool based on widely accepted methodologic principles from Drummond's framework to extract key information on the clinical evidence considered in the reports.

RESULTS

Out of 1376 identified reports, 93 were eligible for analysis. All reports based their assessment primarily on direct evidence, in most cases (68%) identified through an independent systematic literature search. In more than half the identified studies considered in the reports, clinical evidence for demonstration of effectiveness and safety was of moderate or low quality. Even when systematic reviews and randomized controlled trials were available for assessment, most studies showed an unclear or high risk of bias.

CONCLUSIONS

This study confirms that the quality of scientific evidence used in HTA of high-risk MDs is low and therefore the use of evidence needs improvement. The European Commission recently updated the regulation on MDs but mainly focused on the safety of materials and the CE (Conformité Européene [European Conformity]) mark. Our results show that additional changes are necessary, specifically with regard to the marketing authorization process of MDs, with stricter quality requirements based on methodologically robust trials, possibly in combination with other evidence sources.

Evidence-based decision-making for diagnostic and therapeutic methods: the changing landscape of assessment approaches in Germany

This article examines the current status and most important changes over time to the legislative framework on the health technology assessment-informed decision-making process on diagnostic and therapeutic ‘methods’ in Germany. The relevant information was obtained through documentary analysis covering the period 1990 to 2017. The findings show that, even if the outpatient care sector appears to be much more regulated than the inpatient sector (based on a strict separation of the two care settings), developments in Germany have led to a more tightened assessment framework, making the use of evidence a firm component in the decision-making process. Nevertheless, a comprehensive approach for a systematic assessment of diagnostic and therapeutic ‘methods’ still does not exist. Readjustments of current regulations in Germany, such as the existing ‘Verbotsvorbehalt’ (i.e. provision of a diagnostic and therapeutic ‘method’ possible unless actively delisted) in the inpatient care setting, as well as further developments at the European level are needed in order to create a system that ensures early access to innovation under controlled study conditions.