Do existing real-world data sources generate suitable evidence for the HTA of medical devices in Europe? Mapping and critical appraisal

Economic value of diastasis repair with the use of mesh compared to no intervention in Italy

AIM

Rectus abdominal diastasis (RAD) can cause mainly incontinence and lower-back pain. Despite its high incidence, there is no consensus regarding surgical indication. We aimed at comparing RAD repair (minimally invasive technique with mesh implant) with no treatment (standard of care - SOC) through cost-effectiveness and budget impact analyses from both National Healthcare Service (NHS) and societal perspectives in Italy.

METHODS

A model was developed including social costs and productivity losses derived by the online administration of a socio-economic questionnaire, including the EuroQol for the assessment of quality of life. Costs for the NHS were based on reimbursement tariffs.

RESULTS

Over a lifetime horizon, estimated costs were 64,115€ for SOC and 46,541€ for RAD repair in the societal perspective; QALYs were 19.55 and 25.75 for the two groups, respectively. Considering the NHS perspective, RAD repair showed an additional cost per patient of 5,104€ compared to SOC, leading to an ICUR of 824€. RAD repair may be either cost-saving or cost-effective compared to SOC depending on the perspective considered. Considering a current scenario of 100% SOC, an increased diffusion of RAD repair from 2 to 10% in the next 5 years would lead to an incremental cost of 184,147,624€ for the whole society (87% borne by the NHS) and to incremental 16,155 QALYs.

CONCLUSION

In light of the lack of economic evaluations for minimally invasive RAD repair, the present study provides relevant clinical and economic evidence to help improving the decision-making process and allocating scarce resources between competing ends.

Ethical challenges for Health Technology Assessment (HTA) in the evolving evidence landscape

Since its inception, Health Technology Assessment (HTA) has typically determined the value of a technology by collecting information derived from randomized clinical trials (RCTs), in line with the principles of evidence-based medicine (EBM). However, data from RCTs did not constitute the sole source of information, as other types of evidence (such as primary qualitative research) have often been utilized. Recent advances in both generating and collecting other types of evidence are broadening the landscape of evidence, adding complexity to the discussion of "robustness of evidence." What are the consequences of these recent developments for the methodology and conduct of HTA, the HTA community, and its ethical commitments? The aim of this article is to explore some ethical challenges that are emerging in the current evolving evidence landscape, particularly changes in evidence generation and collection (e.g., diversification of data sources), and shifting standards of evidence in the field of HTA (e.g., increasing acceptability of evidence that is thought of as lower quality). Our conclusion is that deciding how to best maintain trustworthiness is common to all these issues.

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review

BACKGROUND

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking.

OBJECTIVE

This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices.

METHODS

We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites.

RESULTS

A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation).

CONCLUSIONS

The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Real-world data: a comprehensive literature review on the barriers, challenges, and opportunities associated with their inclusion in the health technology assessment process

Objective: This review aimed to assess the current use and acceptance of real-world data (RWD) and real-world evidence (RWE) in health technology assessment (HTA) process. It additionally aimed to discern stakeholders' viewpoints concerning RWD and RWE in HTA and illuminate the obstacles, difficulties, prospects, and consequences associated with the incorporation of RWD and RWE into the realm of HTA. Methods: A comprehensive PRISMA-based systematic review was performed in July 2022 in PubMed/Medline, Scopus, IDEAS-RePEc, International HTA database, and Centre for Reviews and Dissemination with ad hoc supplementary search in Google Scholar and international organization websites. The review included pre-determined inclusion criteria while the selection of eligible studies, the data extraction process and quality assessment were carried out using standardized and transparent methods. Results: Twenty-nine (n = 29) studies were included in the review out of 2,115 studies identified by the search strategy. In various global contexts, disparities in RWD utilization were evident, with randomized controlled trials (RCTs) serving as the primary evidence source. RWD and RWE played pivotal roles, surpassing relative effectiveness assessments (REAs) and significantly influencing decision-making and cost-effectiveness analyses. Identified challenges impeding RWD integration into HTA encompassed limited local data access, complexities in non-randomized trial design, data quality, privacy, and fragmentation. Addressing these is imperative for optimal RWD utilization. Incorporating RWD/RWE in HTA yields multifaceted advantages, enhancing understanding of treatment efficacy, resource utilization, and cost analysis, particularly via patient registries. RWE complements assessments of advanced therapy medicinal products (ATMPs) and rare diseases. Local data utilization strengthens HTA, bridging gaps when RCT data is lacking. RWD aids medical device decision-making, cancer drug reassessment, and indirect treatment comparisons. Challenges include data availability, stakeholder acceptance, expertise, and privacy. However, standardization, training, collaboration, and guidance can surmount these barriers, fostering enhanced RWD utilization in HTA. Conclusion: This study highlights the intricate global landscape of RWD and RWE acceptance in HTA. Recognizing regional nuances, addressing methodological challenges, and promoting collaboration are pivotal, among others, for leveraging RWD and RWE effectively in healthcare decision-making.

Economic Evaluation of a Bioinductive Implant for the Repair of Rotator Cuff Tears Compared with Standard Surgery in Italy

INTRODUCTION

Rotator cuff tear (RCT) is a painful, progressive condition resulting from damage to the rotator cuff tendons and is the leading cause of shoulder-related disability. Surgical repair of rotator cuff is an established standard of care (SOC); however, failure of the procedure can occur. In this context, the use of collagen-based bioinductive implant REGENETEN showed long-term improvements in clinical scores. The aim of the study was to assess the cost-effectiveness of REGENETEN combined with SOC (SOC + REGENETEN) compared to SOC alone from both National Healthcare Service (NHS) and societal perspectives in Italy.

METHODS

A decision analytic model was developed to estimate the number of tears healed and costs for the two considered treatment strategies over 1 year. Clinical data were retrieved from the literature, and the clinical pathways for the management of patients with RCTs were retrieved from four key opinion leaders in Italy.

RESULTS

Over a 1-year time horizon, healed lesions were 90.70% and 72.90% for surgical repair of RCTs with and without REGENETEN, respectively. Considering the NHS perspective, mean costs per patient were €7828 and €4650 for the two strategies, respectively, leading to an incremental cost-effectiveness ratio (ICER) of €17,857 per healed tear. From the societal perspective, the mean costs per patient were €12,659 for SOC and €11,784 for REGENETEN, thus showing savings of €4918 per healed tear when the bioinductive implant is used. The sensitivity analyses confirmed the robustness of the model results.

CONCLUSION

In the context of paucity of cost-effectiveness studies, our findings provide additional evidence for clinicians and payers regarding the value of a new treatment option that supports a tailored approach for the management of patients with RCTs.

Integration of real-world evidence from different data sources in health technology assessment

Real-world evidence (RWE) is being increasingly used by a wide range of stakeholders involved in the therapeutic product lifecycle but remains underutilized in the health technology assessment (HTA) process. RWE aims to fill the current evidence gaps, reduce the uncertainty around the benefits of medical technologies, and better understand the long-term impact of health technologies in real-world conditions. Despite the minimal use of RWE in some elements of HTA, there has been a larger push to further utilize RWE in the HTA processes. HTA bodies, as other stakeholders, work towards developing more robust means to leverage RWE from various data sources in the HTA processes. However, these agencies need to overcome important challenges before the broader incorporation of RWE into their routine practice. This paper aims to explore the extensive integration of RWE utilizing diverse sources of RWD. We discuss the utilization of RWE in HTA processes, considering aspects such as when, where, and how RWE can be effectively applied. Additionally, we seek the potential challenges and barriers associated with the utilization of different data sources.

Time-Driven Activity-Based Costing for Capturing the Complexity of Healthcare Processes: The Case of Deep Vein Thrombosis and Leg Ulcers

Time-driven activity-based costing (TDABC) is suggested to assess costs within the value-based healthcare approach, but there is a paucity of applications in chronic diseases such as deep vein thrombosis (DVT) and leg ulcers. In this context, we applied TDABC in a cost-effectiveness analysis comparing venous stenting to compression ± anticoagulation (standard of care-SOC) from both hospital and societal perspectives in Italy. TDABC was applied to both treatments to assess costs that were included in a cost-effectiveness model. Clinical inputs were retrieved from the literature and integrated with real-world data. The Incremental Cost Utility Ratio (ICUR) of stenting compared to SOC was EUR 10,270/QALY and EUR 8962/QALY for hospital and societal perspectives, respectively. The mean cost per patient for venous stenting of EUR 5082 was higher than the Diagnosis-Related Group (DRG) reimbursement (EUR 4742). For SOC, an ulcer healing in 3 months costs EUR 1892, of which EUR 302 (16%) is borne by the patient versus a reimbursement of EUR 1132. TDABC showed that venous stenting may be cost-effective compared with SOC but that reimbursement rates may not completely cover the real costs, which are partially sustained by the patients. A more efficient policy for covering the real costs may be beneficial for both clinical centers and patients.

Recommendations to overcome barriers to the use of artificial intelligence-driven evidence in health technology assessment

Background

Artificial intelligence (AI) has attracted much attention because of its enormous potential in healthcare, but uptake has been slow. There are substantial barriers that challenge health technology assessment (HTA) professionals to use AI-generated evidence for decision-making from large real-world databases (e.g., based on claims data). As part of the European Commission-funded HTx H2020 (Next Generation Health Technology Assessment) project, we aimed to put forward recommendations to support healthcare decision-makers in integrating AI into the HTA processes. The barriers, addressed by the paper, are particularly focusing on Central and Eastern European (CEE) countries, where the implementation of HTA and access to health databases lag behind Western European countries.

Methods

We constructed a survey to rank the barriers to using AI for HTA purposes, completed by respondents from CEE jurisdictions with expertise in HTA. Using the results, two members of the HTx consortium from CEE developed recommendations on the most critical barriers. Then these recommendations were discussed in a workshop by a wider group of experts, including HTA and reimbursement decision-makers from both CEE countries and Western European countries, and summarized in a consensus report.

Results

Recommendations have been developed to address the top 15 barriers in areas of (1) human factor-related barriers, focusing on educating HTA doers and users, establishing collaborations and best practice sharing; (2) regulatory and policy-related barriers, proposing increasing awareness and political commitment and improving the management of sensitive information for AI use; (3) data-related barriers, suggesting enhancing standardization and collaboration with data networks, managing missing and unstructured data, using analytical and statistical approaches to address bias, using quality assessment tools and quality standards, improving reporting, and developing better conditions for the use of data; and (4) technological barriers, suggesting sustainable development of AI infrastructure.

Conclusion

In the field of HTA, the great potential of AI to support evidence generation and evaluation has not yet been sufficiently explored and realized. Raising awareness of the intended and unintended consequences of AI-based methods and encouraging political commitment from policymakers is necessary to upgrade the regulatory and infrastructural environment and knowledge base required to integrate AI into HTA-based decision-making processes better.

Health technology assessment of medical devices: current landscape, challenges, and a way forward

Background

Health Technology Assessment (HTA) has been widely recognized as informing healthcare decision-making, and interest in HTA of medical devices has been steadily increasing. How does the assessment of medical devices differ from that of drug therapies, and what innovations can be adopted to overcome the inherent challenges in medical device HTA?

Method

HTA Accelerator Database was used to describe the landscape of HTA reports for medical devices from HTA bodies, and a literature search was conducted to understand the growth trend of relevant HTA publications in four case studies. Another literature review was conducted for a narrative synthesis of the characteristic differences and challenges of HTA in medical devices. We further conducted a focused Internet search of guidelines and a narrative review of methodologies specific to the HTA of medical devices.

Main body

The evidence of HTA reports and journal publications on medical devices around the world has been growing. The challenges in assessing medical devices include scarcity of well-designed randomized controlled trials, inconsistent real-world evidence data sources and methods, device-user interaction, short product lifecycles, inexplicit target population, and a lack of direct medical outcomes. Practical solutions in terms of methodological advancement of HTA for medical devices were also discussed in some HTA guidelines and literature.

Conclusion

To better conduct HTA on medical devices, we recommend considering multi-source evidence such as real-world evidence; standardizing HTA processes, methodologies, and criteria; and integrating HTA into decision-making.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12962-022-00389-6.

How real can we get in generating real world evidence? Exploring the opportunities of routinely collected administrative data for evaluation of medical devices

Real-world data are considered a potentially valuable source of evidence for assessing medical technologies in clinical practice, but their widespread use is hampered by numerous challenges. Using the case of coronary stents in Italy, we investigate the potential of administrative databases for estimating costs and health outcomes associated with the use of medical devices in real world conditions. An administrative dataset was created ad hoc by merging hospital records from patients admitted between 2013 and 2019 for stent implantations with ambulatory records, pharmaceutical use data and vital statistics. Health outcomes were multifold: all-cause and cardiac mortality and myocardial infarction, within 30 days, 1, 2, 5 years. Costs were estimated from the National Health System perspective. We used multivariable Cox models and propensity score (PS) methods (PS matching; stratification on PS; inverse probability of treatment weighting using PS; PS adjustment). 257,907 coronary stents were implanted in 113,912 patients. For all health outcomes and follow-up times, and across all methods, patients receiving drug-eluting stents (DES) presented lower risk. For all-cause mortality, the DES patient advantage over bare-metal stent (BMS) patients declined over time but remained significant even at 5 years. For myocardial infarction, results remained quite stable. The DES group presented lower cumulative total costs (ranging from 3264 to 2363 Euros less depending on methods). Our results confirm the consolidated evidence of the benefits of DES compared to BMS. The consistency of results across methods suggests internal validity of the study, while highlighting strengths and limitations of each depending on research context. Administrative data yield great potential to perform comparative effectiveness and cost-effectiveness analysis of medical devices provided certain conditions are met.

Pushing the boundaries of evaluation, diffusion, and use of medical devices in Europe: Insights from the COMED project

The field of medical devices has attracted considerable interest from scholarly research in health economics in recent years. Medical devices are indispensable tools for quality health care delivery, but their assessment and appropriate use pose significant challenges to healthcare systems. More research is needed to overcome existing gaps associated with evaluation of digital technologies, address challenges in the use of real-world data in generating evidence for decision-making and to uncover drivers of variation in access to medical devices across countries. Furthermore, the translation of the results and recommendations stemming from research projects into health technology assessment practices needs to be strengthened. The European Union (EU) project COMED aimed to address these gaps by improving existing research and developing new research streams on the methods for evaluation and diffusion of medical devices. The project also intended to provide directly applicable policy advice and tools to inform decision-making, with the aim of impacting public health in the EU. This Health Economics Supplement, together with references of other published outputs of the project, is intended to be the main source for researchers and policy makers seeking information on the COMED project.

Cost-effectiveness analysis of personalised versus standard dosimetry for selective internal radiation therapy with TheraSphere in patients with hepatocellular carcinoma

Aims

To perform a cost-effectiveness analysis (CEA) comparing personalised dosimetry with standard dosimetry in the context of selective internal radiation therapy (SIRT) with TheraSphere for the management of adult patients with locally advanced hepatocellular carcinoma (HCC) from the Italian Healthcare Service perspective.

Materials and methods

A partition survival model was developed to project costs and the quality-adjusted life years (QALYs) over a lifetime horizon. Clinical inputs were retrieved from a published randomised controlled trial. Health resource utilisation inputs were extracted from the questionnaires administered to clinicians in three oncology centres in Italy, respectively. Cost parameters were based on Italian official tariffs.

Results

Over a lifetime horizon, the model estimated the average QALYs of 1.292 and 0.578, respectively, for patients undergoing personalised and standard dosimetry approaches. The estimated mean costs per patient were €23,487 and €19,877, respectively. The incremental cost-utility ratio (ICUR) of personalised versus standard dosimetry approaches was €5,056/QALY.

Conclusions

Personalised dosimetry may be considered a cost-effective option compared to standard dosimetry for patients undergoing SIRT for HCC in Italy. These findings provide evidence for clinicians and payers on the value of personalised dosimetry as a treatment option for patients with HCC.

Solving the Evidence Interpretability Crisis in Health Technology Assessment: A Role for Mechanistic Models?

Health technology assessment (HTA) aims to be a systematic, transparent, unbiased synthesis of clinical efficacy, safety, and value of medical products (MPs) to help policymakers, payers, clinicians, and industry to make informed decisions. The evidence available for HTA has gaps-impeding timely prediction of the individual long-term effect in real clinical practice. Also, appraisal of an MP needs cross-stakeholder communication and engagement. Both aspects may benefit from extended use of modeling and simulation. Modeling is used in HTA for data-synthesis and health-economic projections. In parallel, regulatory consideration of model informed drug development (MIDD) has brought attention to mechanistic modeling techniques that could in fact be relevant for HTA. The ability to extrapolate and generate personalized predictions renders the mechanistic MIDD approaches suitable to support translation between clinical trial data into real-world evidence. In this perspective, we therefore discuss concrete examples of how mechanistic models could address HTA-related questions. We shed light on different stakeholder's contributions and needs in the appraisal phase and suggest how mechanistic modeling strategies and reporting can contribute to this effort. There are still barriers dissecting the HTA space and the clinical development space with regard to modeling: lack of an adapted model validation framework for decision-making process, inconsistent and unclear support by stakeholders, limited generalizable use cases, and absence of appropriate incentives. To address this challenge, we suggest to intensify the collaboration between competent authorities, drug developers and modelers with the aim to implement mechanistic models central in the evidence generation, synthesis, and appraisal of HTA so that the totality of mechanistic and clinical evidence can be leveraged by all relevant stakeholders.