How real can we get in generating real world evidence? Exploring the opportunities of routinely collected administrative data for evaluation of medical devices

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review

BACKGROUND

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking.

OBJECTIVE

This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices.

METHODS

We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites.

RESULTS

A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation).

CONCLUSIONS

The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Evolving Use of Health Technology Assessment in Medical Device Procurement-Global Systematic Review: An ISPOR Special Interest Group Report

OBJECTIVES

To review the current academic evidence describing how data from health technology assessments (HTAs) informs procurement decisions for medical devices.

METHODS

A systematic literature review was performed to identify relevant studies and criteria used in medical device purchasing or procurement decisions. Included articles were screened for relevancy and risk of bias. The included studies were summarized qualitatively.

RESULTS

A total of 292 studies were screened, of which 11 matched the inclusion criteria. Included studies' geographies and HTA maturity varied. Some studies described hospital-level HTA processes, whereas others focused on national-level recommendations. Criteria for procurement decisions included standard HTA factors, such as efficacy, cost, cost-effectiveness, and budget impact; broader issues were also noted, including impact on the organization, ethical aspects, staff workload, and volume. There was little consideration of device-specific characteristics, such as life cycle, learning curve, or incremental technical innovation. Few decisions referred to HTA reports as part of the procurement decision; similarly, few HTA reports included a procurement perspective to help guide the procurement bodies.

CONCLUSIONS

There is minimal evidence that notes HTA influencing medical device procurement. Procurement bodies and hospitals may not be incentivized to publish their work and transparency could be improved; further research would better describe the link between HTA and procurement. Such research would enable the HTA agencies to meaningfully assess devices to target procurement bodies and allow device sponsors to prioritize evidence. This could limit redundancy, improve evidence, and ultimately promote savings to healthcare systems and expand access.

Coverage with evidence development for medical devices in Europe: Can practice meet theory?

Health economists have written extensively on the design and implementation of coverage with evidence development (CED) schemes and have proposed theoretical frameworks based on cost-effectiveness modeling and value of information analysis. CED may aid decision-makers when there is uncertainty about the (cost-)effectiveness of a new health technology at the time of reimbursement. Medical devices are potential candidates for CED schemes, as regulatory regimes do not usually require the same level of efficacy and safety data normally needed for pharmaceuticals. The purpose of this research is to assess whether the actual practice of CED for medical devices in Europe meets the theoretical principles proposed by health economists and whether theory and practice can be more closely aligned. Based on decision-makers' perceptions of the challenges associated with CED schemes, plus examples from the schemes themselves, we discuss a series of proposals for assessing the desirability of schemes, their design, implementation, and evaluation. These proposals, while reflecting the practical challenges with developing CED programs, embody many of the principles suggested by economists and should support decision-makers in dealing with uncertainty about the real-world performance of devices.

Pushing the boundaries of evaluation, diffusion, and use of medical devices in Europe: Insights from the COMED project

The field of medical devices has attracted considerable interest from scholarly research in health economics in recent years. Medical devices are indispensable tools for quality health care delivery, but their assessment and appropriate use pose significant challenges to healthcare systems. More research is needed to overcome existing gaps associated with evaluation of digital technologies, address challenges in the use of real-world data in generating evidence for decision-making and to uncover drivers of variation in access to medical devices across countries. Furthermore, the translation of the results and recommendations stemming from research projects into health technology assessment practices needs to be strengthened. The European Union (EU) project COMED aimed to address these gaps by improving existing research and developing new research streams on the methods for evaluation and diffusion of medical devices. The project also intended to provide directly applicable policy advice and tools to inform decision-making, with the aim of impacting public health in the EU. This Health Economics Supplement, together with references of other published outputs of the project, is intended to be the main source for researchers and policy makers seeking information on the COMED project.