Health Technology Assessment: managing the introduction and use of medical devices in clinical practice in Italy

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review

BACKGROUND

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking.

OBJECTIVE

This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices.

METHODS

We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites.

RESULTS

A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation).

CONCLUSIONS

The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Thermal ablation for benign, non-functioning thyroid nodules: A clinical review focused on outcomes, technical remarks, and comparisons with surgery

Thermal ablation (TA) is a therapeutic option for benign, non-functioning thyroid nodules causing symptoms of compression and/or aesthetic concerns. TA was initially introduced as a treatment for patients who refused or were ineligible for surgery. In more recent years, the increase in the positive experiences of TA have paved the way for the idea that TA could be suggested as a first-line treatment. The present review was conceived to summarize the evidence achieved in this field, and to offer a clinical perspective on TA, with particular reference to the comparison between TA and surgery. We searched literature that was focused on two types of TA, laser (LA) and radiofrequency (RFA). The searched literature included short- mid-term prospective and retrospective studies, randomized trials, and meta-analyses that demonstrated a satisfactory volume reduction ratio (VRR), and benefits in cosmetic and symptoms scores. An important drawback of the use of TA, is the regrowth of a certain number of nodules, which necessitate further TA procedures or surgery. Long-term randomized controlled trials to evaluate the cost/effectiveness of TA vs surgery are not currently available. The selection of the nodule, the optimization of interventional techniques, and ultimately, a well-timed second treatment, are all factors that should be considered in a proactive strategy to prevent TA failure.

Defining the clinician's role in early health technology assessment during medical device innovation - a systematic review

Background

Early Health Technology Assessment (EHTA) is an evolving field in health policy which aims to provide decision support and mitigate risk during early medical device innovation. The clinician is a key stakeholder in this process and their role has traditionally been confined to assessing device efficacy and safety alone. There is however, no data exploring their role in this process and how they can contribute towards it. This motivated us to carry out a systematic review to delineate the role of the clinician in EHTA as per the PRISMA guidelines.

Methods

A systematic search of peer reviewed literature was undertaken across PUBMED, OVID Medline and Web of science up till June 2018. Studies that were suitable for inclusion focused on clinician input in health technology assessment or early medical device innovation. A qualitative approach was utilised to generate themes on how clinicians could contribute in general and specific areas of EHTA. Data was manually extracted by the authors and themes were agreed in consensus using a grounded theory framework. The specific stages included: All stages of EHTA, Basic research on mechanisms, Targeting for specific product, Proof of principle and Prototype and product development. Bias was assessed utilising the NICE Qualitative checklist.

Results

A total of 33 articles met the inclusion criteria for the review. Areas identified in which the clinicians could contribute to EHTA included: i) needs driven problem solving, ii) conformity assessment of MDs, iii) economic evaluation of MDs and iv) addressing the conflicts in interest. For clinicians’ input across the various specific areas of EHTA, an innovation framework was generated based on the subthemes extracted.

Conclusions

The following review has identified the various segments in which clinicians can contribute to EHTA to inform stakeholders and has also proposed an innovation framework.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4305-9) contains supplementary material, which is available to authorized users.

Designing medical technology for resilience: integrating health economics and human factors approaches

INTRODUCTION

The slow adoption of innovation into healthcare calls into question the manner of evidence generation for medical technology. This paper identifies potential reasons for this including a lack of attention to human factors, poor evaluation of economic benefits, lack of understanding of the existing healthcare system and a failure to recognise the need to generate resilient products. Areas covered: Recognising a cross-disciplinary need to enhance evidence generation early in a technology's life cycle, the present paper proposes a new approach that integrates human factors and health economic evaluation as part of a wider systems approach to the design of technology. This approach (Human and Economic Resilience Design for Medical Technology or HERD MedTech) supports early stages of product development and is based on the recent experiences of the National Institute for Health Research London Diagnostic Evidence Co-operative in the UK. Expert commentary: HERD MedTech i) proposes a shift from design for usability to design for resilience, ii) aspires to reduce the need for service adaptation to technological constraints iii) ensures value of innovation at the time of product development, and iv) aims to stimulate discussion around the integration of pre- and post-market methods of assessment of medical technology.

TAXONOMY OF MEDICAL DEVICES IN THE LOGIC OF HEALTH TECHNOLOGY ASSESSMENT

OBJECTIVES

The suitability of general HTA methodology for medical devices is gaining interest as a topic of scientific discourse. Given the broad range of medical devices, there might be differences between groups of devices that impact both the necessity and the methods of their assessment. Our aim is to develop a taxonomy that provides researchers and policy makers with an orientation tool on how to approach the assessment of different types of medical devices.

METHODS

Several classifications for medical devices based on varying rationales for different regulatory and reporting purposes were analyzed in detail to develop a comprehensive taxonomic model.

RESULTS

The taxonomy is based on relevant aspects of existing classification schemes incorporating elements of risk and functionality. Its 9 × 6 matrix distinguishes between the diagnostic or therapeutic nature of devices and considers whether the medical device is directly used by patients, constitutes part of a specific procedure, or can be used for a variety of procedures. We considered the relevance of different device categories in regard to HTA to be considerably variable, ranging from high to low.

CONCLUSIONS

Existing medical device classifications cannot be used for HTA as they are based on different underlying logics. The developed taxonomy combines different device classification schemes used for different purposes. It aims at providing decision makers with a tool enabling them to consider device characteristics in detail across more than one dimension. The placement of device groups in the matrix can provide decision support on the necessity of conducting a full HTA.

Implantable devices for the closure of patent foramen ovale in adults: an Italian rapid health technology assessment

Percutaneous closure of patent foramen ovale (PFO) is offered to patients suffering from cryptogenic stroke, transient ischemic attack or persistent migraine. Several PFO closure devices are CE marked but none have yet been approved by the FDA. On the Italian market 11 different PFO closure devices are available and more than 2500 PFO procedures were reported in 2012. We report findings of a systematic review and meta-analysis of studies in which patients with PFO and transient ischemic attacks, cryptogenic stroke or persistent migraine who underwent PFO closure were compared to patients treated by usual care. We included five controlled clinical trials and one randomized controlled trial. Included studies had poor methodological quality and heterogeneity. In the included randomized controlled trial, 4.7% of procedure-related serious adverse events were observed. Large multicenter, sufficiently powered, and properly randomized trials need to be conducted in Europe with particular attention to patient selection.

PRE-MARKET CLINICAL EVALUATIONS OF INNOVATIVE HIGH-RISK MEDICAL DEVICES IN EUROPE

Objectives: High-quality clinical evidence is most often lacking when novel high-risk devices enter the European market. At the same time, a randomized controlled trial (RCT) is often initiated as a requirement for obtaining market access in the US. Should coverage in Europe be postponed until RCT data are available? We studied the premarket clinical evaluation of innovative high-risk medical devices in Europe compared with the US, and with medicines, where appropriate.

Methods: The literature and regulatory documents were checked. Representatives from industry, Competent Authorities, Notified Bodies, Ethics Committees, and HTA agencies were consulted. We also discuss patient safety and the transparency of information.

Results: In contrast to the US, there is no requirement in Europe to demonstrate the clinical efficacy of high-risk devices in the premarket phase. Patients in Europe can thus have earlier access to a potentially lifesaving device, but at the risk of insufficiently documented efficacy and safety. Variations in the stringency of clinical reviews, both at the level of Notified Bodies and Competent Authorities, do not guarantee patient safety. We tried to document the design of premarket trials in Europe and number of patients exposed, but failed as this information is not made public. Furthermore, the Helsinki Declaration is not followed with respect to the registration and publication of premarket trials.

Conclusions: For innovative high-risk devices, new EU legislation should require the premarket demonstration of clinical efficacy and safety, using an RCT if possible, and a transparent clinical review, preferably centralized.

IMPLEMENTING A NATIONAL EARLY AWARENESS AND ALERT SYSTEM FOR NEW AND EMERGING HEALTH TECHNOLOGIES IN ITALY: THE COTE PROJECT

Objectives: The aim of this study was to establish a national Early Awareness and Alert (EAA) system for the identification and assessment of new and emerging health technologies in Italy.

Methods: In 2008, Agenas, a public body supporting Regions and the Ministry of Health (MoH) in health services research, started a project named COTE (Observatory of New and Emerging Health Technologies) with the ultimate aim of implementing a national EAA system. The COTE project involved all stakeholders (MoH, Regions, Industry, Universities, technical government bodies, and Scientific Societies), in defining the key characteristics and methods of the EAA system. Agreement with stakeholders was reached using three separate workshops.

Results: During the workshops, participants shared and agreed methods for identification of new and emerging health technologies, prioritization, and assessment. The structure of the Horizon Scanning (HS) reports was discussed and defined. The main channels for dissemination of outputs were identified as the EuroScan database, and the stakeholders’ Web portals. During the final workshop, Agenas presented the first three HS reports produced at national level and proposed the establishment of a permanent national EAA system.

Conclusions: The COTE Project created the basis for a permanent national EAA system in Italy. An infrastructure to enable the stakeholders network to grow was created, methods to submit new and emerging health technologies for possible evaluation were established, methods for assessment of the technologies selected were defined, and the stakeholders involvement was delineated (in the identification, assessment, and dissemination stages).