Factors influencing coverage decisions on medical devices: A retrospective analysis of 78 medical device appraisals for the Austrian hospital benefit catalogue 2008⿿2015

Gaps in the evidence underpinning high-risk medical devices in Europe at market entry, and potential solutions

AIM

To determine the level of evidence for innovative high-risk medical devices at market entry.

METHODS

We reviewed all Belgian healthcare payer (RIZIV-INAMI) assessor reports on novel implants or invasive medical devices (n = 18, Class IIb-III) available between 2018 to mid-2019 on applications submitted for inclusion on their reimbursement list. We also conducted a review of the literature on evidence gaps and an analysis of relevant legal and ethical frameworks within the European context.

FINDINGS

Conformity assessment of medical devices is based on performance, safety, and an acceptable risk-benefit balance. Information submitted for obtaining CE marking is confidential and legally protected, limiting access to clinical evidence. Seven out of the 18 RIZIV-INAMI assessor reports (39%) included a randomized controlled trial (RCT) using the novel device, whilst 2 applications (11%) referred to an RCT that used a different device. The population included was inappropriate or unclear for 3 devices (17%). Only half of the applications presented evidence on quality of life or functioning and 2 (11%) presented overall survival data. Four applications (22%) included no data beyond twelve months. The findings from the literature demonstrated similar problems with the study design and the clinical evidence.

DISCUSSION AND CONCLUSIONS

CE marking does not indicate that a device is effective, only that it complies with the law. The lack of transparency hampers evidence-based decision making. Despite greater emphasis on clinical benefit for the patient, the provisions of the European Medical Device Regulation (MDR) are not yet fully aligned with international ethical standards for clinical research. The MDR fails to address key issues, such as the lack of access to data submitted for CE marking and a failure to require evidence of clinical effectiveness. Indeed, a first report shows no improvement in the clinical evidence for implantable devices generated under the MDR. Thus, patients may continue to be exposed to ineffective or unsafe novel devices. The Health Technology Assessment Regulation plans for Joint Scientific Consultations for specific high-risk devices before companies begin their pivotal clinical investigations. The demanded comparative evidence should facilitate payer decisions. Nevertheless, there is also a need for legislation requiring comparative RCTs assessing patient-relevant outcomes for high-risk devices to ensure implementation, including development and implementation of common specifications for study designs.

Hospital crowdedness evaluation and in-hospital resource allocation based on image recognition technology

How to allocate the existing medical resources reasonably, alleviate hospital congestion and improve the patient experience are problems faced by all hospitals. At present, the combination of artificial intelligence and the medical field is mainly in the field of disease diagnosis, but lacks successful application in medical management. We distinguish each area of the emergency department by the division of medical links. In the spatial dimension, in this study, the waitlist number in real-time is got by processing videos using image recognition via a convolutional neural network. The congestion rate based on psychology and architecture is defined for measuring crowdedness. In the time dimension, diagnosis time and time-consuming after diagnosis are calculated from visit records. Factors related to congestion are analyzed. A total of 4717 visit records from the emergency department and 1130 videos from five areas are collected in the study. Of these, the waiting list of the pediatric waiting area is the largest, including 10,436 (person-time) people, and its average congestion rate is 2.75, which is the highest in all areas. The utilization rate of pharmacy is low, with an average of only 3.8 people using it at the one time. Its average congestion rate is only 0.16, and there is obvious space waste. It has been found that the length of diagnosis time and the length of time after diagnosis are related to age, the number of diagnoses and disease type. The most common disease type comes from respiratory problems, accounting for 54.3%. This emergency department has congestion and waste of medical resources. People can use artificial intelligence to investigate the congestion in hospitals effectively. Using artificial intelligence methods and traditional statistics methods can lead to better research on healthcare resource allocation issues in hospitals.

Health technology assessment of medical devices: current landscape, challenges, and a way forward

Background

Health Technology Assessment (HTA) has been widely recognized as informing healthcare decision-making, and interest in HTA of medical devices has been steadily increasing. How does the assessment of medical devices differ from that of drug therapies, and what innovations can be adopted to overcome the inherent challenges in medical device HTA?

Method

HTA Accelerator Database was used to describe the landscape of HTA reports for medical devices from HTA bodies, and a literature search was conducted to understand the growth trend of relevant HTA publications in four case studies. Another literature review was conducted for a narrative synthesis of the characteristic differences and challenges of HTA in medical devices. We further conducted a focused Internet search of guidelines and a narrative review of methodologies specific to the HTA of medical devices.

Main body

The evidence of HTA reports and journal publications on medical devices around the world has been growing. The challenges in assessing medical devices include scarcity of well-designed randomized controlled trials, inconsistent real-world evidence data sources and methods, device-user interaction, short product lifecycles, inexplicit target population, and a lack of direct medical outcomes. Practical solutions in terms of methodological advancement of HTA for medical devices were also discussed in some HTA guidelines and literature.

Conclusion

To better conduct HTA on medical devices, we recommend considering multi-source evidence such as real-world evidence; standardizing HTA processes, methodologies, and criteria; and integrating HTA into decision-making.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12962-022-00389-6.

Using the Dynamic SWOT Analysis to Assess Options for Implementing the HB-HTA Model

This paper is aimed at exploring the role of the HB-HTA ecosystem as an important pathway for popularizing the implementation of innovations in healthcare organizations. The scientific debate has largely been focused on the rising importance of HB-HTA and the principles guiding the process. Solutions implemented by individual countries differ, which may be rooted in historical, cultural, and institutional differences. Our understanding of the impact of individual countries’ healthcare systems on HB-HTA solutions and infrastructure still lacks a basis in interpretative studies. A conceptual framework is proposed to assess the aptness of the HB-HTA model designed for hospitals operating in a country or region, focused on the concepts of adaptiveness and responsiveness to features of the healthcare system present there. A tool is proposed for investigating factors that are likely to assist the successful implementation of the HB-HTA ecosystem. A dynamic SWOT analysis on the case of the HB-HTA model designed for Poland provides interesting insights into the building of the conceptual framework. The results of this study help explain how to create an HB-HTA model that is best adapted to the regional or national healthcare system, including potential risks and opportunities.

Reimbursement decisions for medical services in Austria: an analysis of influencing factors for the hospital individual services catalogue between 2008 and 2020

OBJECTIVES

To (1) describe the (evidence-based) reimbursement process of hospital individual services, (2) evaluate the accordance between evidence-based recommendations and reimbursement decision of individual services and (3) elaborate potential aspects that play a role in the decision-making process in Austria.

METHOD

The reimbursement process is described based on selected relevant sources such as official documents. Evidence-based recommendations and subsequent reimbursement decisions for the annual maintenance of the hospital individual service catalogue in Austria between 2008 and 2020 were analysed using a mixed methods approach, encompassing descriptive statistics and a focus group with Austrian decision makers.

RESULTS

118 evidence-based recommendations were analysed. There were 93 (78.8%) negative and 25 (21.2%) positive evidence-based recommendations. In total, 107 out of 118 evidence-based recommendations (90.1%) did not lead to a deviating reimbursement decision. We identified six aspects that may have played a role in the decision-making process for the annual maintenance of the hospital individual service catalogue, with clinical evidence being the most notable. Further aspects included quality assurance/organisational aspects (i.e., structural quality assurance), costs (if comparable to already existing medical services, not: cost-effectiveness), procedural aspects (e.g., if certain criteria for adoption have not been met formally through the proposals), "other countries" (i.e., taking into account how other countries decided) and situational aspects (such as the COVID-19 pandemic).

CONCLUSIONS

There is good accordance between evidence-based recommendations and reimbursement decisions regarding hospital individual services in Austria. Beyond clinical evidence, organisational aspects seem to be considered often with regard to quality assurance but costs do not appear to play a major role. The Austrian system has mechanisms in place that can restrict widespread adoption of novel hospital individual services with uncertain clinical benefits. Future studies could investigate how well these mechanisms work and how they compare to other health systems in Europe.

Recommendations for the Implementation of Hospital Based HTA in Poland: Lessons Learned From International Experience

Introduction: The main challenge of modern hospitals is purchasing medical technologies. Hospital-based health technology assessments (HB-HTAs) are used in healthcare facilities around the world to support management boards in providing relevant technologies for patients. Aim: This study was undertaken to update the existing body of knowledge on the characteristics of HB-HTA systems/models in the selected European countries. Insights gained from this study were used to provide an optimal approach for implementing HB-HTA in Poland. Materials and methods: Firstly, we carried out a systematic review in PubMed and embase. Secondly, we searched for gray literature via the AdHopHTA online handbook and the design book of the AdHopHTA project, as well as literature describing healthcare systems provided by the WHO. Then, we conducted in-depth interviews with HB-HTA experts from four countries. Finally, we selected ten countries from Europe and prepared frameworks for data collection and analyses. Results: The selected countries (Switzerland, Spain, France, Italy, Denmark, Finland, Sweden, the Netherlands, and Austria) are examples of decentralized or deconcentrated healthcare systems. In terms of HB-HTA, differences in organisational models (independent group, stand-alone, integrated-essential, integrated-specialised), type of financing (internally vs. externally), collaboration with an HTA National Agency and other stakeholders (e.g., Patients' Associations) were identified. HB-HTA engages multi-skilled staff with various academic backgrounds and operates mainly on a voluntary basis. Conclusion: Strengths and weaknesses associated with various organisational models must be carefully considered in the context of support for decentralized or centralized models of implementation while embarking on HTA activities in Polish hospitals.

The status of health economic evaluation within decision making in Austria

BACKGROUND

Given limited resources compared to the demand for them, spending resources efficiently is important. Key methods applied for supporting efficient resource allocation are health economic evaluations.

METHODS

Based on secondary literature, we analyze international challenges for using two types of economic evaluations-cost-effectiveness analysis and cost-utility analysis-in reimbursement decisions and reflect on them for the Austrian case.

RESULTS

The main challenges with the application of economic evaluations are related to the methods, the decision-making culture, and the respective system. The challenges also apply to the Austrian Bismarck system, where almost no formal requirements for using economic evaluations exist, except on a case-by-case basis. Resource allocation in Austria hence occurs, for the most part, implicitly.

CONCLUSION

One way forward towards more explicit efficiency considerations may be to consider more descriptive study types and foster capacity building, standardization of methods and presentation of results, and a mandatory detailed guideline.

Pre-reimbursement: early assessment for coverage decisions

Background

In the past decade, the Ludwig Boltzmann Institute for Health Technology Assessment (LBI-HTA) has introduced two programs: “Horizon Scanning in Oncology” (HSO) and extra medical services (“MELs”), which are to facilitate coverage decisions based on early assessments. This article aims to outline the general process and methods within these two programs.

Methods

A narrative-descriptive synthesis of the literature was performed to outline the general and LBI-HTA-specific processes and methods of early assessments.

Results

In total, 79 HSO assessments (2009–2018) and 95 MELs (2008–2018) have been conducted by the LBI-HTA. Recently, additional methods that contribute to European applicability have been introduced into these programs.

Conclusions

Overall, pre-coverage decisions based on early assessment reports are dependent on the existing evidence. However, the organisation of the health care system and the cross-linking between decision-makers and HTA institutions can have an impact.

Scientific Evidence in Health Technology Assessment Reports: An In-Depth Analysis of European Assessments on High-Risk Medical Devices

BACKGROUND

The aim of this study was to examine the scientific evidence on clinical effectiveness and safety used in health technology assessments (HTAs) of high-risk medical devices (MDs) in Europe.

METHODS

We applied a systematic approach to identify European institutions involved in HTA and to select reports assessing MDs considered high-risk according to the definition in the new German health care regulation §137h. Reports published between 2010 and 2015 were considered in our subsequent analysis. We used a structured tool based on widely accepted methodologic principles from Drummond's framework to extract key information on the clinical evidence considered in the reports.

RESULTS

Out of 1376 identified reports, 93 were eligible for analysis. All reports based their assessment primarily on direct evidence, in most cases (68%) identified through an independent systematic literature search. In more than half the identified studies considered in the reports, clinical evidence for demonstration of effectiveness and safety was of moderate or low quality. Even when systematic reviews and randomized controlled trials were available for assessment, most studies showed an unclear or high risk of bias.

CONCLUSIONS

This study confirms that the quality of scientific evidence used in HTA of high-risk MDs is low and therefore the use of evidence needs improvement. The European Commission recently updated the regulation on MDs but mainly focused on the safety of materials and the CE (Conformité Européene [European Conformity]) mark. Our results show that additional changes are necessary, specifically with regard to the marketing authorization process of MDs, with stricter quality requirements based on methodologically robust trials, possibly in combination with other evidence sources.

The bare necessities? A realist review of necessity argumentations used in health care coverage decisions

CONTEXT

Policy makers and insurance companies decide on coverage of care by both calculating (cost-) effectiveness and assessing the necessity of coverage.

AIM

To investigate argumentations pertaining to necessity used in coverage decisions made by policy makers and insurance companies, as well as those argumentations used by patients, authors, the public and the media.

METHODS

This study is designed as a realist review, adhering to the RAMESES quality standards. Embase, Medline and Web of Science were searched and 98 articles were included that detailed necessity-based argumentations.

RESULTS

We identified twenty necessity-based argumentation types. Seven are only used to argue in favour of coverage, five solely for arguing against coverage, and eight are used to argue both ways. A positive decision appears to be facilitated when patients or the public set the decision on the agenda. Moreover, half the argumentation types are only used by patients, authors, the public and the media, whereas the other half is also used by policy makers and insurance companies. The latter group is more accepted and used in more different countries.

CONCLUSION

The majority of necessity-based argumentation types is used for either favouring or opposing coverage, and not for both. Patients, authors, the public and the media use a broader repertoire of argumentation types than policy makers and insurance companies.