Multiple Criteria Decision Analysis in Health Technology Assessment for Drugs: Just Another Illusion?

Synthesis of relevant information around non-core domains to support Multi-Criteria Decision Analysis (MCDA) for decision making

Countries fundamentally base macro and micro decision making in the field of health on economic considerations, the budgetary impact of technologies being a major criterion. Nevertheless, the value of the technology of interest and its dimensions are more complex if we seek to take decisions based on the value itself. The use of structured and explicit approaches that require the assessment of multiple criteria that reflect the dimensions of this value may significantly improve the quality of the decision making. Multi-criteria decision analysis (MCDA) is a complementary decision-making tool that is able to systematically incorporate dimensions or domains such as ethical, organisational, legal, environmental and social considerations, as well as costs and benefits of medical interventions, together with the distinct perspectives of the interested parties. The objective of this article is to propose the implementation of analysis of non-core domains, in reports of Health Technology Assessment (HTA) agencies/units. To assess the scientific evidence on MCDA techniques a systematic review was conducted using structured searches in biomedical databases and websites of various HTA organisations. A consensus group was held using the nominal group technique and involving users of healthcare services, providers, managers and academics. Complementary, a survey was sent to HTA agencies to ascertain the degree of implementation of MCDA in their methods. 42 articles reporting the use of non-core criteria for the assessment of health technologies were included in the analysis. From these articles, a total of 216 non-core criteria were retrieved and categorised into domains by the researchers, and of these, 56 were classified as socioeconomic, 59 as organisational, 10 as legal, 8 as environmental and 47 as ethical, while 36 were considered to relate to other domains. The consensus group, based on the 216 non-core criteria obtained from the systematic review, proposed, and defined 26 criteria that participants considered necessary for decision making in healthcare. The consensus group did not consider that any of the domains should be given more weight than others or that any individual criteria should dominate. These approaches can serve as a framework of reference for a well-structured systematic discussion concerning the basis of individual criteria and the evidence supporting them.

Multi-criteria decision analysis for health technology assessment: addressing methodological challenges to improve the state of the art

BACKGROUND

Multi-criteria decision analysis (MCDA) concepts, models and tools have been used increasingly in health technology assessment (HTA), with several studies pointing out practical and theoretical issues related to its use. This study provides a critical review of published studies on MCDA in the context of HTA by assessing their methodological quality and summarising methodological challenges.

METHODS

A systematic review was conducted to identify studies discussing, developing or reviewing the use of MCDA in HTA using aggregation approaches. Studies were classified according to publication time and type, country of study, technology type and study type. The PROACTIVE-S approach was constructed and used to analyse methodological quality. Challenges and limitations reported in eligible studies were collected and summarised; this was followed by a critical discussion on research requirements to address the identified challenges.

RESULTS

129 journal articles were eligible for review, 56% of which were published in 2015-2017; 42% focused on pharmaceuticals; 36, 26 and 18% reported model applications, issues regarding MCDA implementation analyses, and proposing frameworks, respectively. Poor compliance with good methodological practice (< 25% complying studies) was found regarding behavioural analyses, discussion of model assumptions and uncertainties, modelling of value functions, and dealing with judgment inconsistencies. The five most reported challenges related to evidence and data synthesis; value system differences and participant selection issues; participant difficulties; methodological complexity and resource balance; and criteria and attributes modelling. A critical discussion on ways to address these challenges ensues.

DISCUSSION

Results highlight the need for advancement in robust methodologies, procedures and tools to improve methodological quality of MCDA in HTA studies. Research pathways include developing new model features, good practice guidelines, technologies to enable participation and behavioural research.

From Health Technology Assessment to Health Technology Sustainability

This paper aims to propose a methodological lens to the assessment of technological innovations in healthcare based on the principles of social, economic, and political sustainability. Starting from the consideration of a lack of a unified interpretative framework of health technology assessment, using a content analysis of the relevant literature on the topic, we identified both the scientific perspectives adopted by the scholars and the most widely discussed topics. Consequently, the less explored scientific areas were framed, and, therefore, those more susceptible to further investigation came to light. The result is an overall picture which highlights the absence of unified and generally accepted approaches to evaluation, together with the lack of awareness on the fact that the multiplicity of methods adopted is essentially connected to the multiplicity of innovations, for each of which a method (or a set of methods) of preferable evaluation can be prefigured. Based on these observations, we propose a general reference framework for evaluation, based on the Viable Systems Approach (vSa), and a schematic outline of the connections between the complexity of innovations and the evaluation methodologies.