Exploring the perspectives and preferences for HTA across German healthcare stakeholders using a multi-criteria assessment of a pulmonary heart sensor as a case study

Heterogeneity in preferences for outcomes of integrated care for persons with multiple chronic diseases: a latent class analysis of a discrete choice experiment

Purpose

For an integrated care programme to be successful, preferences of the stakeholders involved should be aligned. The aim of this study is to investigate to which extent outcomes beyond health are valued and to study the heterogeneity of preferences of those involved in integrated care.

Methods

A discrete choice experiment (DCE) was conducted to elicit preferences for eight Triple Aim outcomes, i.e., physical functioning, psychological well-being, social relationships & participation, enjoyment of life, resilience, person-centeredness, continuity of care and total health and social care costs. Stakeholders were recruited among Dutch persons with multi-morbidity, informal caregivers, professionals, payers, and policymakers. A Bayesian mixed-logit model was used to analyse the data. Subsequently, a latent class analysis was performed to identify stakeholders with similar preferences.

Results

739 stakeholders completed the DCE. Enjoyment of life was perceived as the most important outcome (relative importance: 0.221) across stakeholders, while total health and social care costs were perceived as least important (0.063). The latent class analysis identified four classes. The first class (19.9%) put most weight on experience with care outcomes. The second class (39%) favoured enjoyment of life. The third class (18%) focused relatively more on physical health. The fourth class (24%) had the least consistent preferences.

Conclusion

This study has highlighted the heterogeneity in views of stakeholders in integrated care on what is important in health(care) for persons with multi-morbidity. To accurately value integrated care a variety of outcomes beyond health–e.g., enjoyment of life and experience with care–should be taken into account.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-022-03147-6.

Exploring physicians and patients' perspectives for current interventions on thyroid nodules using a MCDA method

BACKGROUND

The detection of thyroid cancer has rapidly increased over last few decades without an increase in disease specific mortality. Several studies claim that the diagnose of thyroid nodules through routine ultrasound imaging is often the trigger for cascade effects leading to unnecessary follow-up over many years or to invasive treatment. The objective of this study was to explore physicians' and patients' insights and preferences regarding the current interventions on thyroid nodules.

METHODS

An online survey was developed using a comprehensive multi-criteria decision analysis (MCDA) framework, the EVIdence based Decision-Making (EVIDEM). The EVIDEM core model used in this study encompassed 13 quantitative criteria and four qualitative criteria. Participants were asked to provide weights referring to what matters most important in general for each criterion, performance scores for appraising the interventions on thyroid nodules and their consideration of impact of contextual criteria. Normalized weights and standardized scores were combined to calculate a value contribution across all participants, additionally differences across physicians and patients' group were explored.

RESULTS

48 patients and 31 physicians were included in the analysis. The value estimate of the interventions on thyroid nodules reached 0.549 for patients' group and 0.5 was reported by the physicians' group, compared to 0.543 for all participants. The highest value contributor was 'Comparative effectiveness' (0.073 ± 0.020). For the physicians' group, 'Comparative safety' (0.050 ± 0.023) was given with higher value. And for the patients' group, 'Type of preventive benefits' (0.059 ± 0.022) contributed more positively to the value estimation. 51% participants considered 'Population priorities and access' having a negative impact on the interventions of nodules.66% participants thought that the 'system capacity' had a negative impact.

CONCLUSION

Our study shows participants' preferences on each criterion, i.e., physician indicated keeping the interventions safe and effective more important, patients indicated quality of life after receiving interventions more important. Through comparison among participants, differences have been highlighted, which can make better communication between physicians and patients. This study provides a supportive decision-making for healthcare providers when they explored the interventions on thyroid nodules.

Overcoming Challenges with the Adoption of Point-of-Care Testing: From Technology Push and Clinical Needs to Value Propositions

Major technical challenges often prevent developers from producing new point-of-care technologies that deliver the required clinical performance in the intended settings of use. But even when devices meet clinical requirements, they can fail to be adopted and successfully implemented. Adoption barriers occur when decision makers do not understand the "value proposition" of new technologies. Current discussions of value in the context of point-of-care testing focus predominantly on the intended use and performance of the device from the manufacturer's point-of-view. However, the perspective of potential adopters in determining whether new devices provide value is also important, as is the opinion of all stakeholders who will be impacted. Incorporating value concepts into decisions made across the full development-to-adoption continuum can increase the likelihood that point-of-care testing will have the desired impact on health care delivery and patient outcomes. This article discusses how various approaches to technology development impact adoption and compares the characteristics of these approaches to emerging value concepts. It also provides an overview of value initiatives and tools that are being developed to support the evaluation of value propositions. These are presented for a range of technology adoption decision contexts, with particular applicability to point-of-care testing. Expanding the focus of research to address gaps in both the creation and evaluation of value propositions is imperative in order for value concepts to positively influence the adoption of point-of-care testing.

Multi-criteria decision analysis for health technology assessment: addressing methodological challenges to improve the state of the art

BACKGROUND

Multi-criteria decision analysis (MCDA) concepts, models and tools have been used increasingly in health technology assessment (HTA), with several studies pointing out practical and theoretical issues related to its use. This study provides a critical review of published studies on MCDA in the context of HTA by assessing their methodological quality and summarising methodological challenges.

METHODS

A systematic review was conducted to identify studies discussing, developing or reviewing the use of MCDA in HTA using aggregation approaches. Studies were classified according to publication time and type, country of study, technology type and study type. The PROACTIVE-S approach was constructed and used to analyse methodological quality. Challenges and limitations reported in eligible studies were collected and summarised; this was followed by a critical discussion on research requirements to address the identified challenges.

RESULTS

129 journal articles were eligible for review, 56% of which were published in 2015-2017; 42% focused on pharmaceuticals; 36, 26 and 18% reported model applications, issues regarding MCDA implementation analyses, and proposing frameworks, respectively. Poor compliance with good methodological practice (< 25% complying studies) was found regarding behavioural analyses, discussion of model assumptions and uncertainties, modelling of value functions, and dealing with judgment inconsistencies. The five most reported challenges related to evidence and data synthesis; value system differences and participant selection issues; participant difficulties; methodological complexity and resource balance; and criteria and attributes modelling. A critical discussion on ways to address these challenges ensues.

DISCUSSION

Results highlight the need for advancement in robust methodologies, procedures and tools to improve methodological quality of MCDA in HTA studies. Research pathways include developing new model features, good practice guidelines, technologies to enable participation and behavioural research.

Hospital staff perspectives towards health technology assessment: data from a multidisciplinary survey

BACKGROUND

Technology adoption in hospitals is usually based on cost-effectiveness analysis, feasibility and potential success. Different countries have embraced a range of principles to accomplish an effective comprehensive process of health technology assessment (HTA). The aim of the study was to analyse the viewpoints and relative weight of technology-oriented hospital staff members toward the clinical, social, technological and economic aspects of HTA.

METHODS

Using a structured questionnaire, a survey was conducted among different professionals in an 850-bed hospital.

RESULTS

We revealed a range of viewpoints among hospital staff members according to their personal characteristics and professional standpoints. The clinical aspects of HTA were considered 'highly important' (HI) by most participants, especially the 'lifesaving' parameter. Similarly, the 'lack of effective alternative technology' was ranked HI by a high percentage of participants, independent of their profession. Economic aspects were ranked HI only by half of the participants, while social and technological aspects were ranked HI only by a relatively low percentage. Nurses added 'improving quality of life', 'increasing teamwork efficiency' and 'improving medical standards'. Allied health professionals focused on 'lack of effective alternative technologies' as a main argument for adoption of HTA, alongside increasing efficiency, budget savings and contribution to hospital reputation. Engineers emphasised the requirement of significant investment in infrastructure and increasing efficiency. Administrators ranked patient experience as HI. Interestingly, the high ranking of social aspects correlated with older responders, while junior staff ranked safety significantly higher.

CONCLUSIONS

A multi-perspective multidisciplinary approach would be beneficial for policy-makers at hospitals and even on a national scale in Israel.

Can reflective multicriteria be the new paradigm for healthcare decision-making? The EVIDEM journey

Background

Multiple technologies, procedures and programs call for fairly-based decisions for prioritization of healthcare interventions. There is a diversity of perspectives of what constitutes a legitimate decision, which depends on both the process and the reasoning applied. Current approaches focus on technical aspects while methods to support alignment of decisions with the compassionate impetus of healthcare systems is lacking.

Methods

The framework was developed based on an analysis of the foundations of healthcare systems, the reasoning underlying decisions and fair processes. The concept of reflective multicriteria was created: it assumes that decisionmakers guided by a generic interpretative frame rooted in the compassionate impetus of healthcare systems, can sharpen their reasoning, raise awareness of their motivation and increase legitimacy of decisions. The initial framework was made available through a not for profit organization (the EVIDEM Collaboration, 2006–2017) to stimulate its development with thought leaders and stakeholders in an open source philosophy. Development was tailored to the real-life needs of decisionmakers and drew on several domains of knowledge including healthcare ethics, evidenced-based medicine, health economics, health technology assessment and multicriteria approaches.

Results

The 10th edition framework builds on four dimensions: (1) the universal impetus of healthcare systems, (2) reasoning, values and ethics, (3) evidence and knowledge on interventions, and (4) a transformative process. Mathematical aspects of the framework are designed to help clarify, express and share individual reasoning; this non-conventional use of numbers requires a cultural change and needs to be phased in slowly. The framework includes four tools for easy adaptation and operationalization: (a) concepts and operationalization, (b) adapt and pilot, (c) evidence matrix, (d) mathematical representation of reasoning. Application is useful throughout all types of healthcare interventions, for all levels of decision, and across the globe.

Conclusion

By clarifying their reasoning while keeping decisionmakers aware of the impetus of healthcare systems, reflective multicriteria provides an effective approach to increase the legitimacy of decisions. Beyond a tool, reflective multicriteria pioneered by EVIDEM is geared to transform our vision of the value of healthcare interventions and how they might contribute to relevant, equitable and sustainable healthcare systems.

Electronic supplementary material

The online version of this article (10.1186/s12962-018-0116-9) contains supplementary material, which is available to authorized users.

Multicriteria decision analysis (MCDA) in health care: a systematic review of the main characteristics and methodological steps

Background

The health area is one of the most affected systems on the perspective of decision-making with multiobjectives, thus becoming prone to errors in the final solution, however, multicriteria decision analysis (MDCA) appears as an aid tool for this process decision-making. Therefore,the present study aims to analyze and synthesize articles found in the literature, involing MCDA in health care, evaluating general issues and methodological aspects, structuring them in a single work.

Methods

Surveys in the bibliographic databases SCOPUS and PUBMED indicated 1852 documents on the subject, however after a careful verificatios, 66 studies were selected to be analyzed completely. The data extracted from the included articles were organized into a spreadsheet for the preparation of analysis, and the technique used was descriptive statistics.

Results

It was possible to identify a growth trend in the application of the MCDA in the health area, but no dominance was identified in relation to the authors of the publication and the periodicals where they are published, but some countries stood out in terms of the number of published researches, such as: Canada and Turkey. In defining the decision problem, and in defining criteria, the “literature” presented the greatest demand for those who wish to structure their decision problem. Finally, it was verified by the analysis of the problem, that the MCDA to solve the problems of ranking has comprehensive application and that there is a greater incidence in the use of the AHP and Logic methods Fuzzy.

Conclusion

With this, it is possible to observe, through the data of this review, that more than the multicriteria methods, the multicriteria decision model has been highlighted, also in the health area. In addition, the study can guide new applications and techniques using MCDA in the health care.

Multicriteria decision analysis (MCDA) for health technology assessment: the Queensland Health experience

Objectives In determining whether new health technologies should be funded, health technology assessment (HTA) committees prefer explicit to implicit methods of analysis in enhancing transparency and consistency of decision making. The aim of this study was to develop and pilot a multicriteria decision analysis (MCDA) framework for the Queensland Department of Health HTA program committee, which weighted decision making criteria according to their perceived importance as determined by group consensus. Methods The criteria used in the MCDA framework were identified by reviewing the five unweighted criteria used in the existing process, consultation with committee members and literature review. Criteria were clearly defined and ordinal categories of lowest to highest preferred were assigned against which technology submissions would be rated. Criteria weights were determined through a discrete choice experiment (DCE) survey of committee members using validated software. Mean weighted technology scores were then used to guide deliberative discussions in determining final funding decisions. Results The MCDA framework created one additional criterion to the previous five. The criteria and their mean weights identified through the DCE survey were clinical benefit and safety (27.2%), quality of evidence (19.2%), implementation capacity (16.9%), innovation (15.4%), burden of disease and clinical need (13.3%) and societal and ethical values (8.0%). Criterion weights varied considerably between individual committee members, with one criterion having a difference of 36.9% between the highest and lowest preference weights. Following deliberative discussions, all but one of 10 submissions were awarded funding. The submission not supported received the third lowest score through the MCDA model. Conclusions This pilot application of an MCDA framework, as a complement to committee deliberation, conferred greater transparency and objectivity on HTA assessment of technologies. The framework converted an implicit, unweighted review process to one that is more explicit, flexible in weighting importance and pragmatic. What is known about the topic? HTA programs involve complex decision-making processes requiring the consideration of multiple criteria. Explicit methods of analysis that use weighted criteria according to their relative importance enhance transparency and consistency of decision making by HTA committees, and are preferred to implicit reviews using unweighted criteria. What does this paper add? This article describes the development and piloting of an MCDA framework that aims to improve transparency, objectivity and consistency of funding decisions of the Queensland HTA committee. Criteria were identified through a review of current processes, committee discussions and a literature review, and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) quality of evidence system. Criteria were weighted using a discrete choice experiment involving committee members. Using weighted criteria, mean technology scores were calculated and incorporated into deliberative discussions to determine funding decisions. What are the implications for practitioners? The MCDA framework described here converted a more implicit, unweighted process to one that was more pragmatic, explicit and flexible in scoring HTA submissions. This framework may be useful to other HTA programs and could be expanded to resource allocation decision making in many other healthcare settings.

Applying a Multicriteria Decision Analysis (MCDA) Approach to Elicit Stakeholders' Preferences in Italy: The Case of Obinutuzumab for Rituximab-Refractory Indolent Non-Hodgkin Lymphoma (iNHL)

BACKGROUND

Healthcare decision makers need to make trade-offs between different elements of value of new treatments. Multicriteria decision analysis (MCDA) provides a framework that can help decision makers to understand stakeholders' preferences and be explicit about the trade-offs that are being made.

OBJECTIVE

The objective of this study was to use MCDA to obtain preferences and views on decision criteria across three stakeholder groups (patients, clinicians and payers) in Italy and to use these to assess the performance of obinutuzumab for rituximab-refractory indolent non-Hodgkin lymphoma (iNHL).

METHODS

We used EVIDEM V3.0, an MCDA framework, and collected participants' preferences via an online survey and structured meetings.

RESULTS

Patients and clinicians expressed a preference for interventions targeting severe conditions. Payers expressed preference for treatments targeting areas with an unmet need, which are cheaper than the comparator, and with high-quality evidence. Obinutuzumab in combination with bendamustine, compared with bendamustine alone, received high positive scores for the criteria 'disease severity' and 'type of therapeutic benefit' by all three groups, and negative scores on the economic-related criteria, according to all stakeholder groups.

CONCLUSIONS

MCDA can be used to elicit the views of different stakeholder groups and has the potential to structure and inform reimbursement decisions.

The Use of MCDA in HTA: Great Potential, but More Effort Needed

The potential for multi-criteria decision analysis (MCDA) to support health technology assessment (HTA) has been much discussed, and various HTA agencies are piloting or applying MCDA. Alongside these developments, good practice guidelines for the application of MCDA in health care have been developed. An assessment of current applications of MCDA to HTA in light of good practice guidelines reveals, however, that many have methodologic flaws that undermine their usefulness. Three challenges are considered: the use of additive models, a lack of connection between criteria scales and weights, and the use of MCDA in economic evaluation. More attention needs to be paid to MCDA good practice by researchers, journal editors, and decision makers and further methodologic developments are required if MCDA is to achieve its potential to support HTA.

AN INTEGRATED PERSPECTIVE ON THE ASSESSMENT OF TECHNOLOGIES: INTEGRATE-HTA

OBJECTIVES

Current health technology assessment (HTA) is not well equipped to assess complex technologies as insufficient attention is being paid to the diversity in patient characteristics and preferences, context, and implementation. Strategies to integrate these and several other aspects, such as ethical considerations, in a comprehensive assessment are missing. The aim of the European research project INTEGRATE-HTA was to develop a model for an integrated HTA of complex technologies.

METHODS

A multi-method, four-stage approach guided the development of the INTEGRATE-HTA Model: (i) definition of the different dimensions of information to be integrated, (ii) literature review of existing methods for integration, (iii) adjustment of concepts and methods for assessing distinct aspects of complex technologies in the frame of an integrated process, and (iv) application of the model in a case study and subsequent revisions.

RESULTS

The INTEGRATE-HTA Model consists of five steps, each involving stakeholders: (i) definition of the technology and the objective of the HTA; (ii) development of a logic model to provide a structured overview of the technology and the system in which it is embedded; (iii) evidence assessment on effectiveness, economic, ethical, legal, and socio-cultural aspects, taking variability of participants, context, implementation issues, and their interactions into account; (iv) populating the logic model with the data generated in step 3; (v) structured process of decision-making.

CONCLUSIONS

The INTEGRATE-HTA Model provides a structured process for integrated HTAs of complex technologies. Stakeholder involvement in all steps is essential as a means of ensuring relevance and meaningful interpretation of the evidence.

Appraising the holistic value of Lenvatinib for radio-iodine refractory differentiated thyroid cancer: A multi-country study applying pragmatic MCDA

BACKGROUND

The objective of the study was to reveal through pragmatic MCDA (EVIDEM) the contribution of a broad range of criteria to the value of the orphan drug lenvatinib for radioiodine refractory differentiated thyroid cancer (RR-DTC) in country-specific contexts.

METHODS

The study was designed to enable comprehensive appraisal (12 quantitative, 7 qualitative criteria) in the current disease context (watchful waiting, sorafenib) of France, Italy and Spain. Data on the value of lenvatinib was collected from diverse stakeholders during country-specific panels and included: criteria weights (individual and social values); performance scores (judgments on evidence-collected through MCDA systematic review); qualitative impacts of contextual criteria; and verbal and written insights structured by criteria. The value contribution of each criterion was calculated and uncertainty explored.

RESULTS

Comparative effectiveness, Quality of evidence (Spain and Italy) and Disease severity (France) received the greatest weights. Four criteria contributed most to the value of lenvatinib, reflecting its superior Comparative effectiveness (16-22% of value), the severity of RR-DTC (16-22%), significant unmet needs (14-21%) and robust evidence (14-20%). Contributions varied by comparator, country and individuals, highlighting the importance of context and consultation. Results were reproducible at the group level. Impacts of contextual criteria varied across countries reflecting different health systems and cultural backgrounds. The MCDA process promoted sharing stakeholders' knowledge on lenvatinib and insights on context.

CONCLUSIONS

The value of lenvatinib was consistently positive across diverse therapeutic contexts. MCDA identified the aspects contributing most to value, revealed rich contextual insights, and helped participants express and explicitly tackle ethical trade-offs inherent to balanced appraisal and decisionmaking.

Recommendations from the European Working Group for Value Assessment and Funding Processes in Rare Diseases (ORPH-VAL)

Rare diseases are an important public health issue with high unmet need. The introduction of the EU Regulation on orphan medicinal products (OMP) has been successful in stimulating investment in the research and development of OMPs. Despite this advancement, patients do not have universal access to these new medicines. There are many factors that affect OMP uptake, but one of the most important is the difficulty of making pricing and reimbursement (P&R) decisions in rare diseases. Until now, there has been little consensus on the most appropriate assessment criteria, perspective or appraisal process. This paper proposes nine principles to help improve the consistency of OMP P&R assessment in Europe and ensure that value assessment, pricing and funding processes reflect the specificities of rare diseases and contribute to both the sustainability of healthcare systems and the sustainability of innovation in this field. These recommendations are the output of the European Working Group for Value Assessment and Funding Processes in Rare Diseases (ORPH-VAL), a collaboration between rare disease experts, patient representatives, academics, health technology assessment (HTA) practitioners, politicians and industry representatives. ORPH-VAL reached its recommendations through careful consideration of existing OMP P&R literature and through a wide consultation with expert stakeholders, including payers, regulators and patients. The principles cover four areas: OMP decision criteria, OMP decision process, OMP sustainable funding systems and European co-ordination. This paper also presents a guide to the core elements of value relevant to OMPs that should be consistently considered in all OMP appraisals. The principles outlined in this paper may be helpful in drawing together an emerging consensus on this topic and identifying areas where consistency in payer approach could be achievable and beneficial. All stakeholders have an obligation to work together to ensure that the promise of OMP's is realised.

Eliciting societal preferences of reimbursement decision criteria for anti cancer drugs in South Korea

INTRODUCTION

In order to look beyond the cost-effectiveness analysis, this study used a multi-criteria decision analysis (MCDA), which reflects societal values with regard to reimbursement decisions. This study aims to elicit societal preferences of the reimbursement decision criteria for anti cancer drugs from public and healthcare professionals.

METHODS

Eight criteria were defined based on a literature review and focus group sessions: disease severity, disease population size, pediatrics targets, unmet needs, innovation, clinical benefits, cost-effectiveness, and budget impacts. Using quota sampling and purposive sampling, 300 participants from the Korean public and 30 healthcare professionals were selected for the survey. Preferences were elicited using an analytic hierarchy process.

RESULTS

Both groups rated clinical benefits the highest, followed by cost-effectiveness and disease severity, but differed with regard to disease population size and unmet needs. Innovation was the least preferred criteria.

CONCLUSIONS

Clinical benefits and other social values should be reflected appropriately with cost-effectiveness in healthcare coverage. MCDA can be used to assess decision priorities for complicated health policy decisions, including reimbursement decisions. It is a promising method for making logical and transparent drug reimbursement decisions that consider a broad range of factors, which are perceived as important by relevant stakeholders.

Health Technology Assessment and Appraisal of Therapies for Rare Diseases

Innovative rare disease therapies and health technology assessment (HTA) share a lot of similarities. Both represent cases of interaction of epidemiology and health economics. Both are relatively new topics in public health practice. And both pose a lot of challenges to rare disease stakeholders who are currently looking for tools to support the timely access to innovative treatments while putting budget spending in order. This is why optimisation of assessment and appraisal of new rare disease therapies is a fundamental issue in rare disease health policy. Rare disease patients and caregivers expect prolonged life expectancy and improved quality of life and they perceive innovative health technologies as a rightful way to achieve these objectives.Multi-criteria decision analysis (MCDA) provides a structured, transparent approach to identify preferred alternatives by means of combined calculation of relative importance of different criteria and performance of the alternatives on these criteria. The labyrinth of competing interests and numerous stakeholders involved is why innovative rare disease health technologies make an excellent case study of the integration between HTA and MCDA. This kind of formalisation of decision-making is perceived as fair and legitimate, leading to a balance and agreement. MCDA provides a stage for a debate of policy priorities, health system specifics and societal attitudes, while also addressing the impact of rarity on all criteria and considerations.

Multi-Criteria Decision Analysis for Assessment and Appraisal of Orphan Drugs

Background

Limited resources and expanding expectations push all countries and types of health systems to adopt new approaches in priority setting and resources allocation. Despite best efforts, it is difficult to reconcile all competing interests, and trade-offs are inevitable. This is why multi-criteria decision analysis (MCDA) has played a major role in recent uptake of value-based reimbursement. MCDA framework enables exploration of stakeholders’ preferences, as well as explicit organization of broad range of criteria on which real-world decisions are made. Assessment and appraisal of orphan drugs tend to be one of the most complicated health technology assessment (HTA) tasks. Access to market approved orphan therapies remains an issue. Early constructive dialog among rare disease stakeholders and elaboration of orphan drug-tailored decision support tools could set the scene for ongoing accumulation of evidence, as well as for proper reimbursement decision-making.

Objective

The objective of this study was to create an MCDA value measurement model to assess and appraise orphan drugs. This was achieved by exploring the preferences on decision criteria’s weights and performance scores through a stakeholder-representative survey and a focus group discussion that were both organized in Bulgaria.

Results/Conclusion

Decision criteria that describe the health technology’s characteristics were unanimously agreed as the most important group of reimbursement considerations. This outcome, combined with the high individual weight of disease severity and disease burden criteria, underlined some of the fundamental principles of health care – equity and fairness. Our study proved that strength of evidence may be a key criterion in orphan drug assessment and appraisal. Evidence is used not only to shape reimbursement decision-making but also to lend legitimacy to policies pursued. The need for real-world data on orphan drugs was largely stressed. Improved knowledge on MCDA feasibility and integration to HTA is of paramount importance, as progress in medicine and innovative health technologies should correspond to patient, health-care system, and societal values.

Balancing costs and benefits at different stages of medical innovation: a systematic review of Multi-criteria decision analysis (MCDA)

Background

The diffusion of health technologies from translational research to reimbursement depends on several factors included the results of health economic analysis. Recent research identified several flaws in health economic concepts. Additionally, the heterogeneous viewpoints of participating stakeholders are rarely systematically addressed in current decision-making. Multi-criteria Decision Analysis (MCDA) provides an opportunity to tackle these issues. The objective of this study was to review applications of MCDA methods in decisions addressing the trade-off between costs and benefits.

Methods

Using basic steps of the PRISMA guidelines, a systematic review of the healthcare literature was performed to identify original research articles from January 1990 to April 2014. Medline, PubMed, Springer Link and specific journals were searched. Using predefined categories, bibliographic records were systematically extracted regarding the type of policy applications, MCDA methodology, criteria used and their definitions.

Results

22 studies were included in the analysis. 15 studies (68 %) used direct MCDA approaches and seven studies (32 %) used preference elicitation approaches. Four studies (19 %) focused on technologies in the early innovation process. The majority (18 studies - 81 %) examined reimbursement decisions. Decision criteria used in studies were obtained from the literature research and context-specific studies, expert opinions, and group discussions. The number of criteria ranged between three up to 15. The most frequently used criteria were health outcomes (73 %), disease impact (59 %), and implementation of the intervention (40 %). Economic criteria included cost-effectiveness criteria (14 studies, 64 %), and total costs/budget impact of an intervention (eight studies, 36 %). The process of including economic aspects is very different among studies. Some studies directly compare costs with other criteria while some include economic consideration in a second step.

Conclusions

In early innovation processes, MCDA can provide information about stakeholder preferences as well as evidence needs in further development. However, only a minority of these studies include economic features due to the limited evidence. The most important economic criterion cost-effectiveness should not be included from a technical perspective as it is already a composite of costs and benefit. There is a significant lack of consensus in methodology employed by the various studies which highlights the need for guidance on application of MCDA at specific phases of an innovation.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-0930-0) contains supplementary material, which is available to authorized users.