International experiences in multicriteria decision analysis (MCDA) for evaluating orphan drugs: a scoping review

Issues, Challenges and Opportunities for Economic Evaluations of Orphan Drugs in Rare Diseases: An Umbrella Review

BACKGROUND AND OBJECTIVES

There are significant challenges when obtaining clinical and economic evidence for health technology assessments of rare diseases. Many of them have been highlighted in previous systematic reviews but they have not been summarised in a comprehensive manner. For all stakeholders working with rare diseases, it is important to be aware and understand these issues. The objective of this review is to identify the main challenges for the economic evaluation of orphan drugs in rare diseases.

METHODS

An umbrella review of systematic reviews of economic studies concerned with orphan and ultra-orphan drugs was conducted. Studies that were not systematic reviews, or on advanced therapeutic medicinal products, personalised medicines or other interventions that were not considered orphan drugs were excluded. The database searches included publications from 2010 to 2023, and were conducted in MEDLINE, EMBASE and the Cochrane library using filters for systematic reviews, and economic evaluations and models. These filters were combined with search terms for rare diseases and orphan drugs. A hand search supplemented the literature searches. The findings were reported by a compliant Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram.

RESULTS

Two hundred and eighty-two records were identified from the literature searches, of which 64 were duplicates, whereas five reviews were identified from the hand search. A total of 36 reviews were included after screening against inclusion/exclusion criteria, 35 from literature searches and one from hand searching. Of those studies 1, 27 and 8 were low, moderate and high quality, respectively. The reviews highlight the scarcity of evidence for health economic parameters, for example, clinical effectiveness, costs, quality of life and the natural history of disease. Health economic evaluations such as cost-effectiveness and budget-impact analyses were scarce, and generally low-to-moderate quality. The causes were limited health economic parameters, together with publications bias, especially for cost-effectiveness analyses.

CONCLUSIONS

The results highlighted issues around a considerable paucity of evidence for economic evaluations and few cost-effectiveness analyses, supporting the notion that a paucity of evidence makes economic evaluations of rare diseases more challenging compared with more prevalent diseases. Furthermore, we provide recommendations for more sustainable approaches in economic evaluations of rare diseases.

Novel approach to decision making for orphan drugs

BACKGROUND

Out of 185 orphan medicinal products (OMPs) registered in 2015-2021, a mere 110 (59 percent) were available to Czech patients, and only 54 (29 percent) were officially reimbursed. Moreover, this proportion has steadily decreased over time. After years of public debate induced by this unsatisfactory OMP patient access, the national viewpoint shifted toward creating a special pathway for the reimbursement of OMP. Thus, a rigorous pricing and reimbursement procedure with strict timelines and elaborated methodology has been recently adopted in Czechia.

METHODOLOGY

The innovative legislation follows the recommendations for value assessment and funding processes for rare diseases and incorporates additional elements of value, such as the societal perspective. First, the application with clinical evidence, cost-effectiveness, and budget impact analyses is submitted to the governmental health technology assessment (HTA) agency by the Marketing Authorization Holder or a Health Insurance Fund. Moreover, professional associations and patients' organizations are rightful participants in the proceeding, providing evidence and comments. Then, the HTA agency performs the assessment/appraisal of the evidence. It subsequently publishes the assessment report summarizing available information. The report is then forwarded to the Ministry of Health and its advisory body consisting of patients, clinical experts, health insurance funds, and the State. They critically evaluate the documents and issue a binding opinion following prespecified decision-making criteria. Based on this binding opinion, the decision is issued by the HTA agency. Thus, the role of the advisory body in this process is crucial.

CONCLUSION

We believe that this novel approach may offer satisfactory patient access to orphan drugs. Moreover, it serves as a real-world example of "value-based" decision making.

ODs with a positive TPR conclusion, not subject to a conditional approval, and approved without requering a pass would be more likely to be reimbursed in Spain

BACKGROUND

The present study aims to assess clinical and regulatory variables that would influence pricing and reimbursement (P&R) decisions for Orphan Drugs (ODs) in Spain. ODs approved by the European Commission (EC) between 2006 and 2021 were classified according to their P&R status in Spain: approved, undergoing decision and rejected. A statistical analysis was carried out to assess the potential association between clinical and regulatory variables and P&R decision of ODs in Spain: therapeutic area, rarity of disease, existence of alternative therapies, availability of survival-related outcomes, safety profile, type of population, conditional approval status granted by the European Medicines Agency (EMA) and a positive Therapeutic Positioning Report (TPR) opinion.

RESULTS

111 ODs have been approved by the EC and have obtained marketing authorisation in Spain between 2006 and 2021. Out of the 111 ODs, 57 (51.4%) were reimbursed, 24 (21.6%) were undergoing decision and 30 (27%) were rejected. According to the statistical analysis, ODs with a positive TPR conclusion (p-value < 0.01), not subject to a conditional approval by the EMA (p-value < 0.05) and approved without the obligation to conduct a post-authorisation safety study (PASS) (p-value < 0.05), were statistically significant, and therefore, would be more likely to obtain P&R approval in Spain.

CONCLUSIONS

This study shows that the TPR plays a key role in the P&R process in Spain and highlights that traditional evaluation tools, such us safety and efficacy, were the main drivers of P&R decisions for ODs. A positive conclusion of the TPR, non-conditional approval by the EMA and no obligation for a PASS seems to favourably affect P&R decisions in Spain.

Introduction of managed entry agreements in Korea: Problem, policy, and politics

Objectives: This study aimed to understand Managed Entry Agreements (MEAs) in Korea through the framework of three streams of the policy window model and its practical management and impact on pricing and reimbursement scheme. Methods: An extensive literature review based on Kingdon's model was conducted. We also performed descriptive analyses of MEA implementation using data on medicines listed in Korea and compared its MEA scheme with four different countries. Results: As per problem streams, patients with rare disease or cancers have considerable difficulties in affording their medicines and this has challenged the drug benefit system and raised an issue of patient's access. Policy streams highlighted that MEAs were introduced as a benefit enhancement plan for four major diseases since January 2014. MEAs have also been strengthened as a bypass mechanism to expand the insurance coverage especially for new premium-priced medicines under Moon Care (Listing all non-listed services). In descriptive analysis of MEAs, a total of 48 medicines were contracted as MEAs from January 2014 to December 2020, accounting for 73.4% of listed medicines for cancer or rare diseases and 97.9% of the cases were finance-based contracts. Meanwhile, outcome-based contracts such as CED accounted for only 2.1%. The application of MEAs differs across countries, resulting in a kappa coefficient of 0.00-0.14 (United Kingdom 0.03, Italy 0.00, Australia 0.14), indicating a lack of consistency compared to South Korea. Conclusion: MEAs, which were introduced as a bypass mechanism, have now superseded the standard process for anticancer agents or orphan drugs. Further studies are needed to evaluate the impact of the confidential agreements and effectiveness of new high-priced medicines with limited clinical data at launch.

A Cross-Sectional Study of Price and Affordability of Drugs for Rare Diseases in Shandong Province, China

OBJECTIVE

The affordability of rare disease drugs has become a social issue that cannot be ignored. This study aims to evaluate the current price and affordability of rare disease drugs in China, with evidence from Shandong province.

METHODS

Data on prices and affordability of 50 drugs for 22 rare diseases were collected from secondary and tertiary public hospitals in Shandong Province, using an adaptation of the World Health Organization/Health Action International (WHO/HAI) methodology. Prices were measured as Median Price Ratios (MPRs). Affordability was measured as days of daily per capita disposable income required for the cost of one month's treatment.

RESULTS

Out of the 50 rare disease drugs, 11 drugs had MSH reference prices and 34 had PBS reference prices. Median prices of 11 drugs were higher than MSH reference prices (median 1.33), and median prices of 34 drugs were higher that Australian PBS prices (median 1.97). Thirty-six (72.00%) and forty-four (88.00%) drugs were unaffordable for urban and rural residents, respectively. Thirty-four (68.00%) and thirty-eight (76.00%) drugs were unaffordable for urban and rural residents even after reimbursement by the health insurance schemes of China, respectively.

CONCLUSIONS

The affordability of some rare disease drugs remained poor with their relatively high prices in Shandong Province. Sustainable mechanisms are needed to reduce the price of rare disease drugs and to improve the affordability of rare disease patients.

Social pharmaceutical innovation and alternative forms of research, development and deployment for drugs for rare diseases

Rare diseases are associated with difficulties in addressing unmet medical needs, lack of access to treatment, high prices, evidentiary mismatch, equity, etc. While challenges facing the development of drugs for rare diseases are experienced differently globally (i.e., higher vs. lower and middle income countries), many are also expressed transnationally, which suggests systemic issues. Pharmaceutical innovation is highly regulated and institutionalized, leading to firmly established innovation pathways. While deviating from these innovation pathways is difficult, we take the position that doing so is of critical importance. The reason is that the current model of pharmaceutical innovation alone will not deliver the quantity of products needed to address the unmet needs faced by rare disease patients, nor at a price point that is sustainable for healthcare systems. In light of the problems in rare diseases, we hold that re-thinking innovation is crucial and more room should be provided for alternative innovation pathways. We already observe a significant number and variety of new types of initiatives in the rare diseases field that propose or use alternative pharmaceutical innovation pathways which have in common that they involve a diverse set of societal stakeholders, explicitly address a higher societal goal, or both. Our position is that principles of social innovation can be drawn on in the framing and articulation of such alternative pathways, which we term here social pharmaceutical innovation (SPIN), and that it should be given more room for development. As an interdisciplinary research team in the social sciences, public health and law, the cases of SPIN we investigate are spread transnationally, and include higher income as well as middle income countries. We do this to develop a better understanding of the social pharmaceutical innovation field's breadth and to advance changes ranging from the bedside to system levels. We seek collaborations with those working in such projects (e.g., patients and patient organisations, researchers in rare diseases, industry, and policy makers). We aim to add comparative and evaluative value to social pharmaceutical innovation, and we seek to ignite further interest in these initiatives, thereby actively contributing to them as a part of our work.

A systematic review of moral reasons on orphan drug reimbursement

BACKGROUND

The number of market approvals of orphan medicinal products (OMPs) has been increasing steadily in the last 3 decades. While OMPs can offer a unique chance for patients suffering from rare diseases, they are usually very expensive. The growing number of approved OMPs increases their budget impact despite their low prevalence, making it pressing to find solutions to ethical challenges on how to fairly allocate scarce healthcare resources under this context. One potential solution could be to grant OMPs special status when considering them for reimbursement, meaning that they are subject to different, and less stringent criteria than other drugs. This study aims to provide a systematic analysis of moral reasons for and against such a special status for the reimbursement of OMPs in publicly funded healthcare systems from a multidisciplinary perspective.

RESULTS

With a systematic review of reasons, we identified 39 reasons represented in 243 articles (scientific and grey literature) for and against special status for the reimbursement of OMPs, then categorized them into nine topics. Taking a multidisciplinary perspective, we found that most articles came from health policy (n = 103) and health economics (n = 49). More articles took the position for a special status of OMPs (n = 97) than those against it (n = 31) and there was a larger number of reasons identified in favour (29 reasons) than against (10 reasons) this special status.

CONCLUSION

Results suggest that OMP reimbursement issues should be assessed and analysed from a multidisciplinary perspective. Despite the higher occurrence of reasons and articles in favour of a special status, there is no clear-cut solution for this ethical challenge. The binary perspective of whether or not OMPs should be granted special status oversimplifies the issue: both OMPs and rare diseases are too heterogeneous in their characteristics for such a binary perspective. Thus, the scientific debate should focus less on the question of disease prevalence but rather on how the important variability of different OMPs concerning e.g. target population, cost-effectiveness, level of evidence or mechanism of action could be meaningfully addressed and implemented in Health Technology Assessments.

Case studies for implementing MCDA for tender and purchasing decisions in hospitals in Indonesia and Thailand

Background

A multi-criteria decision analysis (MCDA) approach has been suggested for helping purchasers in low- and middle-income countries in an evidence-based assessment of multi-source pharmaceuticals to mitigate potential adverse consequences of price-based decisions on patient access to effective medicines. Six workshops for developing MCDA-instruments for purchasing were conducted in Indonesia, Kazakhstan, Thailand, and Kuwait in 2017–2020. In Indonesia and Thailand, two pilot-initiatives aimed to implement the instruments for hospital drug purchasing decisions.

Objective

By analysing and comparing the experiences and progress from the MCDA-workshops and the two case-examples for hospital implementation in Indonesia and Thailand, we aim to gain insights, which will support future implementation.

Methods

The selection of criteria and their average weight were compared quantitatively across the MCDA-instruments developed in all four countries and settings. Implementation experiences from two case-examples were studied, which included (1) testing the instrument across a variety of drugs in seven hospitals in Thailand and (2) implementation in one specialty hospital in Indonesia. Semi-structured interviews were conducted via web-conferences with four diverse stakeholders in the pilot implementation projects in Thailand and Indonesia. The open responses were evaluated through qualitative content analysis and synthesis using grounded theory coding.

Results

Drivers for implementation were making ‘better’ decisions, achieving transparency and a rational selection process, reducing drug shortages, and assuring consistent quality. Challenges were seen on the technical level (definition or of criteria, scoring methods, access to data) or change-related challenges (resistance, perception of increased workload, lack of competencies or capabilities, lack of resources). The comparison of the MCDA instruments revealed high similarity, but also clear need for local adaptations in each specific case.

Conclusion

A set a of measures targeting challenges related to utility, methodology, data requirements, capacity building and training as well as the broader societal impact can help to overcome challenges in the implementation. Careful planning of implementation and organizational change is recommended for ensuring commitment and fit to local context and culture. Designing a collaborative change program for each application of MCDA-based purchasing will enable healthcare stakeholders to maximally benefit in terms of quality and effectiveness of care and access for patients.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40545-021-00333-8.

A multi-stakeholder multicriteria decision analysis for the reimbursement of orphan drugs (FinMHU-MCDA study)

Background

Patient access to orphan medicinal products (OMPs) is limited and varies between countries, reimbursement decisions on OMPs are complex, and there is a need for more transparent processes to know which criteria should be considered to inform these decisions. This study aimed to determine the most relevant criteria for the reimbursement of OMPs in Spain, from a multi-stakeholder perspective, and using multicriteria decision analysis (MCDA).

Methods

An MCDA was developed in 3 phases and included 28 stakeholders closely related to the field of rare diseases (6 physicians, 5 hospital pharmacists, 7 health economists, 4 patient representatives and 6 members from national and regional health authorities). Initially [phase A], a bibliographic review was conducted to identify the potential reimbursement criteria. Then, a reduced advisory board (8 members) proposed, selected, and defined the final list of criteria that could be relevant for reimbursement. A discrete choice experiment (DCE) [phase B] was developed to determine the relevance and relative importance weight of such criteria according to the stakeholders’ preferences by choosing between pairs of hypothetical financing scenarios. A multinomial logit model was fitted to analyze the DCE responses. Finally [phase C], the advisory board review the results using a deliberative process.

Results

Thirteen criteria were selected, related to 4 dimensions: patient population, disease, treatment, and economic evaluation. Nine criteria were deemed relevant for decision-making and associated with a higher relative importance: Health-related quality of life (HRQL) (23.53%), treatment efficacy (14.64%), availability of treatment alternatives (13.51%), disease severity (12.62%), avoided costs (11.21%), age of target population (7.75%), safety (seriousness of adverse events) (4.72%), quality of evidence (3.82%) and size of target population (3.12%). The remaining criteria had a < 3% relative importance: economic burden of disease (2.50%), cost of treatment (1.73%), cost-effectiveness (0.83%) and safety (frequency of adverse events) (0.03%).

Conclusion

The reimbursement of OMPs in Spain should be determined by its effect on patient’s HRQL, the extent of its therapeutic benefit from efficacy and the availability of other therapeutic options. Furthermore, the severity of the rare disease should also influence the decision along with the potential of the treatment to avoid associated costs.

Multiple criteria decision analysis for medicine reimbursement in the Lebanese context

Objective

The objective of this exploratory analysis is to reflect and discuss which criteria of multiple criteria decision analysis (MCDA) would be relevant as part of value determination when appraising healthcare interventions in the Lebanese context.

Methods

A workshop was conducted as part of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Lebanon Chapter and included the two frameworks: Evidence and Value: Impact on Decision Making (EVIDEM) and Advance Value Framework. Thirty-seven participants expressed their individual preferences through a qualitative and a quantitative exercise.

Results

In the qualitative analysis of both frameworks, participants unanimously agreed on the relevance of comparative efficacy, safety, and impact of medical costs. In EVIDEM, disease severity and unmet needs were also considered to be important criteria by more than 90 percent of the participants. In the quantitative analysis of both frameworks, disease severity ranked first (a mean normalized weight of .1 in EVIDEM and .27 in Advance Value Framework), followed by the size of the population (.09), the type of therapeutic benefit at the patient level (.09) and population level (.08), and the efficacy (.07) in EVIDEM. In the Advance Value Framework, the combined unmet need/disease severity criteria were followed by direct and meaningful end points (.15), safety (.12), contraindications (.08), and indirect surrogate end points (.07).

Conclusions

The results were concordant with those reported in countries that have conducted similar surveys such as France, Italy, and Spain. The MCDA methodology could be used as a cornerstone to enhance evidence-based discussions among Lebanese stakeholders involved in evaluation and decision-making purposes.

Multi-Criteria Model for Evaluating Drugs to Prevent Deep Venous Thrombosis Associated With Orthopedic Surgery: A Hospital-Based Case Study

BACKGROUND

It's estimated that 40% to 60% of patients undergoing major orthopedic surgery of the hip or knee who do not receive thromboprophylaxis will develop deep venous thrombosis Instituto Nacional de Traumatologia e Ortopedia has established a guideline to prevent DVT with the administration of the Enoxaparin. Recently, institute stakeholders have been questioning this guideline as new oral anticoagulants that offer more comfort and efficacy, but present higher risk of bleeding, have been appearing in the market for treating deep venous thrombosis.

OBJECTIVE

This study aims to validate the application of a multicriteria decision analysis in a real-world problem, the use of rivaroxaban and enoxaparin to prevent deep venous thrombosis.

METHODS

The multicriteria method MACBETH (Measuring Attractiveness by a Categorical Based Evaluation Technique) was used in a decision conferencing process to develop an evaluation model for measuring the relative value of the drugs on each evaluation criterion, separately and globally. The model-building process was informed by a literature review and meta-analysis of randomized clinical trials with a critical appraisal of the evidence.

RESULTS

We report a model-structure with eight criteria, each one associated with a weighting coefficient and value function. Following a simple additive aggregation process, the model-outputs showed that Rivaroxaban was considered a robust option for DVT. Sensitivity analysis and robustness analysis were performed and testify the consistency of the results.

CONCLUSION

This article contributes to literature by showing how MACBETH method can be combined with scientific evidence and participatory group processes, for health technology assessment in hospitals.

Integrative Review of Managed Entry Agreements: Chances and Limitations

BACKGROUND AND OBJECTIVE

Managed entry agreements (MEAs) consist of a set of instruments to reduce the uncertainty and the budget impact of new high-priced medicines; however, there are concerns. There is a need to critically appraise MEAs with their planned introduction in Brazil. Accordingly, the objective of this article is to identify and appraise key attributes and concerns with MEAs among payers and their advisers, with the findings providing critical considerations for Brazil and other high- and middle-income countries.

METHODS

An integrative review approach was adopted. This involved a review of MEAs across countries. The review question was 'What are the health technology MEAs that have been applied around the world?' This review was supplemented with studies not retrieved in the search known to the senior-level co-authors including key South American markets. It also involved senior-level decision makers and advisers providing guidance on the potential advantages and disadvantages of MEAs and ways forward.

RESULTS

Twenty-five studies were included in the review. Most MEAs included medicines (96.8%), focused on financial arrangements (43%) and included mostly antineoplastic medicines. Most countries kept key information confidential including discounts or had not published such data. Few details were found in the literature regarding South America. Our findings and inputs resulted in both advantages including reimbursement and disadvantages including concerns with data collection for outcome-based schemes.

CONCLUSIONS

We are likely to see a growth in MEAs with the continual launch of new high-priced and often complex treatments, coupled with increasing demands on resources. Whilst outcome-based MEAs could be an important tool to improve access to new innovative medicines, there are critical issues to address. Comparing knowledge, experiences, and practices across countries is crucial to guide high- and middle-income countries when designing their future MEAs.