Criteria and Scoring Functions Used in Multi-criteria Decision Analysis and Value Frameworks for the Assessment of Rare Disease Therapies: A Systematic Literature Review

Issues, Challenges and Opportunities for Economic Evaluations of Orphan Drugs in Rare Diseases: An Umbrella Review

BACKGROUND AND OBJECTIVES

There are significant challenges when obtaining clinical and economic evidence for health technology assessments of rare diseases. Many of them have been highlighted in previous systematic reviews but they have not been summarised in a comprehensive manner. For all stakeholders working with rare diseases, it is important to be aware and understand these issues. The objective of this review is to identify the main challenges for the economic evaluation of orphan drugs in rare diseases.

METHODS

An umbrella review of systematic reviews of economic studies concerned with orphan and ultra-orphan drugs was conducted. Studies that were not systematic reviews, or on advanced therapeutic medicinal products, personalised medicines or other interventions that were not considered orphan drugs were excluded. The database searches included publications from 2010 to 2023, and were conducted in MEDLINE, EMBASE and the Cochrane library using filters for systematic reviews, and economic evaluations and models. These filters were combined with search terms for rare diseases and orphan drugs. A hand search supplemented the literature searches. The findings were reported by a compliant Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram.

RESULTS

Two hundred and eighty-two records were identified from the literature searches, of which 64 were duplicates, whereas five reviews were identified from the hand search. A total of 36 reviews were included after screening against inclusion/exclusion criteria, 35 from literature searches and one from hand searching. Of those studies 1, 27 and 8 were low, moderate and high quality, respectively. The reviews highlight the scarcity of evidence for health economic parameters, for example, clinical effectiveness, costs, quality of life and the natural history of disease. Health economic evaluations such as cost-effectiveness and budget-impact analyses were scarce, and generally low-to-moderate quality. The causes were limited health economic parameters, together with publications bias, especially for cost-effectiveness analyses.

CONCLUSIONS

The results highlighted issues around a considerable paucity of evidence for economic evaluations and few cost-effectiveness analyses, supporting the notion that a paucity of evidence makes economic evaluations of rare diseases more challenging compared with more prevalent diseases. Furthermore, we provide recommendations for more sustainable approaches in economic evaluations of rare diseases.

The application of multi-criteria decision analysis in evaluating the value of drug-oriented intervention: a literature review

Objectives: Multi-Criteria Decision Analysis (MCDA) has gained increasing attention in supporting drug risk-benefit assessment, pricing and reimbursement, as well as optimization of clinical interventions. The objective of this study was to systematically collect and categorize evaluation criteria and techniques of weighting and scoring of MCDA for drug value assessment. Methods: A systematic review of the literature was conducted across seven databases to identify articles utilizing the MCDA frameworks for the evaluation of drug value. Evaluation criteria mentioned in the included studies were extracted and assigned to 5 dimensions including clinical, economic, innovative, societal and humanistic value. A descriptive statistical analysis was performed on the identified drug value evaluation criteria, as well as the weighting and scoring techniques employed. The more a criterion or technique were mentioned in articles, the more important we consider it. Results: Out of the 82 articles included, 111 unique criteria were identified to evaluate the value of drug. Among the 56 unique criteria (448 times) used to measure clinical value, the most frequently mentioned were "comparative safety/tolerability" (58 times), "comparative effectiveness/efficacy" (56 times), "comparative patient-perceived health/patient reported outcomes" (37 times), "disease severity" (34 times), and "unmet needs" (25 times). Regarding economic value measurement, out of the 20 unique criteria (124 times), the most frequently utilized criteria were "cost of intervention" (17 times), "comparative other medical costs" (16 times), and "comparative non-medical costs" (18 times). Out of the 10 criteria (18 times) for assessing innovative value, "a novel pharmacological mechanism" was the most frequently mentioned criterion (5 times). Among the 22 criteria (73 times) used to measure societal value, "system capacity and appropriate use of intervention" was the most frequently cited criterion (14 times). Out of the 3 criteria (15 times) utilized to measure humanistic value, "political/historical/cultural context" was the most frequently mentioned criterion (9 times). Furthermore, 11 scoring and 11 weighting techniques were found from various MCDA frameworks. "Swing weighting" and "a direct rating scale" were the most frequently used techniques in included articles. Conclusion: This study comprehensively presented the current evaluation dimensions, criteria, and techniques for scoring and weighting in drug-oriented MCDA articles. By highlighting the frequently cited evaluation criteria and techniques for scoring and weighting, this analysis will provide a foundation to reasonably select appropriate evaluation criteria and technique in constructing the MCDA framework that aligns with research objectives.

Design of a multiple criteria decision analysis framework for prioritizing high-impact health technologies in a regional health service

OBJECTIVES

This study aims to develop a framework for establishing priorities in the regional health service of Murcia, Spain, to facilitate the creation of a comprehensive multiple criteria decision analysis (MCDA) framework. This framework will aid in decision-making processes related to the assessment, reimbursement, and utilization of high-impact health technologies.

METHOD

Based on the results of a review of existing frameworks for MCDA of health technologies, a set of criteria was proposed to be used in the context of evaluating high-impact health technologies. Key stakeholders within regional healthcare services, including clinical leaders and management personnel, participated in a focus group (n = 11) to discuss the proposed criteria and select the final fifteen. To elicit the weights of the criteria, two surveys were administered, one to a small sample of healthcare professionals (n = 35) and another to a larger representative sample of the general population (n = 494).

RESULTS

The responses obtained from health professionals in the weighting procedure exhibited greater consistency compared to those provided by the general public. The criteria more highly weighted were "Need for intervention" and "Intervention outcomes." The weights finally assigned to each item in the multicriteria framework were derived as the equal-weighted sum of the mean weights from the two samples.

CONCLUSIONS

A multi-attribute function capable of generating a composite measure (multicriteria) to assess the value of high-impact health interventions has been developed. Furthermore, it is recommended to pilot this procedure in a specific decision context to evaluate the efficacy, feasibility, usefulness, and reliability of the proposed tool.

A cost-of-illness study of Behçet syndrome in Italy

OBJECTIVE

This study aims at evaluating the cost-of-illness (COI) of patients diagnosed with Behcet's syndrome (BS) in Italy, trying to depict the impact of different costs' components to the overall economic burden and analysing the variability of costs according to years since diagnosis and age at first symptoms.

METHODS

With a cross-sectional evaluation, we surveyed a large sample of BS patients in Italy assessing several dimensions related to BS, also including fact related to the use of health resources utilization, formal and informal care, and productivity losses. Overall costs, direct health, direct non-health, and indirect costs were thus estimated per patient/year considering a Societal perspective and the impact of years since diagnosis, age at first symptoms on costs was evaluated using generalized linear model (GLM) and a two-part model, adjusting for age and distinguishing among employed and non-employed responders.

RESULTS

A total of 207 patients were considered in the present study. From the perspective of the Society, mean overall costs for BS patient were estimated to be 21,624 € (0;193,617) per patient/year. Direct non-health expenses were the main costs component accounting for 58% of the overall costs, followed direct health costs, 36%, while indirect costs because of productivity losses represented 6% of the overall costs. Being employed resulted in significantly lower overall costs (p = 0.006). Results from the multivariate regression analyses suggested that the probability of incurring in overall costs equal to zero decreased as time from BS diagnosis is 1 year or more as compared to newly diagnosed patients (p < 0.001); while among those incurring in expenses, costs decreased for those experiencing first symptoms between 21 and 30 years (p = 0.027) or later (p = 0.032) as compared to those having symptoms earlier. Similar findings emerged among the subgroups of patients declaring themselves as workers, while no impact of years since diagnosis or age of first symptoms was found among non-workers.

CONCLUSIONS

The present study offers a comprehensive overview of the economic consequences imposed by BS in a societal perspective, providing insights into the distribution of the different costs component related to BS, thus helping the development of targeted policies.

Development of the Emirates Multi-Criteria Decision Analysis Tool for Orphan Drugs

Background The number of orphan drug approvals is currently increasing globally. This creates a significant burden on payers and healthcare systems. This study aimed to create a multi-criteria decision analysis (MCDA) tool for evaluating orphan drugs within the United Arab Emirates (UAE). The intended result of the tool is to provide evidence-based guidance to decision-makers in reimbursement and procurement decisions. Methods We conducted a literature search and local expert interviews to identify relevant preliminary criteria for the MCDA tool. Then we conducted a structured consensus-building session for healthcare experts and decision-makers in the UAE to develop the Emirati MCDA tool for orphan drugs. The experts voted for the criteria to be included in the tool and their ranking according to importance, as well as the weight of each criterion and its scoring function. To improve understanding and facilitate the voting process, experts were provided with a brief illustration of similar tools conducted in other countries before the voting sessions. Finally, the tool was developed in a Microsoft Excel sheet (Microsoft Corporation, Redmond, Washington, United States), and it was validated and tested based on real case studies, then it was fine-tuned accordingly based on the experts' discussions. The final tool was provided to the attendees to guide their decisions in the reimbursement and procurement of orphan drugs. Results The created tool provides a score for each analyzed orphan drug based on its value. Ten criteria were included in the final MCDA tool. These were cost-effectiveness (25.1% of the weight), magnitude of health gain (20.1%), availability of therapeutic alternative (14.3%), disease severity (11%), budget impact (7.9%), disease rarity (5.6%), strength of clinical evidence (5.6%), burden on households (4.5%), indication uniqueness (3.2%), and patients' age (2.6%). Conclusions Implementation of evidence-based healthcare necessitates assessing the fair value of each health technology. Addressing the high unmet medical needs and improving healthcare for patients with rare diseases are priorities within the UAE. The created Emirates MCDA tool for orphan drugs has the potential to help decision-makers implement value-based and evidence-based reimbursement decisions for orphan drugs.

Modelling Informal Carers' Health-Related Quality of Life: Challenges for Economic Evaluation

There has been increasing interest in including carers' health-related qualify of life (HRQoL) in decision models, but currently there is no best practice guidance as to how to do so. Models thus far have typically assumed that carers' HRQoL can be predicted from patient health states, as we illustrate with three examples of disease-modifying treatments. However, this approach limits the mechanisms that influence carers' HRQoL solely to patient health and may not accurately reflect carers' outcomes. In this article, we identify and discuss challenges associated with modelling intervention effects on carers' HRQoL: attaching carer utilities to patient disease states, the size of the caring network, aggregation of carer and patient HRQoL, patient death, and modelling longer-term carer HRQoL. We review and critique potential alternatives to modelling carers' HRQoL in decision models: trial-based analyses, qualitative consideration, cost-consequence analysis, and multicriteria decision analysis, noting that each of these also has its own challenges. We provide a framework of issues to consider when modelling carers' HRQoL and suggest how these can be addressed in current practice and future research.

Long way to go: Progress of orphan drug accessibility in China from 2017 to 2022

Introduction: Over 400 million patients worldwide suffer from rare diseases. Access to orphan drugs is, therefore, crucial for this population. China has been actively working on improving orphan drug accessibility in the past decades, especially since 2018 when the First National List of Rare Diseases was announced. This study aimed to evaluate the current status of orphan drug accessibility in China regarding availability, daily cost, and affordability.

Methods: Market availability of orphan drugs in China was based on their approval status in China up to May 2022. Information on drug availability in hospitals and the cost of each drug from 2017 to 2021 was obtained from the database of the Science and Technology Development Center of the Chinese Pharmaceutical Association. Affordability was assessed by comparing the disposable daily income per capita to the cost of the defined daily dose of each drug.

Results: Market availability rate was 44.3% by May 2022, and the average delay in drug approval in China compared to its orphan approval in the United States of America was 5.9 ± 6.07 years. Drug availability in hospitals showed an upward trend, with availability in tertiary hospitals significantly higher than in secondary hospitals (~20%, p &lt;0.0001). The eastern area was significantly higher in availability from 2019 onwards. Fifty-eight percent of the orphan drugs were still considered to have very low availability (&lt;30%). The national median cost of the defined daily dose across all available orphan drugs had increased to 254.97 RMB in 2021. Only 34.98% of the orphan drugs were considered affordable when compared with the national average disposable daily income in 2021, and drug affordability decreased during the past 5 years.

Discussion: Changes in orphan drug regulations in China have enabled progress regarding the drugs’ market availability, but the current status of drug availability at hospitals, drug cost, and affordability were not optimal. Legislation for encouraging domestic drug development and novel payment schemes for high-value drugs are essential to further improve the availability and cost burden of orphan drugs in China

Stakeholder perception of pharmaceutical value: A multicriteria decision analysis pilot case study for value assessment in the United States

BACKGROUND: Recent attention to value frameworks has highlighted limitations of current conventional value and health technology assessment (V/HTA) methods (eg, cost-effectiveness). Multicriteria decision analysis (MCDA) has potential as a supplemental tool to incorporate additional value criteria into conventional value assessment. OBJECTIVE: To conduct a pilot study to illustrate the impact of an MCDA approach on the value perceptions of hypothetical treatment profiles from a multistakeholder panel. METHODS: Participants voted on value perceptions of 2 hypothetical treatments with similar cost-effectiveness evidence: Treatment A for aggressive B-cell non-Hodgkin lymphoma in adults and treatment B for episodic migraine in adults. Participants voted treatments A and B as low, intermediate, or high value before and after a weighting exercise on prespecified, additional value criteria. Weights from participants were used to calculate treatment-specific MCDA scores from 0 (least favorable) to 100 (most favorable) and were presented to participants for a second value-perception vote. Analyses compared changes in value perceptions within treatments A and B post-MCDA exercise. RESULTS: Before considering MCDA scores for treatment A, 0% of participants considered it to be low, 52% intermediate, and 48% high value. After considering MCDA scores for treatment A, 4% considered it low, 29% intermediate, and 67% high value. Both before and after considering MCDA scores for treatment B, 13%, considered it low, 57% intermediate, and 30% high value. Mean MCDA scores for treatments A and B were 67 and 63, respectively. Of all stakeholders, 41% altered their perception of value for treatment A (9% negatively and 32% positively) and, separately, 45% for treatment B (23% both negatively and positively) after considering MCDA scores. CONCLUSIONS: With nearly half of participants altering their perception of value after consideration of additional value criteria, findings support the need for a more inclusive and flexible value assessment process. DISCLOSURES: This study was funded by The National Pharmaceutical Council. Dr Perfetto was employed by the National Health Council (NHC) at the time this work was completed, and all honoraria and consulting and travel fees were paid to the NHC. The NHC is a not-for-profit, membership organization. It is supported through membership dues and sponsorship funds. The complete list of members and sponsors is located on the NHC's website at www.nationalhealthcouncil.org. She is also an advisor for the Brain Injury Association of America, Dan Lewis Foundation, and Canter for Medical Technology Policy.

Evaluating the national system for rare diseases in China from the point of drug access: progress and challenges

Background

There are about 7000 rare diseases worldwide, of which only 5% of the diseases can be treated with medicines, showing that it’s important to improve patient access to orphan drugs. Recently, China has actively worked to set up a national system for rare diseases to improve the diagnosis and treatment capabilities and ensure the accessibility of drugs. However, the benefits of the system have yet not to be measured. This study aimed to provide an overview of orphan drug access based on the Compendium of China’s First List of Rare Diseases and National Network to Collaborate on Diagnosis and Treatment of Rare Diseases, expecting to map a blueprint for orphan drug access in China.

Methods

Framework of China’s national system for rare diseases was summarized. We surveyed the availability and affordability of 79 approved orphan drugs based on the Compendium of China’s First List of Rare Diseases in 30 leading provincial institutions from 2017 to 2020. The availability was measured annually at 3 levels (market, hospital and drug), and affordability was reflected by comparing costs of daily defined dose with per capita income of urban and rural residents, with the National Basic Medical Insurance considered.

Results

The market availability of orphan drugs in China showed an upward trend. As of 2020, the median hospital-level availability was 41.1% (increased by 1.5 times), highly available drugs increased by 16.5%. There were 64/74 orphan drugs that were affordable to rural/urban residents with the National Basic Medical Insurance considered (an increase of 14.1%), and the urban–rural gap of affordability ratio was narrowed (down by 6.0%). Comprehensive analysis showed the proportions of drugs with better availability and affordability in urban and rural areas by 2020 were 39.4% and 32.3%, respectively, which had increased but were still at a low level.

Conclusions

China’s national system for rare diseases has made great progress in orphan drug access, indicating that it’s been functioning under the joint reformation of medical treatment, medical insurance and medicines supply. The list of rare diseases will be updated and collaboration in networks will be enhanced to further improve the system.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13023-022-02507-2.