The estimation of health state utility values in rare diseases: overview of existing techniques

Estimating Australian Population Utilities for Inherited Retinal Disease Using Time Trade-Off

PURPOSE

Inherited retinal disease (IRD) causes progressive loss of visual function, degenerating towards complete blindness. Economic evaluation of gene therapies for rare forms of genetic IRDs have had to rely on health-related quality of life (HR-QoL) estimates from other diseases because there is limited data available for such a rare condition. This study aimed to estimate Australian societal-based utility values for IRD health states that can be used in cost-utility analyses (CUA) using a time trade-off (TTO) protocol adapted from a UK study.

METHODS

The EuroQol Valuation Technology (EQVT) protocol composite TTO (cTTO) framework was followed, which includes worse-than-death (WTD) states and quality control (QC) measures. Preferences were collected from a general population sample of 110 Australian adult participants. Five health state vignettes from the UK study which had been validated with patients and clinicians were presented randomly to participants during videoconferencing (VC) interviews with one of four interviewers. Technical and protocol feasibility were assessed in a pilot of 10 interviews. QC measures were used to monitor interviewers' performance during the study.

RESULTS

One participant withdrew consent. The final analysis was conducted on 109 respondents (including 4 non-traders). The average time to complete the interview was 44.2 minutes (SD 8.7). Participants reported mean visual analogue scale (VAS) scores between 63.15 for 'moderate impairment' and 17.98 for 'hand motion' to 'no light perception'. Mean health state utilities (HSU) varied between 0.76 (SD 0.26) in 'moderate impairment', and 0.20 (SD 0.58) in 'hand motion' to 'no light perception'. Of all HSU evaluations, 14% were considered WTD which most commonly occurred in the most severe visually impaired health state.

CONCLUSION

This study provides valuable information on HSUs across a range of IRD health states from the Australian general population perspective. The utilities obtained in this study can be used as inputs into CUA of IRD therapies.

Assessment of health state utilities associated with adult and pediatric acid sphingomyelinase deficiency (ASMD)

INTRODUCTION

Acid sphingomyelinase deficiency (ASMD) type B is a rare genetic disorder leading to enlargement of the spleen and liver, pulmonary dysfunction, and other symptoms. Cost-utility analyses are often conducted to quantify the value of new treatments, and these analyses require health state utilities. Therefore, the purpose of this study was to estimate utilities associated with varying levels of severity of adult and pediatric ASMD type B.

METHODS

Seven adult and seven child health state vignettes describing ASMD were developed based on published literature, clinical trial results, and interviews with clinicians, patients with ASMD, and parents of children with ASMD. The health states were valued in time trade-off interviews with adult general population respondents in the UK.

RESULTS

Interviews were completed with 202 participants (50.0% female; mean age = 41.3 years). The health state representing ASMD without impairment had the highest mean utility for both the adult and child health states (0.92/0.94), and severe ASMD had the lowest mean utility (0.33/0.45). Every child health state had a significantly greater utility than the corresponding adult health state. Differences between adult/child paired states ranged from 0.02 to 0.13. Subgroup analyses explored the impact of parenting status on valuation of child health states.

DISCUSSION

Greater severity of ASMD was associated with lower mean utility. Results have implications for valuation of pediatric health states. The resulting utilities may be useful in cost-utility modeling estimating the value of treatment for ASMD.

The estimation of health state utility values in rare diseases: do the approaches in submissions for NICE technology appraisals reflect the existing literature? A scoping review

BACKGROUND

Rare diseases negatively impact patients' quality of life, but the estimation of health state utility values (HSUVs) in research studies and cost-utility models for health technology assessment is challenging.

OBJECTIVES

This study compared the methods for estimating the HSUVs included in manufacturers' submissions of orphan drugs to the National Institute for Health and Care Excellence (NICE) with those of published studies addressing the same rare diseases to understand whether manufacturers fully exploited the existing literature in developing their economic models.

METHODS

All NICE Technology Appraisal (TA) and Highly Specialized Technologies (HST) guidance documents of non-cancer European Medicines Agency (EMA) orphan medicinal products were reviewed and compared with any published primary studies, retrieved via PubMed until November 2020, and estimating HSUVs for the same conditions addressed in manufacturers' submissions.

RESULTS

We identified 22 NICE TA/HST appraisal reports addressing 19 different rare diseases. Sixteen reports presented original HSUVs estimated using EQ-5D or Health Utility Index (n = 12), direct methods (n = 2) or mapping (n = 2), while the other six included values obtained from the literature only. In parallel, we identified 111 published studies: 86.6% used preference-based measures (mainly EQ-5D, 60.7%), 12.5% direct techniques, and 2.7% mapping. The collection of values from non-patient populations (using 'vignettes') was more frequent in manufacturers' submissions than in the literature (22.7% vs. 8.0%).

CONCLUSIONS

The agreement on methodological choices between manufacturers' submissions and published literature was only partial. More efforts should be made by manufacturers to accurately reflect the academic literature and its methodological recommendations in orphan drugs submissions.

Review of economic modeling evidence from NICE appraisals of rare disease treatments for spinal muscular atrophy

INTRODUCTION

The National Institute of Health and Care Excellence (NICE) in England has appraised three treatments for spinal muscular atrophy (SMA), namely, nusinersen, onasemnogene abeparvovec, and risdiplam. As rare disease treatments (RDTs) commonly face challenges in health technology assessment (HTA) processes due to their clinical and economic uncertainties, an in-depth review of these appraisals is useful to enable a deeper understanding of economic modelling considerations for SMA.

AREAS COVERED

This review is a detailed analysis of NICE appraisals for SMA and aims to compare the economic modelling evidence of the three RDTs. This is done by examining differences and similarities and by discussing critical outstanding issues across the economic evaluations of the appraisals.

EXPERT OPINION

This article aims to contribute to the development of evidence that can be used as guidance to inform resource allocation decisions for RDTs for SMA, but also to be a resource about approaches for the generation, analysis and interpretation of economic modelling evidence for RDTs more broadly.

Improving Interpretation of Evidence Relating to Quality of Life in Health Technology Assessments of Rare Disease Treatments

Rare diseases are often severe, debilitating, life-limiting conditions, many of which occur in childhood. These complex conditions have a wide range of clinical manifestations that have a substantial impact on the lives of patients, carers and families and often produce heterogeneous clinical outcomes. Therefore, the evaluation of quality-of-life (QoL) impacts is important. In health technology assessment (HTA), patient-reported outcome measures (PROMs) and/or health state utility values (HSUVs) are used to determine QoL impacts of new treatments, but their use in rare diseases is challenging due to small and heterogeneous populations and limited disease knowledge. This paper describes challenges associated with the use of patient-reported outcomes (PROs)/HSUVs to evaluate QoL in HTA of rare disease treatments (RDTs) and identifies five recommendations to ensure appropriate interpretation of QoL impacts. These were derived from mixed methods research (literature reviews, appraisal document analyses, appraisal committee observations and interviews) examining the use of PROs/HSUVs in HTA of RDTs. They highlight that HTAs of RDTs must (1) understand the QoL impacts of the disease and of treatments; (2) critically assess PRO data, recognising the nuances in development and administration of PROMs/HSUVs, considering what is feasible and what matters most to the patient population; (3) recognise that lack of significant effect on a PRO does not imply no QoL benefit; (4) use different forms of evidence to understand QoL impacts, such as patient input; and (5) provide methodological guidance to capture QoL impacts on patients/carers.

Systemic Diseases with Oral Manifestations and Their Impact on Health-Related Quality of Life

Health-related quality of life is a multidimensional concept established to evaluate the physical, psychological, and social impacts of health conditions on individuals’ well-being. Various tools for measuring health-related quality of life can be categorized into two subsets: generic and disease–specific instruments. The oral cavity can be stricken by a broad range of local and systemic diseases and their systemic treatment modalities. The most common systemic illnesses associated with oral lesions are hematologic disorders, endocrinopathies, neurological disorders, gastrointestinal conditions, mucocutaneous and rheumatic diseases, and neoplastic processes. Their manifestations in the oral cavity are, in most cases, rather nonspecific but should not be overlooked. Oral health is one of the most important parts of overall health, thus it has been proposed that poor oral health may affect health–related quality of life. The presence of oral manifestations of systemic diseases has a negative impact on the daily functioning of patients, decreasing their overall well-being. This article will review the most common systemic diseases with oral manifestations and their impact on the health–related quality of life. Oral health researchers should put a stronger emphasis on the patient-reported quality of life as a primary outcome in future clinical trials. The significance of this area has still not been widely understood in the current dental literature even though it could help improve patients’ health-related quality of life.

Consideration of quality of life in the health technology assessments of rare disease treatments

OBJECTIVES

Challenges with patient-reported outcome (PRO) evidence and health state utility values (HSUVs) in rare diseases exist due to small, heterogeneous populations, lack of disease knowledge and early onset. To better incorporate quality of life (QoL) into Health Technology Assessment, a clearer understanding of these challenges is needed.

METHODS

NICE appraisals of non-oncology treatments with an EMA orphan designation (n = 24), and corresponding appraisals in the Netherlands, France, and Germany were included. Document analysis of appraisal reports investigated how PROs/HSUVs influenced decision-making and was representative of QoL impact of condition and treatment.

RESULTS

PRO evidence was not included in 6/24 NICE appraisals. When included, it either failed to demonstrate change, capture domains important for patients, or was uncertain. In the other countries, little information was reported and evidence largely did not demonstrate change. In NICE appraisals, HSUVs were derived through the collection of EQ-5D data (7/24 cases), mapping (6/24), vignettes (5/24), and published literature or other techniques (6/24). The majority did not use data collected alongside clinical trials. Few measures demonstrated significant change due to lack of sensitivity or face validity, short-term data, or implausible health states. In 8/24 NICE appraisals, patient surveys or input during appraisal committee meetings supported the interpretation of uncertainty or provided evidence about QoL.

CONCLUSIONS

This study sheds light on the nature of PRO evidence in rare diseases and associated challenges. Results emphasise the need for improved development and use of PRO/HSUVs. Other forms of evidence and expert input are crucial to support better appraisal of uncertain or missing evidence.

Patient and Caregiver Health State Utilities in Lennox-Gastaut Syndrome and Dravet Syndrome

PURPOSE

Lennox-Gastaut syndrome (LGS) and Dravet syndrome (DS) are rare, treatment-resistant forms of epilepsy characterized by childhood onset of seizures. Cost-effectiveness analysis for new antiseizure medications typically requires health state utilities (HSUs) that reflect the patient and caregiver burden of the relevant conditions. This study aimed to estimate HSUs for LGS and DS. Focus was placed on valuing the impact of seizure frequency and seizure-free days on health-related quality of life (HRQL) for patients and caregivers.

METHODS

Health state vignettes that described the experience of living with and caring for a child with LGS or DS were developed based on a targeted literature review and feedback from interviews with LGS and DS clinical experts and DS caregivers. Vignettes varied by the number of seizures and seizure-free days per month. Twenty-four vignettes were developed that described patient HRQL (6 per condition) and caregiver HRQL (6 per condition) for LGS or DS. Vignettes were evaluated via interviews from the general population in the United Kingdom and Sweden using a visual analog scale and time trade-off (TTO) method. Participants were recruited by interviewers based in different regions of the United Kingdom and Sweden using convenience sampling.

FINDINGS

Two hundred interviews were conducted by video call from March to April 2020. One hundred participants evaluated each of the 6 patient and 6 caregiver vignettes for LGS; a different 100 participants evaluated each of the DS vignettes. The estimated utility values vary consistently according to seizure frequency and number of seizure-free days. Patient TTO utility values range from -0.186 (highest seizure frequency and fewest seizure-free days) to 0.754 (seizure-free state) for LGS and from 0.171 to 0.778 for DS. The caregiver TTO utility values range from 0.032 to 0.810 and 0.510 to 0.881 for LGS and DS, respectively. Fewer seizures and additional seizure-free days are associated with better patient and caregiver HRQL.

IMPLICATIONS

This study estimated utility values for patients with LGS or DS and their caregivers using visual analog scale and TTO valuation among a general public sample. These utility values can be used in cost-effectiveness assessments of new antiseizure medications. The findings indicate the importance of seizure-free days as well as seizure frequency in patient and caregiver HRQL, which may inform the design of future clinical trials.

Investigating health-related quality of life in rare diseases: a case study in utility value determination for patients with CLN2 disease (neuronal ceroid lipofuscinosis type 2)

Background

Utility studies enable preference-based quantification of a disease’s impact on patients’ health-related quality of life (HRQoL). It is often difficult to obtain utility values for rare, neurodegenerative conditions due to cognitive burden of direct elicitation methods, and the limited size of patient/caregiver populations. CLN2 disease (neuronal ceroid lipofuscinosis type 2) is an ultra-rare, progressive condition, for which there are no published utility data fully capturing all disease stages. This case study demonstrates how utility values can be estimated for ultra-rare paediatric diseases by asking clinicians to complete EQ-5D-5L questionnaires based on vignettes describing the stages of CLN2 disease.

Methods

An indirect elicitation method using proxy-reporting by clinical experts was adopted. Eighteen vignettes were developed, describing nine progressive disease stages as defined by motor and language domain scores of the CLN2 Clinical Rating Scale, in individuals treated with cerliponase alfa or standard care. Eight clinical experts with experience of treating CLN2 disease with cerliponase alfa and current standard care completed the proxy version 2 EQ-5D-5L online after reading these vignettes. Resulting scores were converted to EQ-5D-5L utility values for each disease stage, using UK, German and Spanish value sets.

Results

Utility values, which are typically anchored by 0 (equivalent to death) and 1 (full health), decreased with CLN2 disease progression (results spanned the maximum range of the utility scale). Assigned utility values were consistently higher for patients receiving cerliponase alfa than standard care; differences were statistically significant for the 6 most severe disease stages (p < 0.05). Analysis of the individual dimensions of the EQ-5D-5L showed that greatest differences between patients treated with cerliponase alfa and standard care occurred in the pain dimension (differences in mean scores ranged between no difference and 1.8), with notable differences also observed in the anxiety/depression dimension (differences in mean scores ranged between 0.1 and 1.0).

Conclusions

This study demonstrates a feasible methodology for eliciting utility values in CLN2 disease, indicating HRQoL declines with disease progression. Vignettes describing patients receiving cerliponase alfa were consistently assigned higher utility values for the same disease state, suggesting this treatment improves HRQoL compared with standard care.

Trial registration NCT01907087, NCT02485899.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13023-021-01829-x.