A Roadmap for Increasing the Usefulness and Impact of Patient-Preference Studies in Decision Making in Health: A Good Practices Report of an ISPOR Task Force

Many qualitative and quantitative methods are readily available to study patient preferences in health. These methods are now being used to inform a wide variety of decisions, and there is a growing body of evidence showing studies of patient preferences can be used for decision making in a wide variety of contexts. This ISPOR Task Force report synthesizes current good practices for increasing the usefulness and impact of patient-preference studies in decision making. We provide the ISPOR Roadmap for Patient Preferences in Decision Making that invites patient-preference researchers to work with decision makers, patients and patient groups, and other stakeholders to ensure that studies are useful and impactful. The ISPOR Roadmap consists of 5 key elements: (1) context, (2) purpose, (3) population, (4) method, and (5) impact. In this report, we define these 5 elements and provide good practices on how patient-preference researchers and others can actively contribute to increasing the usefulness and impact of patient-preference studies in decision making. We also present a set of key questions that can support researchers and other stakeholders (eg, funders, reviewers, readers) to assess efforts that promote the ongoing impact (both intended and unintended) of a particular preference study and additional studies in the future.

Line of therapy and patient preferences regarding lung cancer treatment: a discrete-choice experiment

OBJECTIVE

A growing literature on patient preferences informs decisions in research, regulatory science, and value assessment, but few studies have explored how preferences vary across patients with differing treatment experience. We sought to quantify patient preferences for the benefits and risks of lung cancer treatment and test how preferences differed by line of therapy (LOT).

METHODS

Preferences were elicited using a discrete choice experiment (DCE) following rigorous patient and stakeholder engagement. The DCE spanned five attributes (each with three levels): progression-free survival (PFS), short-term side effects, long-term side effects, risk of developing late-onset side effects, and mode of administration (MOA) - each defined across 3 relevant levels. A D-efficient design was used to generate 3 survey blocks of 9 paired-profile choice tasks each and respondents were asked which profile they preferred and then if they preferred to have no treatment (opt-out). A mixed logit model, controlling for opt-out, was used to estimate preferences. Preferences and trade-offs between PFS and other attributes were compared across two groups: those receiving ≤1 LOT and those receiving ≥2 LOT.

RESULTS

Of the 466 participants, 42% received ≤1 LOT and 58% received ≥2 LOT. Stated preferences differed between the groups overall (p<.001) and specifically for 18 months of PFS (p<.001), moderate short-term side effects (p<.001), no long-term side effects (p=.03), and 30% chance of late-onset side effects (p=.02). Those receiving differing amounts of LOT were willing to trade different amounts of PFS to change from moderate to mild short-term side effects (p<.001), moderate to no (p<.001) and mild to no (p<.001) long-term side effects. There were also differing amounts of tradeoff acceptable between the groups for a 10% decrease in risk of late-onset side effects (p=.016), a decrease in MOA from infusion every 3 weeks to pills taken daily at any time (p=.005) and from pills taken daily without food to pills taken daily at any time (p<.001).

CONCLUSION

We demonstrate differences in preferences based on experience with LOT, suggesting that patient treatment experience may have an impact on their preferences. As patient preference data become an important component of treatment decision making, preference differences should be considered when recommending therapies at different stages in the treatment journey. Understanding patient preferences regarding treatment decisions is essential to informing shared decision-making and ensuring treatment plans are consistent with patients' goals.

Variation Among Patients With Crohn's Disease in Benefit vs Risk Preferences and Remission Time Equivalents

BACKGROUND & AIMS

Patients with Crohn's disease (CD) must make decisions about their treatment. We aimed to quantify patients' preferences for different treatment outcomes and adverse events. We also evaluated the effects of latent class heterogeneity on these preferences.

METHODS

An online stated-preference survey was completed by 812 individuals with CD in the Crohn's and Colitis Foundation Partners cohort (IBD Partners). Patients were given information on symptoms and severity of active disease; duration of therapy with corticosteroids; and risks of serious infection, cancer and surgery. Patients were asked to assume that their treatment was not working and to choose an alternative therapy. The primary outcome was remission-time equivalents (RTE) of a given duration of symptom severity or treatment-related risk. Latent class choice models identified groups of patients with dominant treatment-outcome preferences and associated patient characteristics with these groups.

RESULTS

Latent class analysis demonstrated 3 distinct groups of survey responders whose choices were strongly influenced by avoidance of active symptoms (61%), avoidance of corticosteroid use (25%), or avoidance of risks of cancer, infection or surgery (14%) when choosing a therapy. Class membership was correlated with age, sex, mean short CD activity index score and corticosteroid avoidance. RTEs in each latent class differed significantly from the mean RTEs for the overall sample, although the symptom-avoidant class most closely approximated the overall sample.

CONCLUSIONS

In an online survey of patients with CD, we found substantial heterogeneity in preference for medication efficacy and risk of harm. Physicians and regulators should therefore not assume that all patients have mean-value preferences-this could result in significant differences in health-technology assessment models.

Evidence-Based Medicine in Otolaryngology Part 9: Valuing Health Outcomes

Decisions about resource allocation are increasingly based on value trade-offs between health outcomes and cost. This process relies on comprehensive and standardized definitions of health status that accurately measure the physical, mental, and social well-being of patients across disease states. These metrics, assessed through clinical trials, observational studies, and health surveys, can facilitate the integration of patient preferences into clinical practice. This ninth installment in the Evidence-Based Medicine in Otolaryngology Series is a practical overview of health outcome valuation, as well as the integration of both quality and quantity of life into standardized metrics for health research, program planning, and resource allocation. Tools for measuring preference-based health states, measures of effectiveness, and the application of metrics in economic evaluations are discussed.

Chronic pain patients' treatment preferences: a discrete-choice experiment

OBJECTIVE

The objective of this study was to identify, document, and weight attributes of a pain medication that are relevant from the perspective of patients with chronic pain. Within the sub-population of patients suffering from "chronic neuropathic pain", three groups were analyzed in depth: patients with neuropathic back pain, patients with painful diabetic polyneuropathy, and patients suffering from pain due to post-herpetic neuralgia. The central question was: "On which features do patients base their assessment of pain medications and which features are most useful in the process of evaluating and selecting possible therapies?"

METHODS

A detailed literature review, focus groups with patients, and face-to-face interviews with widely recognized experts for pain treatment were conducted to identify relevant treatment attributes of a pain medication. A pre-test was conducted to verify the structure of relevant and dominant attributes using factor analyses by evaluating the most frequently mentioned representatives of each factor. The Discrete-Choice Experiment (DCE) used a survey based on self-reported patient data including socio-demographics and specific parameters concerning pain treatment. Furthermore, the neuropathic pain component was determined in all patients based on their scoring in the painDETECT(®) questionnaire. For statistical data analysis of the DCE, a random effect logit model was used and coefficients were presented.

RESULTS

A total of 1,324 German patients participated in the survey, of whom 44 % suffered from neuropathic back pain (including mixed pain syndrome), 10 % complained about diabetic polyneuropathy, and 4 % reported pain due to post-herpetic neuralgia. A total of 36 single quality aspects of pain treatment, detected in the qualitative survey, were grouped in 7 dimensions by factor analysis. These 7 dimensions were used as attributes for the DCE. The DCE model resulted in the following ranking of relevant attributes for treatment decision: "no character change", "less nausea and vomiting", "pain reduction" (coefficient: >0.9 for all attributes, "high impact"), "rapid effect", "low risk of addiction" (coefficient ~0.5, "middle impact"), "applicability with comorbidity" (coefficient ~0.3), and "improvement of quality of sleep" (coefficient ~0.25). All attributes were highly significant (p < 0.001).

CONCLUSIONS

The results were intended to enable early selection of an individualized pain medication. The results of the study showed that DCE is an appropriate means for the identification of patient preferences when being treated with specific pain medications. Due to the fact that pain perception is subjective in nature, the identification of patients´ preferences will enable therapists to better develop and implement patient-oriented treatment of chronic pain. It is therefore essential to improve the therapists´ understanding of patient preferences in order to make decisions concerning pain treatment. DCE and direct assessment should become valid instruments to elicit treatment preferences in chronic pain.

Assessing patient preferences for treatment options and process of care in inflammatory bowel disease: a critical review of quantitative data

Inflammatory bowel disease (IBD), consisting of both Crohn's disease (CD) and ulcerative colitis (UC), are chronic inflammatory conditions of the intestinal tract. As there is no cure for either CD or UC, patients with these conditions face numerous treatment decisions regarding their disease. The aim of this review is to evaluate literature regarding quantitative studies of patient preferences in therapy for IBD with a focus on the emerging technique of stated preference and its application in IBD. Numerous simple survey-based studies have been performed evaluating IBD patients' preferences for medication frequency, mode of delivery, potential adverse events, etc., as well as variations in these preferences. These studies are limited, however, as they are purely descriptive in nature with limited quantitative information on the relative value of treatment alternatives. Time trade-off and standard-gamble studies have also been utilized to quantify patient utility for various treatment options or outcomes. However, these types of studies suffer from inaccurate assumptions regarding patient choice behavior. Stated preference is an emerging robust methodology increasingly utilized in health care that can determine the relative utility for a therapy option as well as its specific attributes (such as efficacy or adverse side effects). Stated preference techniques have begun to be applied in IBD and offer an innovative way of examining the numerous therapy options these patients and their providers face.

Non-clinical health services – what do they contribute to patient care and how can we measure their contribution?

Background and aims

Assessing the contribution of ‘support services’ to improving healthcare is challenging. Despite involving a significant part of the NHS budget, there is very little published literature on methods and approaches. This article describes the development of an integrated approach to assessing and measuring the health impact of these services.

Methods and results

An empirical approach was developed by the main provider of national support services to NHS Scotland. This involved identifying meaningful ways to describe health impact of services several steps removed from patient care, applying this to the full range of national support services provided by NHS National Services Scotland and developing relevant measurement methodologies. Through this approach it was possible to assess the relative health impact of all 63 NSS services and to use this for planning and prioritisation.

Conclusion

Assessing the contribution of support services to improving patient outcomes is a neglected area, despite the significant dependency of direct patient care services upon these services and the resource involved. The methods described in this article have potential to be used across the range of support services within the NHS to improve quality and efficiency of healthcare services.

Analysis of patients' preferences: direct assessment and discrete-choice experiment in therapy of adults with attention-deficit hyperactivity disorder

BACKGROUND

: Attention-deficit hyperactivity disorder (ADHD) is a complex neuropsychiatric disorder that affects children and young people, as well as adults. Since ADHD does not produce specific organic characteristics, behavior and preferences are crucial to diagnosis and treatment. Comprehensive therapy concepts should take full account of the needs of the patients.

OBJECTIVE

: To document therapy attributes that are important from the adults' perspective and to analyze findings from two different valuation approaches used in the same survey.

METHODS

: A self-administered survey measuring attitudes and preferences was conducted in Germany in 2009 (n = 329). Adult patients (aged ≥18 years) were recruited from all over Germany, with the help of patient advocacy organizations. Attitudes were measured and analyzed using a classic rating scale in 5-point Likert format. Discrete-choice experiment (DCE) scenarios were developed using a fractional factorial design and results were analyzed using random effects logit models.

RESULTS

: The aspect of highest importance for the respondents was that social function (job, studies, friendships) was not impaired (coefficient 2.115; standard error 0.111). The next most important in the view of the respondents was achievement of behavioral changes through treatment (coefficient 1.755; standard error 0.110). The 'drug intake' aspect was not important in the attitude component rating and not significant in the DCE.

CONCLUSIONS

: The primary goal of ADHD treatment is by no means the alleviation of core symptoms. Instead, therapy should help enable patients to set and achieve their own objectives. Treatment should enable patients to organize their social participation in everyday life.

Patients' preferences for treatment outcomes for advanced non-small cell lung cancer: a conjoint analysis

BACKGROUND

Treatment decisions for advanced non-small cell lung cancer (NSCLC) are complex and require trade-offs between the benefits and risks experienced by patients. We evaluated the benefits that patients judged sufficient to compensate for the risks associated with therapy for NSCLC.

METHODS

Participants with a self-reported diagnosis of NSCLC (n=100) were sampled from an online panel in the United Kingdom. Eligible and consenting participants then completed a self-administered online survey about their disease and their treatment preferences were assessed. This involved respondents choosing among systematically paired profiles that spanned eight attributes: progression-free survival [PFS], symptom severity, rash, diarrhoea, fatigue, nausea and vomiting, fever and infection, and mode of treatment administration (infusion and oral). A choice model was estimated using mixed-logit regression. Estimates of importance for each attribute level and attribute were then calculated and acceptable tradeoffs among attributes were explored.

RESULTS

A total of 89 respondents (73% male) completed all choice tasks appropriately. Increases in PFS together with improvements in symptom severity were judged most important and increased with PFS benefit - 4 months: 5.7; 95% CI: 3.5-7.9; 5 months: 7.1; 95% CI: 4.4-9.9; and 7 months: 10.0; 95% CI: 6.1-13.9. However, improvements in PFS were viewed as most beneficial when disease symptoms were mild and as detrimental when patients had severe symptoms. Fatigue (5.0; 95% CI: 2.7-7.3) was judged to be the most important risk, followed by diarrhoea (2.8; 95% CI: 0.7-4.9), nausea and vomiting (2.1; 95% CI: 0.1-4.1), fever and infection (2.1; 95% CI: 0.2-4.1), and rash (2.0; 95% CI: 0.2-3.9). Oral administration was preferred to infusion (1.8; 95% CI: 0.0-3.6). Patients with mild and moderate symptoms traded PFS for less risks or more convenience if the severe symptoms were not experienced.

CONCLUSION

This study demonstrates the value of conjoint analysis in the study of patient preferences for cancer treatments. In this small sample of patients with NSCLC from the UK, we demonstrate that the value of improvements in PFS is conditional upon the severity of disease symptoms; and that risks are valued differently.

Methodologies used in cost-effectiveness models for evaluating treatments in major depressive disorder: a systematic review

BACKGROUND

Decision makers in many jurisdictions use cost-effectiveness estimates as an aid for selecting interventions with an appropriate balance between health benefits and costs. This systematic literature review aims to provide an overview of published cost-effectiveness models in major depressive disorder (MDD) with a focus on the methods employed. Key components of the identified models are discussed and any challenges in developing models are highlighted.

METHODS

A systematic literature search was performed to identify all primary model-based economic evaluations of MDD interventions indexed in MEDLINE, the Cochrane Library, EMBASE, EconLit, and PsycINFO between January 2000 and May 2010.

RESULTS

A total of 37 studies were included in the review. These studies predominantly evaluated antidepressant medications. The analyses were performed across a broad set of countries. The majority of models were decision-trees; eight were Markov models. Most models had a time horizon of less than 1 year. The majority of analyses took a payer perspective. Clinical input data were obtained from pooled placebo-controlled comparative trials, single head-to-head trials, or meta-analyses. The majority of studies (24 of 37) used treatment success or symptom-free days as main outcomes, 14 studies incorporated health state utilities, and 2 used disability-adjusted life-years. A few models (14 of 37) incorporated probabilities and costs associated with suicide and/or suicide attempts. Two models examined the cost-effectiveness of second-line treatment in patients who had failed to respond to initial therapy. Resource use data used in the models were obtained mostly from expert opinion. All studies, with the exception of one, explored parameter uncertainty.

CONCLUSIONS

The review identified several model input data gaps, including utility values in partial responders, efficacy of second-line treatments, and resource utilisation estimates obtained from relevant, high-quality studies. It highlighted the differences in outcome measures among the trials of MDD interventions, which can lead to difficulty in performing indirect comparisons, and the inconsistencies in definitions of health states used in the clinical trials and those used in utility studies. Clinical outcomes contributed to the uncertainty in cost-effectiveness estimates to a greater degree than costs or utility weights.

Healthy-days time equivalents for outcomes of acute rotavirus infections

Rotavirus is the most common cause of severe gastroenteritis in infants and young children worldwide. Health-state utility measures used in economic evaluations of rotavirus vaccines do not reflect differences between mild and severe symptoms of rotavirus gastroenteritis and, therefore, do not adequately capture preferences for non-fatal outcomes associated with rotavirus common in industrialized countries. This paper describes the development and results of a survey specifically designed to develop quality-adjusted time equivalents for rotavirus gastroenteritis among a sample of parents with young children in the United States as an alternative to conventional QALY measures in assessing cost-effectiveness.

Health outcomes in economic evaluation: the QALY and utilities

The quality-adjusted life year (QALY) is routinely used as a summary measure of health outcome for economic evaluation, which incorporates the impact on both the quantity and quality of life. Key studies relating to the QALY and utility measurement are the sources of data. Areas of agreement include the need for a standard measure of health outcome to enable comparisons across different disease areas and populations, and the methods used for valuing health states in utility measurement. Areas of controversy include the limitation of the QALY approach in terms of the health benefits it can capture, its blindness towards equity concerns, the underlying theoretical assumptions and the most appropriate generic preference-based measure of utility. There is growing debate relating to whether a QALY is the same regardless of who accrues it, and also the issue as to who should value health states. Research is required to further enhance the QALY approach to deal with challenges relating to equity-weighted utility maximization and testing the validity of underlying assumptions. Issues around choosing between condition-specific measures and generic instruments also merit further investigation.