Best-Worst Scaling and the Prioritization of Objects in Health: A Systematic Review

Assessing patient information needs for new antidiabetic medications to inform shared decision-making: A best-worst scaling experiment in China

BACKGROUND

Shared decision-making (SDM) is a patient-centred approach to improve the quality of care. An essential requirement for the SDM process is to be fully aware of patient information needs.

OBJECTIVES

Our study aimed to assess patient information needs for new antidiabetic medications using the best-worst scaling (BWS) experiment.

METHODS

BWS tasks were developed according to a literature review and the focus group discussion. We used a balanced incomplete block design and blocking techniques to generate choice sets. The final BWS contains 11 attributes, with 6-choice scenarios in each block. The one-to-one, face-to-face BWS survey was conducted among type 2 diabetic patients in Jiangsu Province. Results were analyzed using count-based analysis and modelling approaches. We also conducted a subgroup analysis to observe preference heterogeneity.

RESULTS

Data from 539 patients were available for analysis. The most desired information domain was the comparative effectiveness of new antidiabetic medications. It consists of the incidence of macrovascular complications, the length of extended life years, changes in health-related quality of life, the incidence of microvascular complications, and the control of glycated haemoglobin. Of all the attributes, the incidence of macrovascular complications was the primary concern. Patients' glycemic control and whether they had diabetes complications exerted a significant influence on their information needs.

CONCLUSIONS

Information on health benefits is of critical significance for diabetic patients. Patients have different information needs as their disease progresses. Personalized patient decision aids that integrate patient information needs and provide evidence of new antidiabetic medications are worthy of being established.

PATIENT OR PUBLIC CONTRIBUTION

Before data collection, a pilot survey was carried out among diabetic patients to provide feedback on the acceptability and intelligibility of the attributes.

Prioritization of ethical concerns regarding HIV molecular epidemiology by public health practitioners and researchers

BACKGROUND

HIV molecular epidemiology (HIV ME) can support the early detection of emerging clusters of new HIV infections by combining HIV sequence data routinely obtained during the clinical treatment of people living with HIV with behavioral, geographic, and sociodemographic information. While information about emerging clusters promises to facilitate HIV prevention and treatment efforts, the use of this data also raises several ethical concerns. We sought to assess how those working on the frontlines of HIV ME, specifically public health practitioners (PHPs) and researchers, prioritized these issues.

METHODS

Ethical issues were identified through literature review, qualitative in-depth interviews, and stakeholder engagement. PHPs and researchers using HIV ME prioritized the issues using best-worst scaling (BWS). A balanced incomplete block design was used to generate 11 choice tasks each consisting of a sub-set of 5 ethical concerns. In each task, respondents were asked to assess the most and least concerning issue. Data were analyzed using conditional logit, with a Swait-Louviere test of poolability. Latent class analysis was then used to explore preference heterogeneity.

RESULTS

In total, 57 respondents completed the BWS experiment May-June 2023 with the Swait-Louviere test indicating that researchers and PHPs could be pooled (p = 0.512). Latent class analysis identified two classes, those highlighting "Harms" (n = 29) (prioritizing concerns about potential risk of legal prosecution, individual harm, and group stigma) and those highlighting "Utility" (n = 28) (prioritizing concerns about limited evidence, resource allocation, non-disclosure of data use for HIV ME, and the potential to infer the directionality of HIV transmission). There were no differences in the characteristics of members across classes.

CONCLUSIONS

The ethical issues of HIV ME vary in importance among stakeholders, reflecting different perspectives on the potential impact and usefulness of the data. Knowing these differences exist can directly inform the focus of future deliberations about the policies and practices of HIV ME in the United States.

A Best-Worst Scaling Study of the General Population's Preferences for Activities in Living Arrangements for Persons With Dementia

BACKGROUND

Activity involvement is a central element of dementia care. However, few studies have examined preferences for types of activities for persons who may be in need of care in the future. In this study, a best-worst scaling (BWS) was conducted to gather insights on preferred activities in small-scale living arrangements for dementia in the general population aged 50-65 years from rural and urban regions.

METHODS

BWS tasks were developed based on literature searches and focus groups. The final BWS contains ten activities, namely 'interaction with animals', 'gardening', 'painting, handicrafts, manual activities', 'household activities (e.g., folding laundry, cooking)', 'watching television', 'practicing religion', 'listening to music and singing familiar songs', 'conversations about the past', 'walks and excursions', 'sport activities (e.g., gymnastics)'. Each participant had to fill out subsets of four objects each and identify them as best and worst. A postal survey was sent to a total of 4390 persons from rural and urban regions aged between 50 and 65 years. Results were analyzed by count analysis and logit models. It was examined if preferences differ with respect to gender, religiousness, and informal caregiving experience.

RESULTS

A total of 840 questionnaires were returned, and 627 surveys were included in the analysis. In the rural sample, the highest relative importance (RI) was assigned to 'walks and excursions' (RI: 100%), 'sport activities (e.g., gymnastics)' (RI: 56%), 'gardening' (RI: 28%), and 'interaction with animals' (26%). In the urban sample, 'walks and excursions' (RI: 100%), 'sport activities (e.g., gymnastics)' (RI: 37%), 'interaction with animals' (25%) and 'gardening' (RI: 22%) were perceived as most important. In both groups, household activities and practicing religion were of lowest importance. Importance ranks differed between subgroups. Results of the logit models with random effects showed the same order as results from the count analyses.

DISCUSSION

Our findings show that respondents generally favored activities with an outdoor component, while the household activities that are part of many concepts were of low importance to respondents. Thus, our study can inform the design of a preference-based specific range of activities in small-scale living arrangements for dementia.

Prioritization of Adverse Consequences After Total Knee Arthroplasty Contributing to a Poor Response: A Best-Worst Scaling Exercise Among Total Knee Arthroplasty Patients and Knee Specialists

BACKGROUND

Total knee arthroplasty (TKA) can have a number of adverse consequences for patients that might contribute to a poor outcome. This study aimed to prioritize these consequences, from the perspective of patients and knee specialists.

METHODS

There were 95 TKA patients and 63 knee specialists who prioritized a set of 29 adverse consequences, based on a previous qualitative study, using a Maximum Difference Scaling method. A hierarchical Bayesian analysis was used to calculate relative importance scores. Differences and agreements between patients versus knee specialists and satisfied versus dissatisfied patients were analyzed using Mann-Whitney-U tests and Kendall's coefficients of concordance.

RESULTS

There were 4 out of 5 items in the top-5 of both patients and knee specialists that were similar, however, the ranking was different. The highest-ranked consequence for patients was: "Inability to do normal activities such as walking, cycling, swimming and heavy household chores", while knee specialists ranked: "No improvement in pain during the day" as the highest. "No improvement in walking" was in the patients' top-5, but was not ranked in the top-5 of knee specialists. For satisfied and dissatisfied patients, the top-5 of consequences was similar.

CONCLUSION

Comparable perspectives were found for patients versus knee specialists and satisfied versus dissatisfied patients on the importance of adverse consequences after TKA. However, when looking in more detail, differences in ranking of specific subitems suggest that patients place slightly more importance on the inability to perform valued activities, while knee specialists prioritize lack of pain relief to a higher degree.

Participatory Value Evaluation (PVE): A New Preference-Elicitation Method for Decision Making in Healthcare

Participatory value evaluation (PVE) has recently been introduced in the field of health as a new method to elicit stated preferences for public policies. PVE is a method in which respondents in a choice experiment are presented with various policy options and their attributes, and are asked to compose their portfolio of preference given a public-resource constraint. This paper aims to illustrate PVE's potential for informing healthcare decision making and to position it relative to established preference-elicitation methods. We first describe PVE and its theoretical background. Next, by means of a narrative review of the eight existing PVE applications within and outside the health domain, we illustrate the different implementations of the main features of the method. We then compare PVE to several established preference-elicitation methods in terms of the structure and nature of the choice tasks presented to respondents. The portfolio-based choice task in a PVE requires respondents to consider a set of policy alternatives in relation to each other and to make trade-offs subject to one or more constraints, which more closely resembles decision making by policymakers. When using a flexible budget constraint, respondents can trade-off their private income with public expenditures. Relative to other methods, a PVE may be cognitively more demanding and is less efficient; however, it seems a promising complementary method for the preference-based assessment of health policies. Further research into the feasibility and validity of the method is required before researchers and policymakers can fully appreciate the advantages and disadvantages of the PVE as a preference-elicitation method.

Patient Preferences in Diagnostic Imaging: A Scoping Review

BACKGROUND

As new diagnostic imaging technologies are adopted, decisions surrounding diagnostic imaging become increasingly complex. As such, understanding patient preferences in imaging decision making is imperative.

OBJECTIVES

We aimed to review quantitative patient preference studies in imaging-related decision making, including characteristics of the literature and the quality of the evidence.

METHODS

The Pubmed, Embase, EconLit, and CINAHL databases were searched to identify studies involving diagnostic imaging and quantitative patient preference measures from January 2000 to June 2022. Study characteristics that were extracted included the preference elicitation method, disease focus, and sample size. We employed the PREFS (Purpose, Respondents, Explanation, Findings, Significance) checklist as our quality assessment tool.

RESULTS

A total of 54 articles were included. The following methods were used to elicit preferences: conjoint analysis/discrete choice experiment methods (n = 27), contingent valuation (n = 16), time trade-off (n = 4), best-worst scaling (n = 3), multicriteria decision analysis (n = 3), and a standard gamble approach (n = 1). Half of the studies were published after 2016 (52%, 28/54). The most common scenario (n = 39) for eliciting patient preferences was cancer screening. Computed tomography, the most frequently studied imaging modality, was included in 20 studies, and sample sizes ranged from 30 to 3469 participants (mean 552). The mean PREFS score was 3.5 (standard deviation 0.8) for the included studies.

CONCLUSIONS

This review highlights that a variety of quantitative preference methods are being used, as diagnostic imaging technologies continue to evolve. While the number of preference studies in diagnostic imaging has increased with time, most examine preventative care/screening, leaving a gap in knowledge regarding imaging for disease characterization and management.

Prioritizing Treatment Goals of People Diagnosed with Bipolar I Disorder in the US: Best-Worst Scaling Results

Purpose

Bipolar I disorder (BP-I) is associated with significant disease burden, but evidence on treatment goals in people diagnosed with BP-I is scarce. This study sought to quantify treatment goals related to the pharmacological management of BP-I in adults in the US and to identify if subgroups of people with similar treatment goals exist.

Patients and Methods

A best-worst scaling (BWS) of treatment goals was developed based on available literature and input from experts and patients and was distributed as part of a survey between August and September 2021. Survey participants were adults with a self-reported diagnosis of BP-I who were recruited via an online panel in the US. Participants were asked to prioritize the importance of 16 treatment goals using BWS. BWS scores were computed using multinomial logistic regression, with the scores across all goals summing to 100 for each participant. Subgroups of people with similar preferences were identified using latent class analysis.

Results

The most important treatment goals for people diagnosed with BP-I (N=255) were "being less impulsive, angry, or irritable" (score: 9.73), or being "able to feel pleasure or happiness" (score: 9.54). Goals related to reducing the incidence of various potential adverse events of medication (scores: ≤4.51) or "reducing dependence on others" (score: 3.04) were less important. Two subgroups were identified. One subgroup (n=111) prioritized symptom-focused goals, considering "reducing frequency of mania, depression, and mixed episodes" and "being less impulsive, angry or irritable" the most important (scores: 12.46 and 11.85, respectively). The other subgroup (n=144) placed significantly more importance on social functioning-focused goals, including beginning or maintaining a relationship with a partner/significant other, and with family and/or friends (scores: 8.45 and 7.70, respectively).

Conclusion

People diagnosed with BP-I prioritized emotional improvements. Subgroups of people with BP-I prioritized either symptom-focused or social functioning-focused treatment goals.

Preferences of people living with HIV for features of tuberculosis preventive treatment regimens - a discrete choice experiment

Background

Tuberculosis (TB) preventive treatment (TPT) is recommended for people living with HIV (PLHIV) in high TB burden settings. While 6 months of daily isoniazid remains widely used, shorter regimens are now available. However, little is known about preferences of PLHIV for key features of TPT regimens.

Methods

We conducted a discrete choice experiment among adult PLHIV engaged in care at an urban HIV clinic in Kampala, Uganda. In nine random choice tasks, participants chose between two hypothetical TPT regimens with different features (pills per dose, frequency, duration, need for adjusted antiretroviral therapy [ART] dosage and side effects). We analyzed preferences using hierarchical Bayesian estimation, latent class analysis, and willingness-to-trade simulations.

Results

Of 400 PLHIV, 392 (median age 44, 72% female, 91% TPT-experienced) had high quality choice task responses. Pills per dose was the most important attribute (relative importance 32.4%, 95% confidence interval [CI] 31.6 - 33.2), followed by frequency (20.5% [95% CI 19.7 - 21.3]), duration (19.5% [95% CI 18.6 - 20.5]), and need for ART dosage adjustment (18.2% [95% CI 17.2 - 19.2]). Latent class analysis identified three preference groups: one prioritized less frequent, weekly dosing (N=222; 57%); another was averse to ART dosage adjustment (N=107; 27%); and the last prioritized short and tolerable regimens (N=63; 16%). All groups highly valued fewer pills per dose. Participants were willing to accept a regimen of 2.8 months' additional duration [95% CI: 2.4 - 3.2] to reduce pills per dose from five to one, 3.6 [95% CI 2.4 - 4.8] months for weekly rather than daily dosing, and 2.2 [95% CI 1.3 - 3.0] months to avoid ART dosage adjustment.

Conclusions

To align with preferences of PLHIV, decision-makers should prioritize the development and implementation of TPT regimens with fewer pills, less frequent dosing, and no need for ART dosage adjustment, rather than focus primarily on duration of treatment.

Increasing Access to Buprenorphine for Opioid Use Disorder in Primary Care: an Assessment of Provider Incentives

BACKGROUND

Primary care providers (PCPs) are essential to increasing access to office-based buprenorphine medication treatment for opioid use disorder (B-MOUD). Barriers to B-MOUD prescribing are well-documented, but there is little information regarding incentives to overcome these barriers.

OBJECTIVE

To identify optimal incentives for PCPs to promote B-MOUD prescribing and compare incentive preferences across provider and practice characteristics.

DESIGN

We surveyed PCPs using best-worst scaling (BWS) to prioritize seven potential incentives for B-MOUD prescribing (monetary compensation, paid vacation, protected time, professional development, reduced workload, service recognition, clinical resources). We then used a direct elicitation approach to determine preferred incentive levels (e.g., monetary thresholds) and types (e.g., specific clinical resources).

PARTICIPANTS

Primary care physicians and advanced practice providers (APPs) at a large Department of Veterans Affairs healthcare system.

MAIN MEASURES

B-MOUD prescribing incentive preferences and relative preference levels using descriptive statistics and conditional logistic regression with relative importance scale transformation (coefficients sum to 100, higher coefficient=greater importance).

KEY RESULTS

Fifty-three PCPs responded (73% response), including 47% APPs and 36% from community-based clinics. Reduced workload (relative importance score=26.8), protected time (18.7), and clinical resources (16.8) were significantly more preferred (Ps < 0.001) than professional development (10.5), paid vacation (10.3), or service recognition (1.5). Relative importance of monetary compensation varied between physicians (12.6) and APPs (17.5) and between PCPs located at a medical center (11.4) versus community clinic (22.3). APPs were more responsive than physicians to compensation increases of $5000 and $12,000 but less responsive to $25,000; trends were similar for medical center versus community clinic PCPs. The most frequently requested clinical resource was on-demand consult access to an addiction specialist.

CONCLUSIONS

Interventions promoting workload reductions, protected time, and clinical resources could increase access to B-MOUD in primary care. Monetary incentives may be additionally needed to improve B-MOUD prescribing among APPs and within community clinics.

Impact of Potential Symptoms and Risks Associated with Acid Sphingomyelinase Deficiency on Patients and Caregivers: A Best-Worst Scaling Study

Purpose

Acid sphingomyelinase deficiency (ASMD) is a rare, progressive, and potentially fatal disease affecting major organs; its symptoms present heterogeneously. Data on the most bothersome symptoms for patients with ASMD types B or A/B and their caregivers or parents are limited. We conducted a survey to quantify the relative impact of potential ASMD symptoms and risks for patients and parents/caregivers.

Patients and Methods

Twenty respondents, recruited via National Niemann-Pick Disease Foundation (United States) and Niemann-Pick United Kingdom, took a preference survey: 11 patients who had a self-reported diagnosis of ASMD types B or A/B and 9 parents who had a child with ASMD types B or A/B. Using object-case best-worst scaling, we explored the most and least bothersome among a set of 15 ASMD symptoms/risks selected based on clinical input and qualitative research with patients and caregivers. In 15 experimentally designed questions containing five items each, respondents ranked the symptoms/risks, irrespective of their experiences with them. Data were analyzed using a conditional multinomial logit model.

Results

Patients reported constant abdominal pain, severe pain in bones and joints, and severe fatigue to be the most bothersome potential symptoms or risks, followed by a chance of bleeding in the spleen. The next most bothersome potential symptom was constant shortness of breath. Easy bruising and noticeable abdominal enlargement were among the least bothersome symptoms. The most bothersome symptom for parents was bleeding in the spleen.

Conclusion

Patients and parents had similar perceptions of the most bothersome potential symptoms/risks. Despite the small sample size typical of rare disease studies, understanding patient preferences is important for such diseases and can inform shared decision-making.

Measuring the preferences of injectable opioid agonist treatment (iOAT) clients: Development of a person-centered scale (best-worst scaling)

BACKGROUND

Injectable opioid agonist treatment (iOAT) is effective for opioid use disorder (OUD), yet little is known about client preferences for accessing iOAT (e.g., with diacetylmorphine, hydromorphone, buprenorphine, fentanyl, etc.). Best-worst scaling (BWS) is a preference elicitation method from health economics that has never been applied to addiction care broadly, or iOAT specifically. We describe the stages of developing a BWS scale that assesses iOAT clients' treatment delivery preferences to inform program planning and maximize healthcare efficiency.

METHODS

We underwent several steps to reveal the relevant attributes/levels and design the scale structure. An initial list of potential attributes and levels was established from a literature review and prior qualitative data. Then, we conducted semi-structured interviews and focus groups with clients (n=21) on their iOAT preferences to confirm the attributes and prioritize/include new ones. Next, we conducted semi-structured interviews and focus groups with iOAT experts and stakeholders to receive their input on the draft list of attributes and levels. A BWS profile case design was piloted with iOAT clients (n=18) from different sites during a think aloud interview. After several rounds of revisions, the final version was tested by iOAT clients (n=2) before the scale was launched.

RESULTS

We developed a person-centered scale that assesses current and former iOAT clients' most and least wanted aspects of iOAT delivery. The final version yielded 7 unique attributes: choice of medication, choice of dose, convenience, location & space, scheduling & routines, staff & training, and types of services offered.

CONCLUSION

This scale can help expand iOAT programs in a way that is person-centered, rapid, and affordable. The methodology is a guide for other regions with similar populations who aim to develop strong quantitative methodologies that prioritize client collaboration.

A Roadmap for Increasing the Usefulness and Impact of Patient-Preference Studies in Decision Making in Health: A Good Practices Report of an ISPOR Task Force

Many qualitative and quantitative methods are readily available to study patient preferences in health. These methods are now being used to inform a wide variety of decisions, and there is a growing body of evidence showing studies of patient preferences can be used for decision making in a wide variety of contexts. This ISPOR Task Force report synthesizes current good practices for increasing the usefulness and impact of patient-preference studies in decision making. We provide the ISPOR Roadmap for Patient Preferences in Decision Making that invites patient-preference researchers to work with decision makers, patients and patient groups, and other stakeholders to ensure that studies are useful and impactful. The ISPOR Roadmap consists of 5 key elements: (1) context, (2) purpose, (3) population, (4) method, and (5) impact. In this report, we define these 5 elements and provide good practices on how patient-preference researchers and others can actively contribute to increasing the usefulness and impact of patient-preference studies in decision making. We also present a set of key questions that can support researchers and other stakeholders (eg, funders, reviewers, readers) to assess efforts that promote the ongoing impact (both intended and unintended) of a particular preference study and additional studies in the future.