Utilising Patient and Public Involvement in Stated Preference Research in Health: Learning from the Existing Literature and a Case Study

Making Use of Technology to Improve Stated Preference Studies

The interest in quantifying stated preferences for health and healthcare continues to grow, as does the technology available to support and improve health preference studies. Technological advancements in the last two decades have implications and opportunities for preference researchers designing, administering, analysing, interpreting and applying the results of stated preference surveys. In this paper, we summarise selected technologies and how these can benefit a preference study. We discuss empirical evaluations of the technology in preference research, with examples from health where possible. The technologies reviewed include serious games, virtual reality, eye tracking, innovative formats and decision aids with values clarification components. We conclude with a critical reflection on the benefits and limitations of implementing (often costly) technology alongside stated preference studies.

Developing a person-centered stated preference survey for dementia with Lewy bodies: value of a personal and public involvement process

Introduction

The development of high-quality stated preference (SP) surveys requires a rigorous design process involving engagement with representatives from the target population. However, while transparency in the reporting of the development of SP surveys is encouraged, few studies report on this process and the outcomes. Recommended stages of instrument development includes both steps for stakeholder/end-user engagement and pretesting. Pretesting typically involves interviews, often across multiple waves, with improvements made at each wave; pretesting is therefore resource intensive. The aims of this paper are to report on the outcomes of collaboration with a Lewy body dementia research advisory group during the design phase of a SP survey. We also evaluate an alternative approach to instrument development, necessitated by a resource constrained context.

Method

The approach involved conducting the stages of end-user engagement and pretesting together during a public involvement event. A hybrid approach involving a focus group with breakout interviews was employed. Feedback from contributors informed the evolution of the survey instrument.

Results

Changes to the survey instrument were organized into four categories: attribute modifications; choice task presentation and understanding; information presentation, clarity and content; and best-best scaling presentation. The hybrid approach facilitated group brainstorming while still allowing the researcher to assess the feasibility of choice tasks in an interview setting. However, greater individual exploration and the opportunity to trial iterative improvements across waves was not feasible with this approach.

Discussion

Involvement of the research advisory group resulted in a more person-centered survey design. In a context constrained by time and budget, and with consideration of the capacity and vulnerability of the target population, the approach taken was a feasible and pragmatic mechanism for improving the design of a SP survey.

Preferences for innovations in healthcare delivery models in the Swiss elderly population: a latent class, choice modelling study

BACKGROUND

With the increasing number of people affected by multiple chronic conditions, it is essential for public-health professionals to promote strategies addressing patient needs for coordinated care. We aim to explore preference heterogeneity for better-coordinated care delivery models in Swiss older adults, and identify profiles of individuals more open to healthcare reforms.

METHODS

A DCE (discrete choice experiment) survey was developed online and on paper for the Swiss adults aged 50+, following best practice. To elicit preferences, we estimated a latent class model allowing grouping individuals with similar preferences into distinct classes, and examined what background characteristics contributed to specific class membership.

RESULTS

The optimal model identified three classes with different openness to reforms. Class 1 (49%) members were concerned with premium increases and were in favour of integrated care structures with care managed by interprofessional teams. Individuals in class 2 (19%) were younger, open to reforms, and expressed the needs for radical changes within the Swiss healthcare system. Class 3 respondents (32%) were strongly reluctant to changes.

CONCLUSIONS

Our study goes beyond average preferences and identifies three distinct population profiles, a majority open to reforms on specific aspects of care delivery, a smallest group in favour radical changes, and a third strongly against changes. Therefore, tailored approaches around healthcare reforms are needed, e.g. explaining the role of interprofessional teams in coordinating care, electronic health records and insurance premium variation.

Stakeholder Engagement in Designing Attributes for a Discrete Choice Experiment With Policy Implications: An Example of 2 Swiss Studies on Healthcare Delivery

OBJECTIVES

The use of discrete choice experiments (DCEs) has become increasingly popular in health policy development by involving and analyzing the preferences of target groups for different aspects of the policy intervention. In this article, we aim to contribute to the standardization of the process of attribute and attribute level development for DCEs with policy relevance. To do so, we propose and empirically illustrate a framework tool for the development and reporting of attributes and attribute levels, with the systematic engagement of relevant stakeholders.

METHODS

The framework tool was kept general to allow its use as a standard reporting approach on the development process of a DCE, involving relevant stakeholders at each stage. The proposed 3-stage process consists of (1) collection, (2) selection, and (3) refinement of the DCE attributes and attribute levels. The application of the framework tool is illustrated by 2 projects, Health2040 and COCONUTS-both concerning the preferences of the Swiss population for the future organization of healthcare.

RESULTS

By engaging stakeholders, we identified and included attributes and attribute levels that would not have been identified solely through the existing literature. In addition, including multiple stakeholders from different professional backgrounds ensured that the selected attributes and attribute levels were policy relevant, were applicable in practice, and reflected the opinions of multiple actors in healthcare.

CONCLUSION

The proposed framework helps to strengthen the standardization of the reporting on attribute and attribute level development with stakeholder engagement and to guide future research teams designing a DCE with policy implications.

Patients as research partners in preference studies: learnings from IMI-PREFER

BACKGROUND

There is growing recognition of the importance of patient and public stakeholder involvement (PPI) in patient preference research. However, limited evidence exists regarding the impact, barriers and enablers of PPI in preference studies. The Innovative Medicines Initiative (IMI)-PREFER project conducted a series of preference case studies which incorporated PPI.

OBJECTIVE

To describe: (1) how PPI was operationalized in the PREFER case studies, (2) the impact of PPI, and (3) factors that served to impede and facilitate PPI.

METHODS

We reviewed the PREFER final study reports to determine how patient partners were involved. We conducted a thematic framework analysis to characterize the impact of PPI and then administered a questionnaire to the PREFER study leads to identify barriers and facilitators to effective PPI.

RESULTS

Eight PREFER case studies involved patients as research partners. Patient partners were involved in activities spanning all phases of the patient preference research process, including in study design, conduct and dissemination. However, the type and degree of patient partner involvement varied considerably. Positive impacts of PPI included improvements in the: (1) quality of the research and research process; (2) patient partner empowerment; (3) study transparency and dissemination of results; (4) research ethics, and (5) trust and respect between the research team and the patient community. Of the 13 barriers identified, the 3 most frequently reported were inadequate resources, insufficient time to fully involve patient partners, and uncertainty regarding how to operationalize the role of 'patient partner. Among the 12 facilitators identified, the two most frequently cited were (1) having a clearly stated purpose for involving patients as research partners; and (2) having multiple patient partners involved in the study.

CONCLUSION

PPI had many positive impacts on the PREFER studies. Preference study leads with prior PPI experience reported a greater number of positive impacts than those with no such experience. In light of the numerous barriers identified, multi-faceted implementation strategies should be considered to support adoption, integration and sustainment of PPI within preference research. Additional case studies of patient partner involvement in preference research are needed as well to inform best practices in this area.

A framework for implementing Patient and Public Involvement in mental health research: The PATHWAY research programme benchmarked against NIHR standards

BACKGROUND

Patient and Public Involvement (PPI) in research has become a key component recommended by research commissioners, grant award bodies and specified in government policies. Despite the increased call for PPI, few studies have demonstrated how to implement PPI within large-scale research studies.

OBJECTIVE

The aim of the current study was to provide a case example of the implementation of a patient advisory group in a large-scale mental health research programme (PATHWAY) and to benchmark this against UK standards.

METHOD

A PPI group was incorporated throughout the PATHWAY research programme, from grant development to dissemination. The group attended regular meetings and supported participant recruitment, evaluated patient-facing documents, supported the piloting of the research intervention and co-developed the dissemination and impact strategy. The implementation of PPI throughout the project was benchmarked against the UK standards for PPI.

RESULTS

The inclusion of PPI in the PATHWAY project provided tangible changes to the research project (i.e., improving study documents, co-developing dissemination materials) but also proved to be a beneficial experience to PPI members through the development of new skills and the opportunity to provide a patient voice in research. We show how PPI was involved across seven study phases and provide examples of implementation of the six UK standards. The study did not include PPI in data analysis but met all the UK standards for PPI. Challenges regarding practical components (i.e., meeting frequency, language use), increasing diversity and PPI members' knowledge of research were highlighted as areas for further improvement.

CONCLUSIONS

We provide a case example of how PPI can be implemented throughout a research lifecycle and we note the barriers faced and make suggestions for PPI in future implementation and research.

PATIENT AND PUBLIC CONTRIBUTION

PPI members were involved throughout the lifecycle of the research programme. The PPI lead was a co-author on the manuscript and contributed to report writing.

Constructing Health State Descriptions for Low-Risk Thyroid Cancer: Stakeholder Engagement and Formative Qualitative Research

OVERVIEW

This paper describes stakeholder involvement and formative qualitative research in the creation of health state descriptions (HSDs) or vignettes for low-risk thyroid cancer. The aim of this project was to engage stakeholders in the contribution of a novel set of HSDs, an important first step in the process of assessing value in thyroid cancer health states.

METHODS

We draw upon formative, descriptive qualitative methods, following a multi-stage framework of data collection. We conducted individual semi-structured interviews, cognitive interviews, and focus groups with thyroid cancer patients, community providers, academic subspecialists, and participants with no thyroid cancer diagnosis (N = 31). The HSDs went through several iterations over the course of a year, in collaboration with a highly engaged community advisory board, laying the groundwork for HSDs that are comprehensible, comparable, and appropriate for stated-preference research.

FINDINGS

Thyroid cancer survivors compared their experiences with those described in the HSDs. Feedback included concern for the emotional well-being of study participants who would be reading them. Providers were attuned to the need for clinical accuracy and made suggestions to reflect their clinical experience, including for patients with complications or disease progression. The pilot participants with no thyroid cancer were particularly valuable in promoting the need to simplify language and maximize readability.

DISCUSSION

Stakeholder engagement was critical to being responsive to feedback as the iterations were refined and presented. Continuous engagement and consultation with multiple sources strengthened the HSDs. A secondary outcome from this project is that stakeholders expressed interest in adapting the HSDs into decision aids for people newly diagnosed with low-risk thyroid cancer.

Discrete choice experiment to investigate preferences for psychological intervention in cardiac rehabilitation

OBJECTIVE

Cardiac rehabilitation (CR) is offered to people who recently experienced a cardiac event, and often comprises of exercise, education and psychological care. This stated preference study aimed to investigate preferences for attributes of a psychological therapy intervention in CR.

METHODS

A discrete choice experiment (DCE) was conducted and recruited a general population sample and a trial sample. DCE attributes included the modality (group or individual), healthcare professional providing care, information provided prior to therapy, location and the cost to the National Health Service (NHS). Participants were asked to choose between two hypothetical designs of therapy, with a separate opt-out included. A mixed logit model was used to analyse preferences. Cost to the NHS was used to estimate willingness to pay (WTP) for aspects of the intervention design.

RESULTS

Three hundred and four participants completed the DCE (general public sample (n=262, mean age 47, 48% female) and trial sample (n=42, mean age 66, 45% female)). A preference for receiving psychological therapy was demonstrated by both samples (general population WTP £1081; 95% CI £957 to £1206). The general population appeared to favour individual therapy (WTP £213; 95% CI £160 to £266), delivered by a CR professional (WTP £48; 9% % CI £4 to £93) and with a lower cost (β=-0.002; p<0.001). Participants preferred to avoid options where no information was received prior to starting therapy (WTP -£106; 95% CI -£153 to -£59). Results for the location attribute were variable and challenging to interpret.

CONCLUSIONS

The study demonstrates a preference for psychological therapy as part of a programme of CR, as participants were more likely to opt-in to therapy. Results indicate that some aspects of the delivery which may be important to participants can be tailored to design a psychological therapy. Preference heterogeneity is an issue which may prevent a 'one-size-fits-all' approach to psychological therapy in CR.

Using discrete-choice experiments to elicit preferences for digital wearable health technology for self-management of chronic kidney disease

Objectives

Wearable digital health technologies (DHTs) have the potential to improve chronic kidney disease (CKD) management through patient engagement. This study aimed to investigate and elicit preferences of individuals with CKD toward wearable DHTs designed to support self-management of their condition.

Methods

Using the results of our review of the published literature and after conducting qualitative patient interviews, five-choice attributes were identified and included in a discrete-choice experiment. The design consisted of 10-choice tasks, each comprising two hypothetical technologies and one opt-out scenario. We collected data from 113 adult patients with CKD stages 3–5 not on dialysis and analyzed their responses via a latent class model to explore preference heterogeneity.

Results

Two patient segments were identified. In all preference segments, the most important attributes were the device appearance, format, and type of information provided. Patients within the largest preference class (70 percent) favored information provided in any format except the audio, while individuals in the other class preferred information in text format. In terms of the style of engagement with the device, both classes wanted a device that provides options rather than telling them what to do.

Conclusions

Our analysis indicates that user preferences differ between patient subgroups, supporting the case for offering a different design of the device for different patients’ strata, thus moving away from a one-size-fits-all service provision. Furthermore, we showed how to leverage the information from user preferences early in the R&D process to inform and support the provision of nuanced person-centered wearable DHTs.

Evaluating Metacognitive Therapy to Improve Treatment of Anxiety and Depression in Cardiovascular Disease: The NIHR Funded PATHWAY Research Programme

BACKGROUND

Anxiety and depression contribute to poorer physical and mental health outcomes in cardiac patients. Psychological treatments are not routinely offered in cardiac care and have mixed and small effects. We conducted a series of studies under the PATHWAY research programme aimed at understanding and improving mental health outcomes for patients undergoing cardiac rehabilitation (CR) through provision of metacognitive therapy (MCT).

METHODS

PATHWAY was a series of feasibility trials, single-blind, multicenter, randomized controlled trials (RCTs), qualitative, stated preferences for therapy and health economics studies.

FINDINGS

Patients felt their psychological needs were not met in CR and their narratives of distress could be parsimoniously explained by the metacognitive model. Patients reported they would prefer therapy over no therapy as part of CR, which included delivery by a cardiac professional. Two feasibility studies demonstrated that RCTs of group-based and self-help MCT were acceptable, could be embedded in CR services, and that RCTs of these interventions were feasible. A definitive RCT of group-MCT within CR (n = 332) demonstrated significantly greater reductions in the severity of anxiety and depression, exceeding CR alone, with gains maintained at 12 month follow-up (SMD HADS total score = 0.52 at 4 months and 0.33 at 12 months). A definitive trial of self-help MCT is ongoing.

CONCLUSION

There is a need to better meet the psychological needs of CR patients. Embedding MCT into CR demonstrated high acceptability and improved efficacy on psychological outcomes. Results support roll-out of MCT in CR with evaluation of national implementation.

REGISTRATION

URL: NCT02420431; ISRCTN74643496; NCT03129282.

Attributes Used for Cancer Screening Discrete Choice Experiments: A Systematic Review

BACKGROUND

Evidence from discrete choice experiments can be used to enrich understanding of preferences, inform the (re)design of screening programmes and/or improve communication within public campaigns about the benefits and harms of screening. However, reviews of screening discrete choice experiments highlight significant discrepancies between stated choices and real choices, particularly regarding willingness to undergo cancer screening. The identification and selection of attributes and associated levels is a fundamental component of designing a discrete choice experiment. Misspecification or misinterpretation of attributes may lead to non-compensatory behaviours, attribute non-attendance and responses that lack external validity.

OBJECTIVES

We aimed to synthesise evidence on attribute development, alongside an in-depth review of included attributes and methodological challenges, to provide a resource for researchers undertaking future studies in cancer screening.

METHODS

A systematic review was conducted to identify discrete choice experiments estimating preferences towards cancer screening, dated between 1990 and December 2020. Data were synthesised narratively. In-depth analysis of attributes led to classification into four categories: test specific, service delivery, outcomes and monetary. Attribute significance and relative importance were also analysed. The International Society for Pharmacoeconomics and Outcomes Research conjoint analysis checklist was used to assess the quality of reporting.

RESULTS

Forty-nine studies were included at full text. They covered a range of cancer sites: over half (26/49) examined colorectal screening. Most studies elicited general public preferences (34/49). In total, 280 attributes were included, 90% (252/280) of which were significant. Overall, test sensitivity and mortality reduction were most frequently found to be the most important to respondents.

CONCLUSIONS

Improvements in reporting the identification, selection and construction of attributes used within cancer screening discrete choice experiments are needed. This review also highlights the importance of considering the complexity of choice tasks when considering risk information or compound attributes. Patient and public involvement and stakeholder engagement are recommended to optimise understanding of unavoidably complex choice tasks throughout the design process. To ensure quality and maximise comparability across studies, further research is needed to develop a risk-of-bias measure for discrete choice experiments.

Delivery preferences for psychological intervention in cardiac rehabilitation: a pilot discrete choice experiment

Background

Cardiac rehabilitation (CR) is a programme of care offered to people who recently experienced a cardiac event. There is a growing focus on home-based formats of CR and a lack of evidence on preferences for psychological care in CR. This pilot study aimed to investigate preferences for delivery attributes of a psychological therapy intervention in CR patients with symptoms of anxiety and/or depression.

Methods

A discrete choice experiment (DCE) was conducted and recruited participants from a feasibility trial. Participants were asked to choose between two hypothetical interventions, described using five attributes; intervention type (home or centre-based), information provided, therapy manual format, cost to the National Health Service (NHS) and waiting time. A separate opt-out was included. A conditional logit using maximum likelihood estimation was used to analyse preferences. The NHS cost was used to estimate willingness to pay for aspects of the intervention delivery.

Results

35 responses were received (39% response rate). Results indicated that participants would prefer to receive any form of therapy compared with no therapy. Statistically significant results were limited, but included participants being keen to avoid not receiving information prior to therapy (β=−0.270; p=0.03) and preferring a lower cost to the NHS (β=−0.001; p=0.00). No significant results were identified for the type of psychological intervention, format of therapy/exercises and programme start time. Coefficients indicated preferences were stronger for home-based therapy compared with centre-based, but this was not significant.

Conclusions

The pilot study demonstrates the feasibility of a DCE in this group, it identifies potential attributes and levels, and estimates the sample sizes needed for a full study. Preliminary evidence indicated that sampled participants tended to prefer home-based psychological therapy in CR and wanted to receive information before initiating therapy. Results are limited due to the pilot design and further research is needed.

Dealing with Discontinuity in Cancer Care Trajectories: Patients' Solutions

Introduction

Patients with cancer require specialized care from different care providers, challenging continuity of care in terms of information, relationships, and/or management. The recognition of discontinuity of care has led to different initiatives by the healthcare system over the years. Yet, making use of the theory on boundary objects and brokers, this research explores the active role of patients themselves in resolving discontinuity along their care trajectories.

Methods

Semi-structured interviews were conducted with 33 patients to unravel the discontinuities that they experience and their attempts to resolve these. Interview data were analyzed using directed-content analysis informed by concepts from boundary crossing literature (i.e., data were searched for potential boundary objects and brokers).

Results

To re-establish continuity of care, patients actively use the objects and people provided by the healthcare system when these meet their needs. Patients also introduce own objects and people into the care trajectory. As such, information and management discontinuity can typically be resolved. Relational continuity appears to be more difficult to resolve, in some cases leaving patients to take drastic measures, such as changing care providers.

Discussion

The use of boundary crossing theory in improving care from a patient perspective is relatively novel. When patients and providers together address the objects and people that support establishing continuity of care, a continuous care process may be encouraged. We advocate an integrated approach, rather than provider or healthcare system initiatives exclusively, to patient care and continuity.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40271-021-00535-x.

Systematic Review of Studies Using Conjoint Analysis Techniques to Investigate Patients' Preferences Regarding Osteoarthritis Treatment

BACKGROUND

The use of conjoint analysis (CA) to elicit patients' preferences for osteoarthritis (OA) treatment has the potential to contribute to tailoring treatments and enhancing patients' compliance and adherence. This review's main aim was to identify and summarise the evidence that used conjoint analysis techniques to quantify patient preferences for OA treatments.

METHODS

A comprehensive search strategy was conducted using electronic databases and hand reference checks. Databases were searched from their inception until 10th June 2019. All OA and CA related terms were used to conduct the search. The authors reviewed the papers and used the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) checklist to assess the quality of the included studies.

RESULTS

The search identified 534 records. Sixteen records were selected for full-text review and quality assessment and all were included in the narrative data synthesis. All included studies suggested that the severity of symptoms influenced the patients' preference for OA treatment. All included studies recognised CA as a useful method to investigate patients' preferences concerning OA treatment.

CONCLUSION

Patients preference for OA treatment is driven by the severity of patients' symptoms and the desire to avoid treatment side effects and CA is a useful tool to investigate patients' preferences for OA treatment.