The role of co-production in Learning Health Systems

Background

Co-production of health is defined as ‘the interdependent work of users and professionals who are creating, designing, producing, delivering, assessing, and evaluating the relationships and actions that contribute to the health of individuals and populations’. It can assume many forms and include multiple stakeholders in pursuit of continuous improvement, as in Learning Health Systems (LHSs). There is increasing interest in how the LHS concept allows integration of different knowledge domains to support and achieve better health. Even if definitions of LHSs include engaging users and their family as active participants in aspects of enabling better health for individuals and populations, LHS descriptions emphasize technological solutions, such as the use of information systems. Fewer LHS texts address how interpersonal interactions contribute to the design and improvement of healthcare services.

Objective

We examined the literature on LHS to clarify the role and contributions of co-production in LHS conceptualizations and applications.

Method

First, we undertook a scoping review of LHS conceptualizations. Second, we compared those conceptualizations to the characteristics of LHSs first described by the US Institute of Medicine. Third, we examined the LHS conceptualizations to assess how they bring four types of value co-creation in public services into play: co-production, co-design, co-construction and co-innovation. These were used to describe core ideas, as principles, to guide development.

Result

Among 17 identified LHS conceptualizations, 3 qualified as most comprehensive regarding fidelity to LHS characteristics and their use in multiple settings: (i) the Cincinnati Collaborative LHS Model, (ii) the Dartmouth Coproduction LHS Model and (iii) the Michigan Learning Cycle Model. These conceptualizations exhibit all four types of value co-creation, provide examples of how LHSs can harness co-production and are used to identify principles that can enhance value co-creation: (i) use a shared aim, (ii) navigate towards improved outcomes, (iii) tailor feedback with and for users, (iv) distribute leadership, (v) facilitate interactions, (vi) co-design services and (vii) support self-organization.

Conclusions

The LHS conceptualizations have common features and harness co-production to generate value for individual patients as well as for health systems. They facilitate learning and improvement by integrating supportive technologies into the sociotechnical systems that make up healthcare. Further research on LHS applications in real-world complex settings is needed to unpack how LHSs are grown through coproduction and other types of value co-creation.

An Audio Personal Health Library of Clinic Visit Recordings for Patients and Their Caregivers (HealthPAL): User-Centered Design Approach

Background

Providing digital recordings of clinic visits to patients has emerged as a strategy to promote patient and family engagement in care. With advances in natural language processing, an opportunity exists to maximize the value of visit recordings for patients by automatically tagging key visit information (eg, medications, tests, and imaging) and linkages to trustworthy web-based resources curated in an audio-based personal health library.

Objective

This study aims to report on the user-centered development of HealthPAL, an audio personal health library.

Methods

Our user-centered design and usability evaluation approach incorporated iterative rounds of video-recorded sessions from 2016 to 2019. We recruited participants from a range of community settings to represent older patient and caregiver perspectives. In the first round, we used paper prototypes and focused on feature envisionment. We moved to low-fidelity and high-fidelity versions of the HealthPAL in later rounds, which focused on functionality and use; all sessions included a debriefing interview. Participants listened to a deidentified, standardized primary care visit recording before completing a series of tasks (eg, finding where a medication was discussed in the recording). In the final round, we recorded the patients’ primary care clinic visits for use in the session. Findings from each round informed the agile software development process. Task completion and critical incidents were recorded in each round, and the System Usability Scale was completed by participants using the digital prototype in later rounds.

Results

We completed 5 rounds of usability sessions with 40 participants, of whom 25 (63%) were women with a median age of 68 years (range 23-89). Feedback from sessions resulted in color-coding and highlighting of information tags, a more prominent play button, clearer structure to move between one’s own recordings and others’ recordings, the ability to filter recording content by the topic discussed and descriptions, 10-second forward and rewind controls, and a help link and search bar. Perceived usability increased over the rounds, with a median System Usability Scale of 78.2 (range 20-100) in the final round. Participants were overwhelmingly positive about the concept of accessing a curated audio recording of a clinic visit. Some participants reported concerns about privacy and the computer-based skills necessary to access recordings.

Conclusions

To our knowledge, HealthPAL is the first patient-centered app designed to allow patients and their caregivers to access easy-to-navigate recordings of clinic visits, with key concepts tagged and hyperlinks to further information provided. The HealthPAL user interface has been rigorously co-designed with older adult patients and their caregivers and is now ready for further field testing. The successful development and use of HealthPAL may help improve the ability of patients to manage their own care, especially older adult patients who have to navigate complex treatment plans.

Relationships among Antecedents, Processes, and Outcomes for Shared Decision Making: A Cross-Sectional Survey of Patients with Lumbar Degenerative Disease

BACKGROUND

Among musculoskeletal disorders, lumbar degenerative disease (LDD) is the leading cause of total disability-adjusted life years globally. Clinical guidelines for LDD describe multiple treatment options in which shared decision making becomes appropriate.

OBJECTIVES

To explore the relationships among measures of decision antecedents, process, and outcomes in patients with LDD.

METHODS

Patients with LDD were recruited from outpatient clinics in a teaching hospital in Taiwan and administered surveys to collect measures of decision antecedents, processes, and outcomes. Multiple linear regression was conducted to assess the association between decision antecedents and the decision making process. Hierarchical linear regression was conducted to assess the relationships among decision antecedents, the decision making process, and decision outcomes.

RESULTS

A total of 132 patients (mean age, 61 years) completed the survey. After adjustment for personal factors, 2 decision antecedents (namely, decision making self-efficacy and readiness) significantly predicted patients' experiences of engaging in shared decision making (SDM). Decision making readiness and process were associated with fewer decisional conflicts and greater decision satisfaction.

LIMITATIONS

Models derived from cross-sectional surveys cannot establish causal relationships among decision antecedents, decision making processes, and decision outcomes.

CONCLUSIONS

Our results support the SDM framework, which proposes relationships among decision antecedents, the decision making process, and decision outcomes.

Effectiveness of shared decision-making intervention in patients with lumbar degenerative diseases: A randomized controlled trial

OBJECTIVE

To evaluate the efficacy of shared decision-making (SDM) intervention among patients with lumbar degenerative diseases (LDDs) in terms of decision self-efficacy, control preferences, SDM process, decision satisfaction, and conflict.

METHODS

A total of 130 outpatients with LDDs recruited from orthopedic or rehabilitation clinics were randomly assigned to the SDM intervention (n = 67) or comparison (n = 63) groups. Patients in the intervention group received decision aids (DAs) with decision coaching and those in controlled group received standard educational materials from a health educator. The primary outcome was decision self-efficacy, and secondary outcomes were control preference, SDM process, conflict, and satisfaction.

RESULTS

The SDM intervention significantly improved decision self-efficacy (mean difference [MD] = 7.1, 95% confidence interval [CI]: 1.7-12.5, partial η² = 0.05) and reduced conflict (MD = -7.0, 95% CI: -12.2 to -1.9, partial η² = 0.06), especially in patients without family involvement, compared with the health education group. However, no significant between-group differences were observed in other outcomes.

CONCLUSION

SDM intervention improved SDM self-efficacy and reduced conflict in patients with LDDs.

PRACTICE IMPLICATIONS

Clinicians can integrate DAs and decision coaching in SDM conversations. SDM intervention seems to engage patients in decision-making, especially those without family involvement.

A Systematic Review and Meta-Analysis of Patient Decision Aids for Socially Disadvantaged Populations: Update from the International Patient Decision Aid Standards (IPDAS)

BACKGROUND

The effectiveness of patient decision aids (PtDAs) and other shared decision-making (SDM) interventions for socially disadvantaged populations has not been well studied.

PURPOSE

To assess whether PtDAs and other SDM interventions improve outcomes or decrease health inequalities among socially disadvantaged populations and determine the critical features of successful interventions.

DATA SOURCES

MEDLINE, CINAHL, Cochrane, PsycINFO, and Web of Science from inception to October 2019. Cochrane systematic reviews on PtDAs.

STUDY SELECTION

Randomized controlled trials of PtDAs and SDM interventions that included socially disadvantaged populations.

DATA EXTRACTION

Independent double data extraction using a standardized form and the Template for Intervention Description and Replication checklist.

DATA SYNTHESIS

Twenty-five PtDA and 13 other SDM intervention trials met our inclusion criteria. Compared with usual care, PtDAs improved knowledge (mean difference = 13.91, 95% confidence interval [CI] 9.01, 18.82 [I2 = 96%]) and patient-clinician communication (relative risk = 1.62, 95% CI 1.42, 1.84 [I2 = 0%]). PtDAs reduced decisional conflict (mean difference = -9.59; 95% CI -18.94, -0.24 [I2 = 84%]) and the proportion undecided (relative risk = 0.39; 95% CI 0.28, 0.53 [I2 = 75%]). PtDAs did not affect anxiety (standardized mean difference = 0.02, 95% CI -0.22, 0.26 [I2 = 70%]). Only 1 trial looked at clinical outcomes (hemoglobin A1C). Five of the 12 PtDA studies that compared outcomes by disadvantaged standing found that outcomes improved more for socially disadvantaged participants. No evidence indicated which intervention characteristics were most effective. Results were similar for SDM intervention trials.

LIMITATIONS

Sixteen PtDA studies had an overall unclear risk of bias. Heterogeneity was high for most outcomes. Most studies only had short-term follow-up.

CONCLUSIONS

PtDAs led to better outcomes among socially disadvantaged populations but did not reduce health inequalities. We could not determine which intervention features were most effective.[Box: see text].

Development and piloting of four decision aids for implantable cardioverter-defibrillators in different media formats

BACKGROUND

Using DAs for preference-sensitive decisions is an evidence-based way to improve patient-centered decisions. Reimbursement mandates have increased the need for DAs in ICD care, although none have been formally evaluated. The objectives were to develop and pilot implantable cardioverter-defibrillator (ICD) decision aids (DAs) for patients considering primary prevention ICDs.

METHODS

Development Phase: An expert panel, including patients and physicians, iteratively developed four DAs: a one-page Option Grid^TM conversation aid, a four-page in-depth paper tool, a 17-minute video, and an interactive website. Trial Phase: At three sites, patients with heart failure who were eligible for primary prevention ICDs were randomly assigned 2:1 to intervention (received DAs) or control (usual care). We conducted a mixed-methods evaluation exploring acceptability and feasibility.

RESULTS

Twenty-one eligible patients enrolled (15 intervention). Most intervention participants found the DAs to be unbiased (67%), helpful (89%), and would recommend them to others (100%). The pilot was feasible at all sites; however, using clinic staff to identify eligible patients was more efficient than chart review. Although the main goals were to measure acceptability and feasibility, intervention participants trended towards increased concordance between longevity values and ICD decisions (71% concordant vs. 29%, p = .06). Participants preferred the in-depth paper tool and video DAs. Access to a nurse during the decision-making window encouraged questions and improved participant-perceived confidence.

CONCLUSIONS

Participants felt the DAs provided helpful, balanced information that they would recommend to other patients. Further exploration of this larger context of DA use and strategies to promote independent use related to electrophysiology (EP) visits are needed.

Encounter decision aids to facilitate shared decision-making with women experiencing heavy menstrual bleeding or symptomatic uterine fibroids: A before-after study

OBJECTIVE

Is the level of shared decision-making (SDM) higher after introduction of a SDM package (including encounter decision aids on treatment options for heavy menstrual bleeding and training for clinicians) than before?.

METHODS

This before-after study, performed in OB-GYN practice, compared consultations before and after introduction of a SDM package. The target sample size was 25 patients per group. Women seeking treatment for heavy menstrual bleeding were eligible. After their appointments, patients filled out a three-item patient-reported SDM measure. Treatment discussions were audio-recorded and rated for SDM using Observer OPTION⁵. Consultation transcripts in the 'after' group were checked for adherence to the steps required for intended use of decision aids.

RESULTS

16 gynaecologists participated. 25 patients participated before introduction of the decision aids and 28 after. The proportion of women reporting optimal SDM was higher after introduction (75 %) than before (50 %;p < 0.001). The mean observer-rated level of SDM was also significantly higher after than before (MD = 12.50,95 % CI 5.53-19.47).

CONCLUSION

The level of SDM was higher after the introduction of the package than before.

PRACTICE IMPLICATIONS

This study was conducted in a real-life setting in three clinics, both large academic and small rural, offering opportunities for implementation in different type of organizations.

The development of incorpoRATE: A measure of physicians' willingness to incorporate shared decision making into practice

OBJECTIVES

To develop 'incorpoRATE', a brief and broadly applicable measure of physicians' willingness to incorporate shared decision making (SDM) into practice.

METHODS

incorpoRATE was developed across three phases: 1) A review of relevant literature to inform candidate domain and item development, 2) Cognitive interviews with US physicians to iteratively refine the measure, and 3) Pilot testing of the measure across a larger sample of US physicians to explore item and measure performance.

RESULTS

The final measure consists of seven items that assess physician perspectives on various components of SDM use that may present as barriers in practice. During pilot testing, the majority of physicians expressed positive opinions about the overall concept of SDM, yet were less comfortable acting on informed patient choices when there was known incongruence with their own recommendations.

CONCLUSIONS

incorpoRATE is a novel physician-reported measure that assesses physicians' willingness to incorporate SDM in practice.

PRACTICE IMPLICATIONS

incorpoRATE has the potential to help us further understand the limited adoption of SDM and areas of focus for improving the use of SDM in the future. We recommend that incorpoRATE be subject to further psychometric, real-world testing, in order to explore its performance across different samples of physicians and organizations.

Assessing Shared Decision-Making in Cystic Fibrosis Care Using collaboRATE: A Cross-Sectional Study of 159 Programs

There are numerous opportunities for shared decision-making (SDM) in cystic fibrosis (CF) care, yet little is known about patients’ SDM experiences. This study evaluated SDM across 159 CF care programs (4024 participants) in the United States. Shared decision-making was assessed using the patient-reported collaboRATE measure, which was included in the CF Foundation’s Patient and Family Experience of Care Survey over 18 months. Overall, 69% of respondents reported experiencing SDM. Respondents at pediatric programs were more likely to experience SDM than those at adult programs (72% vs 67%, P < .001). Multivariable logistic regression analyses showed a relationship between SDM and patient age, whereby SDM was less likely to occur with patients aged 18 to 24 years, compared to some younger and older age groups (P = .02-<.001). Shared decision-making was more likely to occur at pediatric programs when patients had better general health (P = .02-<.01), and at pediatric and adult programs when patients had better mental health (P = .02-<.001). Disparities in SDM experiences highlight a need to improve decision-making processes in CF care. Interventions tailored for improving SDM among specific patient populations may be particularly advantageous.

Cardiology providers' recommendations for treatments and use of patient decision aids for multivessel coronary artery disease

Background

Rates of recommending percutaneous coronary intervention (PCI) and coronary artery bypass grafting (CABG) vary across clinicians. Whether clinicians agree on preferred treatment options for multivessel coronary artery disease patients has not been well studied.

Methods and results

We distributed a survey to 104 clinicians from the Northern New England Cardiovascular Study Group through email and at a regional meeting with 88 (84.6%) responses. The survey described three clinical vignettes of multivessel coronary artery disease patients. For each patient vignette participants selected appropriate treatment options and whether they would use a patient decision aid. The likelihood of choosing PCI only or PCI/CABG over CABG only was modeled using a multinomial regression. Across all vignettes, participants selected CABG only as an appropriate treatment option 24.2% of the time, PCI only 25.4% of the time, and both CABG or PCI as appropriate treatment options 50.4% of the time. Surgeons were less likely to choose PCI over CABG (RR 0.14, 95% CI 0.03, 0.59) or both treatments over CABG only (RR 0.10, 95% CI 0.03, 0.34) relative to cardiologists. Overall, 65% of participants responded they would use a patient decision aid with each vignette.

Conclusions

There is a lack of consensus on the appropriate treatment options across cardiologists and surgeons for patients with multivessel coronary artery disease. Treatment choice is influenced by both patient characteristics and clinician specialty.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12872-021-02223-y.

Natural language processing for automated annotation of medication mentions in primary care visit conversations

OBJECTIVES

The objective of this study is to build and evaluate a natural language processing approach to identify medication mentions in primary care visit conversations between patients and physicians.

MATERIALS AND METHODS

Eight clinicians contributed to a data set of 85 clinic visit transcripts, and 10 transcripts were randomly selected from this data set as a development set. Our approach utilizes Apache cTAKES and Unified Medical Language System controlled vocabulary to generate a list of medication candidates in the transcribed text and then performs multiple customized filters to exclude common false positives from this list while including some additional common mentions of the supplements and immunizations.

RESULTS

Sixty-five transcripts with 1121 medication mentions were randomly selected as an evaluation set. Our proposed method achieved an F-score of 85.0% for identifying the medication mentions in the test set, significantly outperforming existing medication information extraction systems for medical records with F-scores ranging from 42.9% to 68.9% on the same test set.

DISCUSSION

Our medication information extraction approach for primary care visit conversations showed promising results, extracting about 27% more medication mentions from our evaluation set while eliminating many false positives in comparison to existing baseline systems. We made our approach publicly available on the web as an open-source software.

CONCLUSION

Integration of our annotation system with clinical recording applications has the potential to improve patients' understanding and recall of key information from their clinic visits, and, in turn, to positively impact health outcomes.

Comparing the impact of an icon array versus a bar graph on preference and understanding of risk information: Results from an online, randomized study

BACKGROUND

Few studies have examined the best way to convey the probability of serious events occurring in the future (i.e., risk of stroke or death) to persons with low numeracy or graph literacy proficiency. To address this gap, we developed and user-tested a bar graph and compared it to icon arrays to assess its impact on understanding and preference for viewing risk information.

OBJECTIVES

To determine the: (i) formats' impact on participants' understanding of risk information; (ii) formats' impact on understanding and format preference across numeracy and graph literacy subgroups; (iii) rationale supporting participants' preference for each graphical display format.

METHODS

An online sample (evenly made up of participants with high and low objective numeracy and graph literacy) was randomized to view either the icon array or the bar graph. Each format conveyed the risk of major stroke and death five years after choosing surgery, a stent, or medication to treat carotid artery stenosis. Participants answered questions to assess their understanding of the risk information. Lastly, both formats were presented in parallel, and participants were asked to identify their preferred format to view risk information and explain their preference.

RESULTS

Of the 407 participants, 197 were assigned the icon array and 210 the bar graph. Understanding of risk information and format preference did not differ significantly between the two trial arms, irrespective of numeracy and graph literacy proficiency. High numeracy and graph literacy proficiency was associated with high understanding (p<0.01) and a preference for the bar graph (p = 0.01).

CONCLUSION

We found no evidence to demonstrate the superiority of one format over another on understanding. The majority of participants preferred viewing the risk information using the bar graph format.

Shared decision making: What is the work?

Cooperation has emerged as a fundamental characteristic of human society, and many argue that this ability is the basis for the phenomenal development in our capability as a species. When we focus our attention to the interactions that occur in healthcare, we inevitably notice power asymmetry due to unequal knowledge, experience, and status. However, as many have argued since the 1970s, there is an ethical imperative to respect the agency of individuals, offer information, collaborate, and support deliberation when difficult decisions arise. This process is particularly important when reasonable alternative courses of action exist and where the priorities and preferences of individuals would be expected to sway such decisions. This position article argues that this process, commonly described as shared decision making, involves work that is cognitive, emotional, and relational, and, particularly if people are ill, should have the underpinning goal of restoring autonomy. It covers the origin of the term and describes the core components; it describes how to do the cognitive, emotional, and relational work that is required, and offers a model to guide the process.

Cost talk: protocol for a stepped-wedge cluster randomized trial of an intervention helping patients and urologic surgeons discuss costs of care for slow-growing prostate cancer during shared decision-making

BACKGROUND

Costs of care are important to patients making cancer treatment decisions, but clinicians often do not feel prepared to discuss treatment costs. We aim to (1) assess the impact of a conversation-based decision aid (Option Grid) containing cost information about slow-growing prostate cancer management options, combined with urologic surgeon training, on the frequency and quality of patient-urologic surgeon cost conversations, and (2) examine the impact of the decision aid and surgeon training on decision quality.

METHODS

We will conduct a stepped-wedge cluster randomized trial in outpatient urology practices affiliated with a large academic medical center in the USA. We will randomize five urologic surgeons to four intervention sequences and enroll their patients with a first-time diagnosis of slow-growing prostate cancer independently at each period. Primary outcomes include frequency of cost conversations, initiator of cost conversations, and whether or not a referral is made to address costs. These outcomes will be collected by patient report (post-visit survey) and by observation (audio-recorded clinic visits) with consent. Other outcomes include the following: patient-reported decisional conflict post-visit and at 3-month follow-up, decision regret at 3-month follow-up, shared decision-making post-visit, communication post-visit, and financial toxicity post-visit and at 3-month follow-up; clinician-reported attitudes about shared decision-making before and after the study, and feasibility of sustained intervention use. We will use hierarchical regression analysis to assess patient-level outcomes, including urologic surgeon as a random effect to account for clustering of patient participants.

DISCUSSION

This study evaluates a two-part intervention to improve cost discussions between urologic surgeons and patients when deciding how to manage slow-growing prostate cancer. Establishing the effectiveness of the strategy under study will allow for its replication in other clinical decision contexts.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04397016 . Registered on 21 May 2020.

A systematic review of decision aids for gender affirming therapy

BACKGROUND

Transgender and gender diverse (TGD) persons considering gender affirming therapy have to make many complex medical decisions, potentially without understanding the associated harms or benefits of hormonal and surgical interventions. Further, clinicians are often unaware of how best to communicate information to persons seeking gender affirming therapy. Patient decision aids have been developed to provide evidence-based information as a way to help people make decisions in collaboration with their clinicians. It is unclear whether such tools exist for persons seeking gender affirming therapy. The objective of our systematic review is to search for and determine the quality of any existing patient decision aids developed for TGD persons considering gender affirming therapy, and the outcomes associated with their use.

METHODS

We adapted a search strategy for databases using two key concepts "decision support intervention/patient decision aid" and "transgender". We also conducted a brief online search of Google and abstracts from relevant conferences to identify any tools not published in the academic literature. Following study selection and data extraction, we used the International Patient Decision Aid Standards instrument (IPDASi) to assess the quality of patient decision aids, and the Standards for UNiversal reporting of patient Decision Aid Evaluations (SUNDAE) checklist to assess the quality of evaluations.

RESULTS

We identified 762 studies; none were identified from Google or conference content. One tool met our inclusion criteria: an online, pre-encounter patient decision aid for transmasculine genital gender-affirming surgery developed in Amsterdam, translated in English and Dutch. The tool met all the IPDASi qualifying criteria, and scored a 17/28 on the certification criteria, and 57/112 on the quality criteria. The efficacy of the patient decision aid has not been evaluated.

CONCLUSIONS

Despite multiple decisions required for gender affirming therapies, only one patient decision aid has been developed for transmasculine genital reconstruction. Further research is required to develop patient decision aids for the multiple decision points along the gender affirming journey.

'Because Everybody is so Different': a qualitative analysis of the lived experiences and information needs of rectal cancer survivors

OBJECTIVE

To (1) characterise (A) the lived experiences and (B) information needs of patients with rectal cancer; and (2) compare to the perceived lived experiences and information needs of colorectal surgeons.

DESIGN

We conducted 1-hour semistructured qualitative interviews, dual independent transcript coding and thematic analysis.

SETTING/PARTICIPANTS

Interviews included rectal cancer survivors (stages I-III), some accompanied by caregivers, at Dartmouth-Hitchcock Medical Center and experienced colorectal surgeons.

RESULTS

We performed 25 interviews involving 30 participants, including 15 patients with 5 caregivers, plus 10 physicians. Two major themes emerged. First, patients reported major impacts on their lives following rectal cancer, including on their everyday lives and leisure activities; identity, self-confidence and intimacy; mental health, especially anxiety. These impacts were mediated by their medical experiences, lifestyle and attitudes. Second, the diversity of effects on patients' lives means that care, counselling and information needs should be personalised for a better medical experience and outcomes. Surgeons did not report knowledge of the full range of patient experiences and reported limited counselling in key areas, particularly concerning intimacy and mental health.

CONCLUSION

Rectal cancer diagnosis, treatment and survivorship dramatically affect all people, regardless of which surgical treatment they undergo. Effects are varied and necessitate customised care, counselling and information, which surgeons are not currently providing. Because rectal cancer affects every part of patients' lives, they need holistic support and information. Patients would benefit from substantial support after treatment as they establish a new normal.

Processes for evidence summarization for patient decision aids: A Delphi consensus study

BACKGROUND

Patient decision aids (PDAs) should provide evidence-based information so patients can make informed decisions. Yet, PDA developers do not have an agreed-upon process to select, synthesize and present evidence in PDAs.

OBJECTIVE

To reach the consensus on an evidence summarization process for PDAs.

DESIGN

A two-round modified Delphi survey.

SETTING AND PARTICIPANTS

A group of international experts in PDA development invited developers, scientific networks, patient groups and listservs to complete Delphi surveys.

DATA COLLECTION

We emailed participants the study description and a link to the online survey. Participants were asked to rate each potential criterion (omit, possible, desirable, essential) and provide qualitative feedback.

ANALYSIS

Criteria in each round were retained if rated by >80% of participants as desirable or essential. If two or more participants suggested rewording, reordering or merging, the steering group considered the suggestion.

RESULTS

Following two Delphi survey rounds, the evidence summarization process included defining the decision, reporting the processes and policies of the evidence summarization process, assembling the editorial team and managing (collect, manage, report) their conflicts of interest, conducting a systematic search, selecting and appraising the evidence, presenting the harms and benefits in plain language, and describing the method of seeking external review and the plan for updating the evidence (search, selection and appraisal of new evidence).

CONCLUSION

A multidisciplinary stakeholder group reached consensus on an evidence summarization process to guide the creation of high-quality PDAs.

PATIENT CONTRIBUTION

A patient partner was part of the steering group and involved in the development of the Delphi survey.

Implementation and sustainability factors of two early-stage breast cancer conversation aids in diverse practices

BACKGROUND

Conversation aids can facilitate shared decision-making and improve patient-centered outcomes. However, few examples exist of sustained use of conversation aids in routine care due to numerous barriers at clinical and organizational levels. We explored factors that will promote the sustained use of two early-stage breast cancer conversation aids. We examined differences in opinions between the two conversation aids and across socioeconomic strata.

METHODS

We nested this study within a randomized controlled trial that demonstrated the effectiveness of two early-stage breast cancer surgery conversation aids, one text-based and one picture-based. These conversation aids facilitated more shared decision-making and improved the decision process, among other outcomes, across four health systems with socioeconomically diverse patient populations. We conducted semi-structured interviews with a purposive sample of patient participants across conversation aid assignment and socioeconomic status (SES) and collected observations and field notes. We interviewed trial surgeons and other stakeholders. Two independent coders conducted framework analysis using the NOrmalization MeAsure Development through Normalization Process Theory. We also conducted an inductive analysis. We conducted additional sub-analyses based on conversation aid assignment and patient SES.

RESULTS

We conducted 73 semi-structured interviews with 43 patients, 16 surgeons, and 14 stakeholders like nurses, cancer center directors, and electronic health record (EHR) experts. Patients and surgeons felt the conversation aids should be used in breast cancer care in the future and were open to various methods of giving and receiving the conversation aid (EHR, email, patient portal, before consultation). Patients of higher SES were more likely to note the conversation aids influenced their treatment discussion, while patients of lower SES noted more influence on their decision-making. Intervention surgeons reported using the conversation aids did not lengthen their typical consultation time. Most intervention surgeons felt using the conversation aids enhanced their usual care after using it a few times, and most patients felt it appeared part of their normal routine.

CONCLUSIONS

Key factors that will guide the future sustained implementation of the conversation aids include adapting to existing clinical workflows, flexibility of use, patient characteristics, and communication preferences.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03136367 , registered on May 2, 2017.

Integrating Option Grid Patient Decision Aids in the Epic Electronic Health Record: Case Study at 5 Health Systems

Background

Some researchers argue that the successful implementation of patient decision aids (PDAs) into clinical workflows depends on their integration into electronic health records (EHRs). Anecdotally, we know that EHR integration is a complex and time-consuming task; yet, the process has not been examined in detail. As part of an implementation project, we examined the work involved in integrating an encounter PDA for symptomatic uterine fibroids into Epic EHR systems.

Objective

This study aims to identify the steps and time required to integrate a PDA into the Epic EHR system and examine facilitators and barriers to the integration effort.

Methods

We conducted a case study at 5 academic medical centers in the United States. A clinical champion at each institution liaised with their Epic EHR team to initiate the integration of the uterine fibroid Option Grid PDAs into clinician-facing menus. We scheduled regular meetings with the Epic software analysts and an expert Epic technologist to discuss how best to integrate the tools into Epic for use by clinicians with patients. The meetings were then recorded and transcribed. Two researchers independently coded the transcripts and field notes before categorizing the codes and conducting a thematic analysis to identify the facilitators and barriers to EHR integration. The steps were reviewed and edited by an Epic technologist to ensure their accuracy.

Results

Integrating the uterine fibroid Option Grid PDA into clinician-facing menus required an 18-month timeline and a 6-step process, as follows: task priority negotiation with Epic software teams, security risk assessment, technical review, Epic configuration; troubleshooting, and launch. The key facilitators of the process were the clinical champions who advocated for integration at the institutional level and the presence of an experienced technologist who guided Epic software analysts during the build. Another facilitator was the use of an emerging industry standard app platform (Health Level 7 Substitutable Medical Applications and Reusable Technologies on Fast Healthcare Interoperability Resources) as a means of integrating the Option Grid into existing systems. This standard platform enabled clinicians to access the tools by using single sign-on credentials and prevented protected health information from leaving the EHR. Key barriers were the lack of control over the Option Grid product developed by EBSCO (Elton B Stephens Company) Health; the periodic Epic upgrades that can result in a pause on new software configurations; and the unforeseen software problems with Option Grid (ie, inability to print the PDA), which delayed the launch of the PDA.

Conclusions

The integration of PDAs into the Epic EHR system requires a 6-step process and an 18-month timeline. The process required support and prioritization from a clinical champion, guidance from an experienced technologist, and a willing EHR software developer team.

Measuring Patient Experiences of Integration in Health Care Delivery: Psychometric Validation of IntegRATE Under Controlled Conditions

The objective of this study was to assess the psychometric properties of IntegRATE—a 4-item patient-reported measure of integration in health care delivery—under controlled conditions. Adults who reported having received health care in the previous year were exposed to a fictional health care scenario featuring good, mixed, or poor integration on 1 or 2 occasions. They were then asked to imagine themselves as a patient in the scenario and complete IntegRATE and other measures. The data collected were analyzed to assess the discriminative, concurrent, and divergent validity of IntegRATE and its test–retest reliability and responsiveness using both “sum score” and “top score” scoring approaches. Six-hundred people participated in the study with 190 taking part on 2 occasions. The IntegRATE sum score demonstrated discriminative validity, concurrent validity, divergent validity, and responsiveness and partially demonstrated test–retest reliability. The IntegRATE top score demonstrated concurrent validity, divergent validity, and responsiveness and partially demonstrated discriminative validity and test–retest reliability. We conclude that the IntegRATE sum score exhibits encouraging psychometric properties and performs more optimally than the IntegRATE top score.

Co-Design of a Disease Activity Based Self-Management Approach for Patients with Rheumatoid Arthritis

Objective:

The systematic development of an intervention to improve disease activity-based management of rheumatoid arthritis (RA) in daily clinical practice that is based on patient-level barriers.

Methods:

The self-management strategy was developed through a step-wise approach, in a process of co-design with all stakeholders and by addressing patient level barriers to RA management based on disease activity.

Results:

The resulting DAS-pass strategy consists of decision supportive information and guidance by a specialised rheumatology nurse. It aims to increase patients’ knowledge on DAS28, to empower patients to be involved in disease management, and to improve patients’ medication beliefs. The decision supportive information includes an informational leaflet and a patient held record. The nurse individualises the information, stimulates patients to communicate about disease activity, and offers the opportunity for questions or additional support.

Conclusion:

The DAS-pass strategy was found helpful by stakeholders. It can be used to improve RA daily clinical practice. Our systematic approach can be used to improve patient knowledge and self-management on other RA related topics. Also, it can be used to improve the management of other chronic conditions. We therefore provide a detailed description of our methodology to assist those interested in developing an evidence-based strategy for educating and empowering patients.

User-Centered Design of the consideRATE Questions, a Measure of People's Experiences When They Are Seriously Ill

CONTEXT

No brief patient-reported experience measure focuses on the most significant concerns of seriously ill individuals.

OBJECTIVES

The objective of the study was to develop the consideRATE questions.

METHODS

This user-centered design study had three phases. We reviewed the literature and consulted stakeholders, including caregivers, clinicians, and researchers, to identify the elements of care most important to patients (Phase 1). We refined items based on cognitive interviews with patients, families, and clinicians (Phase 2). We piloted the measure with patients and families (Phase 3).

RESULTS

Phase 1 resulted in seven questions addressing the following elements: 1) care team attention to patients' physical symptoms, 2) emotional symptoms, 3) environment of care, 4) respect for patients' priorities, 5) communication about future plans, 6) communication about financial and similar affairs, and 7) communication about illness trajectory. Phase 2 participants included eight patients, eight family members, and seven clinicians. We added an open-text comment option. We did not identify any other issues that were important enough to participants to include. Response choices ranged from one (very bad) to four (very good), with a not applicable option (does not apply). Phase 3 involved 15 patients and 16 family members and demonstrated the acceptability of the consideRATE questions. Most reported that the questions were not distressing, disruptive, or confusing. Completion time averaged 2.4 minutes (range 1-5).

CONCLUSION

Our brief patient-reported serious illness experience measure is based on what matters most to patients, families, and clinicians. It was acceptable to patients and families in a regional sample. It has promise for use in clinical settings.

Women Who Are Young, Non-White, and with Lower Socioeconomic Status Report Higher Financial Toxicity up to 1 Year After Breast Cancer Surgery: A Mixed-Effects Regression Analysis

PURPOSE

We examined self-reported financial toxicity and out-of-pocket expenses among adult women with breast cancer.

METHODS

Patients spoke English, Spanish, or Mandarin Chinese, were aged 18+ years, had stage I-IIIA breast cancer, and were eligible for breast-conserving and mastectomy surgery. Participants completed surveys about out-of-pocket costs and financial toxicity at 1 week, 12 weeks, and 1 year postsurgery.

RESULTS

Three hundred ninety-five of 448 eligible patients (88.2%) from the parent trial completed surveys. Excluding those reporting zero costs, crude mean ± SD out-of-pocket costs were $1,512 ± $2,074 at 1 week, $2,609 ± $6,369 at 12 weeks, and $3,308 ± $5,000 at 1 year postsurgery. Controlling for surgery, cancer stage, and demographics with surgeon and clinic as random effects, higher out-of-pocket costs were associated with higher financial toxicity 1 week and 12 weeks postsurgery (p < .001). Lower socioeconomic status (SES) was associated with lower out-of-pocket costs at each time point (p = .002-.013). One week postsurgery, participants with lower SES reported financial toxicity scores 1.02 points higher than participants with higher SES (95% confidence interval [CI], 0.08-1.95). Black and non-White/non-Black participants reported financial toxicity scores 1.91 (95% CI, 0.46-3.37) and 2.55 (95% CI, 1.11-3.99) points higher than White participants. Older (65+ years) participants reported financial toxicity scores 2.58 points lower than younger (<65 years) participants (95% CI, -3.41, -1.74). Younger participants reported significantly higher financial toxicity at each time point.

DISCUSSION

Younger age, non-White race, and lower SES were associated with higher financial toxicity regardless of costs. Out-of-pocket costs increased over time and were positively associated with financial toxicity. Future work should reduce the impact of cancer care costs among vulnerable groups.

IMPLICATIONS FOR PRACTICE

This study was one of the first to examine out-of-pocket costs and financial toxicity up to 1 year after breast cancer surgery. Younger age, Black race, race other than Black or White, and lower socioeconomic status were associated with higher financial toxicity. Findings highlight the importance of addressing patients' financial toxicity in several ways, particularly for groups vulnerable to its effects.