Is the Promise of PROMs Being Realized? Implementation Experience in a Large Orthopedic Practice

Patient-Reported Outcome Measures as an Intervention: A Comprehensive Overview of Systematic Reviews on the Effects of Feedback

OBJECTIVES

Patient-reported outcome measures (PROMs) have emerged as a promising approach to involve patients in their treatment process. Beyond serving as outcome measures, PROMs can be applied to provide feedback to healthcare providers and patients, thereby offering valuable insights that can improve health outcomes and care processes. This overview offers a comprehensive synthesis of the effects of PROM feedback, contributing to the evidence-based discussion on PROMs' potential to enhance patient care.

METHODS

Following Cochrane Collaboration recommendations, this overview included literature reviews across diverse treatment areas, investigating the impact of PROM feedback on patient health outcomes (including quality of life, symptoms, or survival) and care process outcomes (including communication, symptom identification, or clinical practice). The methodological quality of the evidence was assessed with a modified version of A Measurement Tool to Assess Systematic Reviews 2, and the potential overlap of primary studies was quantified. Results were narratively synthesized.

RESULTS

Forty reviews grouped into 4 categories of treatment areas were included. Overall, their methodological quality was low. The overall overlap of primary studies was 2.2%, reaching up to 15.7% within specific treatment areas. The results indicate that PROM feedback may enhance the quality-of-care processes, whereas its effects on patient health outcomes remained less conclusive.

CONCLUSIONS

PROM feedback positively influences the interaction between physicians and patients across the included treatment areas. Further research is needed to comprehend the trickle-down effects of PROM feedback and how to enhance its potential in yielding health benefits for patients.

Using the technology acceptance model to assess clinician perceptions and experiences with a rheumatoid arthritis outcomes dashboard: qualitative study

BACKGROUND

Improving shared decision-making using a treat-to-target approach, including the use of clinical outcome measures, is important to providing high quality care for rheumatoid arthritis (RA). We developed an Electronic Health Record (EHR) integrated, patient-facing sidecar dashboard application that displays RA outcomes, medications, and lab results for use during clinical visits ("RA PRO dashboard"). The purpose of this study was to assess clinician perceptions and experiences using the dashboard in a university rheumatology clinic.

METHODS

We conducted focus group (FG) discussions with clinicians who had access to the dashboard as part of a randomized, stepped-wedge pragmatic trial. FGs explored clinician perceptions towards the usability, acceptability, and usefulness of the dashboard. FG data were analyzed thematically using deductive and inductive techniques; generated themes were categorized into the domains of the Technology Acceptance Model (TAM).

RESULTS

3 FG discussions were conducted with a total of 13 clinicians. Overall, clinicians were enthusiastic about the dashboard and expressed the usefulness of visualizing RA outcome trajectories in a graphical format for motivating patients, enhancing patient understanding of their RA outcomes, and improving communication about medications. Major themes that emerged from the FG analysis as barriers to using the dashboard included inconsistent collection of RA outcomes leading to sparse data in the dashboard and concerns about explaining RA outcomes, especially to patients with fibromyalgia. Other challenges included time constraints and technical difficulties refreshing the dashboard to display real-time data. Methods for integrating the dashboard into the visit varied: some clinicians used the dashboard at the beginning of the visit as they documented RA outcomes; others used it at the end to justify changes to therapy; and a few shared it only with stable patients.

CONCLUSIONS

The study provides valuable insights into clinicians' perceptions and experiences with the RA PRO dashboard. The dashboard showed promise in enhancing patient-clinician communication, shared decision-making, and overall acceptance among clinicians. Addressing challenges related to data collection, education, and tailoring dashboard use to specific patient populations will be crucial for maximizing its potential impact on RA care. Further research and ongoing improvements in dashboard design and implementation are warranted to ensure its successful integration into routine clinical practice.

Practical guide to implementing patient-reported outcome measures in gender-affirming care: evaluating acceptability, appropriateness and feasibility

OBJECTIVE

Assess acceptability, appropriateness and feasibility of the Practical Guide to Implementing patient-reported outcome measures (PROMs) in Gender-Affirming Care (PG-PROM-GAC) from a sample of patients and healthcare professionals.

DESIGN

Cross-sectional study conducted August-October 2023.

SETTING

Participants were recruited from a National Health Service (NHS) gender clinic.

PARTICIPANTS

Patient participants seeking care and healthcare professionals working at an NHS gender clinic were eligible for participation. The PG-PROM-GAC was sent to participants via email for review.

OUTCOME MEASURES

Three validated tools to measure acceptability, appropriateness and feasibility were administered: the acceptability of intervention measure (AIM), intervention appropriateness measure (IAM) and feasibility of intervention measure (FIM). The percentage of participants indicating agreement or disagreement with items on the AIM, IAM and FIM was calculated.

RESULTS

A total of 132 transgender and gender diverse (TGD) patients (mean age, SD: 33, 14) and 13 gender-affirming healthcare professionals (mean age, SD: 43, 11) completed the AIM, IAM and FIM, representing a range of gender identities. The cumulative percentage of patients indicating agree or strongly agree on the AIM, IAM and FIM for the patient-relevant strategies in the PG-PROM-GAC was over 50% for each item. The cumulative percentage of patients indicating disagree or strongly disagree on the AIM, IAM and FIM for the PG-PROM-GAC was less than 20% for each item. The cumulative percentage of healthcare professionals indicating agree or strongly agree on the AIM, IAM and FIM for the healthcare professional-relevant strategies in the PG-PROM-GAC was over 38% for each item. The cumulative percentage of healthcare professionals indicating disagree or strongly disagree on the AIM, IAM and FIM for the PG-PROM-GAC was less than 15% for each item.

CONCLUSIONS

Gender-affirming healthcare professionals and TGD patients find the PG-PROM-GAC acceptable, appropriate and feasible. The PG-PROM-GAC is ready-to-use for clinicians, policy-makers and researchers committed to service improvement for gender-affirming care.

Implementing strategies to improve uptake of patient-reported outcome measures (PROMs) in gender-affirming care: a mixed-methods implementation study

IMPORTANCE

The Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC) is an evidence-based resource, which was developed in response to international calls for improved patient-reported outcome measure (PROM) implementation in gender-affirming care. The PG-PROM-GAC has the potential to improve PROM implementation; however, its real-world effectiveness has not yet been investigated.

OBJECTIVE

Investigate effectiveness and fidelity of three implementation strategies from the PG-PROM-GAC in a real-world gender clinic setting.

DESIGN

Interrupted time series mixed-methods study investigating response rates to a PROM deployed alongside implementation strategies from the PG-PROM-GAC; and open-ended feedback on the fidelity and effectiveness of implementation strategies.

SETTING

Participants were recruited from a National Health Service (NHS) gender clinic.

PARTICIPANTS

Eligible participants were being seen at an NHS gender clinic for an appointment during the study period, and were invited to participate in this study via email.

INTERVENTION

Three implementation strategies from the PG-PROM-GAC deployed alongside a PROM.

MAIN OUTCOMES AND MEASURES

Response rates were calculated at 2-week intervals, in line with the deployment of each implementation strategy. Open-ended responses were thematically analysed by two researchers following guidance from implementation science and interpretation from Normalisation Process Theory.

RESULTS

A total of 28 participants were included in this study with a mean (SD) age of 39 (17) years. In general, participants rated education material for PROMs as the most important for PROM implementation, and accessibility options for PROMs as the second most important. Response rates to PROM completion dropped as the study progressed, as the burden of reviewing implementation strategies increased. Results were used to construct recommendations for future PROM implementation efforts.

CONCLUSIONS AND RELEVANCE

The PG-PROM-GAC and implementation strategy materials developed from this study (ie, educational video on PROMs co-developed with key stakeholders) can be used by clinicians, researchers and policymakers to lead PROM implementation efforts in gender-affirming care.

Developing feasible and acceptable strategies for integrating the use of patient-reported outcome measures (PROMs) in gender-affirming care: An implementation study

OBJECTIVE

Use CFIR guidance to create comprehensive, evidence-based, feasible, and acceptable gender-affirming care PROM implementation strategies.

DESIGN, SETTING, PARTICIPANTS

A 3-Phase participatory process was followed to design feasible and acceptable strategies for integrating PROMs in gender-affirming care. In Phase 1, barriers and enablers to PROM implementation for gender-affirming care were identified from a previous systematic review and our prior qualitative study. We used the CFIR-ERIC tool to match previously identified barriers and enablers with expert-endorsed implementation strategies. In Phase 2, implementation strategy outputs from CFIR-ERIC were organised according to cumulative percentage value. In Phase 3, gender-affirming care PROM implementation strategies underwent iterative refinement based on rounds of stakeholder feedback with seven patient and public partners and a gender-affirming healthcare professional.

RESULTS

The systematic review and qualitative study identified barriers and enablers to PROM implementation spanning all five CFIR domains, and 30 CFIR constructs. The top healthcare professional-relevant strategies to PROM implementation from the CFIR-ERIC output include: identifying and preparing implementation champions, collecting feedback on PROM implementation, and capturing and sharing local knowledge between clinics on implementation. Top patient-relevant strategies include: having educational material on PROMs, ensuring adaptability of PROMs, and collaborating with key local organisations who may be able to support patients.

CONCLUSIONS

This study developed evidence-based, feasible, and acceptable strategies for integrating PROMs in gender-affirming care, representing evidence from a systematic review of 286 international articles, a qualitative study of 24 gender-affirming care patients and healthcare professionals, and iteration from 7 patient and public partners and a gender-affirming healthcare professional. The finalised strategies include patient- and healthcare professional-relevant strategies for implementing PROMs in gender-affirming care. Clinicians and researchers can select and tailor implementation strategies best applying to their gender-affirming care setting.

The Impact of Text Messaging to Promote Patient Reported Outcome Measures (PROMs) Completion in Orthopedic Practice: Findings From a Randomized Controlled Study

It is difficult to achieve high response rates to Patient Reported Outcome Measures (PROMs) surveys collected as part of clinical care. However, they are operationally and clinically important. To understand the impact of text message reminders on response rates to PROMs collected via email as part of routine care for hip or knee replacement surgery, initial nonresponders were randomized to receive a text reminder or not at 7 and 12 days, if needed. At day 7, the overall survey response rate was 63%. Model-derived estimates for survey return after this point were 51.1% (95% confidence interval [CI], 48.0%-54.2%) in the text arm compared to 34.5% (95% CI, 31.6%-37.6%) in the no text arm. The effect of text messages on response rates did not vary by subpopulations considered nor were there differences in rates of key outcomes between the 2 groups, suggesting that it did not impact any underlying response bias. Given the relative low cost of text messages, they can be an efficient means to increase response rates.

Research Trends of Patient-Reported Outcome Measures in Orthopedic Medical Practices: A Bibliometric and Visualized Study

Background and Objectives: Patient-reported outcome measures (PROMs), also known as self-report measures, are critical tools for evaluating health outcomes by gathering information directly from patients without external interpretation. There has been a growing trend in the number of publications focusing on PROMs in orthopedic-related research. This study aims to identify the most valuable publications, influential journals, leading researchers, and core countries in this field using bibliometric analysis, providing researchers with an understanding of the current state and future trends of PROMs in orthopedic research. Materials and Methods: All PROMs in orthopedic-related publications from 1991 to 2022 were obtained from the WoSCC database. R software (version 4.2.2), VOSviewer (version 1.6.17), and Microsoft Excel (version 2303) were used for the bibliometric and visual analysis. Results: A total of 2273 publication records were found from 1991 to 2022. The results indicated that the United States (US) has made significant contributions to orthopedic-related PROMs. The majority of active research institutions are located in the US. J ORTHOP RES has published the most articles. J BONE JOINT SURG AM has the highest total citations. Conclusions: Our study provides a valuable reference for further exploration of the application of PROMs in orthopedics. PROMs have emerged as an increasingly popular area of research within the field of orthopedics, both in clinical practice and academic research. We conducted a bibliometric analysis in terms of journals, authors, countries, and institutions in this field. Additionally, we analyzed the potentialities and advantages of using PROMs in orthopedic research. There is an increasing trend towards using network-based or short message service (SMS)-based electronic patient-reported outcome measures (ePROMs) in orthopedic medical practices. It is anticipated that the role of PROMs in psychological and mental health research and telemedicine will continue to grow in importance.

KOOS score maps were externally validated to inform knee arthroplasty shared decision making

PURPOSE

The Knee injury and Osteoarthritis Outcome Survey (KOOS) profile of outcome measures are among the most commonly used outcome measures in knee arthroplasty (KA). The purpose was to develop and externally validate "score maps" (one-page figural depictions of most likely scores) for KOOS Pain and Function subscales to facilitate a variety of clinical decisions related to shared decision making prior to KA.

METHODS

Presurgical KA data collected within 1 year of surgery and obtained in two independent studies were used in this cross-sectional study. Score maps were designed to be easily understandable, single-page graphical depictions of predicted KOOS Pain, and KOOS Function, daily activity subscales. To create the score maps, individual item scores from one dataset were used to determine the most probable responses for each item for the entire range of possible scores. Predicted KOOS score maps were derived from Osteoarthritis Initiative (OAI) data and externally validated using an independent single site KA cohort study. Score map predicted scores from OAI were compared to actual presurgical KOOS subscale scores using Weighted Kappa (Κw) agreement coefficients and actual versus predicted differences in scores.

RESULTS

The score maps derived from OAI and applied to actual scores in the validation sample demonstrated moderate to substantial chance-corrected agreement for both KOOS Pain and KOOS Function, daily activity subscale items. For example, KOOS Pain score map scores applied to the external validation dataset showed chance-corrected agreement with Κw ranging from 0.43 to 0.73. Score maps predicted actual item scores within ± 1 point at least 94% of the time. Findings for the KOOS Function, daily activity subscale items were similar.

CONCLUSIONS

Score maps derived from OAI data agreed with actual KOOS scores obtained on an independent dataset at an acceptable degree of precision. Easy-to-use KOOS Pain and Function, daily activity score maps have potential to facilitate a variety of important clinical decisions during discussions between patients and surgeons prior to KA.

LEVEL OF EVIDENCE

Level III prognostic study.