Montreal Accord on Patient-Reported Outcomes (PROs) use series - Paper 6: creating national initiatives to support development and use-the PROMIS example

Symptoms of depression and catastrophic thinking attenuate the relationship of pain intensity and magnitude of incapability with fracture severity

OBJECTIVE

The relative association of pain intensity and magnitude of incapability with pathophysiology, accounting for psychological factors, is incompletely understood. Using moderation analysis, we assessed the association of pain intensity and magnitude of incapability (dependent variables) with fracture severity (independent variable) and the influence of symptoms of depression and catastrophic thinking (moderators) at early and later stages of recovery.

METHODS

A cohort of 731 patients recovering from a shoulder, elbow, or wrist fracture, completed self-reported measures of pain intensity, upper extremity capability, symptoms of depression, and catastrophic thinking between 2 and 4 weeks after injury and again between 6 and 9 months after injury. Fracture severity was rated by clinicians, and we used multivariable regression analysis to examine interaction effects of fracture severity, depression, catastrophic thinking, pain intensity, and magnitude of incapability at early and later stages of recovery.

RESULTS

Symptoms of depression and catastrophic thinking attenuate the relationship between pain intensity and fracture severity at earlier and later stages of recovery. Symptoms of depression and catastrophic thinking also attenuate the relationship between the magnitude of incapability and fracture severity, but only at early stages of recovery.

CONCLUSION

The relative divergence of pain intensity and magnitude of incapability from the level of fracture severity due to the moderating effects of unhelpful thinking and distress, signals a benefit to anticipating mental health opportunities during recovery after fracture. Fracture management can incorporate measures of unhelpful thinking and symptoms of distress to better address these opportunities and ensure comprehensive optimization of recovery.

LEVEL OF EVIDENCE

Level IIc, prognostic.

Reliability of Patient-Report, Physician-Report, and Medical Record Review to Identify Hospital-Acquired Complications: A Prospective Cohort Study

This prospective study of internal medicine inpatients treated at 2 hospitals in Toronto, Canada, between September 1, 2016, and September 1, 2017, compared patient-report, physician-report, and detailed medical record review to identify specific hospital-acquired complications. Six complications were assessed: delirium, catheter-associated urinary tract infection, acute kidney injury, deep vein thrombosis/pulmonary embolism, hospital-acquired pneumonia, or fall. The study included 207 patients and physician responses were obtained for 156 (75%). Complications were identified in 28 (14%) patients by medical record review, 30 (14%) patients by patient-report, and 11 (7%) patients by physician-report. Fifty-four (26%) patients experienced a complication as identified through at least one of the 3 methods. There was little agreement between the 3 methods (Fleiss' ĸ 0.15, P < 0.001). All 3 sources agreed on the occurrence of a specific complication in only 1 patient (1%). Multiple approaches likely are needed to adequately measure hospital-acquired complications.

Minimal important change (MIC): a conceptual clarification and systematic review of MIC estimates of PROMIS measures

We define the minimal important change (MIC) as a threshold for a minimal within-person change over time above which patients perceive themselves importantly changed. There is a lot of confusion about the concept of MIC, particularly about the concepts of minimal important change and minimal detectable change, which questions the validity of published MIC values. The aims of this study were: (1) to clarify the concept of MIC and how to use it; (2) to provide practical guidance for estimating methodologically sound MIC values; and (3) to improve the applicability of PROMIS by summarizing the available evidence on plausible PROMIS MIC values. We discuss the concept of MIC and how to use it and provide practical guidance for estimating MIC values. In addition, we performed a systematic review in PubMed on MIC values of any PROMIS measure from studies using recommended approaches. A total of 50 studies estimated the MIC of a PROMIS measure, of which 19 studies used less appropriate methods. MIC values of the remaining 31 studies ranged from 0.1 to 12.7 T-score points. We recommend to use the predictive modeling method, possibly supplemented with the vignette-based method, in future MIC studies. We consider a MIC value of 2-6 T-score points for PROMIS measures reasonable to assume at this point. For surgical interventions a higher MIC value might be appropriate. We recommend more high-quality studies estimating MIC values for PROMIS.

Patient preferences for visualization of longitudinal patient-reported outcomes data

OBJECTIVE

The study sought to design symptom reports of longitudinal patient-reported outcomes data that are understandable and meaningful to end users.

MATERIALS AND METHODS

We completed a 2-phase iterative design and evaluation process. In phase I, we developed symptom reports and refined them according to expert input. End users then completed a survey containing demographics, a measure of health literacy, and items to assess visualization preferences and comprehension of reports. We then collected participants' perspectives on reports through semistructured interviews and modified them accordingly. In phase II, refined reports were evaluated in a survey that included demographics, validated measures of health and graph literacy, and items to assess preferences and comprehension of reports. Surveys were administered using a think-aloud protocol.

RESULTS

Fifty-five English- and Spanish-speaking end users, 89.1% of whom had limited health literacy, participated. In phase I, experts recommended improvements and 20 end users evaluated reports. From the feedback received, we added emojis, changed date and font formats, and simplified the y-axis scale of reports. In phase II, 35 end users evaluated refined designs, of whom 94.3% preferred reports with emojis, the favorite being a bar graph combined with emojis, which also promoted comprehension. In both phases, participants literally interpreted reports and provided suggestions for future visualizations.

CONCLUSIONS

A bar graph combined with emojis was participants' preferred format and the one that promoted comprehension. Target end users must be included in visualization design to identify literal interpretations of images and ensure final products are meaningful.

Relationship Between Magnitude of Limitations and Patient Experience During Recovery from Upper-Extremity Fracture

The relationship between the magnitude of limitations (measured by patient-reported outcome measures, or PROMs) and satisfaction with care providers and hospital services (measured by patient-reported experience measures, or PREMs) over the course of recovery after injury is unclear. The purpose of this study was to assess the relationship between a range of PROMs and 2 PREMs at 3 time points (initial office visit within a week, 2 to 4 weeks, and 6 to 9 months) after shoulder, elbow, and wrist fractures.

METHODS

We enrolled 744 adult patients with an isolated shoulder, elbow, or wrist fracture and invited them to complete PROMs (the Patient-Reported Outcomes Measurement Information System Upper Extremity Physical Function computer adaptive test [PROMIS UE], PROMIS Physical Function (PROMIS PF) scale, Quick Disabilities of the Arm, Shoulder and Hand [QuickDASH] questionnaire, EuroQol 5-Dimensions 3-Level Index [EQ-5D-3L], and Oxford Shoulder Score [OSS], Oxford Elbow Score [OES], or Patient-Rated Wrist Evaluation [PRWE]) and PREMs (Numerical Rating Scale [NRS] for satisfaction with care providers [NRS-C] and for satisfaction with hospital services [NRS-S]) at their initial visit at the outpatient surgical practice (maximum, 1 week after the fracture), between 2 and 4 weeks after the injury, and between 6 and 9 months after the injury. Correlational analysis was performed at each time point.

RESULTS

There was moderate correlation between the PROMIS UE and the NRS-C (r = 0.56) and NRS-S (r = 0.59) at 6 to 9 months after injury, which was stronger than the correlation at the 2 to 4-week mark (NRS-C, r = 0.34; NRS-S, r = 0.36) and at the evaluation that took place within a week after the injury (NRS-C, r = 0.18; NRS-S, r = 0.16). These correlational trends were observed with all forms of PROMs. Patients reporting greater limitations after injury were also less satisfied with their care and services.

CONCLUSIONS

The increasing alignment of PROMs and PREMs over the course of recovery after an upper-extremity fracture suggests that restored physical function may improve perceptions of satisfaction with care providers and hospital services over time. Future studies should assess factors that could be addressed to improve patient satisfaction and their limitations during recovery after fracture in order to maximize patient outcomes.

LEVEL OF EVIDENCE

Therapeutic Level IV. See Instructions for Authors for a complete description of levels of evidence.

Patient-Reported Outcomes Measurement Information System Versus Legacy Instruments: Are They Ready for Prime Time?

"Legacy" patient-reported outcome measures (PROs) have been used for decades; however, they have many limitations. The National Institutes of Health-funded PRO Measurement Information System (PROMIS) was developed to be a generic, flexible, precise, and reliable tool to measure core and additional domains of physical and emotional health and social well-being. Unlike Legacy PROs, PROMIS measures can be implemented across diseases, and use a common T-score metric-based scoring system derived using item response theory. PROMIS measure scores have potential to predict scores of Legacy PROs and could be the only set of measures needed to assess PROs.

Measurement invariance and general population reference values of the PROMIS Profile 29 in the UK, France, and Germany

PURPOSE

Comparability of patient-reported outcome measures over different languages is essential to allow cross-national research. We investigate the comparability of the PROMIS Profile 29, a generic health-related quality of life measure, in general population samples in the UK, France, and Germany and present general population reference values.

METHODS

A web-based survey was simultaneously conducted in the UK (n = 1509), France (1501), and Germany (1502). Along with the PROMIS Profile 29, we collected sociodemographic information as well as the EQ-5D. We tested measurement invariance by means of multigroup confirmatory factor analysis (CFA). Differences in the health-related quality of life between countries were modeled by linear regression analysis. We present general population reference data for the included PROMIS domains utilizing plausible value imputation and quantile regression.

RESULTS

Multigroup CFA of the PROMIS Profile 29 showed that factor means are insensitive to potential measurement bias except in one item. We observed significant differences in patient-reported health between countries, which could be partially explained by the differences in overall ratings of health. The physical function and pain interference scales showed considerable floor effects in the normal population in all countries.

CONCLUSIONS

Scores derived from the PROMIS Profile 29 are largely comparable across the UK, France, and Germany. Due to the use of plausible value imputation, the presented general population reference values can be compared to data collected with other PROMIS short forms or computer-adaptive tests.

Patient-Reported Outcomes in Patients with Chronic Kidney Disease and Kidney Transplant-Part 1

Chronic kidney disease (CKD) is a complex medical condition that is associated with several comorbidities and requires comprehensive medical management. Given the chronic nature of the condition, its frequent association with psychosocial distress, and its very significant symptom burden, the subjective patient experience is key toward understanding the true impact of CKD on the patients’ life. Patient-reported outcome measures are important tools that can be used to support patient-centered care and patient engagement during the complex management of patients with CKD. The routine collection and use of patient-reported outcomes (PROs) in clinical practice may improve quality of care and outcomes, and may provide useful data to understand the disease from both an individual and a population perspective. Many tools used to measure PROs focus on assessing health-related quality of life, which is significantly impaired among patients with CKD. Health-related quality of life, in addition to being an important outcome itself, is associated with clinical outcomes such as health care use and mortality. In Part 1 of this review, we provide an overview of PROs and implications of their use in the context of CKD. In Part 2, we will review the selection of appropriate measures and the relevant domains of interest for patients with CKD.

Chronic pain has a strong impact on quality of life in facioscapulohumeral muscular dystrophy

Introduction

Earlier small case series and clinical observations reported on chronic pain playing an important role in facioscapulohumeral dystrophy (FSHD). The aim of this study was to determine the characteristics and impact of pain on quality of life (QoL) in patients with FSHD.

Methods

We analyzed patient reported outcome measures collected through the U.K. FSHD Patient Registry.

Results

Of 398 patients, 88.6% reported pain at the time of study. The most frequent locations were shoulders and lower back. A total of 203 participants reported chronic pain, 30.4% of them as severe. The overall disease impact on QoL was significantly higher in patients with early onset and long disease duration. Chronic pain had a negative impact on all Individualised Neuromuscular Quality of Life Questionnaire domains and overall disease score.

Discussion

Our study shows that pain in FSHD type 1 (FSHD1) is frequent and strongly impacts on QoL, similar to other chronic, painful disorders. Management of pain should be considered when treating FSHD1 patients. Muscle Nerve57: 380–387, 2018

Montreal Accord on Patient-Reported Outcomes (PROs) use series - Paper 1: introduction

BACKGROUND

Patient-centered health care, where we design and deliver care to address the needs and preferences of patients, represents an important paradigm shift. Patient-reported outcomes (PROs) are critical to capture the patient voice, understand how illness and treatments affect people, and establish how well services and treatments address what matters most to patients.

OBJECTIVE

Originally developed for use in research, PROs are now used to monitor individuals and populations, manage care, evaluate services and providers, and inform policy. However, moving PROs beyond research settings incurs considerable methodological, organizational, technological, and ethical considerations. National collaborative networks of researchers, clinicians, patients, and other stakeholders can address these challenges by coordinating development, creating standards for use, sharing costs and delivery platforms, and improving widespread uptake of core sets of measures to better inform health care decisions and improve outcomes.

DISCUSSION

We introduce eight papers from researchers, clinicians, patients, and decision makers who participated in deliberations around creating a national network to accelerate the application and harmonized use of PROs in Canada. They offer a snap shot of the strategies that pioneers and innovative thinkers are using to integrate the patient voice into comprehensive care, research, and health policy planning of chronic diseases.