Patient-Reported Outcomes Measurement Information System Versus Legacy Instruments: Are They Ready for Prime Time?

Having More Tender Than Swollen Joints Is Associated With Worse Patient-Reported Outcomes in Patients With Early RA

BACKGROUND/OBJECTIVE

In patients with rheumatoid arthritis (RA), high tender-swollen joint differences (TSJDs) have been associated with worse outcomes. A better understanding of the phenotype and impact of high TSJD on patient-reported outcomes (PROs) in early RA may lead to earlier personalized treatment targeting domains that are important to patients today. Our objectives were to evaluate the impact of TSJD on updated PROs in patients with early RA over 1 year and to determine differences in associations by joint size.

METHODS

This longitudinal cohort study followed patients with active, early RA enrolled in the Canadian Early Arthritis Cohort between 2016 and 2022, who completed clinical assessments and PROMIS-29 measures over 1 year. Twenty-eight joint counts were performed and TSJDs calculated. Adjusted associations between TSJD and PROMIS-29 scores were estimated using separate linear-mixed models. Separate analyses of large versus small-joint TJSDs were performed.

RESULTS

Patients with early RA (n = 547; 70% female; mean [SD] age, 56 [15] years; mean [SD] symptom duration, 5.3 [2.9] months) were evaluated. A 1-point increase in TSJD was significantly associated with worse PROMIS T-scores in all domains: physical function (adjusted regression coefficient, -0.27; 95% confidence interval [CI], -0.39, -0.15), social participation (adjusted regression coefficient, -0.34; 95% CI, -0.50, -0.19), pain interference (adjusted regression coefficient, 0.49; 95% CI, 0.35, 0.64), sleep problems (adjusted regression coefficient, 0.29; 95% CI, 0.16, 0.43), fatigue (adjusted regression coefficient, 0.34; 95% CI, 0.18, 0.50), anxiety (adjusted regression coefficient, 0.23; 95% CI, 0.08, 0.38), and depression (adjusted regression coefficient, 0.20; 95% CI, 0.06, 0.35). Large-joint TSJD was associated with markedly worse PROs compared with small-joint TSJD.

CONCLUSIONS

Elevated TSJD is associated with worse PROs particularly pain interference, social participation, and fatigue. Patients with more tender than swollen joints, especially large joints, may benefit from earlier, targeted therapeutic interventions.

A Swiss digital Delphi study on patient-reported outcomes

AIMS OF THE STUDY

Health-related quality of life (HRQoL) indicators are patient-reported outcomes (PROs). PROs are defined as any report of the status of a patient's health condition or health behaviour that comes directly from the patient, without interpretation of the patient's response by a clinician or anyone else. Despite Swiss national bodies (FOPH, FMH) recognising the potential of PRO measures (PROMs) for improving the health system, no consensus has yet emerged regarding a generic PROM framework or specific domains for practical uptake. The aim of the present digital Delphi study was to generate a consensual Swiss expert opinion on a generic PROM framework, measurement domains and items from a validated instrument (PROMIS [Patient-Reported Outcome Measurement Information System]) as well as on the role and implementation of PROs in the Swiss healthcare system via PRO consensus statements.

METHODS

A 4-round digital Delphi study was conducted among Swiss PRO stakeholders. A total of n = 21 Swiss PROM stakeholders completed round 1 surveys on the PROM framework. During the stakeholder meeting, n = 11 stakeholders completed round 2 and round 3 surveys pertaining to measurement domains and items, respectively. In-meeting key questions and discussion items were extracted, consolidated into statements and subjected to consensus voting in a round 4, post-meeting survey. Consensus was defined as ≥70% agreement.

RESULTS

Pre-meeting, agreement was reached for the tripartite framework of physical, mental and social health (95-100%). During the meeting, agreement was reached on all seven measurement domains of a generic PROM (PROMIS-29), ranging from 80% (Anxiety, Sleep Disturbance) to 100% (Pain Interference, Depression, Ability to Participate in Social Roles). Consensus was also reached for all PROMIS-29 items, with average domain consensus ranging from 83% (Sleep Disturbance, Ability to Participate in Social Roles) to 100% (Depression). Finally, four post-meeting consensus statements regarding PROs in Switzerland reached agreement.

CONCLUSIONS

A Delphi method can help identify areas of need regarding PROMs in Switzerland. The current study identified a generic PROM as a missing quality indicator for the Swiss national health system's value. A pre-meeting informational briefing, expert presentations and moderation supported three voting rounds to help identify PROMIS-29 as a PROM framework (round 1), measurement domains (round 2) and items (round 3) as a basis for further validation research. The empirical agreement among diverse stakeholders supports broad consensus towards preliminary feasibility of integrating generic PROMs into the Swiss health system based on content relevance.

Pain in individuals with idiopathic inflammatory myopathies, other systemic autoimmune rheumatic diseases, and without rheumatic diseases: A report from the COVAD study

OBJECTIVES

To compare pain intensity among individuals with idiopathic inflammatory myopathies (IIMs), other systemic autoimmune rheumatic diseases (AIRDs), and without rheumatic disease (wAIDs).

METHODS

Data were collected from the COVID-19 Vaccination in Autoimmune Diseases (COVAD) study, an international cross-sectional online survey, from December 2020 to August 2021. Pain experienced in the preceding week was assessed using numeral rating scale (NRS). We performed a negative binomial regression analysis to assess pain in IIMs subtypes and whether demographics, disease activity, general health status, and physical function had an impact on pain scores.

RESULTS

Of 6988 participants included, 15.1% had IIMs, 27.9% had other AIRDs, and 57.0% were wAIDs. The median pain NRS in patients with IIMs, other AIRDs, and wAIDs were 2.0 (interquartile range [IQR] = 1.0-5.0), 3.0 (IQR = 1.0-6.0), and 1.0 (IQR = 0-2.0), respectively (P < 0.001). Regression analysis adjusted for gender, age, and ethnicity revealed that overlap myositis and antisynthetase syndrome had the highest pain (NRS = 4.0, 95% CI = 3.5-4.5, and NRS = 3.6, 95% CI = 3.1-4.1, respectively). An additional association between pain and poor functional status was observed in all groups. Female gender was associated with higher pain scores in almost all scenarios. Increasing age was associated with higher pain NRS scores in some scenarios of disease activity, and Asian and Hispanic ethnicities had reduced pain scores in some functional status scenarios.

CONCLUSION

Patients with IIMs reported higher pain levels than wAIDs, but less than patients with other AIRDs. Pain is a disabling manifestation of IIMs and is associated with a poor functional status.

Patient-Reported Outcomes Measurement Information System Is Not as Responsive as Legacy Scores in Detecting Patient Outcomes in Hip Preservation: A Systematic Review

PURPOSE

To evaluate publication trends of Patient-Reported Outcomes Measurement Information System (PROMIS) in hip preservation literature, assess the usage of PROMIS as an outcome measure, and evaluate correlations of all available published PROMIS domains with legacy patient-reported outcomes (PROs).

METHODS

The PubMed, Scopus, Cochrane Central Register of Controlled Trials, and Google Scholar databases were queried for articles evaluating PROMIS scores among hip preservation populations. Inclusion criteria consisted of studies with Level IV evidence or above (per the Sackett et al. levels of evidence), such as case series and cohort studies, reporting on perioperative use of hip PROMIS scores. Exclusion criteria consisted of arthroplasty and trauma studies. Patient demographics, PROMIS usage, and PROMIS Pearson or Spearman correlation coefficients to historic PROs were recorded for each study.

RESULTS

Fifteen articles published between 2017 and 2021 were included in the analysis, with the majority (75%) published between 2020 and 2021. Studies assessing postoperative outcomes had follow-up periods ranging from 6 months to 5 years. The most common PROMIS domain reported was Physical Function (PF), and there was varying usage of other domains including Pain Intensity, Anxiety, and Depression. PROMIS validity was most often assessed in comparison to the modified Harris Hip Score (mHHS) by calculating the Pearson coefficient, which assumes normal data distribution, or Spearman coefficient, which is rank-based and does not require normal data distribution. Studies comparing PROMIS-PF with mHHS reported Pearson coefficients ranging from 0.49 to 0.72 and Spearman coefficients ranging from 0.67 to 0.71.

CONCLUSIONS

There has been a chronologic increase in PROMIS usage in hip preservation literature. PROMIS demonstrates moderate-to-strong correlations with legacy PROs, but there is substantial heterogeneity in follow-up periods, PROMIS domains used, and statistical methodology. The current data show that PROMIS is not as responsive as historically used, validated PROs in quantitatively assessing function and pain in hip preservation patients.

CLINICAL RELEVANCE

Surgeons using PROMIS solely should be aware that the score may not be as responsive as legacy PROs in closely assessing improvements or deterioration in patient performance after hip preservation surgery. Rather than being used alone, PROMIS may be useful as a replacement for a group of legacy PROs. Thus, when used alongside select legacy PROs, overall questionnaire burden can be reduced while maintaining a high level of accuracy in assessing health status.

Minimal clinically important difference (MCID) and substantial clinical benefit (SCB) of upper extremity PROMIS scores following arthroscopic rotator cuff repairs

PURPOSE

To calculate and determine what factors are associated with achieving the Minimal Clinically Important Difference (MCID) and the Substantial Clinical Benefit (SCB) of Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity Computer Adaptive Testing v2.0 (UE), Pain Interference (P-Interference), and Pain Intensity (P-Intensity) in patients undergoing arthroscopic rotator cuff repair (aRCR).

METHODS

The change in PROMIS scores representing the optimal cutoff for a ROC curve with an area under the curve analysis was used to calculate the anchor-based MCID and SCB. To assess the responsiveness of each PROM, effect sizes and standardized response means (SRM) were calculated. To identify factors associated with attaining the MCID and SCB, univariate and multivariate logistic regression analyses were performed.

RESULTS

A total of 323 patients with an average age of 59.9 ± 9.5 were enrolled in this study, of which, 187/323 [57.9%] were male and 136/323 [42.1%] were female. The anchor-based MCID for PROMIS UE, P-Interference, and P-Intensity was: 9.0, 7.5, and 11.2, respectively. The respective SCB was 10.9, 9.3, and 12.7. Effect size and SRM were: PROMIS UE (1.4, 1.3), P-Interference (1.8, 1.5), and P-Intensity (2.3, 2.0). Lower preoperative P-Intensity scores (p = 0.02), dominant arm involvement (p = 0.03), and concomitant biceps tenodesis (p = 0.03) were associated with patients achieving the SCB for PROMIS UE.

CONCLUSION

A large responsiveness for each of the PROMIS instruments due to the majority of patients reporting great improvement after aRCR and a small standard deviation across all outcome measures was shown in our study. Lower preoperative P-Intensity scores and concomitant biceps tenodesis were associated with higher odds of achieving the SCB for PROMIS UE. The knowledge of MCID and SCB values for PROMIS instruments will allow the surgeon to determine whether the improvements in the PROMIS scores after aRCR are clinically meaningful.

LEVEL OF EVIDENCE

Level III.

Evaluation of PROMIS Scores 6 Weeks after Conservative Management of Carpometacarpal Thumb Arthritis

Patient-reported outcome measures are being increasingly emphasized to assign value to care‚ given the current trend toward pay-for-performance healthcare. We sought to determine if the Patient-reported Outcomes Measurement Information System (PROMIS), a general questionnaire, is sensitive enough to detect improvement after corticosteroid injection or splinting/hand therapy for thumb carpometacarpal (CMC) arthritis.

Is the VISA-A Still Seaworthy, or Is It in Need of Maintenance?

Background

The Victorian Institute of Sport Assessment-Achilles (VISA-A) questionnaire is validated and widely used in Achilles tendinopathy. How well it can evaluate treatment outcomes is not well understood.

Purpose

To evaluate the responsiveness of the VISA-A in midportion Achilles tendinopathy and compare it with other patient-reported outcome measures.

Study Design

Cohort study (diagnosis); Level of evidence, 2.

Methods

Enrolled were 97 participants with clinically diagnosed Achilles tendinopathy (median age, 50 years [interquartile range, 18 years]; symptom duration, 10 months [interquartile range, 28.7 months). The participants underwent a baseline evaluation and completed between 1 and 6 follow-up evaluations at 8, 16, 24, 32, 40, and/or 48 weeks. Participants completed the VISA-A, the Patient Reported Outcomes Measurement Information System short form Version 2.0 (PROMIS) Physical Function and Pain Interference subscales, and the Tampa Scale for Kinesiophobia (TSK). Three thresholds were evaluated with a receiver operating characteristic analysis (minimal clinically important difference [MCID], substantial benefit [SB], and complete recovery [CR]) using an 11-point global rating of change scale as an anchor. Thresholds were evaluated on raw scores as well as changes from baseline.

Results

The VISA-A was able to detect all 3 thresholds for changes over time, with raw scores >70.5, >77.5, and >89.5 representing the MCID, SB, and CR, respectively; thresholds for changes from baseline on the VISA-A were increases of 23.5, 19.5, and 37.5 points from baseline, respectively. The PROMIS subscale raw scores had identical thresholds for SB and CR (52.45 for Physical Function and 45.6 for Pain Interference). A score <34.5 on the TSK was the threshold for SB.

Conclusion

The VISA-A was the most responsive outcome measure evaluated. Raw scores had increasingly higher thresholds for the MCID, SB, and CR, which were therefore logically consistent.

Legacy Patient-reported Outcome Measures Can Be Reliably Translated to PROMIS Domains for Use in Adolescent Spinal Deformity

STUDY DESIGN

Retrospective cohort study.

OBJECTIVE

The aim of this study was to determine whether Patient-reported Outcomes Measurement Information System (PROMIS) Pediatric Domain scores can be accurately and reliably predicted from legacy patient-reported outcome measures (PROMs) for use in adolescent idiopathic scoliosis.

SUMMARY OF BACKGROUND DATA

Previous efforts have been made to develop translational models between PROMIS domains and legacy PROMs in adult spinal deformity, but translational models for pediatric and adolescent patients with spinal deformity have not yet been developed.

METHODS

Scores were retrospectively collected on pediatric patients 8-17 years old who were diagnosed with spinal asymmetry or scoliosis for the following PROMs: Scoliosis Research Society-22r (SRS-22r), Trunk Appearance Perception Scale (TAPS), Hospital for Special Surgery Functional Activity Brief Scale (HSS Pedi-FABS), and PROMIS Pediatric Domains: Pain Interference, Mobility, Physical Stress Experiences, Psychological Stress Experiences, and Physical Activity. Pearson correlations were calculated between legacy and PROMIS scores. In the derivation cohort, PROMIS domains were modeled from SRS-22r or HSS Pedi-FABS using linear regression. These equations were used to predict PROMIS scores in the test cohort to determine the reliability of the translation model.

RESULTS

A total of 1171 patients (68% female) with a mean age of 13.4 ± 2.3 years were included in the final analyses. PROMIS Pain Interference was dependent on SRS-22r domains Pain, Function, Mental Health, and Management Satisfaction, PROMIS Mobility was dependent on SRS-22r Pain, Function, Mental Health, and Self-Image, PROMIS Physical Stress Experiences and Psychological Stress Experiences were dependent on SRS-22r Pain, Mental Health, and Management Satisfaction, and PROMIS Physical Activity was dependent on HSS Pedi-FABS. (P < 0.05 for all). In the test cohort, all developed models for PROMIS domains demonstrated strong correlations between estimated and actual scores (r = 0.63-0.75).

CONCLUSION

All of the evaluated PROMIS domains (Pain Interference, Mobility, Physical Stress Experiences, Psychological Stress Experiences, Physical Activity) were reliably translated directly from these legacy scores for pediatric and adolescent patients with spinal deformity.Level of Evidence: 3.

PROMIS Versus Legacy Patient-Reported Outcome Measures for Sports Medicine Patients Undergoing Arthroscopic Knee, Shoulder, and Hip Interventions: A Systematic Review

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS®) was designed to monitor the global wellbeing of patients, with the Physical Function Computer-Adaptive Test (PF-CAT) component focused specifically on functional outcome. PROMIS aims for increased item-bank accuracy, lower administrative burden, and decreased floor and ceiling effects compared to legacy patient-reported outcome measures (PROMs). Our primary research outcomes focused on sports medicine surgical populations, which may skew younger or have wide-ranging functional statuses. Specifically, for this population, we questioned if PROMIS PF-CAT was equal to legacy PROMs in (1) construct validity and (2) convergent/divergent validities; and superior to legacy PROMs with respect to (3) survey burden and (4) floor and ceiling effects.

METHODS

Searches were performed in April 2019 in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, utilizing PubMed, Cochrane Central, and Embase databases for Level I-III evidence. This resulted in 541 records, yielding 12 studies for inclusion. PROM data was available for patients undergoing arthroscopic orthopaedic procedures of the knee, shoulder, and hip. Measures of construct validity, convergent/divergent validity, survey burden, and floor/ceiling effects were evaluated for PROMIS PF-CAT versus legacy PROMs.

RESULTS

PROMIS PF-CAT demonstrated excellent or excellent-good correlation with legacy PROMS for physical function and quality of life for patients undergoing arthroscopic interventions of the knee, shoulder, and hip. Compared to legacy PROM instruments, PROMIS PF-CAT demonstrated the lowest overall survey burden and had the lowest overall number of floor or ceiling effects across participants.

CONCLUSION

PROMIS PF-CAT is an accurate, efficient evaluation tool for sports medicine surgical patients. PROMIS PF-CAT strongly correlates with legacy physical function PROMs while having a lower test burden and less incidence of floor and ceiling effects. PROMIS PF-CAT may be an optimal alternative for traditional physical function PROMs in sports medicine patients undergoing arthroscopic procedures. Further studies are required to extend the generalizability of these findings to patients during postoperative timepoints after shoulder and hip interventionsLevel of Evidence: III.

Why It Hurts: The Mechanisms of Pain in Rheumatoid Arthritis

Pain is a near-universal feature of rheumatoid arthritis, but peripheral joint inflammation may not suffice to explain the etiology of pain in all patients with rheumatoid arthritis. Inflammation in rheumatoid arthritis releases several algogens that may generate pain. Also, central nervous system processes may play a crucial role in the regulation and perpetuation of pain. Several methods for assessing pain in rheumatoid arthritis exist, and recently the role of assessing therapeutics in treating specific etiologies of pain has gained interest.

Patient-reported experience with patient-reported outcome measures in adult patients seen in rheumatology clinics

OBJECTIVES

Patient-reported outcome measures (PROMs) are increasingly utilized in the evaluation of patients with rheumatic diseases. The aim of our study was to assess the patient experience with completing PROMs within rheumatology clinics, and identify patient characteristics associated with a more positive experience.

METHODS

We conducted a retrospective cross-sectional study of adult patients seen in rheumatology clinics between 1/1/2017 and 6/30/2017. Patients were included in the study if they completed at least one patient-reported experience question following completion of PROMs. Patient characteristics associated with more positive experiences were identified through multivariable proportional odds models.

RESULTS

12,597 adult patients (mean age 59 ± 15; 76% female; 84% white) completed PROMs, as well as questions on their experience completing PROMs. Patients agreed/strongly agreed that PROM questions were easy to understand (97%), useful (84%), helped their physician understand their health (78%), improved communication with their provider (78%) and improved control over their own care (70%). Predictors of better experience with PROMs included being younger, non-white, having lower income, and being a new patient. Worse self-reported health also predicted better experience with PROMs.

CONCLUSION

Our study found a positive patient experience with PROMs, which is a crucial component of their successful implementation and utilization. Findings from this study suggest PROMs may be particularly beneficial in new patients, minorities, those with lower income, and worse self-reported quality of life. Collecting PROMs could provide opportunities to improve patient-provider communication and enhance control over care for rheumatology patients who could most benefit.