Performance of PROMIS Physical Function, Pain Interference, and Depression Computer Adaptive Tests Instruments in Patients Undergoing Meniscal Surgery

Revision and Primary Meniscal Allograft Transplantations Provide Clinical Benefit at Mid-Term Follow-Up: A Matched-Cohort Analysis of Patient-Reported Outcomes, Reoperations, and Failures

PURPOSE

To report the mid-term outcomes of patients who underwent revision meniscal allograft transplantation (RMAT) and compare survivorship free from reoperation and failure with a matched cohort of patients who underwent primary meniscal allograft transplantation (PMAT).

METHODS

A retrospective review of prospectively collected data identified patients who underwent RMAT and PMAT between 1999 and 2017. A cohort of PMAT patients matched at a ratio of 2:1 with respect to age, body mass index, sex, and concomitant procedures served as the control group. Patient-reported outcome measures (PROMs) at baseline and at a minimum of 5 years postoperatively were collected. PROMs and the achievement of clinically significant outcomes were analyzed within groups. Graft survivorship free from meniscal reoperation and failure (arthroplasty or subsequent RMAT) was compared between cohorts using log-rank testing.

RESULTS

During the study period, 22 RMATs were performed in 22 patients. Of these RMAT patients, 16 met the inclusion criteria (73% follow-up rate). The mean age of RMAT patients was 29.7 ± 9.3 years, and the mean follow-up period was 9.9 ± 4.2 years (range, 5.4-16.8 years). There were no differences between the RMAT cohort and the 32 matched PMAT patients with respect to age (P = .292), body mass index (P = .623), sex (P = .537), concomitant procedures (P ≥ .286), or baseline PROMs (P ≥ .066). The patient acceptable symptomatic state was achieved by the RMAT cohort for the subjective International Knee Documentation Committee score (70%), Lysholm score (38%), and Knee Injury and Osteoarthritis Outcome Score subscales (Pain [73%], Symptoms [64%], Sport [45%], Activities of Daily Living [55%], and Quality of Life [36%]). In the RMAT cohort, 5 patients (31%) underwent subsequent reoperation at a mean of 4.7 ± 2.1 years (range, 1.7-6.7 years) and 5 patients met the criteria for failure at a mean of 4.9 ± 2.9 years (range, 1.2-8.4 years). There were no significant differences in survivorship free from reoperation (P = .735) or failure (P = .170) between the RMAT and PMAT cohorts.

CONCLUSIONS

At mid-term follow-up, most patients who underwent RMAT achieved the patient acceptable symptomatic state for the subjective International Knee Documentation Committee score and the Knee Injury and Osteoarthritis Outcome Score subscales of Pain, Symptoms, and Activities of Daily Living. Additionally, there were no differences in survival free from meniscal reoperation or failure between the PMAT and RMAT cohorts.

LEVEL OF EVIDENCE

Level III, retrospective comparative cohort.

Responsiveness and minimal important change of seven PROMIS computerized adaptive tests (CAT) in patients with advanced chronic kidney disease

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS®) has the potential to harmonize the measurement of health-related quality of life (HRQL) across medical conditions. We evaluated responsiveness and minimal important change (MIC) of seven Dutch-Flemish PROMIS computerized adaptive tests (CAT) in Dutch patients with advanced chronic kidney disease (CKD).

METHODS

CKD patients (eGFR < 30 ml/min.1.73m²) completed at baseline and after 6 months seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and ability to participate in social roles and activities), Short Form Health Survey 12 (SF-12), PROMIS Pain Intensity single item, Dialysis Symptom Index (DSI), and Global Rating Scales (GRS) of change. Responsiveness was assessed by testing predefined hypotheses about expected correlations among measures, area under the ROC Curve, and effect sizes. MIC was determined with predictive modelling.

RESULTS

207 patients were included; 186 (90%) completed the follow-up. Most results were in accordance with expectations (70-91% of hypotheses confirmed), with some exceptions for PROMIS Anxiety and Ability to Participate (60% and 42% of hypotheses confirmed, respectively). For PROMIS Anxiety and Depression correlations with the GRS were too low (0.04 and 0.20, respectively) to calculate a MIC. MIC values, representing minimal important deterioration, ranged from 0.4 to 2.5 T-score points for the other domains.

CONCLUSION

We found sufficient responsiveness of PROMIS CATs Physical Function, Fatigue, Sleep Disturbance, and Depression. The results for PROMIS CATs Pain Interference were almost sufficient, but some results for Anxiety and Ability to Participate in Social Roles and Activities were not as expected. Reported MIC values should be interpreted with caution because most patients did not change.

Responsiveness and Minimal Important Change of the PROMIS Pain Interference Item Bank in Patients Presented in Musculoskeletal Practice

We evaluated the responsiveness of the Patient Reported Outcome Information System Pain Interference item bank in patients with musculoskeletal pain by testing predefined hypotheses about the relationship between the change scores on the item bank, change scores on legacy instruments and Global Ratings of Change (GRoC), and we estimated Minimal Important Change (MIC). Patients answered the full Dutch-Flemish V1.1 item bank. From the responses we derived scores for the standard 8-item short form (SF8a) and a CAT-score was simulated. Correlations between the change scores on the item bank, GRoC and legacy instruments were calculated, together with Effect Sizes, Standardized Response Means, and Area Under the Curve. GRoC were used as an anchor for estimating the MIC with (adjusted) predictive modeling. Of 1,677 patients answering baseline questionnaires 960 completed follow-up questionnaires at 3 months. The item bank correlated moderately high with the GRoC (Spearman's rho 0.63) and with the legacy instruments (Pearson's R ranging from .45 to .68). It showed a high ES (.97) and Standardized Response Means (.71), and could distinguish well between improved and not improved patients based on the GRoC (Area Under the Curve .77). Comparable results were found for the derived SF8a and CAT-scores. The MIC was estimated to be 3.2 (CI 2.6-3.7) T-score points. PERSPECTIVE: Our study supports the responsiveness of the PROMIS-PI item bank in patients with musculoskeletal complaints. Almost all predefined hypotheses were met (94%). The PROMIS-PI item bank correlated well with several legacy instruments which supports generic use of the item bank. MIC for PROMIS-PI was estimated to be 3.2 T-score points.

Pre-Visit Digital Messaging Improves Patient-Reported Outcome Measure Participation Prior to the Orthopaedic Ambulatory Visit: Results from a Double-Blinded, Prospective, Randomized Controlled Trial

BACKGROUND

Patient-reported outcome measures (PROMs) are metrics that assess physical health, mental health, pain, and satisfaction. However, PROM collection in orthopaedic clinics presents numerous logistical and financial challenges. These challenges are reduced when PROMs are completed before clinic encounters, relieving the workflow constraints of in-office PROM collection. The purpose of this study was to determine the efficacy of 3 different methods with respect to pre-visit electronic PROM completion.

METHODS

Consecutive adult orthopaedic patients with no previous PROM participation were enrolled. Patients who registered with the electronic medical record (EMR) patient portal (MyChart) and with active e-mail addresses were randomly assigned to 1 of 3 arms: control (no pre-visit messages), MyChart (EMR patient portal pre-visit messages), and e-mail (e-mail pre-visit messages). The primary outcome measure was pre-visit PROM completion rates in orthopaedic patients, and the secondary outcome measures were time to pre-visit PROM form completion and PROM form completion rates according to patient demographic characteristics. By default, the Patient-Reported Outcomes Measurement Information System (PROMIS) forms were available for completion through the portal by 7 days before scheduled visits. Pre-visit messages were sent 7 days prior to the scheduled visit except in the control group, with reminders sent 3 days prior if still not completed. The patients in each arm who completed all assigned forms were labeled as having total PROM completion, and those who completed at least 1 completed form were considered as having partial PROM completion. Multivariable logistic regression models were used to assess differences in PROM completion rates between study arms. Kruskal-Wallis tests were performed to compare the date of the form completion.

RESULTS

A total of 291 patients were included. The pre-visit total completion rates for assigned PROMs were higher in the MyChart arm (49% of 97 patients; p = 0.005) and the e-mail arm (52% of 100 patients; p = 0.002) in comparison with the control arm (30% of 94 patients). Male patients were more likely than female patients to have partial pre-visit PROM completion (odds ratio [OR], 1.74; p = 0.03), and Caucasian patients were more likely to have partial pre-visit PROM completion than African American patients (OR, 2.28; p = 0.01).

CONCLUSIONS

Orthopaedic patients receiving either e-mail or patient portal messages demonstrated higher pre-visit PROM completion rates. Pre-visit messaging appears to be a useful strategy for increasing PROM completion rates and limiting the clinical workflow strain imposed by in-clinic PROM administration.

LEVEL OF EVIDENCE

Therapeutic Level I. See Instructions for Authors for a complete description of levels of evidence.

The Current Utilization of Patient-reported Outcome Measurement Information System in Shoulder, Elbow, and Sports Medicine

Clinical research using patient-reported outcome measures has been critical within the field of shoulder, elbow, and sports medicine in helping clinicians deliver evidence-based and value-based medicine. Recently, however, clinicians have advocated for improving the process of obtaining clinically meaningful information from patients while decreasing survey fatigue and increasing compliance. To that end, the National Institutes of Health created the Patient-Reported Outcome Measures Information System (PROMIS) in which a number of institutions and research investigations have adopted for reporting outcomes. A special focus has also been placed on PROMIS Computer Adaptive Testing forms, which tailor questioning through item response theory. The purpose of this study was to provide insight into the utilization, advantages, and disadvantages of PROMIS within the field of shoulder, elbow, and sports medicine and provide a comparison with legacy patient-reported outcome measure measurements.

Two-year validation and minimal clinically important difference of the Veterans RAND 12 Item Health Survey Physical Component Score in patients undergoing minimally invasive transforaminal lumbar interbody fusion

OBJECTIVE

The Physical Component Score of the Veterans RAND 12 Item Health Survey (VR-12 PCS) has been assessed for use at short-term and intermediate-term time points for lumbar fusion populations. This study assesses the long-term validity and establishes minimal clinically important difference (MCID) values of VR-12 PCS in patients undergoing minimally invasive transforaminal lumbar interbody fusion (MIS TLIF).

METHODS

A surgical registry was retrospectively reviewed for primary, elective, single-level MIS TLIF procedures with posterior instrumentation. Patients missing preoperative and 2-year postoperative VR-12 PCS survey data were excluded. VR-12 PCS, SF-12 Health Survey Physical Component Summary (SF-12 PCS), Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS PF), and Oswestry Disability Index (ODI) patient-reported outcome measures (PROMs) were recorded preoperatively and postoperatively. Responsiveness of the VR-12 measure was assessed in two ways. First, the mean postoperative PROM scores were compared with preoperative baseline values using a paired Student t-test. Second, MCID values were calculated using both distribution-based and anchor-based methods and used to assess improvement in VR-12 score at the 2-year time point. Discriminant validity of the VR-12 was assessed using cross-sectional and longitudinal anchors. Convergent validity of the VR-12 measure was assessed using Pearson's correlation coefficient and partial time-independent correlation. Floor and ceiling effects were assessed.

RESULTS

A total of 74 patients who underwent MIS TLIF were included. The VR-12 PCS demonstrated significant improvements at all time points from 12 weeks to 2 years (p < 0.001 for all). VR-12 PCSs were significantly different for patients classified using cross-sectional anchors (p < 0.001) and longitudinal anchors (p ≤ 0.005). Calculated MCID values ranged from 4.1 to 8.5, and 4.1 was selected as the optimal MCID, which 87.8% of patients achieved. Strong, significant correlations of the VR-12 PCS with SF-12 PCS and PROMIS PF were demonstrated at all time points (p < 0.001 for all). No significant floor or ceiling effects were detected.

CONCLUSIONS

The VR-12 PCS demonstrated excellent responsiveness, discriminant and convergent validity, and no significant floor or ceiling effects up to 2 years after MIS TLIF. Therefore, VR-12 PCS may serve as a valid measure of long-term physical function.

Prospective, Single-blind, Randomized Controlled Trial to Evaluate the Effectiveness of a Digital Exercise Therapy Application Compared With Conventional Physical Therapy for the Treatment of Nonoperative Knee Conditions

Objective

To evaluate the effectiveness and adherence of a home exercise therapy program using a digital exercise therapy application (DETA) compared with conventional physical therapy (PT).

Design

Parallel group, randomized controlled trial.

Setting

Two clinics in a tertiary care academic center.

Participants

Participants (N=60) were enrolled within 1 week after a provider visit for knee pain. Inclusion criteria: age 18-75 years, knee pain diagnosis, and clinician-prescribed PT.

Interventions

Participants were randomized to complete either an 8-week intervention of conventional PT (enrolled n=29; complete n=26) or the DETA (enrolled n=31; completed n=24).

Main Outcome Measures

Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference (PI) and Physical Function (PF) scores implemented via computer adaptive tests; number of exercise sessions completed per week (adherence).

Results

Compared with the PT group, the DETA group reported significant decreases in PROMIS-PI scores (−6.1±6.7 vs −1.5±6.6, P<.05, d=0.78) and increases in PROMIS-PF scores (6.0±6.6 vs −0.8±5.8, P<.01, d=0.89) after 8 weeks. No group differences in adherence were observed (P>.05).

Conclusions

Use of this DETA resulted in greater pain and functional improvements compared with PT, with no differences in adherence. It is possible this application may be a viable alternative to conventional PT in certain cases. A larger sample from various geographic locations is needed to improve generalizability and for subgroup analysis. Further investigation is warranted to determine the factors responsible for the differences observed between the groups.

Preoperative Patient-Reported Outcomes Measurement Information System Computerized Adaptive Testing (PROMIS CAT) Scores Predict Achievement of Minimum Clinically Important Difference Following Anterior Cruciate Ligament Reconstruction Using an Anchor-Based Methodology

PURPOSE

To determine the change in Patient-Reported Outcomes Measurement Information System Computerized Adaptive Testing (PROMIS CAT) scores for physical function, pain interference, and depression that constitute minimum clinically important difference (MCID) using an anchor-based technique and to identify pre-operative clinical thresholds in anchor-based MCID that predict likelihood of achieving MCID following anterior cruciate ligament (ACL) reconstruction.

METHODS

Adult patients aged 18 years or older undergoing ACL reconstruction that completed both preoperative and postoperative PROMIS CAT assessments and an anchor-based questionnaire were identified over a 23-month period. Anchor-based MCID was determined for PROMIS CAT forms for physical function (PROMIS PF CAT), pain interference (PROMIS PI CAT), and depression (PROMIS D CAT).

RESULTS

A total of 137 patients were included for statistical analysis, with pre-operative PROMIS CAT forms completed 27.9 ± 31.2 days before surgery and 492.5 ± 219.9 days postoperatively on average. Statistically significant improvements were observed for all PROMIS CAT domains. PROMIS PF CAT improved from 39.5 ± 8.2 to 55.0 ± 9.7 (P < .0005), PROMIS PI CAT from 59.8 ± 7.2 to 48.2 ± 8.3 (P < .0005), and PROMIS D CAT from 47.9 ± 8.8 to 41.5 ± 8.6 (P < .0005). Anchor-based MCID for each PROMIS CAT form was calculated to be +4.5, -5.4, and -4.1 for PROMIS PF CAT, PROMIS PI CAT, and PROMIS D CAT, respectively. Mean difference between preoperative and postoperative PROMIS CAT scores exceeded MCID for all domains. The percentage of patients achieving MCID for PROMIS PF CAT, PROMIS PI CAT, and PROMIS D CAT was 85%, 72%, and 55%, respectively. After introduction of 95% specificity cutoffs, the percentage of patients achieving MCID for PROMIS PF CAT, PROMIS PI CAT, and PROMIS D CAT increased to 100% (<35.6 cutoff score), 92% (>65.7 cutoff score), and 83% (>57.5 cutoff score), respectively.

CONCLUSIONS

According to anchor-based analysis of PROMIS CAT MCID, ACL reconstruction is effective in improving physical function, pain interference, and depression symptoms. In addition, preoperative PROMIS CAT scores can predict the likelihood of achieving MCID postoperatively.

LEVEL OF EVIDENCE

Level IV, prognostic case series.

Age Significantly Affects Response Rate to Outcomes Questionnaires Using Mobile Messaging Software

Purpose

To investigate the demographic factors that influence time to respond (TTR), time to completion (TTC), and response rate when using a text messaging-based system and to determine the feasibility and applicability of mobile messaging-based services for collection of patient-reported outcomes among orthopaedic sports medicine patients.

Methods

On the day of surgery, patient mobile phone number was collected and the automated mobile messaging service (MOSIO, Seattle, WA) messaged patients for 10 ``days postoperatively. Patient visual analog scale (VAS) scores were collected 3 times daily, side effects were asked each evening, and Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference (PI) Short Form was collected on postoperative day 3 and 7.

Results

A total of 177 patients were enrolled in the study. The overall response rate to the survey questions was 75.0%. For all patients, the average TTR of questions was 35.09 ± 12.57 minutes. The TTC was 2.75 ± 3.56 minutes for PROMIS-PI, 3.51 ± 1.26 minutes for VAS, and 3.80 ± 6.87 for side-effect questions. When patients were stratified into age groups, the youngest group, 16 to 32 years, had the greatest response rate of 85.2% and patients in the 49 to 59 years group had the lowest response rate of 68.4% and 69.1%, respectively (P < .001). There was no significant difference in the TTR or TTC for VAS, PROMIS-PI, or side-effect questions when patients were stratified by age or sex groups (P > .05).

Conclusions

Collectively, all age groups successfully achieved a mean response rate of 75%; however, significantly lower response rates were observed for patients >49 years old. Differences in age and sex did not impact the overall TTR or TTC for VAS, PROMIS-PI, or side-effect questions. Mobile-based applications present as an emerging opportunity to track postoperative outcome scores and reduce clinic survey load.

Level of Evidence

Case series, level of evidence IV.

The PROMISⓇ-Plus-Osteoarthritis of the Knee (OAK) profile measure integrates generic and condition-specific content to enhance relevance and efficiency

OBJECTIVE

The Patient-Reported Outcomes Measurement Information System (PROMIS)-Plus-Osteoarthritis of the Knee (OAK) profile integrates universal PROMIS items with knee-specific items across 13 domains. We evaluated the psychometric properties of a subset of six domains associated with quality of life in people with OAK.

STUDY DESIGN AND SETTING

In a cross-sectional study of OAK patients (n=600), we estimated reliability using Pearson and Spearman correlations with Knee Injury and Osteoarthritis Outcome Score (KOOS) subscores and known-groups validity with PROMIS Global Health. Measure responsiveness was tested via paired t-tests in a longitudinal study (n=238), pre/post total knee replacement.

RESULTS

Across the six domains, internal consistency reliability (Cronbach's alpha) was 0.77-0.95 and test-retest reliability (intraclass correlation coefficients) was ≥0.90. Correlations with Knee Injury and Osteoarthritis Outcome Score (KOOS) subscores and PROMIS Global supported convergent and divergent validity. Known-groups validity testing revealed better scores in all domains for high vs. low global status groups, and knee-specific items added value in physical function and pain. All domains reflected (p<0.001) better health status scores at follow up.

CONCLUSION

The six PROMIS-Plus-OAK profile domains demonstrated good psychometric characteristics. The measure integrates universal and knee-specific content to provide enhanced relevance, measurement precision and efficient administration for patient care and clinical research.