Psychometric evaluation of the PROMIS Physical Function Computerized Adaptive Test in comparison to the American Shoulder and Elbow Surgeons score and Simple Shoulder Test in patients with rotator cuff disease

Examining the Relationship Between Relative Value Units and Patient-reported Outcomes: Implications for Value-based Care

INTRODUCTION

Compensation based on work relative value unit (wRVU) production is common among orthopaedic surgeons. With increased adoption of value-based payments, a greater portion of surgeon compensation will be linked to quality and outcome measures-including patient-reported outcomes. Therefore, we aimed to evaluate the relationship between wRVUs and changes in Patient-reported Outcomes Measurement Information System-Physical Function (PROMIS-PF) scores to assess whether wRVUs could serve as a marker of patient-reported functional improvements.

METHODS

A retrospective review of 2,996 orthopaedic surgeries at a single institution was done. Patient characteristics, total wRVUs billed by the surgeon for the case, operating room (OR) time, and change in PROMIS-PF scores from baseline to 6 months postoperatively were compared across subspecialties. Pearson correlation and multivariable linear regression were used to assess the relationship between wRVUs, OR time, and PROMIS-PF change.

RESULTS

Statistically significant differences in average wRVUs, OR times, and PROMIS-PF scores were observed across subspecialties. A strong positive correlation between wRVUs and OR time existed ( r = 0.732, P < 0.001) that explained approximately 54% of OR-time variability. A weak positive correlation between wRVUs and change in PROMIS-PF scores was observed ( r = 0.058, P = 0.002) that explained <1% of the variation. Each 1-point increase in wRVU was associated with a 3-minute increase in surgical duration (β = 3.04, P < 0.001) after controlling for demographics, comorbidities, and subspecialty, accounting for approximately 63% of OR-time variation. Each 1-point increase in wRVU was independently associated with a 0.02-point increase in PROMIS-PF change (β = 0.02, P = 0.036), explaining approximately 7% of the variation.

CONCLUSION

Across orthopaedic subspecialties, notable variability in both wRVUs and physical function improvements at 6 months postoperatively exists. Although highly correlated with surgical time, wRVUs show little association with functional improvement across subspecialties. As the transition toward value-based payment models continues, measurement of and compensation for work complexity and functional outcomes must remain separate and distinct.

Assessing Correlations and Demographic Interactions Between PROMIS25 and SRS30 in Pediatric Patients With Spinal Deformity

INTRODUCTION

Historically, patient-reported outcome measures (PROMs) have been measured using anatomy-specific instruments. However, these instruments may be influenced by the presence of concomitant illnesses not associated with the orthopaedic condition. As such, standardized PROM tool, such as PROMIS25, have been developed to assess patient outcomes. In this study, we aim to compare the correlation and association between 2 common PROMs used for pediatric patients with spinal deformity.

METHODS

This study included patients younger than 21 years who were indicated for spinal deformity surgery at our institution. All patients were invited to complete SRS-30 and PROMIS-25 instruments through an automated, electronic patient-reported outcome platform before surgery. Patient demographics were recorded and Spearman correlations were calculated between the various PROMIS and SRS domains. Correlations were compared between different baseline characteristics and demographics using a rho-to-z transformation method. Ceiling and floor effects were also investigated.

RESULTS

A total of 207 patients were enrolled in this study. The majority of PROMIS and SRS domains had moderate to strong correlations, with higher correlations observed when each instrument tried to capture the same construct. For example, there was strong correlation between PROMIS raw pain and SRS pain (ρ=-0.86, P <0.01), and PROMIS Depression and SRS Mental Health (ρ=-0.76, P <0.01). Ceiling effects ranged from 1.0 to 16.9% in SRS and 0.5 to 28.5% is PROMIS. Floor effects ranged from 0.5 to 1.5% in SRS and 0.5 to 29.0% in PROMIS. There were significant differences in the correlation between SRS Mental Health and PROMIS Depression when comparing between different sexes (male: ρ=-0.74, female: ρ=-0.59, P =0.04). In addition, there were significant differences in the correlation between SRS Mental Health and PROMIS Anxiety when comparing between different insurance payors (commercial: ρ=-0.86, female: ρ=-0.75, P =0.03).

CONCLUSIONS

There is strong correlation between SRS and PROMIS domains in pediatric patients with spinal deformity. These correlations can differ by baseline characteristics and demographics. Providers should consider these differences when interpreting PROMs in diverse patient populations.

LEVEL OF EVIDENCE

Level III; Retrospective comparative study.

Crosswalk between the PROMIS physical function CAT and PROMIS upper extremity CAT v1.2 in a hand surgery population

BACKGROUND

There is no gold standard patient-reported outcome measure (PROM) in hand surgery. As a result, a diverse array of PROM instruments have been utilized across centers over time. Lack of score interchangeability limits the ability to compare or conglomerate scores when new instruments are introduced. Our aim was to develop a linkage for the PROMIS UE CAT v1.2 and PROMIS PF CAT scores and develop crosswalk tables for interconversion between these PROMs.

METHODS

Retrospective review was conducted to identify adult (≥ 18y) patients seen by orthopaedic hand surgeons at a single academic tertiary care hospital who had completed PROMIS UE CAT v1.2 and PROMIS PF CAT score at the same visit. For those with multiple visits, only one randomly selected visit was included in the analyses. Pearson's correlation was calculated to determine the linear relationship between the scores. Linkage from PF to UE was performed utilizing several commonly utilized equating models (identity, mean, linear, equipercentile and circle-arc methods). The performance of the models was assessed using intraclass correlation (ICC) between observed PROMIS UE CAT v1.2 and estimated PROMIS UE CAT v1.2 scores generated using the model as well as Root Mean Square Error (RMSE). The model chosen as the 'best' was further assessed for population invariance using root expected mean squared difference (REMSD) where < 0.08 were considered good.

RESULTS

Of 10,081 included patients, mean age was 48.3 (SD = 17.0), and 54% were female (5,477/10,081). Mean UE CAT v1.2 and PF CAT scores were 37 (SD = 9.8) and 46 (SD = 10.0), respectively. There was a strong correlation between the scores (Pearson correlation r = 0.70). All methods performed acceptably (ICC ≥ 0.66 and RMSE < = 7.52 for all). The equipercentile method had the highest ICC (ICC = 0.70 (95% CI 0.69-0.71)) while the mean and circle arc methods had the lowest RMSE. The circle arc method is the most reliable with the smallest standard error and has satisfactory population invariance across age group (REMSD 0.065) and sex (REMSD 0.036).

CONCLUSIONS

Crosswalk tables to be used for bidirectional conversion between scores were created.

LEVEL OF EVIDENCE

III.

Social vulnerability adversely affects emergency-department utilization but not patient-reported outcomes after total joint arthroplasty

INTRODUCTION

Multiple studies demonstrate social deprivation is associated with inferior outcomes after total hip (THA) and total knee (TKA) arthroplasty; its effect on patient-reported outcomes is debated. The primary objective of this study evaluated the relationship between social vulnerability and the PROMIS-PF measure in patients undergoing THA and TKA. A secondary aim compared social vulnerability between patients who required increased resource utilization or experienced complications and those who didn't.

MATERIALS AND METHODS

A retrospective review of 537 patients from March 2020 to February 2022 was performed. The Centers for Disease Control Social Vulnerability Index (SVI) were used to quantify socioeconomic disadvantage. The cohort was split into THA and TKA populations; univariate and multivariate analyses were performed to evaluate primary and secondary outcomes. Statistical significance was assessed at p < 0.05.

RESULTS

48.6% of patients achieved PROMIS-PF MCID at 1-year postoperatively. Higher levels of overall social vulnerability (0.40 vs. 0.28, p = 0.03) were observed in TKA patients returning to the ED within 90-days of discharge. Increased overall SVI (OR = 9.18, p = 0.027) and household characteristics SVI (OR = 9.57, p = 0.015) were independent risk factors for 90-day ED returns after TKA. In THA patients, increased vulnerability in the household type and transportation dimension was observed in patients requiring 90-day ED returns (0.51 vs. 0.37, p = 0.04).

CONCLUSION

Despite an increased risk for 90-day ED returns, patients with increased social vulnerability still obtain good 1-year functional outcomes. Initiatives seeking to mitigate the effect of social deprivation on TJA outcomes should aim to provide safe alternatives to ED care during early recovery.

The Promising 2-Year Performance of the Patient-Reported Outcomes Measurement Information System in Primary Hip Arthroscopy for Femoroacetabular Impingement Syndrome

BACKGROUND

Minimal clinically important difference (MCID) and patient acceptable symptom state (PASS) thresholds have been previously defined for the Patient-Reported Outcomes Measurement Information System (PROMIS) at 1-year follow-up in patients undergoing hip arthroscopy for femoroacetabular impingement syndrome; however, the MCID and PASS thresholds are yet to be defined for the PROMIS at 2-year follow-up.

PURPOSE

(1) To establish MCID and PASS thresholds for the PROMIS Pain Interference (PROMIS-PI) and PROMIS Physical Function (PROMIS-PF) at 2-year follow-up and (2) to correlate PROMIS scores with hip-specific patient-reported outcome measure (PROM) scores.

STUDY DESIGN

Cohort study (diagnosis); Level of evidence, 3.

METHODS

Patients undergoing primary hip arthroscopy for femoroacetabular impingement syndrome between August and November 2020 with preoperative and minimum 2-year postoperative data were identified. Collected scores included those for the PROMIS-PI, PROMIS-PF, Hip Outcome Score-Activities of Daily Living (HOS-ADL), Hip Outcome Score-Sports Subscale (HOS-SS), International Hip Outcome Tool-12 (iHOT-12), and visual analog scale (VAS) for pain. MCID thresholds were calculated using the distribution-based method and PASS thresholds using the anchor-based method. Pearson correlation coefficients were used to compare scores between PROMs.

RESULTS

A total of 65 patients met the criteria for inclusion (72.3% female; mean age, 36.9 ± 13.5 years; mean body mass index, 26.2 ± 6.0). The mean follow-up was 25.3 ± 3.3 months. Significant preoperative to postoperative improvements were observed for all PROMs (P < .001). MCID thresholds and achievement rates were as follows: HOS-ADL, 10.1 and 75%, respectively; HOS-SS, 13.8 and 79%, respectively; iHOT-12, 14.0 and 67%, respectively; VAS pain, -13.8 and 78%, respectively; PROMIS-PI, -4.7 and 65%, respectively; and PROMIS-PF, 5.8 and 60%, respectively. PASS thresholds and achievement rates were as follows: HOS-ADL, 78.7 and 67%, respectively; HOS-SS, 76.4 and 62%, respectively; iHOT-12, 67.4 and 60%, respectively; VAS pain, 25.5 and 61%, respectively; PROMIS-PI, 57.0 and 65%, respectively; and PROMIS-PF, 45.6 and 58%, respectively. PROMIS-PI scores correlated most strongly with HOS-ADL (r = -0.836), HOS-SS (r = -0.767), and iHOT-12 (r = -0.719) scores and exhibited at least moderate correlations (r≥-0.595) with the other PROM scores. PROMIS-PF demonstrated moderate correlations with all the other PROM scores (r≥-0.586). Strong correlations were seen between the hip-specific PROM scores (r≥-0.745).

CONCLUSION

This study defined 2-year MCID and PASS thresholds for the PROMIS-PI and PROMIS-PF and demonstrated moderate to strong correlations between PROMIS scores and hip-specific PROM scores.

Patient-reported outcomes measurement information system depression psychometrically underperforms compared to legacy measures and is poorly associated with postoperative functional outcomes in shoulder arthroplasty patients

Background

The purpose of this study was to investigate the associations between each mental health patient-reported outcome measure with postoperative functional outcomes following shoulder arthroplasty, and to compare psychometric properties of patient-reported outcomes measurement information system depression to the legacy (VR-12 Mental) patient-reported outcome measure.

Methods

Patients who underwent primary shoulder arthroplasty from July 2018 to February 2019 were retrospectively reviewed. Patient-reported outcomes measurement information system depression and VR-12 Mental were administered preoperatively; American Shoulder and Elbow Surgeons and Single Assessment Numeric Evaluation were administered at 6-month and 1-year postoperatively. Rasch partial credit modeling analysis was used to compare psychometric properties of legacy versus patient-reported outcomes measurement information system instruments in assessing mental health.

Results

Ninety-three patients who underwent total shoulder arthroplasty (n = 52), reverse total shoulder arthroplasty (n = 39), or hemiarthroplasty (n = 2) were included. Preoperative VR-12 Mental scores were moderately associated with American Shoulder and Elbow Surgeons at 6-months (coefficient: 0.52, P = 0.026) and 1-year (coefficient: 0.65, P = 0.002), while preoperative patient-reported outcomes measurement information system depression scores were not. Patient-reported outcomes measurement information system depression demonstrated significant floor effects (16%); VR-12 Mental demonstrated minimal floor and ceiling effects (1.1% for both). VR-12 Mental demonstrated broader coverage of mental outlook on Rasch modeling than patient-reported outcomes measurement information system depression and had adequate model fit after one round of reiterative item elimination.

Discussion

Patient-reported outcomes measurement information system depression was poorly associated with postoperative American Shoulder and Elbow Surgeons scores, demonstrated significant floor effects, and had limited coverage of mental health on Rasch modeling with reiterative elimination.

Level of Evidence

IV.

Many patients fail to achieve MCID for PROMIS upper extremity and pain interference following nonoperative management of rotator cuff tears

Background

Efficacy of nonoperative treatment for rotator cuff tears has been debated, especially for full-thickness tears. The purpose of this study was to a) define the minimal clinically important difference (MCID) of nonoperative treatment with regard to Patient-Reported Outcomes Measurement Information System (PROMIS) pain interference (PI) and upper extremity (UE), and b) determine the proportion of patients with both partial and full-thickness tears (PTRCT, FTRCT) who achieve this improvement following initial nonoperative treatment. We hypothesized that >75% of PTRCT and FTRTC patients would achieve MCID for PROMIS PI and UE.

Methods

We performed a retrospective cohort study evaluating nonoperatively managed patients with image-confirmed PTRCT and FTRCT. Treatment modalities and follow-up PROMIS scores at least 6 months after their initial visit were recorded. Using a distribution technique, MCID was calculated.

Results

A total of 111 FTRCT and 68 PTRCT patients were included with at least 6 months of follow-up. At 6 months from initial presentation, the MCID for PROMIS UE was 3.75 and 3.95 for FTRCT and PTRCT patients, respectively. For PROMIS PI, the MCID was 3.35 and 3.90 for FTRCT and PTRCT, respectively. In total, 41% of FTRCT and 41% of PTRCT achieved MCID for PROMIS UE. Thirty-four percent of FTRCT and 35% of PTRCT achieved MCID for PROMIS PI.

Conclusion

The majority of patients undergoing nonoperative treatment for supraspinatus/infraspinatus rotator cuff tears did not achieve MCID at 6 months for PROMIS PI (34% for FTRCT and 35% for PTRCT) or UE (41% for FTRCT and 41% for PTRCT).

PROMIS physical function and pain perform poorly psychometrically in patients undergoing medial patellofemoral ligament reconstruction

PURPOSE

The purpose of this study was to assess the validity, floor and ceiling effects, and dimensionality of PROMIS Physical Function (PF) and Pain compared to legacy patient reported outcome (PRO) measures in patients undergoing medial patellofemoral ligament (MPFL) reconstruction.

METHODS

Patients who underwent MPFL reconstruction between 2018 to 2020 were retrospectively reviewed. Preoperatively, patients completed the IKDC, VR-12, Kujala, SF-12, KOOS JR, PROMIS PF and Pain surveys. Inter-survey convergence was assessed with Spearman correlations. Psychometric analysis included investigations of inter-survey convergent validity, intra-survey floor and ceiling effects, and Rasch analyses with person-item fit and iterative question elimination model fit testing.

RESULTS

A total of 76 patients (mean age: 22.6 ± 8.4 years) who completed preoperative surveys were included (compliance: 91.7-96.2%). Preoperatively, age was significantly associated with both PROMIS PF (coefficient:  - 0.291, P = 0.005) and Pain scores (coefficient: 0.294, P = 0.002). PROMIS PF had a Very Good correlation with IKDC and PROMIS Pain had a Very Good correlation with KOOS JR. Other correlations ranged from Poor to Good. No significant floor or ceiling effects were observed for any PRO. On iterative question elimination Rasch modelling, only two questions from PROMIS PF remained after 6 rounds of elimination while PROMIS Pain had no questions remaining after 3 rounds of elimination.

CONCLUSION

Preoperative PROMIS PF and Pain provided only Fair to Good correlations with most legacy PROs. Although no significant floor and ceiling effects were observed, PROMIS PF and Pain did not perform well psychometrically in this population of patients undergoing MPFL reconstruction. These results suggest PROMIS questionnaires should be used with caution in this population, especially if used in isolation, when discussing clinical expectations with patients. The authors recommend continued use of legacy PROs specific to assessment of patellar instability and function that have established validity in patellar instability populations.

LEVEL OF EVIDENCE

Level IV.

Effects of increased body mass index on one year outcomes following soft tissue arthroscopic shoulder instability repair

Background

The purpose of this study was to investigate the impact of high body mass index on the 1-year minimal outcome following arthroscopic shoulder stabilization.

Methods

Patients who underwent arthroscopic Bankart repair (ABR) between 2017 and 2021 were identified and assigned to 1 of 3 cohorts based on their preoperative body mass index: normal (18-25), overweight (25-30), and obese (>30). The primary outcomes assessed were postoperative shoulder instability and revision rates. The 3 groups were compared using the Patient-Reported Outcomes Measurement Information System (PROMIS) upper extremity, pain interference, pain intensity, Clinical Global Impression scores, visual analog scale pain scores, and shoulder range of motion at 1 year postoperatively.

Results

During the study period, 142 patients underwent ABR and had an average age of 35 ± 10 years. Obese patients had a higher percentage of partial rotator cuff tears (60% vs. 27%, odds ratio: 3.2 [1.1, 9.2]; P = .009), longer mean operative time (99.8 ± 40.0 vs. 75.7 ± 28.5 minutes; P < .001), and shorter time to complication (0.5 ± 0 vs. 7.0 ± 0 months; P = .038). After controlling for confounding factors, obesity was associated with a lesser improvement in upper extremity function scores (obese vs. normal: -4.9 [-9.4, -0.5]; P = .029); although this difference exists, found future studies are needed to determine the clinical significance. There were no differences in patient reported outcome measures, recurrence rate, or revision surgery rates between cohorts at any time point (P > .05).

Conclusion

Obesity is an independent risk factor for longer operative times but does not confer a higher risk of recurrent instability, revision surgery, or lower outcome scores 1 year following ABR.

Effect of Insurance Reimbursement Status on Pre- and Postoperative Patient-Reported Outcomes Measurement Information System (PROMIS) Scores After Arthroscopic Rotator Cuff Repair

BACKGROUND

Previous studies reported inferior patient-reported outcomes (PROs) after arthroscopic rotator cuff repair for patients receiving workers' compensation (WC) relative to patients with commercial insurance. The extent to which alternative insurance reimbursement, including Medicaid and Medicare, influences outcomes after arthroscopic rotator cuff repair remains understudied.

HYPOTHESIS

Compared with patients with commercial insurance reimbursement, patients with WC or government-issued reimbursement would report lower pre- and postoperative Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) scores, report higher pre- and postoperative PROMIS Depression (D) and Pain Interference (PI) scores, and experience smaller levels of improvement in all PROMIS domains with surgical intervention.

STUDY DESIGN

Cohort study; Level of evidence, 3.

METHODS

Demographic and surgical data were extracted from the medical record, and PROMIS domains were prospectively collected. Patients were divided into cohorts based on insurance reimbursement status. Differences between insurance-based cohorts for baseline variables, pre- and postoperative PROMIS scores, and change from baseline to final follow-up (delta) for PROMIS scores were evaluated using Kruskal-Wallis or chi-square tests. Mixed-effects linear regression models were performed to assess the influence of insurance while controlling for other variables. Survival analysis was performed to determine time to achieve minimal clinically important difference (MCID) for each PROMIS domain per cohort.

RESULTS

1252 patients underwent arthroscopic rotator cuff repair, met inclusion criteria, and completed PROMIS questionnaires. Statistically significant differences were noted in demographic variables including age (P < .001), sex (P < .001), ethnicity (P < .001), and body mass index (P < .001) between insurance-based cohorts. Unadjusted analysis revealed significantly higher PF scores and lower PI and D scores for the group with commercial insurance relative to those with Medicare, Medicaid, and WC at 6- and 12-month follow-up (P < .01 all comparisons), except for the Medicare versus commercial subcohort analysis for PI at 6 months (P = .28). These differences persisted for the Medicare, Medicaid, and WC groups (P < .03 all comparisons) after adjustment for confounding variables in linear regression.

CONCLUSIONS

The baseline characteristics of patients undergoing arthroscopic rotator cuff repair differed based on insurance reimbursement. Patients with commercial insurance reported improved physical function, decreased pain interference, and improved mood (less depression) relative to patients with government-issued and WC insurance, with maximum improvement 6 to 12 months postoperatively. There were few significant differences between insurance groups in change of PROMIS scores from preoperative to postoperative intervals, indicating that differences in the baseline demographic and surgical characteristics of these groups accounted for differences in response to surgery.

Longitudinal Predictors of PROMIS Satisfaction With Social Roles and Activities After Shoulder and Knee Sports Orthopaedic Surgery in United States Military Servicemembers: An Observational Study

Background

Satisfaction with social roles and activities is an important outcome for postsurgical rehabilitation and quality of life but not commonly assessed.

Purpose

To evaluate longitudinal patterns of the Patient-Reported Outcomes Measurement Information System (PROMIS) Satisfaction with Social Roles and Activities measure, including how it relates to other biopsychosocial factors, before and up to 6 months after sports-related orthopaedic surgery.

Study Design

Cohort study (diagnosis); Level of evidence, 3.

Methods

Participants (N = 223) who underwent knee and shoulder sports orthopaedic surgeries between August 2016 and October 2020 completed PROMIS computer-adaptive testing item banks and pain-related measures before surgery and at 6-week, 3-month, and 6-month follow-ups. In a generalized additive mixed model, covariates included time point; peripheral nerve block; the PROMIS Anxiety, Sleep Disturbance, and Pain Behavior measures; and previous 24-hour pain intensity. Patient-reported outcomes were modeled as nonlinear (smoothed) effects.

Results

The linear (estimate, 2.06; 95% CI, 0.77-3.35; P = .002) and quadratic (estimate, 2.93; 95% CI, 1.78-4.08; P < .001) effects of time, as well the nonlinear effects of PROMIS Anxiety (P < .001), PROMIS Sleep Disturbance (P < .001), PROMIS Pain Behavior (P < .001), and pain intensity (P = .02), were significantly associated with PROMIS Satisfaction with Social Roles and Activities. The cubic effect of time (P = .06) and peripheral nerve block (P = .28) were not. The proportion of patients with a 0.5-SD improvement in the primary outcome increased from 23% at 6 weeks to 52% by 6 months postsurgery, whereas those reporting worsening PROMIS Satisfaction with Social Roles and Activities decreased from 30% at 6 weeks to 13% at 6 months.

Conclusion

The PROMIS Satisfaction with Social Roles and Activities measure was found to be related to additional domains of function (eg, mental health, behavioral, pain) associated with postsurgical rehabilitation.

Editorial Commentary: Legacy Patient-Reported Outcome Measures Remain Important Today Despite Responder Burden, but With Further Refinement, Patient-Reported Outcomes Measurement Information System Could Replace Legacy Instruments in the Future

Measuring patient-reported outcomes (PROs) is a key tenet in the drive toward value-based care. A more detailed understanding of outcomes has traditionally been obtained with increasingly frequent and more in-depth patient questionnaires. Legacy PROs require patients to complete a predetermined set of questions. Administering lengthy surveys repeatedly can generate respondent fatigue that compromises quality of the survey responses and overall compliance. In addition, these legacy scales have notable ceiling and floor effects, which limit their capacity to describe the condition of patients who are functioning at relatively high or low levels. Modern computer adaptive instruments, such as PROMIS, strive to minimize responder burden and mitigate floor and ceiling effects associated with many legacy instruments. However, although these new newer instruments correlate (moderately) with legacy scores, PROMIS also shows floor and ceiling effects, and PROMIS responsiveness is currently understudied. Today, we collect both PROMIS and legacy scores for tracking patient outcomes and for research purposes. We predict that with further refinement, PROMIS will replace legacy patient-reported outcome measures.

Assessment of Patient-Reported Physical Function in Persons With Upper Extremity Amputation: Comparison of Short Form Instruments

OBJECTIVE

The aim of the study was to compare psychometric properties of the Patient-Reported Outcomes Measurement Information System upper extremity measure (PROMIS UE) 7-item short form with 6- and 13-item versions for persons with upper limb amputation.

DESIGN

The study used a telephone survey of 681 persons with upper limb amputation. Versions were scored two ways: PROMIS health measure scoring (PROMIS UE HMSS) and sample-specific calibration (PROMIS UE AMP). Factor analyses and Rasch analyses evaluated unidimensionality, monotonicity, item fit, differential item functioning, and reliability. Known group validity was compared for all versions.

RESULTS

Model fit was acceptable for PROMIS-6 UE AMP and marginally acceptable for PROMIS-13 UE AMP and PROMIS-7 UE AMP. Item response categories were collapsed because of disordered categories. A total of 91.4% of participants had PROMIS-13 UE AMP scores with reliability greater than 0.8, compared with 70.4% for PROMIS-7 UE AMP, and 72.1% for PROMIS-6 UE AMP versions. No differences were observed by prosthesis use. Scores differed by amputation for all measures except the HMSS scored 13- and 7-item versions.

CONCLUSIONS

The PROMIS-13 UE AMP short form was superior to the health measures scoring system scored PROMIS-7 UE or PROMIS-6 UE, and to the PROMIS-7 UE AMP and PROMIS-6 UE AMP. Issues with known group validation suggest a need for a population-specific measure of upper extremity function for persons with upper limb amputation.

Race and Socioeconomic Status Are Associated With Inferior Patient-Reported Outcome Measures Following Rotator Cuff Repair

PURPOSE

To investigate the impact social determinants of health (SDOH) have on National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive test scores and postoperative health care use in patients who undergo rotator cuff repair (RCR).

METHODS

All patients who underwent RCR surgery by 3 shoulder and/or sports medicine fellowship-trained orthopaedic surgeons between July 2017 and January 2020 were included. The electronic medical record (EMR) was used to identify SDOH for each patient. PROMIS computer adaptive test measures of Upper Extremity function, Pain Interference, and Depression were completed preoperatively and postoperatively (6 months and 1 year). Postoperative health care use (clinical visits, virtual encounters, imaging encounters, and physical therapy visits) were recorded as well. Univariate associations, multiple linear regressions, and Wilcoxon rank-sum tests were used to analyze mean differences between patient groups based on SDOH.

RESULTS

Three hundred thirty-eight patients who underwent RCR were included. Patients who were Black, in lower median household income quartiles, had public insurance, and female reported lower PROMIS scores compared with their counterparts. Smokers and White patients attended fewer postoperative office visits whereas Black patients had more physical therapy and nonvisit encounters compared with their respective counterparts.

CONCLUSIONS

Black race and lower socioeconomic status are associated with worse function and pain outcomes post-RCR compared with White race. Similarly, Black race and positive smoking status are associated with differential use of health care following RCR. Further attention may be required for these patients to address health care disparities.

LEVEL OF EVIDENCE

III, retrospective cohort study.

Associating Social Determinants of Health With PROMIS CAT Scores and Health Care Utilization After ACL Reconstruction

Background

The term "social determinants of health" (SDOH) refers to social and economic factors that influence a patient's health status. The effect of SDOH on the Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive test (CAT) scores and postoperative resource utilization in patients with anterior cruciate ligament reconstruction (ACLR) have yet to be thoroughly studied.

Purpose

To investigate the impact SDOH have on PROMIS CAT outcomes and postoperative resource utilization in patients with ACLR.

Study Design

Cohort study; Level of evidence, 3.

Methods

The electronic medical record was used to identify the SDOH for patients who underwent ACLR by 1 of 3 sports medicine fellowship-trained orthopaedic surgeons between July 2017 and April 2020. PROMIS CAT measures of Physical Function (PROMIS-PF), Pain Interference (PROMIS-PI), and Depression (PROMIS-D) were completed at the preoperative, 6-month postoperative, and 12-month postoperative time points. Postoperative health care utilization was recorded as well. Independent 2-group t tests and Wilcoxon rank-sum tests were used to analyze mean differences between patient groups based on SDOH.

Results

Two-hundred and thirty patients who underwent ACLR were included (mean age, 27 years; 59% male). Compared with White patients, Black patients were represented more frequently in the lowest median household income (MHI) quartile (63% vs 23%, respectively; P < .001). White patients were represented more frequently in the highest area deprivation index (ADI) quartile when compared with Black patients (67% vs 12%, respectively; P = .006). Significantly worse PROMIS-PF, PROMIS-PI, and PROMIS-D scores at all 3 time points were found among patients who were Black, female, smokers, and in the lower MHI quartiles, with higher ADI and public health care coverage. In terms of resource utilization, Black patients attended significantly fewer postoperative physical therapy visits when compared with their respective counterparts. Those in the lower MHI quartiles attended significantly fewer postoperative imaging encounters, and female patients attended significantly more postoperative virtual encounters than male patients.

Conclusion

Specific SDOH variables, particularly those that reflect racial and socioeconomic disparities, were associated with differences in postoperative health care utilization and ACLR outcomes as measured by PROMIS CAT domains.

The Effects of Lower Extremity Rotational Malalignment on Pediatric Patient-reported Outcomes Measurement and Information System (PROMIS) Scores

BACKGROUND

There is sparse literature demonstrating the relationship between lower limb pediatric idiopathic rotational malalignment (IRM) and patient-reported outcomes measurement information system (PROMIS) scores. Our goal is to determine and quantify the amount that IRM deformities, as measured with the 3D gait analysis, affect childrens' pain interference, mobility, and peer relationship PROMIS domains. Secondary outcomes include investigating the potential relationships between IRM and various subgroups (Pediatric Outcomes Data Collection Instrument (PODCI), gender, Body Mass Index (BMI), femur Versus tibia). We also examine whether the PROMIS domains correlate with PODCI in this population.

METHODS

This study was a retrospective cohort, single institution, and consecutively recruited cases series. We identified 47 children over a 3-year period who were evaluated at the motion analysis center at our tertiary care hospital, with increased torsion of the femur or tibia. After exclusions, 25 children with IRM, documented PROMIS data and gait analysis were considered.

RESULTS

Femoral malrotation had a significant relationship with female gender ( P =0.001) and increased BMI ( P <0.001). Femoral malrotation had a correlation with PROMIS pain interference ( P =0.016), whereas tibial rotation did not achieve significance ( P =0.084). In the ANOVA regression analysis, there was a strong prediction of the PROMIS mobility domain when both malrotation and pain interference were present ( P =0.007). There were Pearson Correlations of PROMIS and PODCI domains for Mobility Versus Sports ( P =0.007) and Pain Interference Versus Comfort/Pain ( P =0.004), respectively.

CONCLUSION

The evident relationship between lower limb rotational malalignment and PROMIS scores signifies the likelihood for gait and pain disturbance. This in turn could show us that children are likely to be more debilitated and thus may benefit from timely correction. We aim to conduct this as a multicentre trial to confirm our findings.

LEVEL OF EVIDENCE

Level IV.

Construct Validity of Pediatric PROMIS Computerized Adaptive Testing Measures in Children With Adolescent Idiopathic Scoliosis

BACKGROUND

The use of patient-reported outcome measures, especially Patient-Reported Outcomes Measurement Information System (PROMIS) measures, has increased in recent years. Given this growth, it is imperative to ensure that the measures being used are validated for the intended population(s)/disease(s). Our objective was to assess the construct validity of 8 PROMIS computer adaptive testing (CAT) measures among children with adolescent idiopathic scoliosis (AIS).

METHODS

We prospectively enrolled 200 children (aged 10 to 17 y) with AIS, who completed 8 PROMIS CATs (Anxiety, Depressive Symptoms, Mobility, Pain Behavior, Pain Interference, Peer Relationships, Physical Activity, Physical Stress Experiences) and the Scoliosis Research Society-22r questionnaire (SRS-22r) electronically. Treatment categories were observation, bracing, indicated for surgery, or postoperative from posterior spinal fusion. Construct validity was evaluated using known group analysis and convergent and discriminant validity analyses. Analysis of variance was used to identify differences in PROMIS T -scores by treatment category (known groups). The Spearman rank correlation coefficient ( rs ) was calculated between corresponding PROMIS and SRS-22r domains (convergent) and between unrelated PROMIS domains (discriminant). Floor/ceiling effects were calculated.

RESULTS

Among treatment categories, significant differences were found in PROMIS Mobility, Pain Behavior, Pain Interference, and Physical Stress Experiences and in all SRS-22r domains ( P <0.05) except Mental Health ( P =0.15). SRS-22r Pain was strongly correlated with PROMIS Pain Interference ( rs =-0.72) and Pain Behavior ( rs =-0.71) and moderately correlated with Physical Stress Experiences ( rs =-0.57). SRS-22r Mental Health was strongly correlated with PROMIS Depressive Symptoms ( rs =-0.72) and moderately correlated with Anxiety ( rs =-0.62). SRS-22r Function was moderately correlated with PROMIS Mobility ( rs =0.64) and weakly correlated with Physical Activity ( rs =0.34). SRS-22r Self-Image was weakly correlated with PROMIS Peer Relationships ( rs =0.33). All unrelated PROMIS CATs were weakly correlated (| rs |<0.40). PROMIS Anxiety, Mobility, Pain Behavior, and Pain Interference and SRS-22r Function, Pain, and Satisfaction displayed ceiling effects.

CONCLUSIONS

Evidence supports the construct validity of 6 PROMIS CATs in evaluating AIS patients. Ceiling effects should be considered when using specific PROMIS CATs.

LEVEL OF EVIDENCE

Level II, prognostic.

Risk factors for failure to achieve minimal clinically important difference and significant clinical benefit in PROMIS computer adaptive test domains in patients undergoing rotator cuff repair

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS) has emerged as a valid and efficient means of collecting outcomes in patients with rotator cuff tears. The purpose of this study was to establish threshold score changes to determine minimal clinically important difference (MCID) and substantial clinical benefit (SCB) in PROMIS computer adaptive test (CAT) scores following rotator cuff repair (RCR). Additionally, we sought to identify potential risk factors for failing to achieve MCID and SCB.

METHODS

Patients undergoing arthroscopic RCR were identified over a 24-month period. Only patients who completed both preoperative and postoperative PROMIS CAT assessments were included in this cohort. PROMIS CAT forms for upper extremity physical function (PROMIS-UE), pain interference (PROMIS-PI), and depression (PROMIS-D) were used with a minimum of 1.5-year follow-up. Statistical analysis was performed to determine threshold score changes to determine anchor-based MCID and SCB, as well as risk factors for failure to achieve significant clinical improvement following surgery.

RESULTS

Of 198 eligible patients, 168 (84.8%) were included in analysis. ΔPROMIS-UE values of 5.8 and 9.7 (area under the curve [AUC] = 0.906 and 0.949, respectively) and ΔPROMIS-PI values of -11.4 and -12.9 (AUC = 0.875 and 0.938, respectively) were identified as threshold predictors of MCID and SCB achievement. On average, 81%, 65%, and 55% of patients achieved MCID for PROMIS-UE, PROMIS-PI, and PROMIS-D whereas 71%, 61%, and 38% of patients in the cohort, respectively, achieved SCB. MCID achievement in PROMIS-UE significantly differed according to risk factors, including smoking status (likelihood ratio [LR]: 9.8, P = .037), tear size (LR: 10.4, P < .001), distal clavicle excision (LR: 6.1, P = .005), and prior shoulder surgery (LR: 19.2, P < .001). Factors influencing SCB achievement for PROMIS-UE were smoking status (LR: 9.3, P = .022), tear size (LR: 8.0, P = .039), and prior shoulder surgery (11.9, P < .001). Significantly different rates of MCID and SCB achievement in PROMIS-PI for smoking status (LR: 7.0, P = .030, and LR: 5.2, P = .045) and prior shoulder surgery (LR: 9.1, P = .002, and LR: 7.4, P = .006) were also identified.

DISCUSSION AND CONCLUSION

The majority of patients showed clinically significant improvements that exceeded the established MCID for PROMIS-UE and PROMIS-PI following RCR. Patients with larger tear sizes, a history of prior shoulder surgery, tobacco users, and those who received concomitant distal clavicle excision were at risk for failing to achieve MCID in PROMIS-UE. Additionally, smokers and patients who underwent prior shoulder surgery demonstrated significantly lower improvements in pain scores following surgery.

The Current Utilization of Patient-reported Outcome Measurement Information System in Shoulder, Elbow, and Sports Medicine

Clinical research using patient-reported outcome measures has been critical within the field of shoulder, elbow, and sports medicine in helping clinicians deliver evidence-based and value-based medicine. Recently, however, clinicians have advocated for improving the process of obtaining clinically meaningful information from patients while decreasing survey fatigue and increasing compliance. To that end, the National Institutes of Health created the Patient-Reported Outcome Measures Information System (PROMIS) in which a number of institutions and research investigations have adopted for reporting outcomes. A special focus has also been placed on PROMIS Computer Adaptive Testing forms, which tailor questioning through item response theory. The purpose of this study was to provide insight into the utilization, advantages, and disadvantages of PROMIS within the field of shoulder, elbow, and sports medicine and provide a comparison with legacy patient-reported outcome measure measurements.

Patients With Metastatic Disease Are at Highest Risk for Anxiety and Depression in an Orthopedic Oncology Patient Population

PURPOSE

Patients with cancer are at risk for anxiety and depression; however, the patterns and predictors of symptoms in an orthopedic oncology population have not been studied.

METHODS

We retrospectively reviewed Patient-Reported Outcomes Measurement Information System scores of all adult patients who underwent palliative surgery for metastatic cancer, resection of a sarcoma, or nononcologic total joint arthroplasty at a single institution from 2015 to 2020. Backward stepwise linear regression was used to determine risk factors for perioperative anxiety and depression.

RESULTS

Postoperative anxiety and depression were more prevalent in patients with metastatic disease than localized cancer or nononcologic conditions (P < .001 and P < .001, respectively). Worse preoperative pain and function were associated with higher preoperative anxiety (β = .321, P = .001; β = -.236, P = .012, respectively) and depression (β = .245, P = .009; β = -.279, P = .003, respectively). Worse preoperative anxiety, preoperative depression, and postoperative pain were associated with higher postoperative anxiety (β = .204, P = .012; β = .260, P = .001; β = .447, P < .001, respectively). Worse preoperative depression and postoperative pain also predicted higher postoperative depression (β = .542, P < .001; β = .325, P < .001, respectively).

CONCLUSION

Anxiety and depression were most prevalent in patients with metastatic disease. Compared with total joint arthroplasty patients, patients with cancer less frequently experienced postoperative improvements in anxiety and depression. Worse preoperative pain and function were independently associated with greater preoperative anxiety and depression. Providers should maintain awareness of the relationship between mental and physical health to optimize outcomes.

Predictors of PROMIS Physical Function at 2 Years following Knee Surgery

The purpose of this study was to evaluate Patient-Reported Outcomes Measurement Information System physical function (PROMIS PF) 2 years following knee surgery, and identify preoperative factors associated with postoperative PROMIS PF. Three hundred and sixty-five patients, age 17 years and older, undergoing knee surgery at one institution were studied. Patients completed multiple questionnaires prior to surgery and again 2 years postoperatively including PROMIS PF, International Knee Documentation Committee (IKDC), joint and body numeric pain scales (NPS), Tegner's activity scale (TAS), and Marx's activity rating scale (MARS). Mean PROMIS PF improved from 41.4 to 50.9 at 2 years postoperatively (p < 0.001) and was strongly correlated with 2-year IKDC scores. Older age, female gender, non-Hispanic ethnicity, unemployment, lower income, government insurance, smoking, preoperative opioid use, having a legal claim, comorbidities, previous surgeries, higher body mass index (BMI), and knee arthroplasty were associated with worse 2-year PROMIS PF. Multivariable analysis confirmed that lower BMI, less NPS body pain, and higher MARS were independent predictors of greater 2-year PROMIS PF and better improvement in PROMIS PF. In this large, broad cohort of knee surgery patients, multiple preoperative factors were associated with PROMIS PF 2 years postoperatively. PROMIS PF scores improved significantly, but worse 2 year PROMIS PF scores and less improvement from baseline were independently predicted by higher BMI, greater NPS body pain, and lower MARS activity level. PROMIS PF can be implemented as an efficient means to assess outcomes after knee surgery.

Patient-Reported Outcomes Measurement Information System physical function instruments compare favorably to legacy patient-reported outcome measures in spine patients: a systematic review of the literature

BACKGROUND CONTEXT

Preliminary evidence has suggested favorable correlation between National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS) assessments and traditional ("legacy") patient reported outcome measures (PROMs) in spine surgery. There has been a significant increase in PROMIS research with regards to spinal conditions.

PURPOSE

The purpose of this systematic review is to provide an assessment of PROMIS Physical Function (PF) measures in this patient population.

STUDY DESIGN/SETTING

Systematic review.

METHODS

A systematic search of the PubMed/MEDLINE and Embase databases was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to identify published articles that referenced the various PROMIS PF measures. Two authors independently reviewed selected studies. The search returned 1,060 studies, 124 of which were selected for independent review by two authors. Of these, 37 were selected for inclusion. Mixed linear models were performed to assess for differences between legacy PROMs and PROMIS measures.

RESULTS

The combined sample size of all included studies yielded 10,296 total patients. Overall, PROMIS Physical Function (PF) measures demonstrated strong correlations with legacy PROMs when evaluating spine patients (weighted Pearson correlation, 0.589, standard error [SE]=0.023; weighted Spearman correlation, 0.702, SE=0.028). PROMIS questionnaires had significantly fewer questions than did legacy PROMs (4.2±0.30 vs. 9.53±0.82, p=.015). In spine studies, the PROMIS PF forms were completed in significantly less time than legacy PROMs (48.1±2.9 vs. 174.7±12.6 seconds, p<.001). The differences for the reliability measures and the floor and ceiling effects were not significant.

CONCLUSIONS

Patient-Reported Outcomes Measurement Information System PF forms compare favorably with legacy PROMs with regard to correlations, ease of use, and quality criteria in the field of spine surgery. PROMIS PF scores correlate strongly with commonly used legacy PROMs, particularly in spine patients. Patient-Reported Outcomes Measurement Information System PF forms can be administered efficiently and to a broad patient population while remaining highly reliable.

PROMIS Upper Extremity underperforms psychometrically relative to American Shoulder and Elbow Surgeons score in patients undergoing primary rotator cuff repair

BACKGROUND

A number of patient-reported outcome measure (PROM) instruments are used to assess shoulder pain, function, and postoperative satisfaction. Computer adaptive tests (CATs) have been developed in an effort to tailor question delivery, decrease time to completion and floor/ceiling effects, and increase compliance. Previous investigations have demonstrated excellent correlation between Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity CAT (UE-CAT) and American Shoulder and Elbow Surgeons (ASES) instruments, indicating that the PROMIS UE-CAT may be an acceptable alternative to the ASES. Prior to widespread adoption, however, rigorous psychometric validation must be performed. Thus, the purpose of this study was to evaluate the psychometric properties of PROMIS UE-CAT relative to the ASES score in patients undergoing primary rotator cuff repair (RCR).

METHODS

A retrospective study of an institutional RCR registry was performed from July 2018 through March 2019. Preoperative PROMIS UE-CAT and ASES scores were collected. Floor and ceiling effects were determined, and convergent validity was established through Pearson correlations. Rasch partial credit modeling was used for psychometric analysis of the validity of PROMIS UE-CAT and ASES question items, a previously established methodology for assessing shoulder PROMs. Person-item maps were generated to characterize the distribution of question responses along the latent dimension of shoulder disability.

RESULTS

Responses from 107 patients (107 shoulders) were included. PROMIS UE-CAT had a strong correlation to ASES (r = 0.684; P < .001), with a 3.7% floor effect and no ceiling effect; ASES had no floor or ceiling effects. PROMIS UE-CAT person-item maps revealed excellent test item coverage between floor and ceiling effects; however, all PROMIS UE-CAT items except "Difficulty putting on a jacket" demonstrated nonsequentially ordered responses, indicating poor reliability of item responses corresponding to shoulder function. Although PROMIS UE-CAT initially demonstrated superior instrument efficiency with fewer test items for overall equivalent coverage of shoulder function assessment, final models after recursive item elimination revealed the ASES instrument to have more well-fitting items over a broader range of shoulder function.

CONCLUSION

Despite its overall strong correlation with ASES and equivalent coverage between floor and ceiling effects, the psychometric properties of PROMIS UE-CAT indicate a need for optimization of individual test items to correspond to shoulder function. Until further refinements in the PROMIS UE-CAT instrument are made, it should not replace the ASES instrument in patients undergoing primary RCR.

The performance of PROMIS computer adaptive testing for patient-reported outcomes in hip fracture surgery: a pilot study

INTRODUCTION

Patient-reported outcome measures (PROMs) are essential to patient-centered care in orthopaedics. PROMIS measures have demonstrated reliability, validity, responsiveness, and minimal floor and ceiling effects in various populations of patients receiving orthopaedic care but have not yet been examined in hip fracture patients. This pilot study sought to evaluate the psychometric performance of the PROMIS Physical Function (PROMIS PF) and Pain Interference (PROMIS PI) computer adaptive tests and compare these instruments with legacy outcome measures in hip fracture patients.

METHODS

This study included 67 patients who were 27-96 years old (median 76) and underwent osteosynthesis for a proximal femoral fracture. At 3, 6, and/or 12 months follow-up, patients completed both legacy (mHHS, SF-36-PCS, and VAS for pain) and PROMIS questionnaires (PROMIS PF and PROMIS PI). Respondent burden and floor/ceiling effects were calculated for each outcome measure. Correlation was calculated to determine concurrent validity between related constructs.

RESULTS

A strong correlation was found between PROMIS PF and mHHS (rho = 0.715, p < 0.001) and moderately strong correlation between PROMIS PF and SF-36 PCS (rho = 0.697, p < 0.001). There was also a moderately strong correlation between the VAS and the PROMIS PI (rho = 0.641, p < 0.001). Patients who completed PROMIS PF were required to answer significantly fewer questions as compared with legacy PROMs (mHHS, SF-36). For the PROMIS measures, 1% of patients completing PROMIS PF achieved the highest allowable score while 34% of patients completing PROMIS PI achieved the lowest allowable score. Of the legacy outcome measures, 31% of patients completing the VAS for pain achieved the lowest allowable score and 7% of patients completing the mHHS achieved the highest allowable score.

CONCLUSIONS

The results of this study support the validity of PROMIS CATs for use in hip fracture patients. The PROMIS PF was significantly correlated with SF-36 PCS and mHHS while requiring fewer question items per patient relative to the legacy outcome measures.

How Should We Measure Social Deprivation in Orthopaedic Patients?

BACKGROUND

Social deprivation negatively affects a myriad of physical and behavioral health outcomes. Several measures of social deprivation exist, but it is unclear which measure is best suited to describe patients with orthopaedic conditions.

QUESTIONS/PURPOSES

(1) Which measure of social deprivation, defined as "limited access to society's resources due to poverty, discrimination, or other disadvantage," is most strongly and consistently correlated with patient-reported physical and behavioral health in patients with orthopaedic conditions? (2) Compared with the use of a single measure alone, how much more variability in patient-reported health does the simultaneous use of multiple social deprivation measures capture?

METHODS

Between 2015 and 2017, a total of 79,818 new patient evaluations occurred within the orthopaedic department of a single, large, urban, tertiary-care academic center. Over that period, standardized collection of patient-reported health measures (as described by the Patient-reported Outcomes Measurement Information System [PROMIS]) was implemented in a staged fashion throughout the department. We excluded the 25% (19,926) of patient encounters that did not have associated PROMIS measures reported, which left 75% (59,892) of patient encounters available for analysis in this cross-sectional study of existing medical records. Five markers of social deprivation were collected for each patient: national and state Area Deprivation Index, Medically Underserved Area Status, Rural-Urban Commuting Area code, and insurance classification (private, Medicare, Medicaid, or other). Patient-reported physical and behavioral health was measured via PROMIS computer adaptive test domains, which patients completed as part of standard care before being evaluated by a provider. Adults completed the PROMIS Physical Function version 1.2 or version 2.0, Pain Interference version 1.1, Anxiety version 1.0, and Depression version 1.0. Children ages 5 to 17 years completed the PROMIS Pediatric Mobility version 1.0 or version 2.0, Pain Interference version 1.0 or version 2.0, Upper Extremity version 1.0, and Peer Relationships version 1.0. Age-adjusted partial Pearson correlation coefficients were determined for each social deprivation measure and PROMIS domain. Coefficients of at least 0.1 were considered clinically meaningful for this purpose. Additionally, to determine the percentage of PROMIS score variability that could be attributed to each social deprivation measure, an age-adjusted hierarchical regression analysis was performed for each PROMIS domain, in which social deprivation measures were sequentially added as independent variables. The model coefficients of determination (r2) were compared as social deprivation measures were incrementally added. Improvement of the r2 by at least 10% was considered clinically meaningful.

RESULTS

Insurance classification was the social deprivation measure with the largest (absolute value) age-adjusted correlation coefficient for all adult and pediatric PROMIS physical and behavioral health domains (adults: correlation coefficient 0.40 to 0.43 [95% CI 0.39 to 0.44]; pediatrics: correlation coefficient 0.10 to 0.19 [95% CI 0.08 to 0.21]), followed by national Area Deprivation Index (adults: correlation coefficient 0.18 to 0.22 [95% CI 0.17 to 0.23]; pediatrics: correlation coefficient 0.08 to 0.15 [95% CI 0.06 to 0.17]), followed closely by state Area Deprivation Index. The Medically Underserved Area Status and Rural-Urban Commuting Area code each had correlation coefficients of 0.1 or larger for some PROMIS domains but neither had consistently stronger correlation coefficients than the other. Except for the PROMIS Pediatric Upper Extremity domain, consideration of insurance classification and the national Area Deprivation Index together explained more of the variation in age-adjusted PROMIS scores than the use of insurance classification alone (adults: r2 improvement 32% to 189% [95% CI 0.02 to 0.04]; pediatrics: r2 improvement 56% to 110% [95% CI 0.01 to 0.02]). The addition of the Medically Underserved Area Status, Rural-Urban Commuting Area code, and/or state Area Deprivation Index did not further improve the r2 for any of the PROMIS domains.

CONCLUSION

To capture the most variability due to social deprivation in orthopaedic patients' self-reported physical and behavioral health, insurance classification (categorized as private, Medicare, Medicaid, or other) and national Area Deprivation Index should be included in statistical analyses. If only one measure of social deprivation is preferred, insurance classification or national Area Deprivation Index are reasonable options. Insurance classification may be more readily available, but the national Area Deprivation Index stratifies patients across a wider distribution of values. When conducting clinical outcomes research with social deprivation as a relevant covariate, we encourage researchers to consider accounting for insurance classification and/or national Area Deprivation Index, both of which are freely available and can be obtained from data that are typically collected during routine clinical care.

LEVEL OF EVIDENCE

Level III, therapeutic study.

Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function Instruments Compare Favorably With Legacy Patient-Reported Outcome Measures in Upper- and Lower-Extremity Orthopaedic Patients: A Systematic Review of the Literature

PURPOSE

To compare Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) with traditional ("legacy") patient-reported outcome measures (PROMs) in regard to correlations, ease of use, and quality criteria for upper (UE) and lower extremity (LE) orthopaedic conditions.

METHODS

A systematic search of the PubMed/MEDLINE database was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to identify published articles that referenced the various PROMIS PF measures. Two authors independently reviewed selected studies. The search returned 857 studies, 85 of which were selected for independent review by 2 authors. Of these, 54 were selected for inclusion. Mixed linear models were performed to assess for differences between legacy PROMs and PROMIS measures.

RESULTS

The combined sample size of all included studies yielded 6,074 UE and 9,366 LE patients. Overall, PROMIS PF measures demonstrated strong correlations with legacy PROMs among UE (weighted Pearson correlation, 0.624, standard error [SE] = 0.042; weighted Spearman correlation, 0.566, SE = 0.042) and LE patients (weighted Pearson correlation, 0.645, SE = 0.062; weighted Spearman correlation, 0.631, SE = 0.041). PROMIS PF questionnaires completed by UE patients had fewer questions than legacy PROMs (5.9 vs 17.7, P = .0093) and were completed in less time (90.5 vs 223.8 seconds, P = .084). PROMIS PF questionnaires completed by LE patients had fewer questions than legacy PROMs (4.81 vs 15.33, P < .001) and were completed in less time (63.6 vs 203.2 seconds, P = .0063). The differences for the reliability measures were not significant.

CONCLUSIONS

PROMIS PF scores correlate strongly with commonly used legacy PROMs in orthopaedics, particularly in UE and LE patients. PROMIS PF forms can be administered efficiently and to a broad patient population while remaining highly reliable. Therefore, they can be justified for standardized use among orthopaedic patients with UE and LE conditions, improving the ability to aggregate and compare outcomes in orthopaedic research.

LEVEL OF EVIDENCE

Level IV, systematic review of Level I-IV evidence.

Baseline patient reported outcome measurement information system (PROMIS) scores in children with idiopathic scoliosis and their relation to the SRS-22

PURPOSE

PROMIS is becoming the most commonly utilized patient-reported outcome measure (PROM) in adult orthopaedics, but its adoption has lagged in pediatrics. Limited baseline data exists in pediatric-specific orthopaedic diagnoses. The objective of this study was to determine baseline PROMIS scores in patients with idiopathic scoliosis and to evaluate for correlations with the SRS-22.

METHODS

This was a retrospective analysis of prospectively collected data from six tertiary care pediatric hospitals between July 2016 and July 2018. Patients with a diagnosis of idiopathic scoliosis, adequate radiographs for measurement and completion of PROMIS and SRS-22 questionnaires from the same visit were included. Only the first visit during the study period was included for each subject. Post-operative patients were excluded. Spearman correlations were performed between four PROMIS domains (Pain interference [PI], Mobility [M], Peer Relationships [PR] and Upper Extremity [UE]) and SRS-22 domains. PROMIS scores are calibrated such that 50 is the median value in a population and 10 points is equivalent to one standard deviation.

RESULTS

986 patients with a mean age of 14.6 years were included, 79.8% of which were female. The mean major curve was 33.0° (range: 10-102). The major curve was thoracic in 56.5%, thoracolumbar in 24.4% and lumbar in 19.1% of subjects. The mean PROMIS domain scores were: Pain Interference 44.5 (IQR 17.7); Mobility 52.7 (IQR 12.5); Peer Relationships 55.7 (IQR 15.0); Upper Extremity 53.4 (IQR 7.7). Correlations existed between PROMIS Pain Interference and SRS-22 pain (r = 0.704, p < 0.001) and PROMIS Mobility and SRS-22 function (r = 0.53, p < 0.001). Significant ceiling effects existed in SRS-22 Function (29.9%), Pain (19.2%) and Satisfaction (30.3%) but only for PROMIS Peer Relationships (42.1%).

CONCLUSIONS

PROMIS domain scores for patients with AIS are within normal population limits. PROMIS correlates well with SRS-22 in overlapping domains, and fewer domains demonstrate a ceiling effect. There was no relationship between the magnitude of scoliosis and PROMIS domain scores.

LEVEL OF EVIDENCE

II.

Early Improvement in Patient-Reported Outcome Scores After Operative Treatment of Osteochondritis Dissecans of the Humeral Capitellum

PURPOSE

Outcome measures that lack sensitivity for the detection of clinical changes early after surgery for capitellar osteochondritis dissecans (OCD) make it difficult to determine the optimal treatment for these defects. We sought to evaluate the early responsiveness of patient-reported outcomes measurement information system (PROMIS) scores in a cohort of patients operatively treated for capitellar OCD.

METHODS

Four PROMIS questionnaires (mobility, upper extremity [UE], pain interference, and peer relations) were electronically administered to patients treated for capitellar OCD at a single tertiary academic medical center between January 1, 2015, and July 1, 2018. The questionnaires were administered at the initial preoperative outpatient clinic visit as well as at the 2-week, 6-week, and final return-to-play (RTP) visits.

RESULTS

Twenty-nine patients (31 elbows, mean age 12.9 years) with available preoperative and postoperative PROMIS data were included. The mean final follow-up period was 26 weeks. Compared with that before surgery, there was a significant improvement in the mobility, pain interference, and UE scores at 6 weeks following surgery. The scores improved most significantly by 6 weeks, reached a relative plateau, and remained significantly improved through the RTP visit thereafter. Patients with preoperative, intra-articular loose bodies scored significantly better than those without them during the 6-week and RTP visits. Patients with lesions >1 cm², compared with those with lesions ≤1 cm², demonstrated greater improvement in the UE scores during the RTP visit.

CONCLUSIONS

In patients undergoing operative treatment for capitellar OCD, a significant improvement in the PROMIS domains of mobility, pain interference, and UE can be expected early in the postoperative period, with majority of patients reaching their greatest improvement in scores by 6 weeks following surgery.

CLINICAL RELEVANCE

This is important information for preoperative counseling. In addition, this information is helpful in confirming that PROMIS scores are responsive in the detection of changes in outcomes during the early postoperative period in this population.

Are Baseball Statistics an Appropriate Tool for Assessing Return to Play in Injured Pitchers? Analysis of Statistical Variability in Healthy Players

Background:

Basic pitcher statistics have been used to assess performance in pitchers after injury or surgery without being validated. Even among healthy pitchers, the normal variability of these parameters has not yet been established.

Purpose:

To determine (1) the normal variability of basic and advanced pitcher statistics in healthy professional baseball pitchers and (2) the minimum pitches needed to predict these parameters.

Study Design:

Cross-sectional study; Level of evidence, 3.

Methods:

Publicly available data from the MLB Statcast and PITCHf/x databases were used to analyze MLB pitchers during the 2015 and 2016 seasons who recorded a minimum of 100 innings without injury. Basic and advanced baseball pitcher statistics were analyzed. The variability of each parameter was assessed by computing the coefficient of variation (CV) between individual pitchers and across all pitchers. A CV <10 was indicative of a relatively constant parameter, and parameters with a CV >10 were generally considered inconsistent and unreliable. The minimum number of pitches needed to be followed for each variable was also analyzed.

Results:

A total of 118 pitchers, 55 baseball-specific statistical metrics (38 basic and 17 advanced), and 7.5 million pitches were included and analyzed. Of the 38 basic pitcher statistics, only fastball velocity demonstrated a CV <10 (CV = 1.5), while 6 of 17 (35%) advanced metrics demonstrated acceptable consistency (CV <10). Release position from plate and velocity from the plate were the 2 most consistent advanced parameters. When separated by pitch type, these 2 parameters were the most constant (lowest CV) across every pitch type.

Conclusion:

We recommend against utilizing nonvalidated statistical measures to assess performance after injury, as they demonstrated unacceptably high variability even among healthy, noninjured professional baseball pitchers. It is our hope that this study will serve as the foundation for the identification and implementation of validated pitcher-dependent statistical measures that can be used to assess return-to-play performance after injury in the future.

Patients Require Less Time to Complete Preoperative Patient-Reported Outcomes Measurement Information System (PROMIS) Than Legacy Patient-Reported Outcome Measures

Purpose

To analyze time to completion of preoperative legacy patient-reported outcomes (PROs) and more recent computer adaptive Patient-Reported Outcomes Measurement Information System (PROMIS) questionnaires in patients with symptomatic femoroacetabular impingement syndrome undergoing primary hip arthroscopy.

Methods

A retrospective analysis was conducted on patients undergoing hip arthroscopy by a single fellowship-trained hip arthroscopist. Inclusion criteria were patients undergoing primary arthroscopic hip surgery and completion of at least 1 legacy PRO or PROMIS questionnaire at the preoperative time point. Exclusion criteria were history of contralateral or ipsilateral hip surgery, non-English-speaking patients, patients who completed PROs by phone or by paper form, and patients who did not complete preoperative PROs. Legacy PROs included modified Harris Hip Score (mHHS), Hip Outcome Score (HOS), International Hip Outcome Tool (iHOT-12), and Hip Pain Visual Analog Scale (VAS-Pain). PROMIS PROs included Physical Function (PROMIS-PF), Pain Interference (PROMIS-PI), and Depression (PROMIS-D). Only preoperative PROs were included in the analysis. Completion time was calculated using the questionnaire start and stop time reported by the survey collecting software. The median and interquartile range of each PRO were reported for analysis of central tendency and statistical dispersion, respectively.

Results

A total of 1,901 patients and 269 patients were included in the legacy and PROMIS groups, respectively. The median time required for completion of each PRO in (minutes: seconds) format was as follows: mHHS (1:29), HOS (3:58), iHOT (2:11), VAS-Pain (0:32), PROMIS-PF (0:46), PROMIS-PI (0:37), and PROMIS-D (0:43). The interquartile range of the middle 50% of respondents was as follows; mHHS (0:58), HOS (2:46), iHOT (1:22), VAS-Pain (0:28), PROMIS-PI (0:19), PROMIS-D (0:29), and PROMIS-PF (0:20).

Conclusions

This study supports that preoperative PROMIS forms require less time to complete than preoperative legacy PROs and are not significantly influenced by age, race, or workers compensation status.

Level of Evidence

Level IV, case series.

A High-Sensitivity International Knee Documentation Committee Survey Index From the PROMIS System: The Next-Generation Patient-Reported Outcome for a Knee Injury Population

BACKGROUND

Patient-reported outcomes (PROs) measure progression and quality of care. While legacy PROs such as the International Knee Documentation Committee (IKDC) survey are well-validated, a lengthy PRO creates a time burden on patients, decreasing adherence. In recent years, PROs such as the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function and Pain Interference surveys were developed as computer adaptive tests, reducing time to completion. Previous studies have examined correlation between legacy PROs and PROMIS; however, no studies have developed effective prediction models utilizing PROMIS to create an IKDC index. While the IKDC is the standard knee PRO, computer adaptive PROs offer numerous practical advantages.

PURPOSE

To develop a nonlinear predictive model utilizing PROMIS Physical Function and Pain Interference to estimate IKDC survey scores and examine algorithm sensitivity and validity.

STUDY DESIGN

Cohort study (diagnosis); Level of evidence, 3.

METHODS

The MOTION (Military Orthopaedics Tracking Injuries and Outcomes Network) database is a prospectively collected repository of PROs and intraoperative variables. Patients undergoing knee surgery completed the IKDC and PROMIS surveys at varying time points. Nonlinear multivariable predictive models using Gaussian and beta distributions were created to establish an IKDC index score, which was then validated using leave-one-out techniques and minimal clinically important difference analysis.

RESULTS

A total of 1011 patients completed the IKDC and PROMIS Physical Function and Pain Interference, providing 1618 complete observations. The algorithms for the Gaussian and beta distribution were validated to predict the IKDC (Pearson = 0.84-0.86; R² = 0.71-0.74; root mean square error = 9.3-10.0).

CONCLUSION

The publicly available predictive models can approximate the IKDC score. The results can be used to compare PROMIS Physical Function and Pain Interference against historical IKDC scores by creating an IKDC index score. Serial use of the IKDC index allows for a lower minimal clinically important difference than the conventional IKDC. PROMIS can be substituted to reduce patient burden, increase completion rates, and produce orthopaedic-specific survey analogs.

Evaluating Prospective Patient-Reported Pain and Function Outcomes After Ankle and Hindfoot Arthrodesis

Background:

Hindfoot and ankle fusions are mechanically limiting procedures for patients. However, patient-reported outcomes of these procedures have not been well studied. This study assessed outcomes of hindfoot and ankle fusions by using Patient-Reported Outcome Measurement Information System (PROMIS) Physical Function (PF) and Pain Interference (PI) Computer Adaptive Tests (CATs).

Methods:

Between 2014 and 2018, 102 patients were prospectively enrolled after presenting to a tertiary care facility for ankle and hindfoot fusions, including tibiotalar, tibiotalocalcaneal, subtalar, and triple arthrodeses. Study participants completed preoperative and 12-month postoperative PF and PI CATs. The differences between mean 12-month postoperative and preoperative PROMIS PF and PI T scores were analyzed with paired t tests. The relationship between the 12-month PF and PI differences for the overall sample and patient factors was examined using multiple regression modeling.

Results:

The sample had mean age of 57.69 years; 48% were male, and 55% were obese. Patients who underwent ankle and hindfoot arthrodesis had statistically significant improvements from preoperative to 12 months postoperative in mean PF (36.26±7.85 vs 39.38±6.46, P = .03) and PI (61.07±7.75 vs 56.62±9.81, P = .02). Triple arthrodesis saw the greatest increases in physical function (▵PF = 7.22±7.31, P = .01) and reductions in pain (▵PI = –9.17±8.31, P = .01), achieving minimal clinically important difference (MCID). Patients who underwent tibiotalar fusion had significant improvement in physical function (▵PF = 4.18±5.68, P = .04) and pain reduction that approached statistical significance (▵PI = –6.24±8.50, P = .09), achieving MCID. Older age (≥60 years ) was associated with greater improvements in PF (β = 0.20, P = .07) and PI (β = –0.29, P = .04). Preoperative PF and PI T scores were significantly associated with the 12-month change in PF and PI T scores, respectively (β = –0.74, P < .01; β = –0.61, P < .01).

Conclusion:

Hindfoot and ankle fusions are procedures with favorable patient outcomes leading to increased physical function and decreased pain at 12 months postoperation relative to preoperation.

Level of Evidence:

Level II, prospective comparative study.

The Minimal Clinically Important Difference for PROMIS Physical Function in Patients With Thumb Carpometacarpal Arthritis

Background: This study was performed to determine the minimal clinically important difference (MCID) of Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) computer adaptive test (CAT) for patients with thumb carpometacarpal (CMC) arthritis. Methods: This study retrospectively analyzed data from 152 adults receiving surgical and nonsurgical care for unilateral thumb CMC arthritis at a single institution between January 2016 and January 2018. Patients completed PROMIS PF v1.2/2.0 CAT at each visit. At follow-up, patients also completed two 6-item anchor questions assessing the degree of perceived improvement. Statistical testing analyzed the ability of the clinical anchor to discriminate levels of improvement. An anchor-based MCID estimate was calculated as the mean PROMIS PF change score in the mild improvement group. The anchor-based MCID value was examined for the influence of patient age, initial and final PROMIS scores, and follow-up interval. A distribution-based MCID value was calculated incorporating the standard error of measurement and effect size. Results: The change in PROMIS PF scores was significantly different between encounters where patients reported no change, mild improvement, and much improvement. The anchor-based MCID estimate for PROMIS PF was 3.9 (95% confidence interval, 3.3-4.7). Individual MCID values were weakly correlated with the final absolute PROMIS PF score but did not correlate with patient age, time between visits, or the initial absolute PROMIS PF score. The distribution-based MCID value was 3.5 (95% confidence interval, 3.1-3.9). Conclusions: The estimated range of MCID values for PROMIS PF is 3.5 to 3.9 points in patients treated for thumb CMC arthritis.

Development of the computerized adaptive test of motor development (MD-CAT) adopting multidimensional Rasch analysis

OBJECTIVE

This study aimed to develop the computerized adaptive test of motor development (MD-CAT) in preschool children based on multidimensional Rasch analysis.

DESIGN

A retrospective study with cross-sectional design SETTING: A medical center PARTICIPANTS: 1,738 children INTERVENTIONS: Not applicable MAIN OUTCOME MEASURES: MD-CAT RESULTS: Multidimensional Rasch analysis was used to develop the item bank of the MD-CAT. The item bank of the MD-CAT contained 74 items, with 44 and 30 items respectively for the subscales of gross and fine motor skills. High correlation existed between the two subscales (r = 0.96). Three stopping rules were set for the MD-CAT: (1) the person reliability achieved 0.95 or the limited reliability increased by < 0.01, (2) at least 3 items were assessed in each dimension, and (3) the number of items used for assessment reached 16. Based on the three stopping rules, the MD-CAT had high correlations with its total test length (r =0.87 to 0.98 for the two dimensions), indicating sufficient construct validity. The MD-CAT also had adequate diagnostic validity (area under the curve = 0.72-0.93) and efficiency (an average of 3 to 6 items used for the assessment).

CONCLUSION

The MD-CAT has high precision and efficiency, good construct validity and high diagnostic validity. The results of our study indicate that the MD-CAT can be useful in clinical practice and in research as a diagnostic measure.

Defining Clinically Significant Improvement on the Patient-Reported Outcomes Measurement Information System Test at 1-Year Follow-up for Patients Undergoing Hip Arthroscopy for the Treatment of Femoroacetabular Impingement Syndrome

BACKGROUND

Although minimal clinically important difference (MCID), Patient Acceptable Symptom State (PASS), and substantial clinical benefit (SCB) have been defined for hip-specific legacy patient-reported outcome measures, these metrics have not been defined for the Patient-Reported Outcomes Measurement Information System (PROMIS) instruments for patients undergoing hip arthroscopy.

PURPOSE

To define the MCID, PASS, and SCB thresholds for the PROMIS Physical Function (PF) computerized adaptive test (CAT) and PROMIS Pain Interference (PI) instruments in patients undergoing hip arthroscopy for femoroacetabular impingement syndrome (FAIS).

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 2.

METHODS

Patients undergoing primary hip arthroscopy between August 2018 and January 2019 for the treatment of FAIS were retrospectively analyzed. Patients were administered the PROMIS-PF, PROMIS-PI, Hip Outcome Score (HOS)-Activities of Daily Living, HOS-Sports Subscale, modified Harris Hip Score, and International Hip Outcome Tool-12 preoperatively and at 1 year postoperatively. MCID was calculated using the distribution method, whereas PASS and SCB were calculated using an anchor-based method. Patients achieving clinically significant outcomes (CSOs) were compared with those who did not achieve CSOs via chi-square and independent-samples t tests, and a multivariate logistic regression was conducted to determine predictors of CSO achievement.

RESULTS

124 patients with a mean age of 32.7 ± 12.3 years were included in the analysis. The threshold scores required to achieve MCID, PASS, and SCB, respectively, were as follows: PROMIS-PI (-3.1, 53.7, 51.9) and PROMIS-PF (3.3, 47.0, 49.9). Patients achieved any MCID, PASS, and SCB for PROMIS scores at a rate of 89.0%, 71.8%, and 62.1%, respectively, compared with 87.1%, 76.6%, and 71.8% for legacy patient-reported outcome measurements. For PROMIS-PF, higher preoperative PROMIS-PF score was a positive predictor of CSO achievement, and patients achieving SCB were significantly younger (30.3 ± 12 vs 35.6 ± 12 years; P = .017) with significantly lower body mass index (BMI) (24.7 ± 6.4 vs 27.9 ± 7; P = .009). Preoperative chronic pain and history of orthopaedic surgery were negative predictors of PROMIS-PI CSO achievement, whereas higher (worse) preoperative PROMIS-PI scores were a positive predictor.

CONCLUSION

Our study defined the MCID, PASS, and SCB for the PROMIS-PF CAT and PROMIS-PI CAT at 1 year postoperatively. Patients with higher preoperative PROMIS scores, younger age, and lower BMI were more likely to achieve CSO, whereas preoperative chronic pain and history of orthopaedic surgery were negative predictors of CSO achievement.

Editorial Commentary: Delivering the PROMIS for Patients With Shoulder Disorders-Fool's Gold, a Mirage, or an Oasis

Comparative psychometric performance of Patient-Reported Outcome Measurement Information System (PROMIS) instruments to legacy patient-reported outcomes for shoulder disorders is relevant and timely, as numerous stakeholders are engaged in the process of capturing, comparing, and evaluating performance results at the individual and population health levels. Depending on the stakeholder type, patient-reported outcomes could be used for clinical research, reimbursement, point-of-care, or benchmarking for patient comparison with a matched population cohort or comparative surgeon scorecard. Identifying and using the appropriate patient-reported outcome measure may be dependent on the purpose for measurement and stakeholder engagement and, as such, could be considered fool's gold, a mirage, or an oasis. At this time, PROMIS instruments are not a suitable replacement for legacy patient-reported outcomes when orthopaedic surgeons are looking to perform level I and level II clinical studies to develop future clinical practice guidelines grounded in strong evidence.

The American Shoulder and Elbow Surgeons score highly correlates with the Simple Shoulder Test

BACKGROUND/HYPOTHESIS

There is no consensus to which patient-determined shoulder outcome scores should be considered when analyzing patient outcomes for either clinical or research purposes. The use of multiple outcome scores may be redundant and cause increased responder burden. The hypothesis of this study is that the American Shoulder and Elbow Surgeons score (ASES) will highly correlate with the Simple Shoulder Test (SST) for rotator cuff repair and total shoulder arthroplasty and have comparable responsiveness. If determined to be highly correlated, the use of these scores simultaneously may be redundant and one score may be eliminated.

METHODS

A retrospective review of the senior author's database of patients undergoing rotator cuff repair and total shoulder arthroplasty was reviewed in which the ASES was recorded simultaneously with the SST. Correlations were determined using the Pearson correlation coefficient (r > 0.7 excellent; r = 0.61-0.7 strong-moderate; r = 0.31-0.6 moderate; r = 0.2-0.3 poor) for all interactions between the 2 scores. Subgroup analysis was performed to determine if correlations differed in (1) preoperative outcome and (2) postoperative outcome determinations. Responsiveness was determined by calculating the standardized response mean and the effect size of both scores.

RESULTS

There were a total of 1810 simultaneous measurements (both rotator cuff repair and total shoulder arthroplasty) of the ASES and SST. The correlation was excellent for the ASES and SST for all patients (n = 1810; r = 0.81; P < .0001). The correlation of preoperative scores was strong-moderate (n = 1191; r = 0.60; P < .0001), and the correlation of postoperative scores was excellent (n = 619; r = 0.78; P < .0001). Both scores were determined to be highly responsive, but both the standardized response mean (2.8 vs. 2.1) and the effect size (2.2 vs. 1.8) of the ASES were greater than those of the SST.

CONCLUSION

In general, there was an excellent correlation between the ASES and the SST for all patients undergoing arthroscopic rotator cuff repair and total shoulder arthroplasty. Because there is an excellent correlation between the 2 scores, including these 2 scores simultaneously in tracking patient-determined outcomes appears to be redundant and therefore unnecessary. Because there is superior responsiveness of the ASES score compared with the SST, the authors recommend utilization of the ASES over the SST in patients undergoing rotator cuff repair and total shoulder arthroplasty.

Patient-Reported Outcomes Measurement Information System Scores Are Inconsistently Correlated With Legacy Patient-Reported Outcome Measures in Shoulder Pathology: A Systematic Review

PURPOSE

To evaluate the current literature regarding Patient-Reported Outcomes Measurement Information System (PROMIS) and its correlation to legacy patient-reported outcomes measures (PROMs) in 5 domains: (1) rotator cuff disease, (2) shoulder instability, (3) shoulder arthroplasty, (4) proximal humerus fractures, and (5) glenohumeral arthritis. The secondary purpose is to evaluate the floor and ceiling effects, the number of questions, and time needed to complete PROMIS and legacy PROMs in shoulder care.

METHODS

A systematic review of the available literature on PROMIS scores in shoulder care was performed. This review was accomplished per PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines.

RESULTS

A total of 11 studies that reported data on 1485 patients met inclusion criteria. There was a strong correlation between general function PROMs and the PROMIS PF for patients with rotator cuff disease, shoulder instability, shoulder arthroplasty, and proximal humerus fractures. In addition, there was a strong correlation between PROMIS UE and legacy PROMs in patients with rotator cuff injury and shoulder instability. PROMIS instruments asked fewer questions than legacy PROMs (9.46 vs 12.99, respectively), took less time to complete (88.21 vs 96.53 seconds, respectively), had less floor effects in both PROMIS PF and UE (0.17% and 0.62% vs 2.89%, respectively), and had lower ceiling effects for PROMIS PF but not PROMIS UE assessments (0.17% and 6.37% vs 1.89%, respectively).

CONCLUSIONS

This systematic review demonstrated PROMIS instruments have varying correlations with legacy PROMs measures for patients with rotator cuff disease, shoulder instability, shoulder arthroplasty, and glenohumeral arthritis. PROMIS instruments do measure clinical outcomes faster and with fewer questions. Other than PROMIS UE v1.2 ceiling effects, PROMIS instruments have lower rates of floor and ceiling effects.

LEVEL OF EVIDENCE

Level IV, systematic review of Level II-IV studies.

Generating the American Shoulder and Elbow Surgeons Score Using Multivariable Predictive Models and Computer Adaptive Testing to Reduce Survey Burden

BACKGROUND

The preferred patient-reported outcome measure for the assessment of shoulder conditions continues to evolve. Previous studies correlating the Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive tests (CATs) to the American Shoulder and Elbow Surgeons (ASES) score have focused on a singular domain (pain or physical function) but have not evaluated the combined domains of pain and physical function that compose the ASES score. Additionally, previous studies have not provided a multivariable prediction tool to convert PROMIS scores to more familiar legacy scores.

PURPOSE

To establish a valid predictive model of ASES scores using a nonlinear combination of PROMIS domains for physical function and pain.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 3.

METHODS

The Military Orthopaedics Tracking Injuries and Outcomes Network (MOTION) database is a prospectively collected repository of patient-reported outcomes and intraoperative variables. Patients in MOTION research who underwent shoulder surgery and completed the ASES, PROMIS Physical Function, and PROMIS Pain Interference at varying time points were included in the present analysis. Nonlinear multivariable predictive models were created to establish an ASES index score and then validated using "leave 1 out" techniques and minimal clinically important difference /substantial clinical benefit (MCID/SCB) analysis.

RESULTS

A total of 909 patients completed the ASES, PROMIS Physical Function, and PROMIS Pain Interference at presurgery, 6 weeks, 6 months, and 1 year after surgery, providing 1502 complete observations. The PROMIS CAT predictive model was strongly validated to predict the ASES (Pearson coefficient = 0.76-0.78; R² = 0.57-0.62; root mean square error = 13.3-14.1). The MCID/SCB for the ASES was 21.7, and the best ASES index MCID/SCB was 19.4, suggesting that the derived ASES index is effective and can reliably re-create ASES scores.

CONCLUSION

The PROMIS CAT predictive models are able to approximate the ASES score within 13 to 14 points, which is 7 points more accurate than the ASES MCID/SCB derived from the sample. Our ASES index algorithm, which is freely available online (https://osf.io/ctmnd/), has a lower MCID/SCB than the ASES itself. This algorithm can be used to decrease patient survey burden by 11 questions and provide a reliable ASES analog to clinicians.

Correlation of Patient Reported Outcome Measurement Information System (PROMIS) with American Shoulder and Elbow Surgeon (ASES), and Constant (CS) scores in idiopathic adhesive capsulitis

PURPOSE

To correlate the Patient Reported Outcomes Measurement Information System Upper Extremity (PROMIS UE) score with pre-existing validated outcome scores, American Shoulder and Elbow Surgeons score (ASES), and Constant score (CS) in patients with idiopathic adhesive capsulitis (AC).

METHODS

Patients with a clinical diagnosis of idiopathic AC ("freezing" or "frozen" phases) who agreed to complete the ASES, CS, and PROMIS UE scores during their office visit were included in this study. Trained researchers performed the objective clinical assessments on the included patients. Responses to the 3 outcome scores were statistically analyzed and compared using Pearson correlation coefficients. Floor and ceiling effects were calculated.

RESULTS

The final cohort included 100 patients with AC, of whom there were 72% female and 87% right hand dominant, with a mean age of 55 years. The PROMIS UE required fewer question responses (5.02 ± 1.84) compared with the fixed question burden with ASES (12) and CS (9). The mean outcome scores were 34.6 ± 2.5 (PROMIS UE), 55 ± 22 (ASES), and 51 ± 16 (CS). The PROMIS UE displayed an excellent correlation with both the ASES (r = 0.80, 95% confidence interval [0.72, 0.86], P < .001) and CS (r = 0.76, 95% confidence interval [0.67, 0.83], P < .001). Neither ceiling nor floor effects were present.

CONCLUSION

The PROMIS UE displayed comparable efficacy to commonly used legacy outcome scores (ASES and CS) in AC. A lower question burden with the PROMIS UE carries potential for wider acceptability with the researchers and patients with shoulder pathology.

The PROMIS CAT Demonstrates Responsiveness in Patients After ACL Reconstruction Across Numerous Health Domains

Background:

The Patient-Reported Outcomes Measurement Information System (PROMIS) has emerged as a dynamic, efficient, and validated patient-reported outcome measure in the field of orthopaedics. However, the responsiveness, which is defined as the ability to detect changes in scores over time, of PROMIS computer adaptive tests (CATs) after anterior cruciate ligament reconstruction (ACLR) has not been well documented.

Purpose:

To investigate the responsiveness up to 1 year postoperatively of multiple PROMIS CAT domains in patients undergoing ACLR.

Study Design:

Cohort study (diagnosis); Level of evidence, 3.

Methods:

All patients who underwent ACLR by 1 of 2 fellowship-trained sports medicine orthopaedic surgeons, with preoperative and at least 6 months postoperative visits, were included in this study. PROMIS CAT physical function (PF), pain interference (PI), and depression (D) scores from each visit were collected and analyzed. Preoperative patient-centric factors, including demographic factors and meniscal pathology, were analyzed for associations with improvements in PROMIS scores.

Results:

A total of 100 patients (62 male patients and 38 female patients; mean age, 27.6 ± 11.8 years) with an average follow-up of 338.5 ± 137.5 days were included in this study. Preoperative PF, PI, and D scores improved significantly from 38.5 ± 7.3, 60.3 ± 7.0, and 47.9 ± 9.1, respectively, to 53.6 ± 10.3, 48.1 ± 8.5, and 41.0 ± 9.9, respectively (P < .001 for each domain). Lower preoperative PF scores, PI scores, and a lower body mass index (BMI) were predictive for greater improvements in PF. Higher preoperative PI scores and a lower BMI were predictors for greater improvements in PI. Meniscal pathology was not predictive of improvement in PROMIS scores.

Conclusion:

PROMIS CAT assessments of PF, PI, and D demonstrated responsiveness in patients undergoing ACLR up to 1 year. Worse preoperative PROMIS scores and a lower BMI were predictive of greater improvements in PROMIS scores.

Evaluating the performance of PROMIS and QuickDASH instruments in an intercollegiate Division 1 athlete population

BACKGROUND

Athletes demonstrate high levels of physical function, leading to difficulties in patient-reported outcome scoring and interpretation. In particular, the ability of patient-reported outcome (PRO) instruments to adequately discriminate between high levels of upper extremity function-that is, the ceiling effect-is limited. This study evaluated performance characteristics of the shortened version of the Disabilities of the Arm, Shoulder, and Hand (QuickDASH) survey and Patient-Reported Outcomes Measurement Information System (PROMIS) metrics in a population of Division 1 intercollegiate athletes, with specific attention to ceiling effects.

METHODS

At a single institution, Division I intercollegiate athletes cleared for full participation in the 2018-2019 season were eligible. The following PROs were collected prospectively via tablet computer: PROMIS upper extremity (UE) computer adaptive test (CAT), PROMIS physical function (PF) CAT, QuickDASH, and QuickDASH Sports/Performing Arts Module. Descriptive statistics, and ceiling and floor effects, were calculated. The proportion of athletes with maximal scores on each PRO were compared to normative values using the 1-sample Wilcoxon signed rank test.

RESULTS

A total of 268 participants were included; the mean age was 19.9 ± 1.5 years, 49% were female, and 61% were overhead athletes. Large ceiling effects were observed for the UE CAT (46%), QuickDASH (58%), and QuickDASH Sports Module (82%). The PF CAT demonstrated a relatively low ceiling effect of 6.7%. Athlete scores were all significantly better than published age-matched values from a normative population for all instruments, with the exception of no difference on the QuickDASH for males.

DISCUSSION AND/OR CONCLUSION

The PROMIS UE CAT and QuickDash instruments are limited in their ability to assess and discriminate upper extremity function in highly functioning individuals such as Division I athletes. The PROMIS PF CAT, a measure of general physical function, did not suffer from a large ceiling effect.

Pediatric PROMIS Computer Adaptive Tests Are Highly Correlated With Adult PROMIS Computer Adaptive Tests in Pediatric Sports Medicine Patients

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS) is a powerful set of patient-reported outcome measures (PROMs) that are gaining popularity throughout orthopaedic surgery. The use of both adult and pediatric PROMIS questionnaires in orthopaedic sports medicine limits the value of the PROMIS in routine sports medicine clinical care, research, and quality improvement. Because orthopaedic sports medicine surgeons see patients across a wide age range, simplifying the collection of PROMIS computer adaptive tests (CATs) to a single set of questionnaires, regardless of age, is of notable value.

PURPOSE/HYPOTHESIS

The purpose was to determine the strength of the correlation between the pediatric and adult PROMIS questionnaires. We hypothesized that there would be a high correlation between the adult and pediatric versions for each PROMIS domain, thereby justifying the use of only the adult version for most sports medicine providers, regardless of patient age.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 2.

METHODS

Between December 2018 and December 2019, all pediatric sports medicine patients presenting to a single, academic, orthopaedic sports medicine clinic were asked to participate in the present study with their parents' consent. Patients were asked to complete a set of adult PROMIS domains (Physical Function and/or Upper Extremity, Pain Interference, and Depression) as well as a set of pediatric PROMIS domains (Mobility and/or Upper Extremity, Pain Interference, and Depressive Symptoms). Concurrent validity was assessed using Pearson correlation coefficients (r). Ceiling and floor effects were determined.

RESULTS

A total of 188 patients met our inclusion criteria. The correlation between the adult and pediatric PROMIS Upper Extremity, Physical Function and Mobility, Pain Interference, and Depression and Depressive Symptoms forms were high-moderate (r = 0.68; P < .01), high-moderate (r = 0.69; P < .01), high (r = 0.78; P < .01), and high (r = 0.85; P < .01), respectively. Both adult and pediatric depression-related PROMIS domains demonstrated notable floor effects (adult: 38%; pediatric: 24%). The pediatric PROMIS Upper Extremity domain demonstrated a ceiling effect (20%).

CONCLUSION

Adult PROMIS CATs may be used in an orthopaedic sports medicine clinic for both adult and pediatric patients. Our findings will help decrease the amount of resources needed for the implementation and use of PROMs for patient care, research, and quality improvement in orthopaedic sports medicine clinics.

Patient-Reported Outcomes Measurement Information System (PROMIS) in Left Ventricular Assist Devices

BACKGROUND

Appropriate collection of quality of life (QOL) measurements for left ventricular assist device (LVAD) patients is challenging. Patient-Reported Outcomes Measurement Information System (PROMIS) is a popular tool that has been validated across multiple disciplines, but its applicability to the LVAD population remains unknown.

METHODS

This single-center, retrospective review included LVAD patients that completed a PROMIS assessment and Kansas City Cardiomyopathy Questionnaire (KCCQ-12) survey at clinical encounters postoperatively. Patients completed computer adaptive PROMIS assessments for physical function, pain interference and depression. All PROMIS domains are designed to follow a normal distribution (mean T-score 50, standard deviation 10) in the general population. Assessments were aggregated over time and correlation between the KCCQ-12 summary score and each PROMIS domain was assessed individually.

RESULTS

A total of 178 LVAD patients were included in the study. The median time between LVAD implantation and PRO collection was 16.5 [interquartile range, 7.9-37.8] months. Patients typically had worse physical function (T-score 38.8 [33.6-44.2]) but comparable pain (51.1 [38.7-59.2]) and depression (49.9 [41.7-57.5]) as the general population. The KCCQ-12 was more strongly correlated to PROMIS physical function (Spearman's ρ = 0.746) than pain (ρ = -0.539) or depression (ρ = -0.591).

CONCLUSIONS

PROMIS provides a robust QOL data collection system that can be implemented in a clinical setting without imposing a significant burden. Using this more holistic system may allow for better patient-centered care in order to address QOL limitations imposed by LVAD support that are not directly related to heart failure symptoms.

Reporting and utilization of Patient-Reported Outcomes Measurement Information System® (PROMIS®) measures in orthopedic research and practice: a systematic review

BACKGROUND

The Patient-Reported Outcomes Measurement Information SystemⓇ (PROMISⓇ) is a dynamic system of psychometrically sound patient-reported outcome (PRO) measures. There has been a recent increase in the use of PROMIS measures, yet little has been written about the reporting of these measures in the field of orthopedics. The purpose of this study was to conduct a systematic review to determine the uptake of PROMIS measures across orthopedics and to identify the type of PROMIS measures and domains that are most commonly used in orthopedic research and practice.

METHODS

We searched PubMed, Embase, and Scopus using keywords and database-specific subject headings to capture orthopedic studies reporting PROMIS measures through November 2018. Our inclusion criteria were use of PROMIS measures as an outcome or used to describe a population of patients in an orthopedic setting in patients ≥ 18 years of age. We excluded non-quantitative studies, reviews, and case reports.

RESULTS

Our final search yielded 88 studies published from 2013 through 2018, with 57% (50 studies) published in 2018 alone. By body region, 28% (25 studies) reported PROMIS measures in the upper extremity (shoulder, elbow, hand), 36% (32 studies) reported PROMIS measures in the lower extremity (hip, knee, ankle, foot), 19% (17 studies) reported PROMIS measures in the spine, 10% (9 studies) reported PROMIS measures in trauma patients, and 6% (5 studies) reported PROMIS measures in general orthopedic patients. The majority of studies reported between one and three PROMIS domains (82%, 73 studies). The PROMIS Computerized Adaptive Test (CAT) approach was most commonly used (81%, 72 studies). The most frequently reported PROMIS domains were physical function (81%, 71 studies) and pain interference (61%, 54 studies).

CONCLUSION

Our review found an increase in the reporting of PROMIS measures over the recent years. Utilization of PROMIS measures in orthopedic populations is clinically appropriate and can facilitate communication of outcomes across different provider types and with reduced respondent burden.

REGISTRATION

The protocol for this systematic review was designed in accordance with the PRISMA guidelines and is registered with the PROSPERO database (CRD42018088260).

Usage Trends of Patient-reported Outcome Measures in Shoulder Literature

INTRODUCTION

Quantifying patient outcomes is integral in orthopaedic practice, and patient-reported outcome measures (PROMs) assist with this goal and assist clinicians in assessing subjective outcomes (pain, satisfaction, etc.). This study seeks to identify the most highly used PROMs in the shoulder literature and analyze their usage trends.

METHODS

PubMed was queried for all shoulder-based articles published in eight selected journals from 2007 to 2017. Articles were assessed for PROM usage, surgical approach, surgical procedure, and disease pathology. Frequency analyses identified the most used PROMs overall, and for each approach, procedure, and pathology. Last, usage trends, question number, validation, and clinician dependence of PROMs with ≥20 uses were analyzed.

RESULTS

In total, 1,740 of 2,462 articles (71%) used 105 unique PROMs 4,394 times during the study. PROM usage increased 18%, and the use of multiple PROMs increased by 20%. PROMs with a clinician component increased 21% slower than the baseline. Twenty-two PROMs (17%) had >20 uses, with the most used PROMs being the Constant-Murley Score (783), American Shoulder and Elbow Surgeons Shoulder Score (731), Visual Analog Scale (685), Simple Shoulder Test (372), and the University of California, Los Angeles, Shoulder Rating Scale (274). PROMs demonstrating the greatest usage increase were the EuroQol 5-Dimensions Questionnaire (1,282%), Shoulder Pain and Disability Index (638%), Western Ontario Rotator Cuff Index (632%), Western Ontario Osteoarthritis of the Shoulder Index (582%), and Oxford Shoulder Score (462%)-all without a clinician component.

DISCUSSION

PROM usage is increasing, often with multiple PROMs being used to evaluate patient outcomes. PROMs without a clinician component are growing at higher rates than their clinician-dependent counterparts, highlighting an emphasis on patient reporting of outcomes. This study suggests that the American Shoulder and Elbow Surgeons Shoulder Score, Oxford Shoulder Score, Visual Analog Scales-all without a mandatory clinician component and high levels of use-will be the most highly used PROMs moving forward to assess shoulder function.

Validation of PROMIS Global-10 compared with legacy instruments in patients with shoulder instability

BACKGROUND

Outcomes instruments are used to measure patients' subjective assessment of health status. The Patient-Reported Outcomes Measurement Information System (PROMIS) Global-10 was developed to be a concise yet comprehensive instrument that provides physical and mental health scores and an estimated EuroQol-5 Dimension (EQ-5D) score.

METHODS

A total of 175 prospectively enrolled patients with shoulder instability completed the PROMIS Global-10, EQ-5D, American Shoulder and Elbow Surgeons (ASES), Single Assessment Numeric Evaluation (SANE), and Western Ontario Shoulder Instability Index. Spearman correlations between PROMIS scores and the legacy instruments were calculated. Bland-Altman analysis assessed agreement between estimated and actual EQ-5D scores. Floor and ceiling effects were recorded.

RESULTS

Correlation between actual and estimated EQ-5D was excellent-good (0.64/p < 0.0005), but Bland-Altman agreement revealed high variability for estimated EQ-5D scores (95% CI: -0.30 to +0.34). Correlation of PROMIS physical scores was excellent-good with ASES (0.69/p < 0.0005), good with SANE (0.43/p<0.0005), and poor with WOSI (0.17/p = 0.13). Correlation between PROMIS mental scores and all legacy instruments was poor.

CONCLUSIONS

PROMIS Global-10 physical function scores show high correlation with ASES but poor correlation with other legacy instruments, suggesting it is an unreliable outcomes instrument in populations with shoulder instability. The PROMIS Global-10 cannot replace actual EQ-5D scores for cost-effectiveness assessment in this population.

LEVEL OF EVIDENCE

Level II, study of diagnostic test.