Editorial Commentary: Are We Comparing Apples to Oranges? The Need for Standardized Outcomes Reporting in Orthopaedic Surgery

Race and Socioeconomic Status Are Associated With Inferior Patient-Reported Outcome Measures Following Rotator Cuff Repair

PURPOSE

To investigate the impact social determinants of health (SDOH) have on National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive test scores and postoperative health care use in patients who undergo rotator cuff repair (RCR).

METHODS

All patients who underwent RCR surgery by 3 shoulder and/or sports medicine fellowship-trained orthopaedic surgeons between July 2017 and January 2020 were included. The electronic medical record (EMR) was used to identify SDOH for each patient. PROMIS computer adaptive test measures of Upper Extremity function, Pain Interference, and Depression were completed preoperatively and postoperatively (6 months and 1 year). Postoperative health care use (clinical visits, virtual encounters, imaging encounters, and physical therapy visits) were recorded as well. Univariate associations, multiple linear regressions, and Wilcoxon rank-sum tests were used to analyze mean differences between patient groups based on SDOH.

RESULTS

Three hundred thirty-eight patients who underwent RCR were included. Patients who were Black, in lower median household income quartiles, had public insurance, and female reported lower PROMIS scores compared with their counterparts. Smokers and White patients attended fewer postoperative office visits whereas Black patients had more physical therapy and nonvisit encounters compared with their respective counterparts.

CONCLUSIONS

Black race and lower socioeconomic status are associated with worse function and pain outcomes post-RCR compared with White race. Similarly, Black race and positive smoking status are associated with differential use of health care following RCR. Further attention may be required for these patients to address health care disparities.

LEVEL OF EVIDENCE

III, retrospective cohort study.

Creating a Value Dashboard for Orthopaedic Surgical Procedures

BACKGROUND

Value-based health-care delivery is a framework for restructuring our health-care systems with the goal of providing better outcomes for patients at lower cost. Value is determined by patient health outcomes per dollar spent on health services. We sought to develop a value dashboard that could be used to easily track and improve the value of total hip and knee arthroplasty (THA and TKA).

METHODS

We created a value dashboard for TKAs and THAs at our institution. Value was defined as quality of outcomes per dollar spent. The dashboard for each procedure displayed the average value by surgeon, compared with institutional averages for physical function scores and cost. Quality metrics were determined by weighted surgeon ranking using a modified Delphi process and included both clinical and patient-reported outcomes, as measured by the mean change in the Patient-Reported Outcomes Measurement Information System Global-10 (PROMIS-10) physical function score, mean change in the Hip disability and Osteoarthritis Outcome Score-Joint Replacement (HOOS-JR) or the Knee injury and Osteoarthritis Outcome Score-Joint Replacement (KOOS-JR), mean change in the modified Single Assessment Numeric Evaluation (SANE) score, complication rate, periprosthetic joint infection (PJI) rate, and 30-day readmission rate. Average direct costs per surgeon were used. Data from January 2017 through April 2018 were included to ensure 1-year follow-up.

RESULTS

Six surgeons were included in the value dashboard for TKA, and 5 were included in the THA dashboard. The value for TKA by surgeon ranged from 7% below to 12% above the institutional benchmark. The value for THA by surgeon ranged from 12% below to 7% above the institutional benchmark.

CONCLUSIONS

The proposed dashboard utilizes value in a health-care framework and could be used for comparing and improving value for THA and TKA. This dashboard successfully combined patient outcome metrics and direct costs of surgical procedures. Future studies should focus on involving patients in this process and using national data to create benchmarks, which could provide a more accurate representation of value than using institutional averages.

Using Patient-Reported Outcome Measurement Information System Computer Adaptive Testing Domains to Investigate the Impact of Obesity on Physical Function, Pain Interference, and Mental Health in Sports Medicine Patients

Background

While obesity has become an increasingly prevalent health concern in the United States, little emphasis has been placed on utilizing patient reported outcome measures (PROM) to investigate its impact on life from the patients’ perspective. The purpose of the study was to determine the association between patients’ body mass index (BMI) and three Patient-Reported Outcome Measurement Information System (PROMIS) computer adaptive test scores: upper extremity physical function (UE) or lower extremity physical function (PF), pain interference (PI), and depression (D).

Methods

Patients were recruited from two sports medicine orthopedic surgery clinics. PROMIS questionnaires were administered to patients arriving for their first visit. Patients were stratified into BMI groupings according to the National Institute of Health standards. Patients’ BMI, sex, race, ethnicity, and injury were determined retroactively. Data were analyzed using a Pearson correlation and a least significant difference post hoc test.

Results

A total of 833 patients completed the set of PROMIS questionnaires that were retrospectively analyzed. BMI was found to have a correlation with PROMIS-UE (R=−0.111, P<0.05), PROMIS-PF (R=−0.174, P<0.01), PROMIS-PI (R=0.224, P<0.01), and PROMIS-D (R=0.092, P<0.05). Obese patients also portrayed the worst PROMIS-UE, PROMIS-PI, and PROMIS-PF.

Conclusion

We found BMI to correlate with each PROMIS domain: negatively with PROMIS-UE, PROMIS-PF, PROMIS-D, and positively with PROMIS-PI. Additionally, overweight and obese BMI patients portrayed worse physical function and pain interference scores than their healthy group counterparts.

Mobile Phone Administration of Hip-Specific Patient-Reported Outcome Instruments Correlates Highly With In-office Administration

INTRODUCTION

Patient-reported outcome (PRO) instruments typically are delivered via paper or computer; we validated administration of hip-specific instruments over a mobile phone software communication platform outside a clinical encounter.

METHODS

Consecutive patients (n = 69) presenting to a hip preservation clinic completed the Hip Disability and Osteoarthritis Outcome Score Short Form physical function and pain subscales (HOOS-PS and HOOS-PAIN) using standard collection techniques. The subsequent day, patients completed these instruments via a text messaging software program. Text reminders were sent to encourage completion of unanswered questions. Correlation between in-office and mobile phone delivery of PROs was assessed.

RESULTS

The intraclass correlation coefficient between in-clinic and mobile phone delivery of HOOS-PS and HOOS-PAIN was 0.72 (95% confidence interval, 0.58 to 0.81) and 0.80 (95% confidence interval, 0.69 to 0.87), respectively. Completion rate of 93% (64 of the 69) was observed using mobile phone and software messaging. Nine patients completed their PRO after being sent a text message reminder. Fifty-one percent of patients completed all PRO questions within 5 minutes; 26% took between 5 and 10 minutes, and 16% took 10 to 30 minutes for completion.

DISCUSSION

HOOS-PS and HOOS-PAIN PRO instruments administered via text messaging with automated reminders demonstrate good to excellent reproducibility, no minimal detectable change between communication methods, and a high completion rate in adolescents and young adults with hip pain. Mobile phone delivery via automated software may be a valid method for administration of other PROs, allowing for communication with patients anytime and anywhere.

LEVEL OF EVIDENCE

Level IV, case series.

Mental Health and Tobacco Use Are Correlated With Physical Function Outcomes in Patients With Knee Pain and Injury

PURPOSE

To examine the relation between the Patient-Reported Outcomes Measurement Information System (PROMIS) domains of Pain Interference (PROMIS-PI), Depression (PROMIS-D), and Physical Function (PROMIS-PF) for nonoperative patients presenting to our ambulatory sports orthopaedic clinic with knee complaints and to determine whether patient demographic characteristics influence PROMIS scores, particularly tobacco use.

METHODS

All patients treated nonoperatively for a primary complaint of knee pain were recruited for participation. Patients were included if they completed all 3 PROMIS questionnaires prior to their clinical evaluation. Patients were excluded if their treatment plan determined that surgical intervention was warranted. Survey results were compiled, and statistical correlations were run between PROMIS domains and patient demographic characteristics.

RESULTS

A total of 527 PROMIS questionnaire sets were included. PROMIS-PF had a strong negative correlation with PROMIS-PI (R = -0.75, P < .001) and a nearly moderate negative correlation with PROMIS-D (R = -0.47, P < .001). When evaluating patient demographic characteristics, we found a significant decrease in physical function scores and increases in pain and depression scores in both current and former tobacco users compared with nonsmokers. Differences in all PROMIS domains between smokers and nonsmokers exceeded minimal clinically important differences.

CONCLUSIONS

Our study showed an inverse correlation between PROMIS-PI and PROMIS-PF, as well as between PROMIS-D and PROMIS-PI, in patients seen in the ambulatory setting for knee complaints treated nonoperatively. A positive correlation was found between PROMIS-PI and PROMIS-D. Tobacco use was a patient demographic factor found to significantly impact PROMIS scores leading to minimal clinically important differences across all 3 PROMIS domains. The findings of this study may be used to identify patients at high risk of poor outcomes.

LEVEL OF EVIDENCE

Level III, observational study.

Impact of Patient Demographic Factors on Preoperative Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function, Pain Interference, and Depression Computer Adaptive Testing Scores in Patients Undergoing Shoulder and Elbow Surgery

Background:

There has been a growing emphasis in orthopaedics on providing patient-centered care. The US National Institutes of Health launched the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative that incorporates patient-reported outcome measures across a number of medical domains. The relationship between PROMIS domains and the impact of patient demographic factors in those undergoing upper extremity surgery remains unclear.

Purpose/Hypothesis:

The goal of this study was to investigate the correlation between physical function, pain interference, and depression in patients undergoing shoulder and elbow surgery as measured by PROMIS computer adaptive testing (CAT) forms and to determine the impact of patient demographic factors. We hypothesized that there would be a significant negative correlation between physical function and both pain interference and depression in this patient population.

Study Design:

Cross-sectional study; Level of evidence, 3.

Methods:

All patients who underwent elective shoulder or elbow surgery by 3 shoulder, elbow, and/or sports medicine fellowship–trained orthopaedic surgeons were included in the study. Preoperative PROMIS–Upper Extremity (PROMIS-UE), PROMIS–Pain Interference (PROMIS-PI), and PROMIS-Depression (PROMIS-D) CAT scores were analyzed. Pearson correlations were calculated between PROMIS domains as well as between PROMIS outcomes with patient demographic factors.

Results:

Preoperative PROMIS CAT scores for all 3 domains were collected and analyzed from 172 unique patients (516 individual CAT forms) with shoulder and elbow injuries. A negative correlation of moderate strength was found between the PROMIS-UE and PROMIS-PI (R = –0.61; P < .001), and a negligible correlation was found between the PROMIS-UE and PROMIS-D (R = –0.28; P < .001). When stratified by patient demographic factors, the correlation between the PROMIS-UE and PROMIS-PI was stronger in female patients compared with male patients (R = –0.77 vs –0.46, respectively; P < .001 for both), stronger in black patients compared with white patients (R = –0.72 vs –0.56, respectively; P < .001 for both), and highest in current tobacco users (R = –0.80; P < .001).

Conclusion:

Before shoulder and elbow surgery, patients demonstrated impairments in physical function and pain interference as measured by CAT forms, with a moderate negative correlation between baseline upper extremity physical function and pain interference scores. In certain subpopulations, such as female patients, black patients, and current tobacco users, the correlations between these tested domains were stronger than in other groups.

Evaluation of the PROMIS Upper Extremity Computer Adaptive Test Against Validated Patient-Reported Outcomes in Patients With Basilar Thumb Arthritis

PURPOSE

The Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity (UE) computer adaptive test was developed to reduce test burden and improve precision. We hypothesized that, in patients with thumb basilar joint arthritis (BJA), (1) PROMIS UE would correlate with established patient-outcomes (PROs), (2) PROMIS UE would require less time and fewer questions than current metrics, (3) there would be no floor or ceiling effects, and (4) PROMIS UE would not correlate with radiographic disease severity.

METHODS

Patients presenting with a primary diagnosis of thumb BJA completed the Quick Disabilities of the Arm Shoulder and Hand (QuickDASH), Thumb Disability Examination (TDX), Patient-Rated Wrist Hand Evaluation (PRWHE), and PROMIS UE. Radiographic disease severity as described by the Eaton scoring system was recorded. The relationships among PROs were described with Spearman correlation coefficients. The presence of a floor or ceiling effect was confirmed if greater than 15% of patients achieved the lowest or the highest possible score, respectively.

RESULTS

One hundred patients with thumb BJA formed the sample for this study. A good to excellent correlation was identified between PROMIS UE and QuickDASH. There were good correlations between PROMIS UE and TDX as well as PRWHE. The PROMIS UE was significantly less time consuming (average: 58.5 seconds vs QuickDASH, 92.2; TDX, 62.6; and PRWHE, 144.7), and required fewer questions than current metrics (average: 4.9 questions vs QuickDASH, 11; TDX, 20; and, 15). In addition, there were no appreciable floor or ceiling effects. Radiographic disease severity did not correlate with PROMIS UE.

CONCLUSIONS

The PROMIS UE has a good to excellent correlation with QuickDASH and good correlations with PRWHE and TDX. In addition, PROMIS UE required less time and fewer questions than established PROs. There were no floor or ceiling effects. Used as a single PRO, PROMIS UE may be a practical alternative to legacy scales in patients with thumb BJA.

CLINICAL RELEVANCE

The PROMIS UE PRO instrument may be a valuable addition in the assessment of patients with basilar thumb arthritis.

Correlation of PROMIS Physical Function, Pain Interference, and Depression in Pediatric and Adolescent Patients in the Ambulatory Sports Medicine Clinic

Background:

Recently, interest has increased in incorporating the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) outcomes into clinical and research applications in sports medicine. The PROMIS forms have not been studied in pediatric and adolescent sports medicine patients.

Purpose/Hypothesis:

The goal of this study was to determine the correlation between PROMIS Computer Adaptive Test (CAT) forms measuring physical function, pain interference, and depression in pediatric and adolescent patients seen in the ambulatory sports medicine clinic. We hypothesized that there would be a negative correlation between physical function and pain interference as well as depression, as has been demonstrated in adult patient populations.

Study Design:

Cross-sectional study; Level of evidence, 3.

Methods:

All patients aged 8 to 17 years seen by 3 shoulder and sports medicine providers were included in this study. Patients completed a series of PROMIS CAT forms at clinic visits, including the PROMIS-PF and PROMIS-UE (Physical Function and Upper Extremity; depending on the nature of the complaint), PROMIS-PI (Pain Interference), and PROMIS-Depression subscales. Pearson correlation coefficients were calculated between the PROMIS forms as well as with other patient demographic data.

Results:

A total of 236 patient visits (152 patients) were included in the study, comprising 712 total PROMIS CAT forms. A negative correlation was found between PROMIS-PF and both PROMIS-Depression (R = –0.34) and PROMIS-PI (R = –0.76). These correlations with PROMIS-Depression and PROMIS-PI were –0.21 and –0.75, respectively, when considering the PROMIS-UE CAT. Patient demographic information had minimal impact on PROMIS scores as well as on correlations between scores.

Conclusion:

Correlations between physical function, pain interference, and depression were found to be similar in pediatric patients as they are in adult patients, as measured by PROMIS CAT forms.

The Correlation Between PROMIS Pain Interference and VAS Pain in Ambulatory Orthopedic Patients

The purpose of this study was to investigate the correlation of Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference (PI) score with traditionally collected visual analog scale (VAS) scores and to determine the influence of patient demographics on PROMIS PI and VAS scores. Patient demographics were collected, and PROMIS PI, PROMIS Physical Function (PF), and VAS questionnaires were distributed to 215 patients in orthopedic ambulatory clinics. The primary outcome was correlation between PROMIS PI and VAS questionnaires. The statistical method of seemingly unrelated regressions was used to identify significant predictors and strengths of correlation between PROMIS PI and conventional forms. The PROMIS PI score was highly correlated to conventional pain and functional scores, with each standard deviation increase in PROMIS PI score predicting a 16-point increase for pain-related VAS scores (current pain, pain at rest, pain during activity, pain at night), an 18-point decrease in satisfaction of function score, and a 6-point decrease in general health score. Each standard deviation increase in PROMIS PF score for black patients predicted a reduction of 11 points for current pain, 10 points for pain at rest, 10 points for pain during activity, and 12 points for pain at night scores. The PROMIS PI score consistently predicts changes in VAS pain scores and can be considered a useful, standardized tool for measuring pain for clinical and research purposes. [Orthopedics. 2018; 41(6):e813-e819.].