1
|
Baxter SN, Johnson AH, Brennan JC, MacDonald JH, Turcotte JJ, King PJ. Social vulnerability adversely affects emergency-department utilization but not patient-reported outcomes after total joint arthroplasty. Arch Orthop Trauma Surg 2024; 144:1803-1811. [PMID: 38206446 DOI: 10.1007/s00402-023-05186-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 12/18/2023] [Indexed: 01/12/2024]
Abstract
INTRODUCTION Multiple studies demonstrate social deprivation is associated with inferior outcomes after total hip (THA) and total knee (TKA) arthroplasty; its effect on patient-reported outcomes is debated. The primary objective of this study evaluated the relationship between social vulnerability and the PROMIS-PF measure in patients undergoing THA and TKA. A secondary aim compared social vulnerability between patients who required increased resource utilization or experienced complications and those who didn't. MATERIALS AND METHODS A retrospective review of 537 patients from March 2020 to February 2022 was performed. The Centers for Disease Control Social Vulnerability Index (SVI) were used to quantify socioeconomic disadvantage. The cohort was split into THA and TKA populations; univariate and multivariate analyses were performed to evaluate primary and secondary outcomes. Statistical significance was assessed at p < 0.05. RESULTS 48.6% of patients achieved PROMIS-PF MCID at 1-year postoperatively. Higher levels of overall social vulnerability (0.40 vs. 0.28, p = 0.03) were observed in TKA patients returning to the ED within 90-days of discharge. Increased overall SVI (OR = 9.18, p = 0.027) and household characteristics SVI (OR = 9.57, p = 0.015) were independent risk factors for 90-day ED returns after TKA. In THA patients, increased vulnerability in the household type and transportation dimension was observed in patients requiring 90-day ED returns (0.51 vs. 0.37, p = 0.04). CONCLUSION Despite an increased risk for 90-day ED returns, patients with increased social vulnerability still obtain good 1-year functional outcomes. Initiatives seeking to mitigate the effect of social deprivation on TJA outcomes should aim to provide safe alternatives to ED care during early recovery.
Collapse
Affiliation(s)
- Samantha N Baxter
- Anne Arundel Medical Center Inc, 2000 Medical Parkway, Annapolis, MD, 21401, USA
| | - Andrea H Johnson
- Anne Arundel Medical Center Inc, 2000 Medical Parkway, Annapolis, MD, 21401, USA
| | - Jane C Brennan
- Anne Arundel Medical Center Inc, 2000 Medical Parkway, Annapolis, MD, 21401, USA
| | - James H MacDonald
- Anne Arundel Medical Center Inc, 2000 Medical Parkway, Annapolis, MD, 21401, USA
| | - Justin J Turcotte
- Anne Arundel Medical Center Inc, 2000 Medical Parkway, Annapolis, MD, 21401, USA.
| | - Paul J King
- Anne Arundel Medical Center Inc, 2000 Medical Parkway, Annapolis, MD, 21401, USA
| |
Collapse
|
2
|
Romeo PV, Papalia AG, Alben MG, Vargas L, Zuckerman JD, Virk MS. Analysis of factors associated with patient-reported outcome (PRO) score completion rate one year after shoulder surgeries. JSES Int 2024; 8:204-211. [PMID: 38312294 PMCID: PMC10837699 DOI: 10.1016/j.jseint.2023.08.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2024] Open
Abstract
Background Patient-reported outcome measurements (PROMs) are important metrics for monitoring improvements following shoulder surgery. Despite the easy accessibility of electronic PROM surveys, completion rates vary, and factors predictive of survey completion for patients enrolled in medical survey follow-up after shoulder surgery remain largely unknown. The purpose of this study is to investigate survey completion rates for common shoulder procedures and identify factors predictive of PROM completion at one-year postoperatively. We hypothesize that the response rate to shoulder PROMs may vary by the shoulder procedure type after surgery. Methods Patients undergoing total shoulder arthroplasty (TSA), rotator cuff repair (RCR), and instability surgery (Latarjet procedure [LP], and arthroscopic Bankart repair [ABR]) from 2019 to 2021 were prospectively enrolled. Each patient was administered PROM surveys via email preoperatively and at 2-weeks, 6-weeks, 3-months, 6-months, and 12-months following surgery. Demographics and socioeconomic characteristics were collected from our institutional database. The primary outcome studied was survey completion rate by procedure. Multivariable logistic regression was performed to identify factors predictive of completing 12-month follow-up. Results A total of 514 (251 TSA, 194 RCR, and 69 instability surgery (35 LP, 34 ABR)) patients with an average age of 58 ± 15 years were included in this study. Overall, the 12-month survey completion rate for all procedures was 57.2%. TSA had the highest completion rate (64.9%), followed by RCR (52.1%), ABR (44.2%), and LP (42.9%). ABR and LP demonstrated more than a 50% drop in survey response at 2 weeks, and the RCR cohort demonstrated an increased attrition in survey response at the 6-month mark. Patients who completed the 12-month follow-up survey were older [61 ± 14 vs. 54 ± 17; P < .001], less frequently self-identified as Hispanic [13% vs. 23%; P = .009], less frequently single [32% vs. 44%; P = .008], and most frequently classified as the American Society of Anesthesiology [ASA] score II [65%, P = .001]. Conclusion Postoperative PROM survey completion rates vary significantly among commonly performed shoulder procedures during the first year after surgery. Hispanic ethnicity and younger age were all predictive of a lower propensity, and the TSA procedure is predictive of higher odds for PROM survey completion at the 12-month follow-up.
Collapse
Affiliation(s)
- Paul V Romeo
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Aidan G Papalia
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Matthew G Alben
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Luilly Vargas
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Joseph D Zuckerman
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Mandeep S Virk
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| |
Collapse
|
3
|
Huyke-Hernández FA, Doxey SA, Robb JL, Bohn DC, Cunningham BP. The Minimum Clinically Important Difference for the Patient-Rated Wrist Evaluation in Surgical Fixation of Distal Radius Fractures: Does Hand Dominance Make a Difference? Injury 2023; 54:110959. [PMID: 37507254 DOI: 10.1016/j.injury.2023.110959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 06/22/2023] [Accepted: 07/22/2023] [Indexed: 07/30/2023]
Abstract
BACKGROUND Distal radius fractures (DRFs) are common orthopaedic injuries. They can be treated in many ways, but the volar locking plate (VLP) is more frequent. Currently, there is limited information regarding the minimum clinically important difference (MCID) in surgically treated DRFs. The purpose of this study was to calculate MCID values for the Patient-Reported Wrist Evaluation (PRWE) in the setting of VLP-treated DRFs. METHODS A retrospective review was conducted for patients with isolated, surgically-treated DRFs with a VLP. Exclusions included any concomitant procedure other than a carpal tunnel release, skeletal immaturity, polytrauma, open fracture, or missing PRWE data. MCID was calculated using PRWE, an overall health question, and the anchor-based method. RESULTS A total of 131 patients were identified. Approximately 54.2% injured their dominant hand. AO/OTA classification 23C was the most common (n=89, 67.9%). Average baseline, 6-week, and 12-week PRWE were 71.8 ± 19.6, 34.3 ± 20.1, and 21.2 ± 18.0 respectively. This corresponds to an average change from baseline PRWE at 6 weeks and 12 weeks of -37.5 ± 23.4 and -50.6 ± 22.3, respectively. Average MCID values for 6 weeks and 12 weeks were 43.1 ± 18 and 56.0 ± 20.0, respectively (p<0.001). Hand dominance did not correlate with MCID value (rs = 0.084 at six weeks, rs = 0.099 at 12 weeks). MCID value additionally did not correlate with sex, AO/OTA classification, smoking status, ASA score, or BMI. Treatment at a level 1 trauma center and diagnosis of anxiety and/or depression correlated with a higher 6-week MCID value (rs = 0.308 and rs = 0.410, respectively). Increasing age weakly correlated with higher 12-week MCID value (rs = 0.352). CONCLUSIONS This study demonstrated an MCID calculation using an overall health anchor. MCID value varied with follow-up time and correlated weakly with age, diagnosis of anxiety and/or depression, and treatment facility, but it did not correlate with injury of the dominant hand. Future research should analyze how to apply MCID and identify successful treatment in the setting of DRF care.
Collapse
Affiliation(s)
- Fernando A Huyke-Hernández
- Department of Orthopaedic Surgery, Park Nicollet Methodist Hospital, St. Louis Park, MN, USA; Department of Orthopaedic Surgery, TRIA Orthopaedic Institute, Bloomington, MN, USA
| | - Stephen A Doxey
- Department of Orthopaedic Surgery, Park Nicollet Methodist Hospital, St. Louis Park, MN, USA; Department of Orthopaedic Surgery, TRIA Orthopaedic Institute, Bloomington, MN, USA
| | - Jennifer L Robb
- Department of Orthopaedic Surgery, TRIA Orthopaedic Institute, Bloomington, MN, USA
| | - Deborah C Bohn
- Department of Orthopaedic Surgery, TRIA Orthopaedic Institute, Bloomington, MN, USA; Department of Orthopaedic Surgery, University of Minnesota, Minneapolis, MN, USA
| | - Brian P Cunningham
- Department of Orthopaedic Surgery, Park Nicollet Methodist Hospital, St. Louis Park, MN, USA; Department of Orthopaedic Surgery, TRIA Orthopaedic Institute, Bloomington, MN, USA.
| |
Collapse
|
4
|
Kuhns BD, Sholtis CD, Reuter JM, Goldblatt J, Bronstein R, Baumhauer JF, Maloney MD, Mannava S. Impact of Sports Participation on Achievement of Clinically Relevant Outcomes 2 Years After ACL Reconstruction. Orthop J Sports Med 2023; 11:23259671231187327. [PMID: 37655256 PMCID: PMC10467379 DOI: 10.1177/23259671231187327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 04/13/2023] [Indexed: 09/02/2023] Open
Abstract
Background Clinically relevant threshold values associated with patient-reported outcome measures after orthopaedic procedures such as anterior cruciate ligament reconstruction (ACLR) are important for relating these scores to meaningful postoperative improvement. Purpose/Hypothesis The purpose of this study was to determine the Patient Acceptable Symptom State (PASS) for the Patient-Reported Outcomes Measurement Information System Computer Adaptive Test (PROMIS-CAT) after ACLR. It was hypothesized that preoperative sport participation would have an impact on PASS achievement. Study Design Case series; Level of evidence, 4. Methods Included were consecutive patients who underwent primary assisted ACLR between January 4 and August 1, 2016. Patients were administered the PROMIS-CAT Physical Function (PF) and Pain Interference domains preoperatively and at a minimum 2 years postoperatively, with external anchor questions used to determine the PASS. Receiver operating characteristic (ROC) curves were constructed for the entire study population as well as separately for athletes and nonathletes to determine PROMIS PASS thresholds for each population. A previously published PROMIS-PF minimal clinically important difference was used to evaluate postoperative improvement. A post hoc multivariate nominal logistic multivariate analysis was constructed to assess the effects of preoperative patient characteristics on the likelihood of attaining both the minimal clinically important difference and PASS. Results In total, 112 patients were included in the study, with 79 (71%) having recreational or higher levels of athletic participation. The PASS for the study population was 56.0 (area under the ROC curve, 0.86) and was unaffected by baseline PROMIS-PF scores but was affected by preoperative athletic participation (56.0 for athletes, 49.0 for nonathletes). A post hoc analysis found 57 patients (51%) achieved the PASS for the PROMIS-PF (cutoff, 56.0), but when the athlete and nonathlete thresholds were applied to their respective patient groups, 66% of athletes and 64% of nonathletes achieved the PASS postoperatively. The multivariate analysis found that sport participation (odds ratio, 6.2; P = .001) but not age, sex, body mass index, or preoperative PROMIS affected the likelihood of achieving the PASS on the PROMIS-PF. Conclusion Preoperative athletic participation significantly affected the ability to achieve PASS.
Collapse
Affiliation(s)
- Benjamin D. Kuhns
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - Connor D. Sholtis
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - John M. Reuter
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - John Goldblatt
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - Robert Bronstein
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - Judith F. Baumhauer
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - Michael D. Maloney
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| | - Sandeep Mannava
- Department of Orthopaedics & Physical Performance, University of Rochester Medical Center, Rochester, New York, USA
| |
Collapse
|
5
|
Romeo PV, Papalia AG, Alben MG, Gambhir N, Shankar D, Bi AS, Zuckerman JD, Virk MS. Prognostic factors associated with improvements in patient-reported outcomes in idiopathic adhesive capsulitis. JSES Int 2023; 7:336-341. [PMID: 36911781 PMCID: PMC9998727 DOI: 10.1016/j.jseint.2022.12.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
Background The purpose of this study was to identify prognostic factors that are associated with improvements in patient-reported outcomes measures (PROMs) related to upper extremity function and pain in those suffering from idiopathic adhesive capsulitis. Methods All patients treated conservatively for primary idiopathic adhesive capsulitis were identified from our institutional database between 2019 and 2021. Exclusion criteria included any patients treated surgically, follow-up less than one year, or incomplete survey results. PROMs including Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity Computer Adaptive Test Version 2.0 (P-UE), Pain Interference (P-Interference), Pain Intensity (P-Intensity), and visual analog scale (VAS) pain scores. They were obtained at initial consultation and at one year to assess patient-perceived impact of their condition. Multiple linear and multivariable logistic regressions were performed to identify factors associated with improvement in patient-perceived pain and shoulder function using final PROM scores and difference in PROM scores from initial consultation. An independent t-test was used to compare baseline and one-year minimum follow-up PROMs. Odds ratios and their 95% confidence intervals were calculated for each factor; a P value of < .05 was considered statistically significant. Results A total of 56 patients (40 females and 16 males) were enrolled in the study with an average age of 54.7 ± 7.7 years. A significant improvement (P < .001) was demonstrated at one-year minimum outcomes for P-UE, P-Interference, P-Intensity, and VAS scores. With respect to comorbid conditions, hypothyroidism [P-UE (β: 9.57, P = .006)] was associated with greater improvements in PROMs, while hyperlipidemia [P-UE (β: -4.13, P = .01) and P-Intensity (β: 2.40, P = .02)] and anxiety [P-UE (β: -4.13, P = .03)] were associated with poorer reported changes in PROMs. Female sex [P-UE (β: 4.03, P = .007) and P-Interference (β: -2.65, P = .04)] and employment in manual labor professions [P-Interference (β: -3.07, P = .01), P-Intensity (β: -2.92, P = .006), and VAS (β: -0.66, P = .03)] were associated with significantly better patient-perceived outcomes. Hispanic heritage was associated with higher reported changes of P-Intensity (β: 8.45, P = .004) and VAS (β: 2.65, P = .002). Conclusion Patient-perceived improvements in PROMIS score during the natural history of adhesive capsulitis are likely multifactorial, with anxiety, hyperlipidemia, increased body mass index, and Hispanic heritage associated with reduced improvement in PROMIS scores.
Collapse
Affiliation(s)
- Paul V Romeo
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Aidan G Papalia
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Matthew G Alben
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Neil Gambhir
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Dhruv Shankar
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Andrew S Bi
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Joseph D Zuckerman
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| | - Mandeep S Virk
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, New York, NY, USA
| |
Collapse
|
6
|
Alben MG, Gordon D, Gambhir N, Kim MT, Romeo PV, Rokito AS, Zuckerman JD, Virk MS. Minimal clinically important difference (MCID) and substantial clinical benefit (SCB) of upper extremity PROMIS scores following arthroscopic rotator cuff repairs. Knee Surg Sports Traumatol Arthrosc 2023:10.1007/s00167-022-07279-7. [PMID: 36622420 DOI: 10.1007/s00167-022-07279-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Accepted: 12/07/2022] [Indexed: 01/10/2023]
Abstract
PURPOSE To calculate and determine what factors are associated with achieving the Minimal Clinically Important Difference (MCID) and the Substantial Clinical Benefit (SCB) of Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity Computer Adaptive Testing v2.0 (UE), Pain Interference (P-Interference), and Pain Intensity (P-Intensity) in patients undergoing arthroscopic rotator cuff repair (aRCR). METHODS The change in PROMIS scores representing the optimal cutoff for a ROC curve with an area under the curve analysis was used to calculate the anchor-based MCID and SCB. To assess the responsiveness of each PROM, effect sizes and standardized response means (SRM) were calculated. To identify factors associated with attaining the MCID and SCB, univariate and multivariate logistic regression analyses were performed. RESULTS A total of 323 patients with an average age of 59.9 ± 9.5 were enrolled in this study, of which, 187/323 [57.9%] were male and 136/323 [42.1%] were female. The anchor-based MCID for PROMIS UE, P-Interference, and P-Intensity was: 9.0, 7.5, and 11.2, respectively. The respective SCB was 10.9, 9.3, and 12.7. Effect size and SRM were: PROMIS UE (1.4, 1.3), P-Interference (1.8, 1.5), and P-Intensity (2.3, 2.0). Lower preoperative P-Intensity scores (p = 0.02), dominant arm involvement (p = 0.03), and concomitant biceps tenodesis (p = 0.03) were associated with patients achieving the SCB for PROMIS UE. CONCLUSION A large responsiveness for each of the PROMIS instruments due to the majority of patients reporting great improvement after aRCR and a small standard deviation across all outcome measures was shown in our study. Lower preoperative P-Intensity scores and concomitant biceps tenodesis were associated with higher odds of achieving the SCB for PROMIS UE. The knowledge of MCID and SCB values for PROMIS instruments will allow the surgeon to determine whether the improvements in the PROMIS scores after aRCR are clinically meaningful. LEVEL OF EVIDENCE Level III.
Collapse
Affiliation(s)
- Matthew G Alben
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA
| | - Dan Gordon
- Department of Orthopedic Surgery, Baylor University Medical Center Dallas, Dallas, TX, USA
| | - Neil Gambhir
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA
| | - Matthew T Kim
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA
| | - Paul V Romeo
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA
| | - Andrew S Rokito
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA
| | - Joseph D Zuckerman
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA
| | - Mandeep S Virk
- Division of Shoulder and Elbow Surgery, Department of Orthopedic Surgery, NYU Grossman School of Medicine, NYU Langone Orthopedic Hospital, NYU Langone Health, 246 East 20Th Street, New York, NY, 10003, USA.
| |
Collapse
|
7
|
Bernstein DN, Cliburn JA, Lachant DJ, White RJ, Hammert WC. Evaluation of Clinical Recovery After Surgical Treatment for Hand Ischemia From Vasospastic and Occlusive Disease Using PROMIS. Hand (N Y) 2023; 18:15-21. [PMID: 33789521 PMCID: PMC9806527 DOI: 10.1177/1558944721999727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
BACKGROUND There is a paucity of literature describing the recovery trajectory after surgery for upper extremity ischemia. Using Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF), Upper Extremity (UE), Pain Interference (PI), and Depression domains, we aimed to describe the postoperative recovery of such patients. METHODS We queried our PROMIS database for patients undergoing surgery for vasospastic or occlusive disease over a 4.5-year period. Inclusion criteria were preoperative, early (average 3 weeks) and late (average 6 months) postoperative PROMIS PF and/or UE, PI, and Depression scores. The change in PROMIS scores was calculated for each time point. Changes in PROMIS scores were compared with minimal clinically important difference estimates. RESULTS We identified 13 patients undergoing 13 surgical interventions that met inclusion criteria. More than one-half of our patients were men (n = 7 [54%]), and more than one-half of the surgeries (n = 7 [54%]) were for isolated occlusive diagnoses, with the remainder for vasospastic disease. At short-term postoperative follow-up, the change in PROMIS PF, UE, PI, and Depression scores was -6.34 (SD: 9.13), -6.81 (SD: 9.61), 3.16 (SD: 5.78), and -3.05 (SD: 8.37), respectively. At mid-term postoperative follow-up, the change in PROMIS PF, UE, PI, and Depression scores was 4.45 (SD: 10.33), 8.04 (SD: 13.84), -7.03 (SD: 7.06), and -12.27 (SD: 10.85), respectively. CONCLUSIONS Our findings suggest patients undergoing surgical treatment for upper extremity ischemia experience a worsening of functional symptoms initially, as expected, followed by notable improvement.
Collapse
|
8
|
Wong A, Burke CE, Bangura A, O'Hara NN, Mundy L, O'Toole RV, Pensy RA. What Outcomes Are Most Important to Patients Following a Lower Extremity Limb-threatening Injury? Ann Surg 2023; 277:21-27. [PMID: 35797182 DOI: 10.1097/sla.0000000000005470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE To determine what outcomes are most important to patients after a limb-threatening injury, and if those preferences vary based on the patients' treatment (salvage vs amputation), health, demographics, or time since injury. BACKGROUND The preferences that motivate the patients' choice of treatment following a limb-threatening injury are poorly understood. Discrete choice experiments (DCEs) are a robust survey methodology to quantify preferences. METHODS Patients with a history of traumatic limb-threatening injury, January 2010 to December 2020, completed a survey with our DCE and the Patient-Reported Outcomes Measurement Information System (PROMIS) questionnaire. The DCE attributes included recovery time, function, appearance, cost, and time in hospital. We used conditional logit modeling to estimate the relative importance of each attribute on a scale of 0% to 100%, determine willingness to pay for improvements in the included attributes, and assess variation in preferences based on patient characteristics, including PROMIS score. RESULTS A total of 150 patients completed the survey (104 limb salvage, 46 amputation; mean age, 48±16 years; 79% male). Regaining preinjury function [relative importance=41%; 95% confidence interval (CI), 37%-45%] and minimizing costs (24%; 95% CI, 21%-28%) were of greatest importance. Changes in appearance were least important (7%; 95% CI, 5%-9%). The hierarchy of preferences did not vary between those who had limb salvage or amputation, but patient age, physical and mental health, and income were associated with preference variation. CONCLUSIONS Patients with limb-threatening injuries most valued gains in function and reduced out-of-pocket costs.
Collapse
Affiliation(s)
- Alison Wong
- Department of Orthopaedics, R Adams Cowley Shock Trauma Center, University of Maryland School of Medicine, Baltimore, MD
| | | | | | | | | | | | | |
Collapse
|
9
|
Paranjape CS, de Araujo OB, Reider LM, Sponseller PD, Carlini AR, McLaughlin K, Bachmann KR, Mitchell SL. Time to Completion of Pediatric PROMIS Computerized Adaptive Testing Measures and the SRS-22r in an Adolescent Idiopathic Scoliosis Population. J Pediatr Orthop 2022; 42:462-466. [PMID: 35973055 PMCID: PMC9474712 DOI: 10.1097/bpo.0000000000002245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
BACKGROUND Patient-reported outcome measures are useful tools to quantify patients' pre-treatment and post-treatment symptoms. Historically used "legacy measures", such as the Scoliosis Research Society-22 revised questionnaire (SRS-22r), are often disease-specific and can be time-intensive. Recently developed Patient-Reported Outcomes Measurement Information System (PROMIS) computerized adaptive testing (CAT) measures may reduce administrative burdens and permit more efficient outcome collection within clinic workflows. In an era of medicine where payments are becoming tied to outcomes, we sought to assess the time to completion (TTC) of 8 pediatric PROMIS CAT measures and the SRS-22r in adolescents with idiopathic scoliosis. MATERIALS AND METHODS Patients presenting to a large, urban tertiary referral hospital were prospectively enrolled into the study. Subjects were first-time survey respondents in various phases and types of treatment for adolescent idiopathic scoliosis. In total, 200 patients ranging from 10 to 17 years old completed 8 Pediatric PROMIS CATs and the SRS-22r. PROMIS CATs administered include Physical Activity, Mobility, Anxiety, Depressive symptoms, Peer Relationships, Physical Stress Experiences, Pain Behavior and Pain Interference. TTC was calculated using start and stop timestamps in the REDCap software. RESULTS The mean (±SD) TTC for each PROMIS CAT was 1.1 (±0.9) minutes with physical activity, mobility, anxiety, depressive symptoms, peer relationships, physical stress experiences, pain behavior, and pain interference taking 1.2, 1.4, 1.0, 0.9, 1.2, 1.0, 1.0, and 1.2 minutes on average to complete, respectively. Mean TTC for the SRS-22r was 5.2 (±3.0) minutes. CONCLUSIONS In this pediatric orthopaedic cohort, completion of 8 PROMIS CATs demonstrated minimal test-taker burden and time required for completion. These findings support rapid and easily integrable PROMIS CATs in clinical practice to aid in increased delivery of efficient, patient-centered care. LEVEL OF EVIDENCE III, cross-sectional study.
Collapse
Affiliation(s)
| | - Olivia B. de Araujo
- Department of Orthopedic Surgery, University of North Carolina, Chapel Hill, NC
| | - Lisa M. Reider
- Department of Health Policy and Management, the Johns Hopkins Bloomberg School of Public Health, Baltimore, MD
| | - Paul D. Sponseller
- Department of Orthopedic Surgery, the Johns Hopkins University School of Medicine, Baltimore, MD
| | - Anthony R. Carlini
- Department of Health Policy and Management, the Johns Hopkins Bloomberg School of Public Health, Baltimore, MD
| | - Kevin McLaughlin
- Department of Physical Medicine and Rehabilitation, the Johns Hopkins University School of Medicine, Baltimore, MD
| | - Keith R. Bachmann
- Department of Orthopaedic Surgery, University of Virginia, Charlottesville, VA
| | - Stuart L. Mitchell
- Department of Orthopedic Surgery, University of North Carolina, Chapel Hill, NC
| |
Collapse
|
10
|
Linking Hip Disability and Osteoarthritis Outcome Score-Physical Function Short Form and PROMIS Physical Function. J Am Acad Orthop Surg 2022; 30:e1043-e1050. [PMID: 35476824 DOI: 10.5435/jaaos-d-21-00736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Accepted: 03/27/2022] [Indexed: 02/01/2023] Open
Abstract
INTRODUCTION Linking scores on patient-reported outcome measures can enable data aggregation for research, clinical care, and quality. We aimed to link scores on the Hip Disability and Osteoarthritis Outcome Score-Physical Function Short Form (HOOS-PS) and the Patient-reported Outcomes Measurement Information System Physical Function (PROMIS PF). METHODS A retrospective study was conducted from 2017 to 2020 evaluating patients with hip osteoarthritis who received routine clinical care from an orthopaedic surgeon. Our sample included 3,382 unique patients with 7,369 pairs of HOOS-PS and PROMIS PF measures completed at a single nonsurgical, preoperative, or postoperative time point. We included one randomly selected time point of scores for each patient in our linking analysis sample. We compared the accuracy of linking using four methods, including equipercentile and item response theory-based approaches. RESULTS PROMIS PF and HOOS-PS scores were strongly correlated ( r = -0.827 for raw HOOS-PS scores and r = 0.820 for summary HOOS-PS scores). The assumptions were met for equipercentile and item response theory approaches to linking. We selected the item response theory-based Stocking-Lord approach as the optimal crosswalk and estimated item parameters for the HOOS-PS items on the PROMIS metric. A sensitivity analysis demonstrated overall robustness of the crosswalk estimates in nonsurgical, preoperative, and postoperative patients. CONCLUSION These crosswalks can be used to convert scores between HOOS-PS and PROMIS PF metric at the group level, which can be valuable for data aggregation. Conversion of individual patient-level data is not recommended secondary to increased risk of error.
Collapse
|
11
|
Brock L, Hightower B, Moore T, Nees D, Heigle B, Shepard S, Kee M, Ottwell R, Hartwell M, Vassar M. Reporting of Patient-Reported Outcome Measures in Randomized Controlled Trials on Shoulder Rotator Cuff Injuries Is Suboptimal and Requires Standardization. Arthrosc Sports Med Rehabil 2022; 4:e1429-e1436. [PMID: 36033194 PMCID: PMC9402470 DOI: 10.1016/j.asmr.2022.04.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Accepted: 04/25/2022] [Indexed: 11/29/2022] Open
Abstract
Purpose Methods Results Conclusions Clinical Relevance
Collapse
Affiliation(s)
- Lydia Brock
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Address correspondence to Lydia Brock, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107.
| | - Brooke Hightower
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Ty Moore
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Danya Nees
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Department of Internal Medicine, University of Oklahoma, School of Community Medicine Tulsa, Oklahoma, U.S.A
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| |
Collapse
|
12
|
Mitchell SL, McLaughlin KH, Bachmann KR, Sponseller PD, Reider LM. Construct Validity of Pediatric PROMIS Computerized Adaptive Testing Measures in Children With Adolescent Idiopathic Scoliosis. J Pediatr Orthop 2022; 42:e720-e726. [PMID: 35703245 PMCID: PMC9276633 DOI: 10.1097/bpo.0000000000002190] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
BACKGROUND The use of patient-reported outcome measures, especially Patient-Reported Outcomes Measurement Information System (PROMIS) measures, has increased in recent years. Given this growth, it is imperative to ensure that the measures being used are validated for the intended population(s)/disease(s). Our objective was to assess the construct validity of 8 PROMIS computer adaptive testing (CAT) measures among children with adolescent idiopathic scoliosis (AIS). METHODS We prospectively enrolled 200 children (aged 10 to 17 y) with AIS, who completed 8 PROMIS CATs (Anxiety, Depressive Symptoms, Mobility, Pain Behavior, Pain Interference, Peer Relationships, Physical Activity, Physical Stress Experiences) and the Scoliosis Research Society-22r questionnaire (SRS-22r) electronically. Treatment categories were observation, bracing, indicated for surgery, or postoperative from posterior spinal fusion. Construct validity was evaluated using known group analysis and convergent and discriminant validity analyses. Analysis of variance was used to identify differences in PROMIS T -scores by treatment category (known groups). The Spearman rank correlation coefficient ( rs ) was calculated between corresponding PROMIS and SRS-22r domains (convergent) and between unrelated PROMIS domains (discriminant). Floor/ceiling effects were calculated. RESULTS Among treatment categories, significant differences were found in PROMIS Mobility, Pain Behavior, Pain Interference, and Physical Stress Experiences and in all SRS-22r domains ( P <0.05) except Mental Health ( P =0.15). SRS-22r Pain was strongly correlated with PROMIS Pain Interference ( rs =-0.72) and Pain Behavior ( rs =-0.71) and moderately correlated with Physical Stress Experiences ( rs =-0.57). SRS-22r Mental Health was strongly correlated with PROMIS Depressive Symptoms ( rs =-0.72) and moderately correlated with Anxiety ( rs =-0.62). SRS-22r Function was moderately correlated with PROMIS Mobility ( rs =0.64) and weakly correlated with Physical Activity ( rs =0.34). SRS-22r Self-Image was weakly correlated with PROMIS Peer Relationships ( rs =0.33). All unrelated PROMIS CATs were weakly correlated (| rs |<0.40). PROMIS Anxiety, Mobility, Pain Behavior, and Pain Interference and SRS-22r Function, Pain, and Satisfaction displayed ceiling effects. CONCLUSIONS Evidence supports the construct validity of 6 PROMIS CATs in evaluating AIS patients. Ceiling effects should be considered when using specific PROMIS CATs. LEVEL OF EVIDENCE Level II, prognostic.
Collapse
Affiliation(s)
- Stuart L. Mitchell
- Department of Orthopaedic Surgery, The Johns Hopkins University School of Medicine, Baltimore, MD
- Department of Orthopaedic Surgery, University of North Carolina, NC
| | - Kevin H. McLaughlin
- Department of Physical Medicine and Rehabilitation, The Johns Hopkins University School of Medicine, Baltimore, MD
| | - Keith R. Bachmann
- Department of Orthopaedic Surgery, University of Virginia, Charlottesville, VA
| | - Paul D. Sponseller
- Department of Orthopaedic Surgery, The Johns Hopkins University School of Medicine, Baltimore, MD
| | - Lisa M. Reider
- Department of Health Policy and Management, The Johns Hopkins Bloomberg School of Public Health, Baltimore, MD
| |
Collapse
|
13
|
Bernstein DN, Karhade AV, Bono CM, Schwab JH, Harris MB, Tobert DG. Sociodemographic Factors Are Associated with Patient-Reported Outcome Measure Completion in Orthopaedic Surgery: An Analysis of Completion Rates and Determinants Among New Patients. JB JS Open Access 2022; 7:e22.00026. [PMID: 35935603 PMCID: PMC9355105 DOI: 10.2106/jbjs.oa.22.00026] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Patient-reported outcome measures (PROMs) and, specifically, the Patient-Reported Outcomes Measurement Information System (PROMIS), are increasingly utilized for clinical research, clinical care, and health-care policy. However, completion of these outcome measures can be inconsistent and challenging. We hypothesized that sociodemographic variables are associated with the completion of PROM questionnaires. The purposes of the present study were to calculate the completion rate of assigned PROM forms and to identify sociodemographic and other variables associated with completion to help guide improved collection efforts. Methods All new orthopaedic patients at a single academic medical center were identified from 2016 to 2020. On the basis of subspecialty and presenting condition, patients were assigned certain PROMIS forms and legacy PROMs. Demographic and clinical information was abstracted from the electronic medical record. Bivariate analyses were performed to compare characteristics among those who completed assigned PROMs and those who did not. A multivariable logistic regression model was created to determine which variables were associated with successful completion of assigned PROMs. Results Of the 219,891 new patients, 88,052 (40%) completed all assigned PROMs. Patients who did not activate their internet-based patient portal had a 62% increased likelihood of not completing assigned PROMs (odds ratio [OR], 1.62; 95% confidence interval [CI], 1.58 to 1.66; p < 0.001). Non-English-speaking patients had a 90% (OR, 1.90; 95% CI, 1.82 to 2.00; p < 0.001) increased likelihood of not completing assigned PROMs at presentation. Older patients (≥65 years of age) and patients of Black race had a 23% (OR, 1.23; 95% CI, 1.19 to 1.27; p < 0.001) and 24% (OR, 1.24; 95% CI, 1.19 to 1.30; p < 0.001) increased likelihood of not completing assigned PROMs, respectively. Conclusions The rate of completion of PROMs varies according to sociodemographic variables. This variability could bias clinical outcomes research in orthopaedic surgery. The present study highlights the need to uniformly increase completion rates so that outcomes research incorporates truly representative cohorts of patients treated. Furthermore, the use of these PROMs to guide health-care policy decisions necessitates a representative patient distribution to avoid bias in the health-care system. Level of Evidence Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence.
Collapse
Affiliation(s)
- David N. Bernstein
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- Harvard Combined Orthopaedic Residency Program, Boston, Massachusetts
| | - Aditya V. Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- Harvard Combined Orthopaedic Residency Program, Boston, Massachusetts
| | - Christopher M. Bono
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Joseph H. Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Mitchel B. Harris
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Daniel G. Tobert
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
14
|
Brodke DJ, Zhang C, Shaw JD, Cizik AM, Saltzman CL, Brodke DS. How Do PROMIS Scores Correspond to Common Physical Abilities? Clin Orthop Relat Res 2022; 480:996-1007. [PMID: 34855330 PMCID: PMC9007194 DOI: 10.1097/corr.0000000000002046] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 10/19/2021] [Indexed: 01/31/2023]
Abstract
BACKGROUND The Patient-Report Outcomes Measurement Information System (PROMIS) is increasingly used as a general-purpose tool for measuring orthopaedic surgery outcomes. This set of questionnaires is efficient, precise, and correlates well with specialty-specific measures, but impactful implementation of patient-specific data, especially at the point of care, remains a challenge. Although clinicians may have substantial experience with established patient-reported outcome measures in their fields, PROMIS is relatively new, and the real-life meaning of PROMIS numerical summary scores may be unknown to many orthopaedic surgeons. QUESTIONS/PURPOSES We aimed to (1) identify a small subset of important items in the PROMIS Physical Function (PF) item bank that are answered by many patients with orthopaedic conditions and (2) graphically display characteristic responses to these items across the physical function spectrum in order to translate PROMIS numerical scores into physical ability levels using clinically relevant, familiar terms. METHODS In a cross-sectional study, 97,852 PROMIS PF assessments completed by 37,517 patients with orthopaedic conditions presenting to a tertiary-care academic institution were pooled and descriptively analyzed. Between 2017 and 2020, we evaluated 75,354 patients for outpatient orthopaedic care. Of these, 67% (50,578) were eligible for inclusion because they completed a PROMIS version 2.0 physical function assessment; 17% (12,720) were excluded because they lacked information in the database on individual item responses, and another < 1% (341) were excluded because the assessment standard error was greater than 0.32, leaving 50% of the patients (37,517) for analysis. The PROMIS PF is scored on a 0-point to 100-point scale, with a population mean of 50 and SD of 10. Anchor-based minimum clinically important differences have been found to be 8 to 10 points in a foot and ankle population, 7 to 8 points in a spine population, and approximately 4 points in a hand surgery population. The most efficient and precise means of administering the PROMIS PF is as a computerized adaptive test (CAT), whereby an algorithm intelligently tailors each follow-up question based on responses to previous questions, requiring only a few targeted questions to generate an accurate result. In this study, the mean PROMIS PF score was 41 ± 9. The questions most frequently used by the PROMIS CAT software were identified (defined in this study as any question administered to > 0.1% of the cohort). To understand the ability levels of patients based on their individual scores, patients were grouped into score categories: < 18, 20 ± 2, 25 ± 2, 30 ± 2, 35 ± 2, 40 ± 2, 45 ± 2, 50 ± 2, 55 ± 2, 60 ± 2, and > 62. For each score category, the relative frequency of each possible response (ranging from "cannot do" to "without any difficulty") was determined for each question. The distribution of responses given by each score group for each question was graphically displayed to generate an intuitive map linking PROMIS scores to patient ability levels (with ability levels represented by how patients responded to the PROMIS items). RESULTS Twenty-eight items from the 165-question item bank were used frequently (that is, administered to more than 0.1% of the cohort) by the PROMIS CAT software. The top four items constituted 63% of all items. These top four items asked about the patient's ability to perform 2 hours of physical labor, yard work, household chores, and walking more than 1 mile. Graphical displays of responses to the top 28 and top four items revealed how PROMIS scores correspond to patient ability levels. Patients with a score of 40 most frequently responded that they experienced "some difficulty" with physical labor, yard work, household chores, and walking more than 1 mile, compared with "little" or "no" difficulty for patients with a score of 50 and "cannot do" for patients with a score of 30. CONCLUSION We provided a visual key linking PROMIS numerical scores to physical ability levels using clinically relevant, familiar terms. Future studies might investigate whether using similar graphical displays as a patient education tool enhances patient-provider communication and improves the patient experience. CLINICAL RELEVANCE The visual explanation of PROMIS scores provided by this study may help new users of the PROMIS understand the instrument, feel empowered to incorporate it into their practices, and use it as a tool for counseling patients about their scores.
Collapse
Affiliation(s)
- Dane J. Brodke
- University of California, Los Angeles, Los Angeles, CA, USA
| | - Chong Zhang
- Department of Orthopaedic Surgery, University of Utah, Salt Lake City, UT, USA
| | - Jeremy D. Shaw
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, PA, USA
| | - Amy M. Cizik
- Department of Orthopaedic Surgery, University of Utah, Salt Lake City, UT, USA
| | - Charles L. Saltzman
- Department of Orthopaedic Surgery, University of Utah, Salt Lake City, UT, USA
| | - Darrel S. Brodke
- Department of Orthopaedic Surgery, University of Utah, Salt Lake City, UT, USA
| |
Collapse
|
15
|
Gruner MP, Hogaboom N, Hasley I, Hoffman J, Gonzalez-Carta K, Cheville AL, Li Z, Sellon JL. Prospective, Single-blind, Randomized Controlled Trial to Evaluate the Effectiveness of a Digital Exercise Therapy Application Compared With Conventional Physical Therapy for the Treatment of Nonoperative Knee Conditions. Arch Rehabil Res Clin Transl 2022; 3:100151. [PMID: 34977534 PMCID: PMC8683841 DOI: 10.1016/j.arrct.2021.100151] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
Objective To evaluate the effectiveness and adherence of a home exercise therapy program using a digital exercise therapy application (DETA) compared with conventional physical therapy (PT). Design Parallel group, randomized controlled trial. Setting Two clinics in a tertiary care academic center. Participants Participants (N=60) were enrolled within 1 week after a provider visit for knee pain. Inclusion criteria: age 18-75 years, knee pain diagnosis, and clinician-prescribed PT. Interventions Participants were randomized to complete either an 8-week intervention of conventional PT (enrolled n=29; complete n=26) or the DETA (enrolled n=31; completed n=24). Main Outcome Measures Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference (PI) and Physical Function (PF) scores implemented via computer adaptive tests; number of exercise sessions completed per week (adherence). Results Compared with the PT group, the DETA group reported significant decreases in PROMIS-PI scores (−6.1±6.7 vs −1.5±6.6, P<.05, d=0.78) and increases in PROMIS-PF scores (6.0±6.6 vs −0.8±5.8, P<.01, d=0.89) after 8 weeks. No group differences in adherence were observed (P>.05). Conclusions Use of this DETA resulted in greater pain and functional improvements compared with PT, with no differences in adherence. It is possible this application may be a viable alternative to conventional PT in certain cases. A larger sample from various geographic locations is needed to improve generalizability and for subgroup analysis. Further investigation is warranted to determine the factors responsible for the differences observed between the groups.
Collapse
Affiliation(s)
- Marc P. Gruner
- Department of Physical Medicine and Rehabilitation, Mayo Clinic College of Medicine and Science, Rochester, MN
- Corresponding author Marc P. Gruner, DO, MBA, 6608 Rivertrail Ct, Bethesda, MD 20817.
| | - Nathan Hogaboom
- Center for Spinal Cord Injury Research, Kessler Foundation, West Orange, NJ
- Center for Outcomes and Assessment Research, Kessler Foundation, West Orange, NJ
| | - Ike Hasley
- Department of Physical Medicine and Rehabilitation, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Jared Hoffman
- Department of Physical Medicine and Rehabilitation, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Karina Gonzalez-Carta
- Department of Physical Medicine and Rehabilitation, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Andrea L. Cheville
- Department of Physical Medicine and Rehabilitation, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Zhuo Li
- Division of Biomedical Statistics and Informatics, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Jacob L. Sellon
- Department of Physical Medicine and Rehabilitation, Mayo Clinic College of Medicine and Science, Rochester, MN
| |
Collapse
|
16
|
Wong LH, Meeker JE. The promise of computer adaptive testing in collection of orthopaedic outcomes: an evaluation of PROMIS utilization. J Patient Rep Outcomes 2022; 6:2. [PMID: 34982280 PMCID: PMC8727662 DOI: 10.1186/s41687-021-00407-w] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 12/15/2021] [Indexed: 12/30/2022] Open
Abstract
Background A crucial component to improving patient care is better clinician understanding of patients’ health-related quality of life (HRQoL). In orthopaedic surgery, HRQoL assessment instruments such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), provide surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s HRQoL. PROMIS has been demonstrated as a valuable instrument in many diseases; however, the extent to which orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research is unclear. Methods Systematic scoping methodology was used to investigate the characteristics of studies using PROMIS to assess HRQoL measures as orthopaedic surgical outcomes as well as studies validating computerized adaptive test (CAT) PROMIS physical health (PH) domains including: Physical Function (PF), Upper Extremity (UE), Lower Extremity (LE). Results A systematic search of PubMed identified 391 publications utilizing PROMIS in orthopaedics; 153 (39%) were PROMIS PH CAT validation publications. One-hundred publications were in Hand and Upper Extremity, 69 in Spine, 44 in Adult Reconstruction, 43 in Foot and Ankle, 43 in Sports, 37 in Trauma, 31 in General orthopaedics, and 24 in Tumor. From 2011 through 2020 there was an upward trend in orthopaedic PROMIS publications each year (range, 1–153) and an increase in studies investigating or utilizing PROMIS PH CAT domains (range, 1–105). Eighty-five percent (n = 130) of orthopaedic surgery PROMIS PH CAT validation publications (n = 153) analyzed PF; 30% (n = 46) analyzed UE; 3% (n = 4) analyzed LE. Conclusions PROMIS utilization within orthopaedics as a whole has significantly increased within the past decade, particularly within PROMIS CAT domains. The existing literature reviewed in this scoping study demonstrates that PROMIS PH CAT domains (PF, UE, and LE) are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. The expanded use of PROMIS CATs in orthopaedic surgery highlights the potential for improved quality of patient care. While challenges of integrating PROMIS into electronic medical records exist, expanded use of PROMIS CAT measurement instruments throughout orthopaedic surgery should be performed. Plain english summary In orthopaedic surgery, health-related quality of life tools such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), offer patients an opportunity to better understand their medical condition and be involved in their own care. Additionally, PROMIS provides surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s functional status and quality of life. The efficacy of PROMIS has been demonstrated in many diseases; however, its application throughout orthopaedic care has yet to be depicted. This study sought to identify the extent to which all orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research in order to identify its potential as an applicable and valuable tool across specialties. We determined that PROMIS utilization has significantly increased within the past decade. The existing literature reviewed in this scoping study demonstrates that the PROMIS computerized adaptive test domains evaluating physical function status are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. Based on these results, this study recommends the expanded and more uniform use of PROMIS computerized adaptive test measurement instruments in the clinical care of orthopaedic patients. Supplementary Information The online version contains supplementary material available at 10.1186/s41687-021-00407-w.
Collapse
Affiliation(s)
- Liam H Wong
- School of Medicine, Oregon Health & Science University, Portland, OR, USA
| | - James E Meeker
- Department of Orthopaedics and Rehabilitation, Oregon Health & Science University, 3303 S. Bond Avenue, Portland, OR, 97239, USA.
| |
Collapse
|
17
|
Ochen Y, Guss D, Houwert RM, Smith JT, DiGiovanni CW, Groenwold RHH, Heng M. Validation of PROMIS Physical Function for Evaluating Outcome After Acute Achilles Tendon Rupture. Orthop J Sports Med 2021; 9:23259671211022686. [PMID: 34692874 PMCID: PMC8527582 DOI: 10.1177/23259671211022686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Accepted: 02/12/2021] [Indexed: 11/30/2022] Open
Abstract
Background: There is increased demand for valid, reliable, and responsive
patient-reported outcome measures (PROMs) to evaluate treatment for Achilles
tendon rupture, but not all PROMs currently in use are reliable and
responsive for this condition. Purpose: To evaluate the measurement properties of the Patient-Reported Outcomes
Measurement Information System Physical Function (PROMIS PF) compared with
other PROMs used after treatment for acute Achilles tendon rupture. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: A retrospective cohort study with a follow-up questionnaire was performed.
All adult patients with an acute Achilles tendon rupture between June 2016
and June 2018 with a minimum 12-month follow-up were eligible for inclusion.
Functional outcome was assessed using the PROMIS PF computerized adaptive
test (CAT), Foot and Ankle Ability Measure (FAAM) Activities of Daily Living
(ADL), FAAM–Sports, and Achilles Tendon Total Rupture Score (ATRS). Pearson
correlation (r) was used to assess the correlations between
PROMs. Absolute and relative floor and ceiling effects were calculated. Results: In total, 103 patients were included (mean age, 44.7 years; 74% male); 82
patients (79.6%) underwent operative repair, while 21 patients (20.4%)
underwent nonoperative management. The mean time between treatment and
collection of PROMs was 25.3 months (range, 15-36 months). The mean scores
were 55.4 ± 9.2 (PROMIS PF), 92.9 ± 12.2 (FAAM-ADL), 77.7 ± 22.9
(FAAM–Sports), and 83.0 ± 19.4 (ATRS). The ATRS was correlated with FAAM-ADL
(r = 0.80; 95% CI, 0.72-0.86; P <
.001) and FAAM–Sports (r = 0.86; 95% CI, 0.80-0.90;
P < .001). The PROMIS PF was correlated with the
FAAM-ADL (r = 0.66; 95% CI, 0.53-0.75; P
< .001), FAAM–Sports (r = 0.65; 95% CI, 0.53-0.75;
P < .001), and ATRS (r = 0.69; 95%
CI, 0.58-0.78; P < .001). The PROMIS PF did not show
absolute floor or ceiling effects (0%). The FAAM-ADL (35.9%), FAAM–Sports
(15.8%), and ATRS (20.4%) had substantial absolute ceiling effects. Conclusion: The PROMIS PF, FAAM-ADL, and FAAM–Sports all showed a moderate to high mutual
correlation with the ATRS. Only the PROMIS PF avoided substantial floor and
ceiling effects. The results suggest that the PROMIS PF CAT is a valid,
reliable, and perhaps the most responsive tool to evaluate patient outcomes
after treatment for an Achilles tendon rupture.
Collapse
Affiliation(s)
- Yassine Ochen
- Department of Orthopedic Surgery, Harvard Medical School Orthopedic Trauma Initiative, Massachusetts General Hospital, Boston, Massachusetts, USA.,Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, the Netherlands.,Department of Surgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Daniel Guss
- Department of Orthopedic Surgery, Foot and Ankle Service, Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA.,Department of Orthopedic Surgery, Foot and Ankle Service, Newton-Wellesley Hospital, Newton, Massachusetts, USA
| | - R Marijn Houwert
- Department of Surgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Jeremy T Smith
- Department of Orthopedic Surgery, Division of Foot and Ankle Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Christopher W DiGiovanni
- Department of Orthopedic Surgery, Foot and Ankle Service, Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA.,Department of Orthopedic Surgery, Foot and Ankle Service, Newton-Wellesley Hospital, Newton, Massachusetts, USA
| | - Rolf H H Groenwold
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, the Netherlands.,Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, the Netherlands
| | - Marilyn Heng
- Department of Orthopedic Surgery, Harvard Medical School Orthopedic Trauma Initiative, Massachusetts General Hospital, Boston, Massachusetts, USA
| |
Collapse
|
18
|
Horn ME, Reinke EK, Yan X, Luo S, Bolognesi M, Reeve BB, George SZ. Use of Patient-Reported Outcomes Measurement Information System (PROMIS) measures to characterise health status for patients seeking care from an orthopaedic provider: a retrospective cohort study. BMJ Open 2021; 11:e047156. [PMID: 34475157 PMCID: PMC8413970 DOI: 10.1136/bmjopen-2020-047156] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
OBJECTIVES Characterise the health status of patients newly consulting an orthopaedic specialist across eight clinical subspecialties. DESIGN Retrospective cohort. SETTING 18 orthopaedic clinics, including 8 subspecialties (14 ambulatory and 4 hospital based) within an academic health system. PARTICIPANTS 14 910 patients consulting an orthopaedic specialist for a new patient consultation who completed baseline Patient-Reported Outcomes Measurement Information System (PROMIS) measures associated with their appointment from 17 November 2017 to 13 May 2019. Patients were aged 55.72±5.8 years old, and 61.3% were female and 79.3% were Caucasian and 13.4% were black or African American. Patients who did not complete PROMIS measures or cancelled their appointment were excluded from the study. PRIMARY OUTCOME PROMIS domains of physical function, pain interference, pain intensity, depression, anxiety, fatigue, sleep disturbance and the ability to participate in social roles. RESULTS Mean PROMIS scores for physical function were (38.1±9.2), pain interference (58.9±8.1), pain intensity (4.6±2.5), depression (47.9±8.9), anxiety (49.9±9.5), fatigue (50.5±10.3), sleep disturbance (51.1±9.8) and ability to participate in social roles (49.1±10.3) for the entire cohort. Across the clinical subspecialties, neurosurgery, spine and trauma patients were most profoundly affected across almost all domains and patients consulting with a hand specialist reported the least limitations or symptoms across domains. There was a moderate, negative correlation between pain interference and physical functioning (r=-0.59) and low correlations between pain interference with anxiety (r=0.36), depression (r=0.39) as well as physical function and anxiety (r=-0.32) and depression(r=-0.30) and sleep (r=-0.31). CONCLUSIONS We directly compared clinically meaningful PROMIS domains across eight orthopaedic subspecialties, which would not have been possible with legacy measures alone. These results support PROMIS's utility as a common metric to assess and compare patient health status across multiple orthopaedic subspecialties.
Collapse
Affiliation(s)
- Maggie E Horn
- Department of Orthopaedic Surgery, Duke University, Durham, NC, USA
- Department of Population Health Sciences, Duke University, Durham, NC, USA
| | - Emily K Reinke
- Department of Orthopaedic Surgery, Duke University, Durham, NC, USA
| | - Xiaofang Yan
- Duke Clinical Research Institute, Durham, North Carolina, USA
| | - Sheng Luo
- Duke University, Durham, North Carolina, USA
| | | | - Bryce B Reeve
- Department of Population Health Sciences, Duke University, Durham, NC, USA
| | - Steven Z George
- Department of Orthopaedic Surgery, Duke University, Durham, NC, USA
- Duke Clinical Research Institute, Durham, North Carolina, USA
| |
Collapse
|
19
|
Preoperative Evaluation of the Lower Extremity-Specific PROMIS Mobility Bank in Patients with ACL Tears. Arthrosc Sports Med Rehabil 2021; 3:e1025-e1029. [PMID: 34430881 PMCID: PMC8365215 DOI: 10.1016/j.asmr.2021.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 03/14/2021] [Indexed: 11/23/2022] Open
Abstract
Purpose The purpose of this study was to preoperatively assess the Patient-Reported Outcomes Measurement Information System (PROMIS) Item Bank v2.0–Mobility in patients with anterior cruciate ligament (ACL) tears to (1) determine construct validity by correlating with legacy patient-reported outcomes (PROs), (2) evaluate test burden, (3) determine the presence of floor or ceiling effects, and (4) revisit the conventional threshold for inclusiveness (floor/ceiling effects) in the modern era of computer adaptive testing (CAT)–based PROs. Methods Patients at a large academic musculoskeletal specialty center diagnosed with ACL tears indicated for surgery were administered the following outcomes measures before surgery: PROMIS Mobility CAT, PROMIS Pain Interference CAT (PROMIS PI), International Knee Documentation Committee (IKDC), the Marx Knee Activity Rating Scale (Marx), and Single Assessment Numeric Evaluation (SANE). Construct validity was evaluated using Spearman correlation coefficients. Correlation strengths were defined as high (≥0.7), high-moderate (0.61-0.69), moderate (0.4-0.6), moderate-weak (0.31-0.39) and weak (≤0.3). Number of questions to completion were recorded as a marker of test burden. The percentage of patients scoring at the extreme high (ceiling) or low (floor) of each measure was recorded to measure inclusivity. Results A total of 1126 patients were evaluated. The mean number of questions answered (± standard deviation) was 4.7 ± 2.1 for PROMIS Mobility and 4.5 ± 1.9 for PROMIS PI. PROMIS Mobility demonstrated a high correlation with IKDC, (r = 0.81, P < .001), a high-moderate correlation with PROMIS PI (r = −0.63), and a moderate correlation with SANE (r = 0.46, P < .01). Neither PROMIS Mobility nor PROMIS PI met conventional criteria for floor or ceiling effects (>15%). Conclusions The PROMIS Mobility measure maintains construct validity, because its scores correlate strongly with other PROs measuring physical function with high efficiency among preoperative patients with ACL injuries. Although ceiling effects of PROMIS Mobility CAT were below the conventional significance threshold of 15% at the preoperative timepoint in this population, this study provides critical feedback for redesigning the Mobility bank. Level of Evidence Level III (Diagnostic study).
Collapse
|
20
|
Bido J, Sullivan SW, Carr JB, Schairer WW, Nwachukwu BU. PROMIS Global-10 performs poorly relative to legacy shoulder instruments in patients undergoing total shoulder arthroplasty for glenohumeral arthritis. J Shoulder Elbow Surg 2021; 30:1780-1786. [PMID: 33220418 DOI: 10.1016/j.jse.2020.10.021] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Revised: 10/13/2020] [Accepted: 10/15/2020] [Indexed: 02/01/2023]
Abstract
BACKGROUND The PROMIS Global-10 is a 10-item questionnaire that assesses general health-related quality of life. There is a paucity of research on the utility of the PROMIS Global-10 in the evaluation of orthopedic conditions. The aim of this study is to compare PROMIS Global-10 and legacy shoulder-specific patient-reported outcome measures (PROMs) in patients undergoing total shoulder arthroplasty (TSA) for shoulder arthritis. METHODS This retrospective cohort study included patients who underwent TSA for shoulder arthritis and completed preoperative and 1-year postoperative surveys. Primary outcome measures were the physical (PROMIS-P) and mental (PROMIS-M) components of PROMIS Global-10. The legacy PROMs included the American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form (ASES) score, the Single Assessment Numeric Evaluation (SANE), and the Shoulder Activity Scale (SAS). Analyses included postoperative changes for each outcome, correlations between measures and a responsiveness assessment. RESULTS A total of 170 patients met inclusion criteria. Average age and body mass index were 67.7 ± 7.8 years and 28.0 ± 4.9, respectively. All legacy PROMs and PROMIS-P were significantly higher at 1-year follow-up compared with the preoperative level (P < .0001), whereas PROMIS-M did not change (P = .06). Preoperatively, both PROMIS components were either poorly correlated with all legacy PROMs (r < .04, P < .05) or not correlated at all (P > .05). Postoperatively, PROMIS-M was poorly correlated with all legacy PROMs (r < .04, P < .01), whereas PROMIS-P had fair correlation with ASES (r = .5, P < .0001) and poor correlation with SANE and SAS (r < .04, P < .01). A floor effect was observed for SANE, and SANE and ASES had a ceiling effect. The effect sizes for SANE and ASES were high (d = 2.01 and 2.39 respectively), whereas the effect size for SAS was moderate (d = 0.65), and the effect sizes for the PROMIS measures were small (d < .5). ASES was the most responsive measure and PROMIS-M was the least responsive. CONCLUSION PROMIS Global-10 had limited correlation with legacy PROMs and was less responsive at 1-year follow-up in patients following TSA. The Global-10 appears to have limited utility in the evaluation of patients with shoulder arthritis both preoperatively and after TSA.
Collapse
Affiliation(s)
- Jennifer Bido
- Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, NY, USA
| | - Spencer W Sullivan
- Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, NY, USA
| | - James B Carr
- Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, NY, USA
| | - William W Schairer
- Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, NY, USA
| | - Benedict U Nwachukwu
- Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, NY, USA.
| |
Collapse
|
21
|
Karhade AV, Fogel HA, Cha TD, Hershman SH, Doorly TP, Kang JD, Bono CM, Harris MB, Schwab JH, Tobert DG. Development of prediction models for clinically meaningful improvement in PROMIS scores after lumbar decompression. Spine J 2021; 21:397-404. [PMID: 33130302 DOI: 10.1016/j.spinee.2020.10.026] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Revised: 10/11/2020] [Accepted: 10/26/2020] [Indexed: 02/03/2023]
Abstract
BACKGROUND The ability to preoperatively predict which patients will achieve a minimal clinically important difference (MCID) after lumbar spine decompression surgery can help determine the appropriateness and timing of surgery. Patient-Reported Outcome Measurement Information System (PROMIS) scores are an increasingly popular outcome instrument. PURPOSE The purpose of this study was to develop algorithms predictive of achieving MCID after primary lumbar decompression surgery. PATIENT SAMPLE This was a retrospective study at two academic medical centers and three community medical centers including adult patients 18 years or older undergoing one or two level posterior decompression for lumbar disc herniation or lumbar spinal stenosis between January 1, 2016 and April 1, 2019. OUTCOME MEASURES The primary outcome, MCID, was defined using distribution-based methods as one half the standard deviation of postoperative patient-reported outcomes (PROMIS physical function, pain interference, pain intensity). METHODS Five machine learning algorithms were developed to predict MCID on these surveys and assessed by discrimination, calibration, Brier score, and decision curve analysis. The final model was incorporated into an open access digital application. RESULTS Overall, 906 patients completed at least one PROMs survey in the 90 days before surgery and at least one PROMs survey in the year after surgery. Attainment of MCID during the study period by PROMIS instrument was 74.3% for physical function, 75.8% for pain interference, and 79.2% for pain intensity. Factors identified for preoperative prediction of MCID attainment on these outcomes included preoperative PROs, percent unemployment in neighborhood of residence, comorbidities, body mass index, private insurance, preoperative opioid use, surgery for disc herniation, and federal poverty level in neighborhood of residence. The discrimination (c-statistic) of the final algorithms for these outcomes was 0.79 for physical function, 0.74 for pain interference, and 0.69 for pain intensity with good calibration. The open access digital application for these algorithms can be found here: https://sorg-apps.shinyapps.io/promis_pld_mcid/ CONCLUSION: Lower preoperative PROMIS scores, fewer comorbidities, and certain sociodemographic factors increase the likelihood of achieving MCID for PROMIS after lumbar spine decompression.
Collapse
Affiliation(s)
- Aditya V Karhade
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Harold A Fogel
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Newton Wellesley Hospital, Newton, MA, USA
| | - Thomas D Cha
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Newton Wellesley Hospital, Newton, MA, USA
| | - Stuart H Hershman
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Terence P Doorly
- Department of Neurosurgery, North Shore Medical Center, Boston, MA, USA
| | - James D Kang
- Department of Orthopedic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Brigham and Women's Faulkner Hospital, Boston, MA, USA
| | - Christopher M Bono
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mitchel B Harris
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Joseph H Schwab
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Newton Wellesley Hospital, Newton, MA, USA
| | - Daniel G Tobert
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Newton Wellesley Hospital, Newton, MA, USA.
| |
Collapse
|
22
|
Karhade AV, Sisodia RC, Bono CM, Fogel HA, Hershman SH, Cha TD, Doorly TP, Kang JD, Schwab JH, Tobert DG. Surgeon-level variance in achieving clinical improvement after lumbar decompression: the importance of adequate risk adjustment. Spine J 2021; 21:405-410. [PMID: 33039548 DOI: 10.1016/j.spinee.2020.10.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Revised: 09/23/2020] [Accepted: 10/05/2020] [Indexed: 02/03/2023]
Abstract
BACKGROUND CONTEXT Patient-Reported Outcome Measurement Information System (PROMIS) scores are increasingly utilized in clinical care. However, it is unclear if PROMIS can discriminate surgeon performance on an individual level. PURPOSE The purpose of this study was to examine surgeon-level variance in rates of achieving minimal clinically important difference (MCID) after lumbar decompression. PATIENT SAMPLE This is a prospective, observational cohort study performed across a healthcare enterprise (two academic medical centers and three community centers). Patients 18 years or older undergoing one- to two-level primary decompression for lumbar disc herniation (LDH) or lumbar spinal stenosis (LSS) were included. OUTCOME MEASURES The primary outcome was achievement of MCID, using a distribution-based method, on paired PROMIS physical function scores. METHODS Descriptive statistics were generated to examine the baseline characteristics of the study cohort. Bivariate analyses were used to examine the impact of surgeon-level variance on rates of MCID. Multivariable analyses were used to examine the risk-adjusted impact of surgeon-level variance on rates of MCID. RESULTS Overall, 636 patients treated by nine surgeons were included. The median patient age was 58 [interquartile range (IQR): 46-70] and 62.3% (n=396) were female. Among all patients, 56.9% (n=362) underwent surgery for LDH. The overall rate of achieving MCID was 75.8% (n=482). Of the surgeons, the median years in practice were 12 (range 4-31) and 55.6% (n=5) were in academic practice settings. On bivariate analysis, patients treated by one of the surgeons had lower rates of achieving MICD (odds ratio=0.37, 95% confidence interval: 0.15-0.91, p=.03). However, on multivariable analysis adjusting for operative indication (LDH vs. LSS), body mass index, number of comorbidities, percent unemployment in patient zip code, and preoperative PROMIS physical function scores, all surgeons were equally likely to obtain MCID. CONCLUSIONS In this cohort, variance in PROMIS scores after primary lumbar decompression is influenced by patient-related factors and not by individual surgeon. Adequate risk adjustment is needed if ascertaining clinical improvement on an individual surgeon basis. LEVEL OF EVIDENCE 2.
Collapse
Affiliation(s)
- Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
| | - Rachel C Sisodia
- Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
| | - Christopher M Bono
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
| | - Harold A Fogel
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA; Department of Orthopaedic Surgery, Newton Wellesley Hospital, Newton, MA 02462, USA
| | - Stuart H Hershman
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
| | - Thomas D Cha
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA; Department of Orthopaedic Surgery, Newton Wellesley Hospital, Newton, MA 02462, USA
| | - Terence P Doorly
- Department of Neurosurgery, North Shore Medical Center, Boston, MA 01923, USA
| | - James D Kang
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02114, USA; Department of Orthopaedic Surgery, Brigham and Women's Faulkner Hospital, Boston, MA 02130, USA
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA; Department of Orthopaedic Surgery, Newton Wellesley Hospital, Newton, MA 02462, USA
| | - Daniel G Tobert
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA; Department of Orthopaedic Surgery, Newton Wellesley Hospital, Newton, MA 02462, USA.
| |
Collapse
|
23
|
Giordano NA, Kent M, Buckenmaier CC, Mauntel TC, Dickens JF, Millington M, Highland KB. A Longitudinal Comparison of Patient-Reported Outcomes Measurement Information System to Legacy Scales in Knee and Shoulder Arthroscopy Patients. Arthroscopy 2021; 37:185-194.e2. [PMID: 32721547 DOI: 10.1016/j.arthro.2020.07.026] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Revised: 07/16/2020] [Accepted: 07/16/2020] [Indexed: 02/02/2023]
Abstract
PURPOSE The purpose of this prospective correlational study was to compare the psychometric properties of the Defense and Veterans Pain Rating Scale (DVPRS) and Patient-Reported Outcomes Measurement Information System (PROMIS) scales with those of traditional legacy scales over a longitudinal postoperative period in patients undergoing arthroscopic procedures. METHODS Active-duty military personnel undergoing shoulder and knee arthroscopic procedures completed the DVPRS, PROMIS, and legacy scales preoperatively and again at 3 months postoperatively. Rolling correlation coefficients (rrm) were used to assess the concurrent validity between the DVPRS average pain scores and computer adaptive testing PROMIS scales (Anxiety, Depression, Pain Behavior, Pain Interference, Mobility, Sleep Disturbance, Satisfaction With Social Roles, and Upper Extremity Physical Function) and the legacy scales (American Shoulder and Elbow Surgeons [ASES] scale, Shoulder Activity Scale, International Knee Documentation Committee [IKDC] questionnaire, Single Assessment Numeric Evaluation [SANE], Marx Activity Rating Scale, and Veterans RAND 12-Item Health Survey). RESULTS A total of 121 participants completed the scales preoperatively, 80 completed them at 3 months postoperatively, and 59 (49% of participants) completed them at both times. Rolling correlation coefficients between PROMIS Pain Interference (rrm = -0.41, P = .006), Satisfaction With Social Roles (rrm = 0.56, P < .001), and Upper Extremity (rrm = 0.71, P < .001) scores showed acceptable concurrent validity with ASES scores over a longitudinal postoperative period. DVPRS scores (rrm = -0.69, P = .002) and PROMIS Pain Behavior (rrm = -0.57, P = .018), Pain Interference (rrm = -0.71, P = .001), Sleep Disturbance (rrm = -0.64, P = .005), and Mobility (rrm = 0.65, P = .005) scores showed acceptable concurrent validity with IKDC scores. There was poor correlation between the PROMIS and DVPRS scores and the Single Assessment Numeric Evaluation, Marx Activity Rating Scale, Shoulder Activity Scale, and Veterans RAND 12-Item Health Survey scores. CONCLUSIONS PROMIS scales measuring physical function, pain presentation, and other health domains showed acceptable concurrent validity with ASES and IKDC scores. By integrating the prospective collection of biopsychosocial PROMIS scales into practice, it is possible for clinicians in orthopaedic settings to assess changes in validated patient-reported outcomes to inform patient-centered care planning throughout the postoperative recovery period. LEVEL OF EVIDENCE Level II, prospective comparative study (with not all participants completing follow-up).
Collapse
Affiliation(s)
- Nicholas A Giordano
- Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, Georgia, U.S.A..
| | - Michael Kent
- Department of Anesthesiology, Duke University Medical Center, Durham, North Carolina, U.S.A
| | - Chester C Buckenmaier
- Defense and Veterans Center for Integrative Pain Management, Department of Military and Emergency Medicine, Uniformed Services University, Rockville, Maryland, U.S.A.; Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, Maryland, U.S.A
| | - Timothy C Mauntel
- Department of Orthopaedic Surgery, Walter Reed National Military Medical Center, Bethesda, Maryland, U.S.A.; DoD-VA Extremity Trauma & Amputation Center of Excellence, Walter Reed National Military Medical Center, Bethesda, Maryland, U.S.A
| | - Jonathan F Dickens
- Department of Surgery, Uniformed Services University, Bethesda, Maryland, U.S.A
| | - Matt Millington
- Defense and Veterans Center for Integrative Pain Management, Department of Military and Emergency Medicine, Uniformed Services University, Rockville, Maryland, U.S.A.; Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, Maryland, U.S.A
| | - Krista Beth Highland
- Defense and Veterans Center for Integrative Pain Management, Department of Military and Emergency Medicine, Uniformed Services University, Rockville, Maryland, U.S.A.; Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, Maryland, U.S.A
| |
Collapse
|
24
|
Recommendations From the 2019 Symposium on Including Functional Status Measurement in Standard Patient Care. J Occup Environ Med 2020; 62:e457-e466. [DOI: 10.1097/jom.0000000000001935] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|