Responsiveness of the PROMIS and FAAM Instruments in Foot and Ankle Orthopedic Population

A New Paradigm in Foot and Ankle Outcomes?: Away From Radiographs and Toward Patient-Centered Outcomes

Having reasonable outcome measures is essential to unbiased research. For years, provider-measured outcomes have been valued as they are more objective and convenient for investigators. However, with the popularity of patient-centered medical care delivery, patient-reported outcome measures are appropriately becoming more popular in foot and ankle research.

Reliability and Validity of the Turkish Version of the American Orthopaedic Foot and Ankle Society Hallux Metatarsophalangeal-Interphalangeal Joint Scale

BACKGROUND

The American Orthopaedic Foot and Ankle Society Hallux Metatarsophalangeal-Interphalangeal (AOFAS Hallux MTP-IP) scale is one of the most widely used outcome measures to evaluate hallux pathologies. This study aimed to translate the AOFAS Hallux MTP-IP scale into Turkish and investigate its psychometric properties.

METHODS

The psychometric properties of the Turkish version of the AOFAS Hallux MTP-IP (AOFAS Hallux MTP-IP-T) scale were tested in 66 patients with hallux pathologies (52 women; mean age, 47.64 ± 12.75 years). Cronbach's alpha was used to assess internal consistency. The intraclass correlation coefficient (ICC) was used to estimate test-retest. Construct validity was analyzed with the Turkish version of the Manchester-Oxford Foot Questionnaire (MOXFQ), Visual Analogue Scale (VAS), and 12-item Short-Form Health Survey(SF-12).

RESULTS

The AOFAS Hallux MTP-IP-T scale had adequate internal consistency (α = 0.71) and test-retest reliability (ICC2,1 = 0.93 for pain, ICC2,1 = 0.97 for function, and ICC2,1 = 0.97 for total score). The AOFAS Hallux MTP-IP-T total score has a moderate to strong correlation with VAS-activity and MOXFQ (ρ = -0.77, P = .001; ρ = -0.69, P = .001, respectively). The weakest correlation was found between the AOFAS Hallux MTP-IP-T and the SF-12 mental component scale (ρ = 0.31, P = .01).

CONCLUSION

AOFAS Hallux MTP-IP-T has sufficient reliability and validity to evaluate Turkish-speaking individuals with a variety of forefoot pathologies including the hallux.

LEVELS OF EVIDENCE

Level II.

"In Situ" Joint Preparation Technique for First Metatarsophalangeal Arthrodesis: A Retrospective Comparative Review of 388 Cases

"Cup-shaped power reamers" and "flat cuts" (FC) are common joint preparation techniques in first metatarsophalangeal (MTP) joint arthrodesis. However, the third option of an "in situ" (IS) technique has rarely been studied. This study aims to compare the clinical, radiographic, and patient-reported outcomes (PROMs) of the IS technique for various MTP pathologies with other MTP joint preparation techniques. A single-center retrospective review was performed for patients who underwent primary MTP joint arthrodesis between 2015 and 2019. In total, 388 cases were included in the study. We found higher nonunion rates in the IS group (11.1% vs 4.6%, p = .016). However, the revision rates were similar between the groups (7.1% vs 6.5%, p = .809). Multivariate analysis revealed that diabetes mellitus was associated with significantly higher overall complication rates (p < .001). The FC technique was associated with transfer metatarsalgia (p = .015) and a more first ray shortening (p < .001). Visual analog scale, PROMIS-10 physical, and PROMIS-CAT physical scores significantly improved in IS and FC groups (p < .001, p = .002, p = .001, respectively). The improvement was comparable between the joint preparation techniques (p = .806). In conclusion, the IS joint preparation technique is simple and effective for first MTP joint arthrodesis. In our series, the IS technique had a higher radiographic nonunion rate that did not correlate with a higher revision rate, and otherwise similar complication profile to the FC technique while providing similar PROMs. The IS technique resulted in significantly less first ray shortening when compared to the FC technique.

Comparison of the PROMIS and iHOT-12 in Determining Satisfaction Levels After Hip Arthroscopy for FAIS

Background

The Patient-Reported Outcomes Measurement Information System (PROMIS) has not been fully evaluated for outcomes assessment after hip arthroscopy to correct femoroacetabular impingement syndrome (FAIS).

Purpose/Hypothesis

The purpose of this study was to compare the accuracy of the PROMIS Physical Function (PF) and Pain Interference (PI) subscales with the 12-Item International Hip Outcome Tool (iHOT-12) to define patients with 3 unique substantial clinical benefit (SCB) scores-patients who reported ≥80%, ≥90%, and 100% satisfaction at 1 year after hip arthroscopy for FAIS. We hypothesized that the iHOT-12 would be more accurate than the PROMIS-PF and PROMIS-PI subscales in identifying these 3 patient groups.

Study Design

Cohort study (diagnosis); Level of evidence, 2.

Methods

We reviewed the records of patients who underwent hip arthroscopy for symptomatic FAIS at 3 centers from January 2019 through June 2021 and had 1-year clinical and radiographic follow-up data. Patients completed the iHOT-12, PROMIS-PF, and PROMIS-PI on initial assessment and at 1 year (±30 days) postoperatively. Postoperative satisfaction was reported on an 11-category scale with anchors defined as "0% satisfied" and "100% satisfied." Receiver operator characteristic analysis was performed to determine the absolute SCB values for the iHOT-12 and PROMIS subscales that would most accurately identify those patients who reported ≥80%, ≥90%, and 100% satisfaction. Area under the curve (AUC) values and 95% CIs for the 3 instruments were compared.

Results

Included were 163 patients (111 [68%] women and 52 [32%] men), with a mean age of 26.1 years. Corresponding absolute SCB scores for patients who reported ≥80%, ≥90%, and 100% satisfaction were as follows: iHOT-12, 68.4, 72.1, 74.7; PROMIS-PF, 45, 47.7, 49.9; and PROMIS-PI, 55.9, 52.4, 51.9. The AUC ranged between 0.67 and 0.82, with overlapping 95% CIs indicating a minimal difference in accuracy between the 3 instruments. Sensitivity and specificity values ranged between 0.61 and 0.82.

Conclusion

The PROMIS-PF and PROMIS-PI subscales were as accurate as the iHOT-12 in defining absolute SCB scores for patients reporting ≥80%, ≥90%, and 100% satisfaction at 1-year follow-up after hip arthroscopy for FAIS.

High complication rates following revision first metatarsophalangeal joint arthrodesis: a retrospective analysis of 79 cases

BACKGROUND

The most common indications for revision of first metatarsophalangeal joint (MTPJ) arthrodesis are symptomatic failures of prior arthrodesis, failed hallux valgus correction, and failed MTPJ arthroplasty implants. However, the outcomes of revision MTPJ arthrodesis have rarely been studied. The purpose of this study was to compare the clinical, radiographic, and patient-reported outcomes of revision MTPJ arthrodesis following different primary procedures.

METHODS

A retrospective review of revision MTPJ arthrodesis cases between January 2015 and December 2019 was performed. The radiographic results, patient-reported outcomes, and rates of complications, subsequent revisions, and nonunions, were analyzed and compared preoperatively and postoperatively. A multivariate analysis was utilized to determine risk factors for complications and reoperations.

RESULTS

This study yielded a total of 79 cases of revision MTPJ arthrodesis. The mean follow-up time was 365 days (SD ± 295). The overall complication rate was 40.5%, of which the overall nonunion rate was 19.0%. Seven cases (8.9%) required further revision surgery. The multivariate analysis revealed that Diabetes mellitus was associated with significantly higher overall complication rates (p = 0.016), and nonunion was associated with "in-situ" joint preparation techniques (p = 0.042). Visual Analog Scale (VAS) significantly improved postoperatively (p < 0.001); However, PROMIS-10 physical health and PROMIS-10 mental health did not change significantly during the study period.

CONCLUSION

Treatment of MTPJ surgery failures is a clinical challenge in orthopedic surgery. In our study, revision of first MTPJ surgery resulted in higher nonunion rates and overall complication rates compared to typical outcomes from primary MTPJ arthrodesis. Diabetes, Tobacco use, and "in-situ" joint preparation technique were found to be independent risk factors for complications and reoperations.

LEVEL OF EVIDENCE

III-Retrospective Cohort Study.

First Metatarsophalangeal Arthrodesis for Hallux Rigidus and Hallux Valgus: A Comparison of Patient Reported and Clinical Outcomes

Few prior studies have compared the patient reported outcomes of first metatarsophalangeal arthrodesis between hallux rigidus and hallux valgus patients. Furthermore, we sought to examine the impact of postoperative radiographic hallux alignment on outcomes scores within each group. A retrospective review of 98 patients who a received primary metatarsophalangeal arthrodesis from January 2010 to March 2020. Clinical complications including nonunion were collected. Patient Reported Outcomes Measurement Information Systems (PROMIS) Physical Function, PROMIS Pain Interference, and the foot function index (FFI) revised short form scores were obtained via telephone. Patients were grouped based on review of preoperative radiographs of the foot and this grouping 37 hallux rigidus and 61 hallux valgus patients. Clinical and patient reported outcomes were compared between these pathologies. No differences in the rate of wound complications, radiographic union, and revision surgery were found between the 2 subgroups. At a median of 2.4 years (3.9 IQR) postoperatively, PROMIS and FFI scores did not vary by pathology group. For both groups, PROMIS scores were similar to the general population of the United States. The postoperative first MTP dorsiflexion angle in the hallux rigidus group was correlated with decreased FFI Pain, FFI Total, and PROMIS Pain Interference domain scores (|r| ≥ 0.40, p < .05 for all). When performing MTP arthrodesis in patients with hallux rigidus, increasing the first MTP dorsiflexion angle may correlate with improved intermediate term patient reported outcomes. However, further studies will need to be done to confirm this theoretical relationship.

Ejection Fraction Improvement Does Not Reflect Changes in Quality of Life Following Cardiac Resynchronization Therapy

OBJECTIVE

To determine if health-related quality of life (HRQoL) improvement after cardiac resynchronization therapy (CRT) correlates with improved left-ventricular ejection fraction (EF).

BACKGROUND

CRT was reported to improve EF and HRQoL in clinical trials of heart failure with reduced EF (HFrEF). It is unknown if improvements in HRQoL reflect EF response to CRT.

METHODS

We included HFrEF patients who underwent CRT and had both pre- and post-CRT HRQoL assessment. EF response was categorized as absent (0% change or decrease), modest (0%-19% increase), or significant ( > 20% increase). We examined the associations between EF response and generic (PROMIS) and HF-specific (KCCQ-12) HRQoL.

RESULTS

The group included 115 patients with mean age of 65 years and baseline EF of 31%; 39% were female (n = 45). Nineteen percent (n = 22) had significant, 57% (n = 66) modest, and 23% (n = 27) absent EF responses. AF burden across significant (8.9%), modest (4.8%), and absent EF responders (1.4%) was similar ( P = 0.20). Significant improvements in KCCQ-12 (43.4-57.5, P = 0.003), current health visual analog scale (49.1-55.9, P = 0.042), PROMIS fatigue (58.9-55.1, P = 0.026), and PROMIS satisfaction (42.7-46.4, P = 0.020) resulted following CRT across all groups. There was no association between significant EF improvement and HRQoL by KCCQ-12 (nonresponse, 44.4%; modest response, 33.3%; and significant response, 22.2%) at 1 year ( P = 0.52 across all groups).

CONCLUSION

CRT was associated with a modest to significant EF response in a majority of patients. However, EF response did not significantly correlate with generic or HF-specific HRQoL measures. Further investigations are warranted into determinants of improved HRQoL following CRT.

Are Patient Reported Outcome Measurement Information System scales responsive in patients attending physical therapy with foot and ankle diagnoses?

BACKGROUND

Patient-reported outcomes (PROs) have been used to provide insight into the patient experience while uncovering an opportunity to improve patient care. Current studies document responsiveness of outcomes using the Patient Reported Outcome Measurement Information System (PROMIS) for a variety of orthopedic problems but are not specific to a physical therapy interval of care.

PURPOSE

The main purpose of this study was to examine responsiveness of the PROMIS Physical Function (PF) and Pain Interference (PI) scales across an interval of care for physical therapy in patients with foot and ankle conditions.

METHODS

Adult records (299 records, averaged 45.1 ± 15.4 years; 61% female) were assessed. Comparisons between pre- and post-physical therapy intervals of care were evaluated using a repeated-measures ANOVA, and the effect size was reported using Cohen's d.

RESULTS

PROMIS PF scores significantly improved from 38.5 ± 8.8 to 45.2 ± 9.1 (6.6; p < .001; Cohen's d = 1.0). PROMIS PI scores significantly improved from 56.8 ± 8.8 to 53.0 ± 9.8 (-3.8; p < .001; Cohen's d = 0.52).

CONCLUSIONS

The person-centered PROMIS PF and PI outcome measures were responsive to change following an interval of care in physical therapy for a large sample of orthopedic patients with foot and ankle diagnoses. The magnitude of change was dependent on starting score and diagnosis.

Does the Canadian Orthopaedic Foot and Ankle Society Postoperative COFAS End-Stage Ankle Arthritis Classification System Correlate With Pre- and Postoperative PROMIS Scores for Total Ankle Arthroplasty?

Background:

Recently, the Canadian Orthopaedic Foot and Ankle Society (COFAS) proposed a classification system addressing adjunct procedures in the treatment for end-stage ankle arthritis. We reviewed Patient-Reported Outcome Measures Information System (PROMIS) data to determine if outcomes of total ankle arthroplasty (TAA) correlated with postoperative COFAS classification. We hypothesize that as COFAS classification increases, patients will demonstrate greater improvement in the change between pre- and postoperative PROMIS scores.

Methods:

From June 2015 to December 2018, a total of 127 patients underwent 132 TAA. Demographic factors and preoperative and most recent postoperative PROMIS scores were collected. Univariate, multivariate and post hoc analyses with a significance threshold of P <.05 were performed.

Results:

Eighty-seven patients with a mean follow-up of 13.6±7.3 months and complete PROMIS scores were classified into COFAS types 1-4. Significant differences were identified in the PROMIS Pain Interference domain comparing COFAS types 2 and 4 and COFAS types 3 and 4. These results demonstrate that more complex ankles with a higher COFAS score had worse interval improvement in PROMIS scores. Additionally, multivariate linear regression showed that age and BMI were associated with worse physical function and depression, whereas diabetes and a history of prior surgeries were associated with improved postoperative function.

Conclusion:

The COFAS postoperative classification system is useful for categorizing end-stage ankle arthritis. Further research into the ideal timing of surgery and higher-level studies to better determine TAA efficacy with different classification systems is warranted. This information can be helpful with preoperative counseling about treatment outcomes. Level of Evidence: Level IV, retrospective analysis of prospectively collected data.

Quantifying the Impact of Atrial Fibrillation on Heart Failure-Related Patient-Reported Outcomes in the Utah mEVAL Program

BACKGROUND

Atrial fibrillation (AF) frequently complicates heart failure (HF), and each is associated with lower overall health-related quality of life. We aimed to quantify the incremental burden of AF on the health-related quality of life of patients with HF in clinical practice.

METHODS AND RESULTS

We used data from the Utah mEVAL program to analyze patient-reported outcomes (PROs) among patients with HF with and without AF. The primary outcome was the HF-specific Kansas City Cardiomyopathy Questionnaire, with generic PROs as secondary outcomes. Among 1707 patients with HF, 36% had AF (n = 616). Those with HF and AF were older (mean age 69 years vs 58 years, P < .001), more likely to have prior stroke (29% vs 17%, P < .001) and ischemic cardiomyopathy (28% vs 23%, P = .01), but had similar ejection fractions (mean 44% each, P = .6). After adjustment, and compared with HF alone, HF with AF was associated with worse Kansas City Cardiomyopathy Questionnaire scores (adjusted mean difference -3.45, 95% confidence interval [CI] -6.24 to -0.65), and worse Patient-Reported Outcomes Measurement Information System physical function scores (adjusted mean difference -1.63, 95% CI -2.59 to -0.67). The difference in visual analog scale general health was borderline (adjusted mean difference -2.01, 95% CI -4.51 to 0.49), and Patient-Reported Outcomes Measurement Information System depression scores were similar (adjusted mean difference 0.54, 95% CI -0.48 to 1.57).

CONCLUSIONS

AF complicates nearly one-third of HF cases, and patients with HF and AF are substantially older and sicker. After adjustment, AF was independently associated with worse disease-specific and overall health-related quality of life than HF alone. Whether maintaining sinus rhythm can improve the HF-related health status of patients with HF in clinical practice should be explored further.

Early Improvement in Patient-Reported Outcome Scores After Operative Treatment of Osteochondritis Dissecans of the Humeral Capitellum

PURPOSE

Outcome measures that lack sensitivity for the detection of clinical changes early after surgery for capitellar osteochondritis dissecans (OCD) make it difficult to determine the optimal treatment for these defects. We sought to evaluate the early responsiveness of patient-reported outcomes measurement information system (PROMIS) scores in a cohort of patients operatively treated for capitellar OCD.

METHODS

Four PROMIS questionnaires (mobility, upper extremity [UE], pain interference, and peer relations) were electronically administered to patients treated for capitellar OCD at a single tertiary academic medical center between January 1, 2015, and July 1, 2018. The questionnaires were administered at the initial preoperative outpatient clinic visit as well as at the 2-week, 6-week, and final return-to-play (RTP) visits.

RESULTS

Twenty-nine patients (31 elbows, mean age 12.9 years) with available preoperative and postoperative PROMIS data were included. The mean final follow-up period was 26 weeks. Compared with that before surgery, there was a significant improvement in the mobility, pain interference, and UE scores at 6 weeks following surgery. The scores improved most significantly by 6 weeks, reached a relative plateau, and remained significantly improved through the RTP visit thereafter. Patients with preoperative, intra-articular loose bodies scored significantly better than those without them during the 6-week and RTP visits. Patients with lesions >1 cm², compared with those with lesions ≤1 cm², demonstrated greater improvement in the UE scores during the RTP visit.

CONCLUSIONS

In patients undergoing operative treatment for capitellar OCD, a significant improvement in the PROMIS domains of mobility, pain interference, and UE can be expected early in the postoperative period, with majority of patients reaching their greatest improvement in scores by 6 weeks following surgery.

CLINICAL RELEVANCE

This is important information for preoperative counseling. In addition, this information is helpful in confirming that PROMIS scores are responsive in the detection of changes in outcomes during the early postoperative period in this population.

Validation of PROMIS Physical Function for Evaluating Outcome After Acute Achilles Tendon Rupture

Background:

There is increased demand for valid, reliable, and responsive patient-reported outcome measures (PROMs) to evaluate treatment for Achilles tendon rupture, but not all PROMs currently in use are reliable and responsive for this condition.

Purpose:

To evaluate the measurement properties of the Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS PF) compared with other PROMs used after treatment for acute Achilles tendon rupture.

Study Design:

Cohort study (diagnosis); Level of evidence, 2.

Methods:

A retrospective cohort study with a follow-up questionnaire was performed. All adult patients with an acute Achilles tendon rupture between June 2016 and June 2018 with a minimum 12-month follow-up were eligible for inclusion. Functional outcome was assessed using the PROMIS PF computerized adaptive test (CAT), Foot and Ankle Ability Measure (FAAM) Activities of Daily Living (ADL), FAAM–Sports, and Achilles Tendon Total Rupture Score (ATRS). Pearson correlation (r) was used to assess the correlations between PROMs. Absolute and relative floor and ceiling effects were calculated.

Results:

In total, 103 patients were included (mean age, 44.7 years; 74% male); 82 patients (79.6%) underwent operative repair, while 21 patients (20.4%) underwent nonoperative management. The mean time between treatment and collection of PROMs was 25.3 months (range, 15-36 months). The mean scores were 55.4 ± 9.2 (PROMIS PF), 92.9 ± 12.2 (FAAM-ADL), 77.7 ± 22.9 (FAAM–Sports), and 83.0 ± 19.4 (ATRS). The ATRS was correlated with FAAM-ADL (r = 0.80; 95% CI, 0.72-0.86; P < .001) and FAAM–Sports (r = 0.86; 95% CI, 0.80-0.90; P < .001). The PROMIS PF was correlated with the FAAM-ADL (r = 0.66; 95% CI, 0.53-0.75; P < .001), FAAM–Sports (r = 0.65; 95% CI, 0.53-0.75; P < .001), and ATRS (r = 0.69; 95% CI, 0.58-0.78; P < .001). The PROMIS PF did not show absolute floor or ceiling effects (0%). The FAAM-ADL (35.9%), FAAM–Sports (15.8%), and ATRS (20.4%) had substantial absolute ceiling effects.

Conclusion:

The PROMIS PF, FAAM-ADL, and FAAM–Sports all showed a moderate to high mutual correlation with the ATRS. Only the PROMIS PF avoided substantial floor and ceiling effects. The results suggest that the PROMIS PF CAT is a valid, reliable, and perhaps the most responsive tool to evaluate patient outcomes after treatment for an Achilles tendon rupture.

Conventional vs Accelerated Rehabilitation Protocol Following Reattachment of Achilles Tendon for Insertional Achilles Tendinopathy

BACKGROUND

No studies have compared early vs conventional postoperative weightbearing following suture bridge Achilles tendon reattachment. We, therefore, evaluated postoperative functional outcomes in these patients.

METHODS

We collected data on 49 patients who underwent surgical treatment of insertional Achilles tendinopathy using a central Achilles tendon-splitting approach and reattachment with suture bridge technique by a single surgeon. Functional outcomes were measured by a visual analog scale (VAS) for pain, Foot and Ankle Ability Measure (FAAM), and Short Form Health Survey (SF-36) at 3, 6, and 12 months postoperatively. The differences in outcomes were analyzed using multiple linear regression.

RESULTS

Eighteen and 31 patients underwent the conventional and accelerated protocols, respectively; their corresponding mean ages were similar, 53 and 57 years, as were all other baseline characteristics. The mean scores (conventional vs accelerated group) for VAS for pain, FAAM, and SF-36 in the conventional group at 3 months postoperatively were 4 ± 1 vs 3 ± 1 points, 53 ± 8 vs 68 ± 3 points, and 57 ± 15 vs 67 ± 10 points (P < .05 for each comparison). There were no statistically significant differences between the groups at 6 and 12 months postoperatively. All patients could perform the single heel raise test at 6 months, and none experienced complications.

CONCLUSION

In this small study, short-term functional outcomes were better in the accelerated group. More data are needed before the accelerated program can be recommended.

LEVEL OF EVIDENCE

Level II, prospective comparative study.

Systematic collection of patient-reported outcomes in atrial fibrillation: feasibility and initial results of the Utah mEVAL AF programme

AIMS

Incorporating patient-reported outcomes (PROs) into routine care of atrial fibrillation (AF) enables direct integration of symptoms, function, and health-related quality of life (HRQoL) into practice. We report our initial experience with a system-wide PRO initiative among AF patients.

METHODS AND RESULTS

All patients with AF in our practice undergo PRO assessment with the Toronto AF Severity Scale (AFSS), and generic PROs, prior to electrophysiology clinic visits. We describe the implementation, feasibility, and results of clinic-based, electronic AF PRO collection, and compare AF-specific and generic HRQoL assessments. From October 2016 to February 2019, 1586 unique AF patients initiated 2379 PRO assessments, 2145 of which had all PRO measures completed (90%). The median completion time for all PRO measures per visit was 7.3 min (1st, 3rd quartiles: 6, 10). Overall, 38% of patients were female (n = 589), mean age was 68 (SD 12) years, and mean CHA2DS2-VASc score was 3.8 (SD 2.0). The mean AFSS symptom score was 8.6 (SD 6.6, 1st, 3rd quartiles: 3, 13), and the full range of values was observed (0, 35). Generic PROs of physical function, general health, and depression were impacted at the most severe quartiles of AF symptom score (P < 0.0001 for each vs. AFSS quartile).

CONCLUSION

Routine clinic-based, PRO collection for AF is feasible in clinical practice and patient time investment was acceptable. Disease-specific AF PROs add value to generic HRQoL instruments. Further research into the relationship between PROs, heart rhythm, and AF burden, as well as PRO-guided management, is necessary to optimize PRO utilization.

Ankle Stability and Movement Coordination Impairments: Lateral Ankle Ligament Sprains Revision 2021

This revised clinical practice guideline (CPG) addresses the distinct but related lower extremity impairments of those with a first-time lateral ankle sprain (LAS) and those with chronic ankle instability (CAI). Depending on many factors, impairments may continue following injury. While most individuals experience resolution of symptoms, complaints of instability may continue and are defined as CAI. The aims of the revision were to provide a concise summary of the contemporary evidence since publication of the original guideline and to develop new recommendations or revise previously published recommendations to support evidence-based practice. J Orthop Sports Phys Ther 2021;51(4):CPG1-CPG80. doi:10.2519/jospt.2021.0302.

A Patient-Reported Outcomes Measurement Information System Short Form for Measuring Physical Function During Geriatric Rehabilitation: Test-Retest Reliability, Construct Validity, Responsiveness, and Interpretability

OBJECTIVES

To study the test-retest reliability and measurement error, construct validity, responsiveness, interpretability, and floor/ceiling effects of a Patient-Reported Outcomes Measurement Information System (PROMIS) short form designed to measure physical function in geriatric rehabilitation patients (PROMIS-PF-GR).

DESIGN

Prospective cohort.

SETTING AND PARTICIPANTS

Inpatient geriatric rehabilitation patients.

METHODS

We evaluated the test-retest reliability by re-administering PROMIS-PF-GR 3 to 5 days after the admission measurement. The intraclass correlation coefficient (ICC) was calculated to determine test-retest reliability; an ICC of ≥0.70 was considered sufficient. Measurement error was established by calculating the standard error of measurement and smallest detectable change. Construct validity and responsiveness were determined by testing a priori formulated hypotheses (criterion: ≥75% hypothesis not rejected). Interpretability was evaluated by calculating the minimal important change using predictive modeling and a global rating as criterion for change. Floor/ceiling effects were established by calculating the percentage patients with the minimum/maximum raw score (criterion: ≤15%) at admission and discharge.

RESULTS

A total of 207 patients participated in the study [mean ± standard deviation age (80 ± 8.3 years), 58% female]. More than one-half of patients (56%) reported to be improved during rehabilitation. The ICC was 0.79 (95% confidence interval 0.70-0.84), the standardized error of measurement was 3.8, and the smallest detectable change 10.6. None of the 4 hypotheses for construct validity were rejected; 2 out of 5 hypotheses for responsiveness were rejected. The minimal important change was 8.0 (95% confidence interval 4.1-12.5). No floor/ceiling effects were found.

CONCLUSIONS AND IMPLICATIONS

The PROMIS-PG-GR showed sufficient test-retest reliability, measurement error, and construct validity. We did not find sufficient evidence for responsiveness, which may be due to the unexplained weak correlation between the PROMIS change score and the Global Rating Scale. We still recommend the use the PROMIS-PG-GR for measuring self-reported physical function in geriatric rehabilitation.

Reporting and utilization of Patient-Reported Outcomes Measurement Information System® (PROMIS®) measures in orthopedic research and practice: a systematic review

BACKGROUND

The Patient-Reported Outcomes Measurement Information SystemⓇ (PROMISⓇ) is a dynamic system of psychometrically sound patient-reported outcome (PRO) measures. There has been a recent increase in the use of PROMIS measures, yet little has been written about the reporting of these measures in the field of orthopedics. The purpose of this study was to conduct a systematic review to determine the uptake of PROMIS measures across orthopedics and to identify the type of PROMIS measures and domains that are most commonly used in orthopedic research and practice.

METHODS

We searched PubMed, Embase, and Scopus using keywords and database-specific subject headings to capture orthopedic studies reporting PROMIS measures through November 2018. Our inclusion criteria were use of PROMIS measures as an outcome or used to describe a population of patients in an orthopedic setting in patients ≥ 18 years of age. We excluded non-quantitative studies, reviews, and case reports.

RESULTS

Our final search yielded 88 studies published from 2013 through 2018, with 57% (50 studies) published in 2018 alone. By body region, 28% (25 studies) reported PROMIS measures in the upper extremity (shoulder, elbow, hand), 36% (32 studies) reported PROMIS measures in the lower extremity (hip, knee, ankle, foot), 19% (17 studies) reported PROMIS measures in the spine, 10% (9 studies) reported PROMIS measures in trauma patients, and 6% (5 studies) reported PROMIS measures in general orthopedic patients. The majority of studies reported between one and three PROMIS domains (82%, 73 studies). The PROMIS Computerized Adaptive Test (CAT) approach was most commonly used (81%, 72 studies). The most frequently reported PROMIS domains were physical function (81%, 71 studies) and pain interference (61%, 54 studies).

CONCLUSION

Our review found an increase in the reporting of PROMIS measures over the recent years. Utilization of PROMIS measures in orthopedic populations is clinically appropriate and can facilitate communication of outcomes across different provider types and with reduced respondent burden.

REGISTRATION

The protocol for this systematic review was designed in accordance with the PRISMA guidelines and is registered with the PROSPERO database (CRD42018088260).

Immediate Improvement in Physical Function After Symptomatic Syndesmotic Screw Removal

OBJECTIVE

To investigate the immediate impact of removing symptomatic syndesmotic screws on PROMIS outcomes and ankle range of motion (ROM) in patients who had previously undergone ankle fracture open reduction and internal fixation (ORIF) and syndesmotic fixation and later experienced functional limitations.

DESIGN

Prospective cohort study.

SETTING

Level 1-trauma center.

PATIENTS/PARTICIPANTS

Fifty-eight patients with ankle fractures with syndesmotic instability that required ORIF with syndesmotic fixation who underwent syndesmotic screw removal (SSR) and 71 patients who underwent ankle ORIF with syndesmotic fixation, but without screw removal during the same study period.

INTERVENTION

Symptomatic SSR for patients with functional limitations and decreased ankle ROM.

MAIN OUTCOME MEASUREMENTS

PROMIS physical function (PF) and pain interference T-scores and ankle ROM before and after screw removal.

RESULTS

Patients who underwent SSR had a statistically significant improvement in the PF T-score to 44.5 (P < 0.01) in the early postoperative period (mean 48 days) after screw removal. The screw removal occurred an average of 184 days after initial ORIF. This PF T-score change also met the minimally clinically important difference. There was a trend toward a significant improvement in PF T-scores for the SSR group as compared to the cohort group (44.5 vs. 41.6; P = 0.06) after screw removal. Removal of symptomatic implants resulted in an early mean improvement of total arc ankle ROM by 17 degrees (P < 0.01).

CONCLUSIONS

Patients experienced an immediate and significant improvement in PF outcomes and ankle ROM after symptomatic SSR for ankle fracture ORIF with syndesmotic fixation.

LEVEL OF EVIDENCE

Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence.

Pattern of recovery and outcomes of patient reported physical function and pain interference after ankle fusion: a retrospective cohort study

Background

Research on outcomes after ankle fusion focuses on basic activities of daily living, fusion rates, and gait parameters. Little has been reported on the patient’s perspective after surgery. The purpose of this study was to determine the change in patient reported physical function and pain interference after ankle fusion surgery to guide patient expectations and improve provider communication.

Methods

This was a retrospective review of prospectively collected patient reported outcome measurement information system (PROMIS) data in 88 ankle arthrodesis procedures performed from May 2015 to March 2018. The PROMIS Physical function (PF) and pain interference (PI) measures were collected as routine care. Linear mixed models were used to assess differences at each follow-up point for PF and PI. Preoperative to last follow-up in the 120–365 day interval was assessed using analysis of variance. Outcomes included T-scores, z-scores, and PROMIS-Preference (PROPr) utility scores for PF and PI and the percentage of patients improving by at least 4 T-score points.

Results

The linear mixed model analysis for PF after the 120–149 days, and for PI, after 90–119 days, indicated recovery plateaued at 39–40 for PF and 57–59 for PI T-scores. The change in the PI T-score was the greatest with a mean T-score improvement of − 5.4 (95% CI − 7.7 to − 3.1). The proportion of patients improving more than 4 points was 66.2% for either PF or PI or both. The change in utility T-scores for both PF (0.06, 95% CI 0.02 to 0.11) and PI (0.15, 95% CI 0.09 to 0.20) was significantly improved, however, only PI approached clinical significance.

Conclusion

Average patients undergoing ankle fusion experience clinically meaningful improvement in pain more so than physical function. Average patient recovery showed progressive improvement in pain and function until the four-month postoperative time point. Traditional dogma states that recovery after an ankle fusion maximizes at a year, however based on the findings in this study, 4 months is a more accurate marker of recovery. A decline in function or an increase in pain after 4 months from surgery may help to predict nonunion and other complications after ankle arthrodesis.

Level of evidence

Level II, prospective single cohort study.

Operative Intervention Does Not Change Pain Perception in Patients With Diabetic Foot Ulcers

Researchers investigated pain perception in patients with diabetic foot ulcers (DFUs) by analyzing pre- and postoperative physical function (PF), pain interference (PI), and depression domains of the Patient-Reported Outcome Measurement Information System (PROMIS). They hypothesized that 1) because of painful diabetic peripheral neuropathy (DPN), a majority of patients with DFUs would have high PROMIS PI scores unchanged by operative intervention, and 2) the initially assessed PI, PF, and depression levels would be correlated with final outcomes. Seventy-five percent of patients with DFUs reported pain, most likely because of painful DPN. Those who reported high PI and low PF were likely to report depression. PF, PI, and depression levels were unchanged after operative intervention or healing of DFUs.

Radiographic and Magnetic Resonance Imaging of the Symptomatic Synthetic Cartilage Implant

BACKGROUND

Synthetic Cartilage Implantation (SCI; Cartiva) is a treatment of hallux rigidus associated with mixed clinical outcomes in the United States. Patients with persistent pain typically undergo diagnostic imaging for evaluation. We aimed to characterize the radiologic findings of SCI and surrounding tissues.

METHODS

This is a retrospective review of patients treated using SCI who underwent magnetic resonance imaging (MRI) for persistent pain. Metatarsophalangeal (MTP) joint spaces were compared on plain radiographs of the foot immediately postoperatively and at most recent follow-up. MRI of the foot were assessed for dimensions of the implant, bony channel, and presence of peri-implant fluid. Clinical follow-up, including Patient-Reported Outcome Measures Informational System (PROMIS) scores, satisfaction rating, and revision surgery, was collected. Eighteen cases of symptomatic SCI from 16 patients (13 females, 3 males) were included. All but 1 case involved a 10-mm implant.

RESULTS

Mean satisfaction rating was 2.25 (1-5 Likert scale). PROMIS scores indicated moderate physical dysfunction (41) and moderate pain interference (63). Six of 16 patients (37.5%) underwent revision surgery at average 20.9 months of follow-up. Plain radiographs over a 13.3-month interval showed joint space narrowing of 2 mm medially and 1.6 mm laterally (P < .001). One hundred percent of cases had radiographic evidence of osteoarthritis (OA) progression. MRI studies were obtained on average 11.5 months postoperatively. The implant diameter averaged 9.7 mm, which mismatched the bony channel diameter of 11.2 mm (P < .001). Fourteen of 18 cases had peri-implant fluid. All cases had edema in the metatarsal, proximal phalanx, and soft tissues.

CONCLUSION

Radiographic loss of MTP joint space and progression of arthritis were present for all cases studied. MRI revealed bony channel widening and a smaller implant, with peri-implant fluid suggesting instability at the implant-bone interface. Persistent edema was observed in soft tissues and bone. Diagnostic imaging of SCI in symptomatic patients demonstrated concerning findings that merit further correlation with patient outcomes.

LEVEL OF EVIDENCE

Level IV, case series.

Establishing "Normal" Patient-Reported Outcomes Measurement Information System Physical Function and Pain Interference Scores: A True Reference Score According to Adults Free of Joint Pain and Disability

Numerous recent studies have demonstrated the validity and efficiency of the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) forms in patients undergoing orthopaedic surgical procedures. It is assumed that a score of 50 in each domain represents the health state of a “reference” population, but this threshold has not been definitively proven. In order to truly assess whether a given orthopaedic intervention is successful, the comparative scores of healthy individuals must be known for any given health domain measured. Therefore, the purpose of this study was to determine baseline scores for the PROMIS general physical function (PROMIS-PF), pain interference (PROMIS-PI), and upper-extremity physical function (PROMIS-UE) domains in physically healthy, asymptomatic adult individuals. We hypothesized that, in individuals <40 years old, the mean PROMIS-PF and PROMIS-UE scores would be >50 and PROMIS-PI scores would be <50. We further hypothesized that these scores would be impacted by participant age.

Responsiveness of the PROMIS and its Concurrent Validity with Other Region- and Condition-specific PROMs in Patients Undergoing Carpal Tunnel Release

BACKGROUND

The Patient-reported Outcome Measurement Information System (PROMIS) continues to be an important universal patient-reported outcomes measure (PROM) in orthopaedic surgery. However, there is concern about the performance of the PROMIS as a general health questionnaire in hand surgery compared with the performance of region- and condition-specific PROMs such as the Michigan Hand Questionnaire (MHQ) and the Boston Carpal Tunnel Questionnaire (BCTQ), respectively. To ensure that PROMIS domains capture patient-reported outcomes to the same degree as region- and condition-specific PROMs do, comparing PROM performance is necessary.

QUESTIONS/PURPOSES

(1) Which PROMs demonstrate high responsiveness among patients undergoing carpal tunnel release (CTR)? (2) Which of the PROMIS domains (Physical Function [PF], Upper Extremity [UE], and Pain Interference [PI]) demonstrate concurrent validity with the HHQ and BCTQ domains?

METHODS

In this prospective study, between November 2014 and October 2016, patients with carpal tunnel syndrome visiting a single surgeon who elected to undergo CTR completed the BCTQ, MHQ, and PROMIS UE, PF, and PI domains at each visit. A total of 101 patients agreed to participate. Of these, 31 patients (31%) did not return for a followup visit at least 6 weeks after CTR and were excluded, leaving a final sample of 70 patients (69%). We compared the PROMIS against region- and condition-specific PROMs in terms of responsiveness and concurrent validity. Responsiveness was determined using Cohen's d or the effect-size index (ESI). The larger the absolute value of the ESI, the greater the effect size. Using the ESI allows surgeons to better quantify the impact of CTR, with a medium ESI (that is, 0.5) representing a visible clinical change to a careful observer. Concurrent validity was determined using Spearman's correlation coefficient with correlation strengths categorized as excellent (> 0.7), excellent-good (0.61-0.70), good (0.4-0.6), and poor (< 0.4). Significance was set a priori at p < 0.05.

RESULTS

Among PROMIS domains, the PI demonstrated the best responsiveness (ESI = 0.74; 95% CI, 0.39-1.08), followed by the UE (ESI = -0.66; 95% CI, -1.00 to -0.31). For the MHQ, the Satisfaction domain had the largest effect size (ESI = -1.48; 95% CI, -1.85 to -1.09), while for the BCTQ, the Symptom Severity domain had the best responsiveness (ESI = 1.54; 95% CI, 1.14-1.91). The PROMIS UE and PI domains demonstrated excellent-good to excellent correlations to the total MHQ and BCTQ-Functional Status scores (preoperative UE to MHQ: ρ = 0.68; PI to MHQ: ρ = 0.74; UE to BCTQ-Functional Status: ρ = 0.74; PI to BCTQ-Functional Status: ρ = 0.67; all p < 0.001), while the PROMIS PF demonstrated poor correlations with the same domains (preoperative PF to MHQ; ρ = 0.33; UE to BCTQ-Functional Status: ρ = 0.39; both p < 0.01).

CONCLUSIONS

The PROMIS UE and PI domains demonstrated slightly worse responsiveness than the MHQ and BCTQ domains that was nonetheless acceptable. The PROMIS PF domain was unresponsive. All three PROMIS domains correlated with the MHQ and BCTQ, but the PROMIS UE and PI domains had notably stronger correlations to the MHQ and BCTQ domains than the PF domain did. We feel that the PROMIS UE and PI can be used to evaluate the clinical outcomes of patients undergoing CTR, while also providing more robust insight into overall health status because they are general PROMs. However, we do not recommend the PROMIS PF for evaluating patients undergoing CTR.

LEVEL OF EVIDENCE

Level II, diagnostic study.