Substantial Loss to Follow-Up and Missing Data in National Arthroscopy Registries: A Systematic Review

Real world data in mechanical thrombectomy: who are we losing to follow-up?

BACKGROUND

Missing outcome data (MOD) is a common problem in clinical trials and registries, and a potential bias when drawing conclusions from these data. Identifying factors associated with MOD may help to increase follow-up rates and assess the need for imputation strategies. We investigated MOD in a multicenter, prospective registry study of mechanical thrombectomy (MT) in large vessel occlusion ischemic stroke.

METHODS

13 082 patients enrolled in the German Stroke Registry-Endovascular Treatment from May 2015 to December 2021 were analyzed with regard to MOD (90 day modified Rankin Scale, mRS). Univariate logistic regression analyses identified factors unbalanced between patients with and without MOD. Subgroup analyses were performed to identify patients for whom increased efforts to perform clinical follow-up after hospital discharge are needed.

RESULTS

We identified 19.7% (2580/13 082) of patients with MOD at the 90 day follow-up. MOD was more common with higher pre-stroke disability (mRS 3-5, 32.2% vs mRS 0-2, 13.7%; P<0.001), absence of bridging intravenous thrombolysis, longer time to treatment, and in patients with high post-stroke disability at discharge (mRS 3-5 vs 0-2: OR 1.234 (95% CI 1.107 to 1.375); P<0.001). In contrast, MOD was less common with futile recanalization (thrombolysis in cerebral infarction (TICI) score of 0-2a, 12.4% vs TICI 2b-3, 15.0%; P=0.001). In patients discharged alive with well documented baseline characteristics, shorter hospital stay (OR 0.992 (95% CI 0.985 to 0.998); P=0.010) and discharge to institutional care or hospital (OR 1.754 (95% CI 1.558 to 1.976); P<0.001) were associated with MOD.

CONCLUSION

MOD in routine care MT registry data was not random. Increased efforts to perform clinical follow-up are needed, especially in the case of higher pre-stroke and post-stroke disability and discharge to hospital or institutional care.

TRIAL REGISTRATION

NCT03356392.

Ten-year results from the UK National Ligament Registry: Patient characteristics and factors predicting nonresponders for completion of outcome scores

PURPOSE

The aim of this study was to report the demographic and mechanism of injury data in the UK National Ligament Registry (NLR) at 10 years and determine factors leading to poor compliance with completion of Patient-Reported Outcome Scores (PROMs).

METHODS

A retrospective review was performed for prospectively collected data on the NLR between January 2013 and December 2022. All patients who underwent primary anterior cruciate ligament reconstruction (ACLR) were included. Patient demographics, mechanism of injury and patient compliance with completing PROMs were analysed. Patient characteristics were further analysed in relation to compliance with completing the different PROMs at the predefined time points. Patients were identified as nonresponders if they had not completed either 1- or 2-year postoperative Knee injury and Osteoarthritis Outcome Score (KOOS).

RESULTS

A total of 17,492 patients were included in this study. The average age for patients undergoing ACLR between 2013 and 2022 was 29.4 (SD, 10.3). Seventy percent were men and 30% women. Football was the most common activity associated with an ACL injury. Patient compliance with recording PROMs was 55% preoperatively and 37%, 32% and 24% at 1-, 2- and 5-year postoperative follow-up, respectively. Nonresponders represented 54% of eligible patients. Multivariate analyses showed that sex, age, smoking, time interval between injury and surgery and low socioeconomic status were associated with low compliance with postoperative PROM completion (p < 0.001).

CONCLUSION

This study reports the demographic characteristics for patients on the NLR since 2013. Male sex, young age, increased waiting time between injury and surgery, smoking and lower socioeconomic class were predictors of low compliance with completion of postoperative PROMs on the UK NLR. Understanding the factors that affect patient compliance with PROMs improves our ability to provide targeted interventions and information to specific patient populations with the aim of enhancing inclusiveness and representation of population in the registry.

LEVEL OF EVIDENCE

Level III.

Patients Consistently Report Worse Outcomes Following Revision Total Knee Arthroplasty Compared to Primary Total Knee Arthroplasty

BACKGROUND

Differences in patient-reported outcome measures (PROMs) between primary TKA (pTKA) and revision TKA (rTKA) have not been well-studied. Therefore, we compared pTKA and rTKA patients by the rates of achieving the Minimal Clinically Important Difference for Improvement (MCID-I) and Worsening (MCID-W).

METHODS

A total of 2,448 patients (2,239 pTKAs/209 rTKAs) were retrospectively studied. Patients who completed the Knee Injury and Osteoarthritis Outcome Score-Physical Function Short Form (KOOS-PS), Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function Short Form 10a (PF10a), PROMIS Global-Mental, or PROMIS Global-Physical questionnaires were identified by Current Procedural Terminology (CPT) codes. Patient-reported outcome measures and MCID-I/MCID-W rates were compared. Multivariate logistic regression models measured relationships between surgery type and postoperative outcomes.

RESULTS

Patients who underwent rTKA (all causes) had lower rates of improvement and higher rates of worsening compared to pTKA patients for KOOS-PS (MCID-I: 54 versus 68%, P < .001; MCID-W: 18 versus 8.6%, P < .001), PF10a (MCID-I: 44 versus 65%, P < .001; MCID-W: 22 versus 11%, P < .001), PROMIS Global-Mental (MCID-I: 34 versus 45%, P = .005), and PROMIS Global-Physical (MCID-I: 51 versus 60%, P = .014; MCID-W: 29 versus 14%, P < .001). Undergoing revision was predictive of worsening postoperatively for KOOS-PS, PF10a, and PROMIS Global-Physical compared to pTKA. Postoperative scores were significantly higher for all 4 PROMs following pTKA.

CONCLUSION

Patients reported significantly less improvement and higher rates of worsening following rTKA, particularly for PROMs that assessed physical function. Although pTKA patients did better overall, the improvement rates may be considered relatively low and should prompt discussions on improving outcomes following pTKA and rTKA.

LEVEL OF EVIDENCE

Level III, retrospective comparative study.

T, Maniar A, Mitrasinovic S, Menta SV, Ranawat A. Intraoperative traction has a negligible time-dependent influence on patient-reported outcomes after hip arthroscopy: a cohort study

The aim of this study is to determine if post-operative patient-reported outcome measures (PROMs) are influenced by hip arthroscopy traction duration. Patients from a local prospective hip arthroscopy database were retrospectively analyzed. Four hip-specific PROMs were utilized: modified Harris Hip Score (mHHS), Hip Outcome Score-Activities of Daily Living (HOS-ADL), Hip Outcome Score-Sports Specific (HOS-SS), and international Hip Outcome Tool (iHOT). PROMs were collected pre-operatively and 6 months, 1 year and 2 years post-operatively. Two cohorts were created based on a cut-off corresponding to the 66th percentile for our patient cohort. Analyses were completed for each PROM at each post-operative interval with univariable statistics. Multivariable statistics were examined to identify the variables that were predictive of achieving post-operative minimal clinically important difference (MCID) at the 2-year follow-up. Overall, 222 patients met the inclusion criteria. The mean age was 32.4 ± 9.4 years, and 116 (52.3%) were female. The average traction time of the study population was 46.1 ± 12.9 min. A total of 145 patients were included in the short traction cohort (65%) with traction times of <50 min (66th percentile). No significant differences were found regarding PROM scores or MCID achievement rates between both cohorts at any post-operative period. In multivariable analyses, achievement of MCID was predicted by a decrease in traction time for all PROMs and pincer-type resection for mHSS, HOS-ADL and iHOT. There was no difference in PROMs and MCID achievement between longer and shorter traction time cohorts. On multivariable analysis, a decrease in traction time is predictive of MCID for all PROM scores and pincer-type resection was predictive of MCID for most PROM scores. Level of evidence: Level III, cohort study.

International cooperation needed to improve national anterior cruciate ligament registries

PURPOSE

The aim of this study is to illustrate an overview of the registries currently operative in many countries to support the introduction of new prospective registries in other countries.

METHODS

The authors carried out a systematic web research in July 2021 to identify national ACL registries' annual reports and scientific literature on national ACL registries. The latest annual public registry reports were collected and analyzed in this study.

RESULTS

There are currently established national ACL registries in Norway, Denmark, Sweden, Luxembourg, New Zealand, the United Kingdom (UK), and the Kaiser Permanente National Anterior Cruciate Ligament Reconstruction Registry in the United States (US). Some differences can be found among the various registries due to the local healthcare system structure, data management rules, and general national laws.

CONCLUSION

It is possible to develop accessible, cost-effective and entirely web-based ACL registries-as demonstrated by the Danish and Swedish registries-respecting the national legislation of different countries. This study supports the introduction of new ACL prospective registries in other countries to obtain valuable information for implementing daily clinical practice.

LEVEL OF EVIDENCE

IV.

Patient Compliance in Assessing Electronic Patient-Reported Outcome Measures after Urologic Surgery

INTRODUCTION

This study aimed to assess patient compliance with a newly established electronic patient-reported outcome measure (ePROM) system after urologic surgery and to identify influencing factors.

METHODS

Digital surveys were provided to patients undergoing cystectomy, radical or partial nephrectomy, or transurethral resection of bladder tumor via a newly established ePROM system. Participants received a baseline survey preoperatively and several follow-up surveys postoperatively. Multivariable regression analysis was performed to identify factors predicting compliance.

RESULTS

Of N = 435 eligible patients, n = 338 completed the baseline survey (78.0%). Patients who did not participate were significantly more likely male (p = 0.004) and older than 70 years (p = 0.005). Overall, 206/337 patients (61.3%) completed the survey at 1-month, 167/312 (53.5%) at 3-month, and 142/276 (51.4%) at 6-month follow-up. Lower baseline quality of life (odds ratio: 2.27; p = 0.004) was a significant predictor for dropout at 1-month follow-up. Low educational level was significantly associated with low compliance at 3- (OR: 1.92; p = 0.01) and 6-month follow-up (OR: 2.88; p < 0.001).

CONCLUSION

Acceptable compliance rates can be achieved with ePROMs following urologic surgery. Several factors influence compliance and should be considered when setting-up ePROM surveys.

The German Arthroscopy Registry DART: what has happened after 5 years?

PURPOSE

The German Arthroscopy Registry (DART) has been initiated in 2017 with the aim to collect real-life data of patients undergoing knee, shoulder, hip or ankle surgery. The purpose of this study was to present an overview of the current status and the collected data thus far.

METHODS

Data entered between 11/2017 and 01/2022 were analyzed. The number of cases (each case is defined as a single operation with or without concomitant procedures) entered for each joint, follow-up rates and trends between different age groups (18-29 years, 30-44 years, 45-64 years,  ≥ 65 years) and across genders, and quality of life improvement (pre- vs. 1 year postoperative EQ visual analogue scale [EQ-VAS]) for frequently performed procedures (medial meniscus repair [MMR] vs. rotator cuff repair [RCR] vs. microfracturing of the talus [MFX-T]) were investigated.

RESULTS

Overall, 6651 cases were entered into DART, forming three distinct modules classified by joint (5370 knee, 1053 shoulder and 228 ankle cases). The most commonly entered procedures were: knee: partial medial meniscectomy (n = 2089), chondroplasty (n = 1389), anterior cruicate ligament reconstruction with hamstring autograft (n = 880); shoulder: sub acromial decompression (n = 631), bursectomy (n = 385), RCR (n = 359); ankle: partial synovectomy (n = 117), tibial osteophyte resection (n = 72), loose body removal (n = 48). In the knee and shoulder modules, middle-aged patients were the predominant age group, whereas in the ankle module, the youngest age group was the most frequent one. The two oldest age groups had the highest 1-year follow-up rates across all modules. In the knee and shoulder module, 1-year follow-up rates were higher in female patients, whereas follow-up rates were higher in male patients in the ankle module. From pre- to 1-year postoperative, MFX-T (EQ-VAS: 50.0 [25-75% interquartile range: 31.8-71.5] to 75.0 [54.3-84.3]; ∆ + 25.0) led to a comparably larger improvement in quality of life than did MMR (EQ-VAS: 70.0 [50.0-80.0] to 85.0 [70.0-94.0]; ∆ + 15.0) or RCR (EQ-VAS: 67.0 [50.0-80.0] to 85.0 [70.0-95.0]; ∆ + 18.0).

CONCLUSION

DART has been sufficiently established and collects high-quality patient-related data with satisfactory follow-up allowing for a comprehensive analysis of the collected data. The current focus lies on improving patient enrolment and follow-up rates as well as initiating the hip module.

Compliance with Electronic Patient Reported Outcome Measure System Data Collection Is 51% Two-years After Shoulder Arthroscopy

Objective

To determine patient compliance in completing electronic patient-reported outcome measures (PROMs) following arthroscopic shoulder surgery and identify risk factors for noncompliance.

Methods

A retrospective review of compliance data was performed for patients who underwent arthroscopic shoulder surgery by a single surgeon in a private practice setting from June 2017 to June 2019. All patients were enrolled in Surgical Outcomes System (Arthrex) as a part of routine clinical care, and outcome reporting was integrated into our practice electronic medical record. Patient compliance with PROMs was calculated at preoperative, three-month, 6-month, 1-year, and 2-year follow-up time points. Compliance was defined as a complete patient response to each assigned outcome module in the database over time. Logistic regression for compliance at the one-year timepoint was performed to assess for factors associated with survey compliance.

Results

Compliance with PROMs was highest preoperatively (91.1%) and decreased at each subsequent time point. The largest decrease in compliance with PROMs occurred between the preoperative and 3-month follow-up time points. Compliance was 58% at 1 year and 51% at 2 years after surgery. Overall, 36% of patients were compliant at all individual time points. There were no significant predictors of compliance with regard to age, sex, race, ethnicity, or procedure.

Conclusions

Patient compliance with PROMs decreased over time with the lowest percentage of patients completing electronic surveys at the traditional 2-year follow-up for shoulder arthroscopy. In this study, basic demographic factors were not predictive of patient compliance with PROMs.

Clinical Relevance

PROMs are commonly collected after arthroscopic shoulder surgery; however, low patient compliance may affect their utility in research and clinical practice.

Loss to patient-reported outcome measure follow-up after hip arthroplasty and knee arthroplasty

Aims

The aim of this study was to determine satisfaction rates after hip and knee arthroplasty in patients who did not respond to postoperative patient-reported outcome measures (PROMs), characteristics of non-responders, and contact preferences to maximize response rates.

Methods

A prospective cohort study of patients planned to undergo hip arthroplasty (n = 713) and knee arthroplasty (n = 737) at a UK university teaching hospital who had completed preoperative PROMs questionnaires, including the EuroQol five-dimension health-related quality of life score, and Oxford Hip Score (OHS) and Oxford Knee Score (OKS). Follow-up questionnaires were sent by post at one year, including satisfaction scoring. Attempts were made to contact patients who did not initially respond. Univariate, logistic regression, and receiver operator curve analysis was performed.

Results

At one year, 667 hip patients (93.5%) and 685 knee patients (92.9%) had undergone surgery and were alive. No response was received from 151/667 hip patients (22.6%), 83 (55.0%) of whom were ultimately contacted); or from 108/685 knee patients (15.8%), 91 (84.3%) of whom were ultimately contacted. There was no difference in satisfaction after arthroplasty between initial non-responders and responders for hips (74/81 satisfied vs 476/516 satisfied; p = 0.847) or knees (81/93 satisfied vs 470/561 satisfied; p = 0.480). Initial non-response and persistent non-response was associated with younger age, higher BMIs, and worse preoperative PROMs for both hip and knee patients (p < 0.050). Being in employment was associated with persistent non-response for hip patients (p = 0.047). Multivariate analysis demonstrated that younger age (p < 0.038), higher BMI (p = 0.018), and poorer preoperative OHS (p = 0.031) were independently associated with persistent non-response to hip PROMs. No independent associations were identified for knees. Using a threshold of > 66.4 years predicted a preference for contact by post (area under the curve 0.723 (95% confidence interval (CI) 0.647 to 0.799; p < 0.001, though this CI crosses the 0.7 limit considered reliable).

Conclusion

The majority of initial non-responders were ultimately contactable with effort. Satisfaction rates were not inferior in patients who did not initially respond to PROMs.

Cite this article: Bone Jt Open 2022;3(4):275–283.

Differences in Baseline Characteristics and Outcome Among Responders, Late Responders, and Never-Responders After Anterior Cruciate Ligament Reconstruction

BACKGROUND

Loss to follow-up in registry studies might affect generalizability and interpretation of results.

PURPOSE

To evaluate the effect of nonresponder bias in our anterior cruciate ligament (ACL) registry.

STUDY DESIGN

Case-control study; Level of evidence, 3.

METHODS

A total of 2042 patients with ACL reconstruction in the Hospital for Special Surgery ACL Registry between 2009 and 2013 were included in the study. Patients who completed the patient-reported outcome measures at 2 or 5 years were considered responders (n = 808). Baseline data and patient characteristics were compared between responders and nonresponders (n = 1234). Both responders and nonresponders were contacted and invited to complete the International Knee Documentation Committee (IKDC) and Marx scores electronically and respond to questions regarding return to sports and subsequent surgeries. Nonresponders who completed the questionnaires after reminders were considered late responders. The remaining nonresponders were considered never-responders. The late responders (n = 367) completed the questionnaires after a mean follow-up of 7.8 years (range, 6.7-9.6 years), while follow-up for the responders was 6.8 years (range, 5.0-9.7 years). Responders and late responders were then compared in terms of differences in IKDC and Marx scores from baseline to final follow-up.

RESULTS

Nonresponders were younger (28.5 vs 31.5 years; P < .001) and more often male (60% vs 53%; P = .003) compared with responders. Responders had a higher level of education and were more likely to be White (79% vs 74%; P = .04). There were no substantial differences in patient characteristics or baseline IKDC and Marx scores between the late responders and never-responders. There were no statistically significant differences in patient-reported outcomes, return to sports, or subsequent surgeries between responders and late responders at a mean follow-up time of 8.8 years (range, 6.7-9.7 years). Repeat email reminders and telephone calls increased response rate by 18% (from 40% to 58%).

CONCLUSION

There was no difference in clinical outcome as evaluated using IKDC and Marx scores between responders and late responders.

Registry Studies Use Inconsistent Methods to Account for Patients Lost to Follow-up, and Rates of Patients LTFU Are High

PURPOSE

To determine methods described in the literature to account for patients lost to follow-up (LTFU) in registry studies and whether rates of patient LTFU are within acceptable margins.

METHODS

A scoping review, where a literature search is conducted for studies from 9 arthroscopy registries, was performed on EMBASE, MEDLINE, and the annual reports of each registry. Inclusion criteria included studies with information on patient-reported outcome measures and being based on 9 national registries identified. Exclusion criteria included review articles, conference abstracts, studies not based on registry data, and studies from regional, claims-based, or multicenter registries. Studies were then divided into categories based on method of LTFU analysis used.

RESULTS

Thirty-six articles were identified for the final analysis. Categories for LTFU analysis included dropout analyses (n = 10), referencing validation studies (n = 12), contacting nonresponders (n = 4), and sensitivity analyses (n = 1). Referencing validation studies was the most common method (n = 12). Majority (n = 35) of the studies exceeded the recommended maximum rates for LTFU.

CONCLUSIONS

Registry studies use inconsistent methods to account for patient LTFU, and rates of patients LTFU are unacceptably high.

CLINICAL RELEVANCE

The impact of patients LTFU in studies related to arthroscopic intervention is unknown. A universal method for accounting for patient follow-up is needed.