Barriers to completion of Patient Reported Outcome Measures

The Acceptability and Efficacy of Electronic Data Collection in a Hospital Neurodevelopmental Clinic: Pilot Questionnaire Study

Background

There is a growing need for cost-efficient and patient-centered approaches to support families in hospital- and community-based neurodevelopmental services. For such purposes, electronic data collection (EDC) may hold advantages over paper-based data collection. Such EDC approaches enable automated data collection for scoring and interpretation, saving time for clinicians and services and promoting more efficient service delivery.

Objective

This pilot study evaluated the efficacy of EDC for the Child Development Unit, a hospital-based diagnostic assessment clinic in the Sydney Children’s Hospital Network. Caregiver response rates and preference for EDC or paper-based methods were evaluated as well as the moderating role of demographic characteristics such as age, level of education, and ethnic background.

Methods

Families were sent either a paper-based questionnaire via post or an electronic mail link for completion before attending their first on-site clinic appointment for assessment. A total of 62 families were provided a paper version of the questionnaire, while 184 families were provided the online version of the same questionnaire.

Results

Completion rates of the questionnaire before the first appointment were significantly higher for EDC (164/184, 89.1%) in comparison to paper-based methods (24/62, 39%; P<.001). Within the EDC group, a vast majority of respondents indicated a preference for completing the questionnaire online (151/173, 87.3%), compared to paper completion (22/173, 12.7%; P<.001). Of the caregiver demographic characteristics, only the respondent’s level of education was associated with modality preference, such that those with a higher level of education reported a greater preference for EDC (P=.04).

Conclusions

These results show that EDC is feasible in hospital-based clinics and has the potential to offer substantial benefits in terms of centralized data collation, time and cost savings, efficiency of service, and resource allocation. The results of this study therefore support the continued use of electronic methods to improve family-centered care in clinical practices.

Validity of five foot and ankle specific electronic patient-reported outcome (ePRO) instruments in patients undergoing elective orthopedic foot or ankle surgery

BACKGROUND

Patient-reported outcomes (PROs) are widely accepted measures for evaluating outcomes of surgical interventions. As patient-reported information is stored in electronic health records, it is essential that there are valid electronic PRO (ePRO) instruments available for clinicians and researchers. The aim of this study was to evaluate the validity of electronic versions of five widely used foot and ankle specific PRO instruments.

METHODS

Altogether 111 consecutive elective foot/ankle surgery patients were invited face-to-face to participate in this study. Patients completed electronic versions of the Foot and Ankle Ability Measure (FAAM), the Foot and Ankle Outcome Score (FAOS), the modified Lower Extremity Function Scale (LEFS), the Manchester-Oxford Foot Questionnaire (MOXFQ), and the Visual Analogue Scale Foot and Ankle (VAS-FA) on the day of elective foot and/or ankle surgery. Construct validity, coverage, and targeting of the scales were assessed.

RESULTS

Based on general and predefined thresholds, construct validity, coverage, and targeting of the ePRO versions of the FAAM, the FAOS, the MOXFQ, and the VAS-FA were acceptable. Major issues arose with score distribution and convergent validity of the modified LEFS instrument.

CONCLUSIONS

The ePRO versions of the FAAM, the FAOS, the MOXFQ, and the VAS-FA provide valid scores for foot and ankle patients. However, our findings do not support the use of the modified LEFS as an electronic outcome measure for patients with orthopedic foot and/or ankle pathologies.

What Factors Are Associated with Patient-reported Outcome Measure Questionnaire Completion for an Electronic Shoulder Arthroplasty Registry?

BACKGROUND

There has been an increase in the use of electronic systems to collect patient-reported outcome measures. There is limited data on the added value of electronic reporting on increasing patient response proportions and little knowledge of which patients are more likely to respond.

QUESTIONS/PURPOSES

(1) What proportion of patients completed patient-reported outcome questionnaires at baseline and at 1 year and 2 years of follow-up after shoulder arthroplasty, and what methods did they use to complete these questionnaires (either automated or manual data collection)? (2) What factors were associated with questionnaire completion?

METHODS

Our shoulder arthroplasty registry from a high-volume, tertiary care center implemented an electronic platform to collect patient-reported outcomes. A total of 2128 patients underwent shoulder arthroplasty between 2016 and 2019. Patients without an email address on file were excluded; 90% (1907 of 2128) of patients were included in the study. The population was 50% women (954 of 1907) with a mean age of 67 ± 9 years. A query was performed to determine whether patients completed questionnaires by either automated or manual data collection at baseline and 1 year and 2 years of follow-up after shoulder arthroplasty. In a logistic regression analysis, patient factors (such as demographics, education, and living arrangements) were evaluated for their association with whether patients completed these questionnaires.

RESULTS

The proportion of questionnaire completion at baseline, 1 year, and 2 years were 72% (1369 of 1907), 47% (456 of 972), and 33% (128 of 393), respectively. Of the patients who completed their questionnaires, 63% (868 of 1369) did so through automated emails at baseline, 84% (381 of 456) did so at 1 year, and 81% (103 of 128) did so at 2 years. The remainder completed their questionnaires through manual data collection with a research assistant: 37% (501 of 1369) at baseline, 16% (75 of 456) at 1 year, and 19% (25 of 128) at 2 years. After controlling for potentially confounding variables like patient demographics, college education, and living arrangements, women were less likely to complete baseline questionnaires than men (odds ratio 0.78 [95% confidence interval 0.62 to 0.99]; p = 0.04), and white patients (OR 1.6 [95% CI 1.05 to 2.44]; p = 0.03) were more likely than nonwhite patients to have complete baseline questionnaires. At 2 years of follow-up, patients with a college education (OR 2.06 [95% CI 1.14 to 3.71]; p = 0.02), those who lived alone (OR 2.11 [95% CI 1.13 to 3.94]; p = 0.02), and those who had higher baseline Shoulder Activity Scale scores (OR 1.05 [95% CI 1.00 to 1.11]; p = 0.04) were more likely to have complete questionnaires than those without a college education, those who lived with other people, and those with lower SAS scores, respectively.

CONCLUSION

The challenges of adopting an online platform include low follow-up proportions and the need for manual assistance by a research assistant to increase patient completion of questionnaires.

CLINICAL RELEVANCE

The knowledge of which patient characteristics are associated with a higher likelihood of completing questionnaires has implications for targeted follow-up or representative sampling of the population in a registry. Populations that are less likely to respond may require more effort to reach to prevent exacerbating health outcome disparities. Random sampling with upweighting of hard-to-reach populations may also provide a solution to achieve a representative population of patients undergoing shoulder arthroplasty.

User Experience of a Chatbot Questionnaire Versus a Regular Computer Questionnaire: Prospective Comparative Study

BACKGROUND

Respondent engagement of questionnaires in health care is fundamental to ensure adequate response rates for the evaluation of services and quality of care. Conventional survey designs are often perceived as dull and unengaging, resulting in negative respondent behavior. It is necessary to make completing a questionnaire attractive and motivating.

OBJECTIVE

The aim of this study is to compare the user experience of a chatbot questionnaire, which mimics intelligent conversation, with a regular computer questionnaire.

METHODS

The research took place at the preoperative outpatient clinic. Patients completed both the standard computer questionnaire and the new chatbot questionnaire. Afterward, patients gave their feedback on both questionnaires by the User Experience Questionnaire, which consists of 26 terms to score.

RESULTS

The mean age of the 40 included patients (25 [63%] women) was 49 (SD 18-79) years; 46.73% (486/1040) of all terms were scored positive for the chatbot. Patients preferred the computer for 7.98% (83/1040) of the terms and for 47.88% (498/1040) of the terms there were no differences. Completion (mean time) of the computer questionnaire took 9.00 minutes by men (SD 2.72) and 7.72 minutes by women (SD 2.60; P=.148). For the chatbot, completion by men took 8.33 minutes (SD 2.99) and by women 7.36 minutes (SD 2.61; P=.287).

CONCLUSIONS

Patients preferred the chatbot questionnaire over the computer questionnaire. Time to completion of both questionnaires did not differ, though the chatbot questionnaire on a tablet felt more rapid compared to the computer questionnaire. This is an important finding because it could lead to higher response rates and to qualitatively better responses in future questionnaires.

Development of Machine Learning Algorithms to Predict Being Lost to Follow-up After Hip Arthroscopy for Femoroacetabular Impingement Syndrome

Purpose

To determine factors predictive of patients who are at risk for being lost to follow-up after hip arthroscopy for femoroacetabular impingement syndrome (FAIS).

Methods

A prospective clinical repository was queried between January 2012 and October 2017 and all patients who underwent hip arthroscopy for primary or revision FAIS with minimum 2-year follow-up were included. A total of 27 potential risk factors for loss to follow-up were available and tested for predictive value. An 80:20 random sample split of all patients was performed to create training and testing sets. Cross-validation, minimum Bayes information criteria, and adaptive machine-learning algorithms were used to develop the predictive model. The model with the best predictive performance was selected based off of the lowest postestimation deviance between the training and testing samples. The c-statistic is a measure of discrimination. It ranges from 0.5 to 1.0, with 1.0 being perfect discrimination and 0.5 indicating the model is no better than chance. A log-likelihood χ² test was used to evaluate the goodness-of-fit of the logistic regression model.

Results

A total of 2113 patients were included. Inference of minimum Bayes information criteria model indicated that male sex (odds ratio [OR] 1.82, P = .028), non-white race (African American OR 2.41, P = .013; other non-white OR 1.42, P = .042), smoking (OR 1.07, P = .021), and failure to provide a phone number (OR 1.78, P = .032) increased the risk for being lost to follow-up. Furthermore, greater preoperative International Hip Outcome Tool 12-item component questionnaire (OR 1.03, P = .004), and modified Harris Hip Score (OR 1.05, P = .014) scores increased the risk of being lost to follow-up. The c-statistic was 0.76 (95% confidence interval 0.701-0.848). The log-likelihood indicated that the regression model as a whole was statistically significant (P = .002).

Conclusions

Patients who are male, non-white, smokers, fail to provide a telephone number, and have greater preoperative modified Harris Hip Score and International Hip Outcome Tool 12-item component questionnaire scores are at an increased risk for being lost to follow-up 2 years after hip arthroscopy for FAIS.

Level of Evidence

Level III, case control study.

Factors associated with completion of patient surveys 1 year after bariatric surgery

BACKGROUND

Patient-reported outcomes (PRO) obtained from follow-up survey data are essential to understanding the longitudinal effects of bariatric surgery. However, capturing data among patients who are well beyond the recovery period of surgery remains a challenge, and little is known about what factors may influence follow-up rates for PRO.

OBJECTIVES

To assess the effect of hospital practices and surgical outcomes on patient survey completion rates at 1 year after bariatric surgery.

SETTING

Prospective, statewide, bariatric-specific clinical registry.

METHODS

Patients at hospitals participating in the Michigan Bariatric Surgery Collaborative are surveyed annually to obtain information on weight loss, medication use, satisfaction, body image, and quality of life following bariatric surgery. Hospital program coordinators were surveyed in June 2017 about their practices for ensuring survey completion among their patients. Hospitals were ranked based on 1-year patient survey completion rates between 2011 and 2015. Multivariable regression analyses were used to identify associations between hospital practices, as well as 30-day outcomes, on hospital survey completion rankings.

RESULTS

Overall, patient survey completion rates at 1 year improved from 2011 (33.9% ± 14.5%) to 2015 (51.0% ± 13.0%), although there was wide variability between hospitals (21.1% versus 77.3% in 2015). Hospitals in the bottom quartile for survey completion rates had higher adjusted rates of 30-day severe complications (2.6% versus 1.7%, respectively; P = .0481), readmissions (5.0% versus 3.9%, respectively; P = .0157), and reoperations (1.5% versus .7%, respectively; P = .0216) than those in the top quartile. While most hospital practices did not significantly impact survey completion at 1 year, physically handing out surveys during clinic visits was independently associated with higher completion rates (odds ratio, 13.60; 95% confidence interval, 1.99-93.03; P =.0078).

CONCLUSIONS

Hospitals vary considerably in completion rates of patient surveys at 1 year after bariatric surgery, and lower rates were associated with hospitals that had higher complication rates. Hospitals with the highest completion rates were more likely to physically hand surveys to patients during clinic visits. Given the value of PRO on longitudinal outcomes of bariatric surgery, improving data collection across multiple hospital systems is imperative.

Outcome Metrics in Pediatric Sports Medicine: Do PROMIS Computer-adaptive Testing Metrics Correlate With Pedi-IKDC?

BACKGROUND

A modified version of the International Knee Documentation Committee (IKDC), the Pedi-IKDC, is a validated patient-reported outcome measure in pediatric patients with knee pain. However, this questionnaire is lengthy and can fatigue patients, leading to inconsistent outcome collection. Thus, we sought to compare more easily attainable Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive testing patient reported outcomes to the gold standard Pedi-IKDC.

METHODS

We prospectively collected PROMIS scores and Pedi-IKDC scores in 100 new, consecutive patients presenting with knee pain to a pediatric sports medicine practice. Patients were excluded if they provided an incomplete Pedi-IKDC, had prior ipsilateral lower extremity surgery, or significant associated medical comorbidities. PROMIS domains including Mobility, Pain Interference, and Upper Extremity (control) were compared with the Pedi-IKDC with Pearson correlations. The number of questions in each metric was analyzed. Floor and ceiling effects of each test were also assessed.

RESULTS

The average age of the study cohort was 14 years (range, 7 to 18  y) with 53% female and 47% male. 70% of patients completed the Pedi-IKDC questionnaire, compared with 100% with PROMIS tests. The average Pedi-IKDC score was 48.8±22.3 (range, 5.4 to 100). Mean scores for Mobility, Pain Interference, and Upper Extremity domains were 38.4±10.1, 53.5±10.3, and 49.7±8.7, respectively. All tests demonstrated similar and acceptable floor and ceiling effects (<15%). The length of the Pedi-IKDC (22 questions) was roughly double that of combined PROMIS Pain Interference and Mobility tests (11.9±2.3 questions). Pedi-IKDC scores correlated with tested PROMIS measures (Mobility/Pain Interference, r=0.42/-0.49). When 7 highly functional patients with significant pain symptoms were removed for a secondary analysis, Mobility and Pain correlations improved to 0.69 and -0.67, respectively.

CONCLUSIONS

PROMIS Mobility and Pain scores demonstrate moderate correlations with the Pedi-IKDC, highlighting these tests are not capturing the same patient experiences. These correlations are weakened by a small group of painful yet highly functioning patients. The Pedi-IKDC was significantly longer and had a much lower completion rate than PROMIS tests, highlighting a need for a validated computer adaptive testing in evaluating pediatric patients with knee pain.

LEVELS OF EVIDENCE

Level II.

Patients' reasons for non-use of digital patient-reported outcome concepts: A scoping review

Data from digitally administered patient reported outcomes (PROs) is used more and more in routine healthcare for long-term conditions as a part of daily clinical practice. This literature study reviews empirical studies of digital PRO to examine patients' reasons for non-use of digitally administered PRO data in routine care. This scoping review searched through PubMed, Embase, Web of Science and PsycINFO databases, reporting on study population, intervention, duration of intervention and motivational factors alongside stated reasons for nonparticipation or dropout for each study. The patients' reasons for not participating, either from study start or by dropout, were analysed through a thematic approach.Fifty-one studies were included, published from 2010 to 2019, mostly from Europe and the Unites States covering different long-term conditions. The reasons for non-use are manifold and cover the themes of ability to use PRO, engagement, emotional distress and technical barriers.Several reasons are given explaining why patients with long-term conditions are not using digitally administered PRO as intended. This should be taken into account in the design phase of digital PRO interventions and considered in conversations with patients during the intervention.

Preoperative patient activation is predictive of improvements in patient-reported outcomes following minimally invasive lumbar decompression

PURPOSE

To determine whether there is an association between preoperative 10-Item Patient Activation Measure (PAM-10) scores and clinical outcomes following MIS LD.

METHODS

Patients undergoing a primary MIS LD were retrospectively reviewed and stratified according to their preoperative PAM-10 scores: "low PAM," "moderate PAM," and "high PAM." Preoperative PAM score cohorts were tested for improvements in Oswestry Disability Index (ODI), 12-Item Short-Form Physical Component Score (SF-12 PCS), and Visual Analog Scale (VAS) back and leg pain using multivariate linear regression.

RESULTS

Eighty-nine patients were included: 29 had a low PAM score, 32 had a moderate PAM score, and 28 had a high PAM score. Cohorts experienced similar preoperative VAS back pain, VAS leg pain, ODI, and SF-12 PCS. Patients with low PAM scores experienced a trend of higher pain scores throughout 6 months with VAS back pain being significant at 3 months and VAS leg pain being significant at 6-week and 3-month follow-up. Patients with lower PAM scores experienced a worse improvement in ODI at 6-week, 3-month, and 6-month timepoints. Lastly, patients with lower PAM scores demonstrated less improvement in SF-12 PCS at 3-month and 6-month follow-up.

CONCLUSIONS

Lower preoperative PAM scores were associated with worse improvement in clinical outcomes following MIS LD. Patients with lower PAM scores had diminished improvement in long-term patient-reported outcomes including ODI, SF-12, and VAS back and leg pain. Our investigation suggests that preoperative PAM assessments may be an effective tool to predict postoperative outcomes following MIS LD.

An update on joint-specific outcome measures in total hip replacement

This is the latest review of joint-specific tools used to evaluate patients undergoing total hip replacement (THR) surgery, which is an effective treatment for end-stage osteoarthritis. Due to the large number and multitude of scales and their variants used, a critical assessment of the available tools is necessary. In the article, we briefly describe six different clinical tools: the Western Ontario and McMaster Universities Osteoarthritis Index, the Hip Disability and Osteoarthritis Outcome Score, the Harris Hip Score, the Oxford Hip Score, the Mayo Hip Score, and the Rheumatoid and Arthritis Outcome Score. We present the advantages and constraints of the different outcome measures, providing a helpful resource of information for clinical trials and for everyday routine evaluation.

Prioritisation of quality indicators for elective perioperative care: a Delphi consensus

BACKGROUND

A systematic review of the peer-reviewed and grey literature previously identified over 1200 perioperative structure and process quality indicators. We undertook a Delphi consensus process with the aim of creating a concise list of indicators that experts deemed most important for assessing quality in perioperative care.

METHODS

A basic Delphi consensus was completed using an online survey which was distributed to surgeons, anaesthetists, nurses, physicians and lay representatives. Participants were asked to prioritise the indicators in order of importance (high, medium or low) to be included for collection in a national perioperative quality improvement programme.

RESULTS

One hundred and thirty-seven indicators were included in the first iteration of the Delphi consensus (91 structure and 48 process indicators). Sixty-three experts agreed to participate and the consensus was completed in five rounds. Ninety-five indicators were agreed as high priority: 65 structural and 30 process indicators.

CONCLUSION

The Delphi consensus process was able to reduce the number of recommended indicators to only a modest extent. Further work to evaluate the practicalities of routinely collecting such a comprehensive list of quality indicators is now required.

Preoperative Validation of the Patient-Reported Outcomes Measurement Information System in Patients With Articular Cartilage Defects of the Knee

PURPOSE

To validate the Patient-Reported Outcomes Measurement Information System (PROMIS) physical function computer adaptive test (PF CAT) with current patient-reported outcome (PRO) instruments in patients with cartilage injuries of the knee.

METHODS

Patients scheduled for osteochondral autograft or allograft transplant, microfracture, autologous chondrocyte implantation, allograft cartilage resurfacing, and chondroplasty were prospectively enrolled in the study and completed PROMIS PF CAT, Knee Injury and Osteoarthritis Outcome Score (KOOS activities of daily living, pain, symptoms, sport, and quality of life), Short Form-36 Health Survey (SF-36 physical function [PF] and Physical Component Summary), and EuroQol-5 Dimension questionnaires. The Spearman correlation coefficient was used to compare instruments. Instrument correlations were defined as excellent (>0.7), excellent to good (0.61-0.69), good (0.4 to 0.6), and poor (<0.39), with significance defined as P < .05.

RESULTS

A total of 293 knees in 275 patients (54.5% male) undergoing 319 cartilage procedures were analyzed. The most commonly performed cartilage procedure was chondroplasty (n = 118; 37.0%), followed by microfracture (n = 100; 31.3%). The mean age was 34.0 ± 14.7 and the mean body mass index was 30.0 ± 6.9. The PROMIS PF CAT had an excellent correlation with the SF-36 PF (r = 0.819; P < .001), SF-36 Physical Component Summary (r = 0.766; P < .001), KOOS activities of daily living (r = 0.733; P < .001), KOOS Sport (r = 0.709; P < .001), and EuroQol-5 Dimension (r = 0.752; P < .001) instruments; an excellent-good correlation with the KOOS pain (r = 0.662; P < .001), and KOOS quality of life (r = 0.640; P < .001) scores; and a good correlation with the KOOS symptoms (r = 0.519; P < .001) scale. The PROMIS PF CAT had no floor or ceiling effects and the smallest question burden (mean 4.17 ± 0.93 questions). Dimensionality analyses demonstrated that the smallest amount of unexplained variance was present in the PROMIS PF CAT (3.6%).

CONCLUSION

The PROMIS PF CAT is an effective tool for preoperative outcome assessment in patients with cartilage defects of the knee. It correlates strongly with legacy PRO measures of physical function with no ceiling and floor effects and a minimal time burden for completion. Further study is warranted to determine postoperative performance and to evaluate the responsiveness of PROMIS to change within a patient.

LEVEL OF EVIDENCE

III; Prognostic retrospective comparative study.

Which Factors Influence the Use of Patient-Reported Outcome Measures in Dutch Physiotherapy Practice? A Cross-Sectional Study

Purpose: Patient-reported outcome measures (PROMs) have the potential to enhance the quality of health care but, as a result of suboptimal implementation, it is unclear whether they fulfil this role in physiotherapy practice. This cross-sectional study aimed to identify the factors influencing PROM use in Dutch private physiotherapy practices. Method: A total of 444 physiotherapists completed a self-assessment questionnaire and uploaded the data from their electronic health record (EHR) systems to the national registry of outcome data. Univariate and multivariate ordinal logistic and linear regression analysis were used to identify the factors associated with self-reported PROM use and PROM use registered in the EHR systems, which were derived from the self-assessment questionnaire and from the data in the national registry, respectively. Five categories with nine independent variables were selected as potential factors for regression analysis. The similarity between self-reported and registered PROM use was verified. Results: On the basis of self-report and EHR report, we found that 21.6% and 29.8% of participants, respectively, used PROMs with more than 80% of their patients, and we identified the factors associated with PROM use. Conclusions: The factors associated with PROM use are EHR systems that support PROM use and more knowledge about PROM use. These findings can guide future strategies to enhance the use of PROMs in physiotherapy practice.

Developing a Preliminary Conceptual Framework for Guidelines on Inclusion of Patient Reported-Outcome Measures (PROMs) in Clinical Quality Registries

Purpose

Patient-centred and value-based health-care organisations are increasingly recognising the importance of the patient perspective in the measurement and evaluation of health outcomes. This has been primarily implemented using patient-reported outcome measures (PROMs). Clinical quality registries (CQRs) are specifically designed to improve direct clinical care, benchmark health-care provision and inform health service planning and policy. Despite CQRs having incorporated the patient perspective to support the evaluation of health-care provision, no evidence-based guidelines for inclusion of PROMs in CQRs exist. This has led to substantial heterogeneity in capturing and reporting PROMs within this setting. This publication is the first in a series describing the development of evidence-informed guidelines for PROMs inclusion within CQRs in Australia.

Methods

This study consisted of three components: 1) a literature review of existing evidence of guidelines, enablers, barriers, and lessons learnt of PROMs use within the CQRs setting; 2) a survey of Australian CQRs to determine current practices for PROMs use and reporting; and 3) development of a preliminary conceptual framework for PROMs inclusion in CQRs.

Results

Content analysis of the literature review and survey of 66 Australian registries elicited eight categories for the conceptual framework. The framework covers eight components: rationale, setting, ethics, selection of PROMs, administration, data management, statistical methods, feedback, and reporting.

Conclusion

We developed a preliminary conceptual framework, which classified findings, from both the literature and the survey, into broad categories ranging from initial development to outcome dissemination providing the structure for development of guidelines in the next phase of this project, engaging national and international leaders in health-related quality of life research, clinicians, researchers, patient advocates and consumers.

Risk Factors for Loss to Follow-up in 3202 Patients at 2 Years After Anterior Cruciate Ligament Reconstruction: Implications for Identifying Health Disparities in the MOON Prospective Cohort Study

BACKGROUND

Understanding the risk factors for loss to follow-up in prospective clinical studies may allow for a targeted approach to minimizing follow-up bias and improving the generalizability of conclusions in anterior cruciate ligament reconstruction (ACLR) and other sports-related interventions.

PURPOSE

To identify independent risk factors associated with failure to complete (ie, loss to follow-up) patient-reported outcome measures (PROMs) at 2 years after ACLR within a well-funded prospective longitudinal cohort.

STUDY DESIGN

Cohort study (prognosis); Level of evidence, 2.

METHODS

All patients undergoing primary or revision ACLR enrolled in the prospectively collected database of the multicenter consortium between 2002 and 2008 were included. Multivariate regression analyses were conducted to determine which baseline risk factors were significantly associated with loss to follow-up at a minimum of 2 years after surgery. Predictors assessed for loss to follow-up were as follows: consortium site, sex, race, marital status, smoking status, phone number provided (home or cell), email address provided (primary or secondary), years of school completed, average hours worked per week, working status (full-time, part-time, homemaker, retired, student, or disabled), number of people living at home, and preoperative PROMs (Knee injury and Osteoarthritis Outcome Score, Marx Activity Rating Scale, and International Knee Documentation Committee).

RESULTS

A total of 3202 patients who underwent ACLR were enrolled. The 2-year PROM follow-up rate for this cohort was 88% (2821 of 3202). Multivariate analyses showed that patient sex (male: odds ratio [OR], 1.80) and race (black: OR, 3.64; other nonwhite: OR, 1.81) were independent predictors of 2-year loss to follow-up of PROMs. Education level was a nonconfounder.

CONCLUSION

While education level did not predict loss to follow-up, patients who are male and nonwhite are at increased risk of loss to follow-up of PROM at 2 years. Capturing patient outcomes with minimal loss depends on equitable, not equal, opportunity to maximize generalizability and mitigate potential population-level health disparities.

REGISTRATION

NCT00478894 (ClinicalTrials.gov identifier).

Value Denominator: The Fundamentals of Costing for Orthopaedic Surgeons

In any discipline, improving quality and efficiency of services acts as a unifying goal. In health care, the goal of achieving high-value care is the new doctrine for all individual entities: payors, providers, and patients. Value is defined as the ratio of outcomes to costs incurred. Therefore, a strong understanding and interpretation of cost measures is crucial to accurately deriving health care value. Health care costing is not simply limited to the costs of implants or the procedure but the costs required to deliver treatment throughout the episode of care. Consequently, physicians serve a keystone role toward driving change in health care costs and initiate high-value care practices. However, physicians require a better understanding of health care costs and institutional accounting practices. To this effort, it is critical that health care providers begin to close the knowledge gap around health care costing and provide leadership when advocating for high-value patient care. This review is purposed to provide a basic review of fundamental components for health care economics, deciphering health care costing, and preview current strategies that prioritize high-value patient care.

Exploring the perspective of patients with musculoskeletal health problems in primary care on the use of patient-reported outcome measures to stimulate quality improvement in physiotherapist practice; a qualitative study

Background: Patient-reported outcome measures (PROMs) in clinical practice might enhance patient- centeredness and effectiveness of physiotherapy practice. Although patients have a crucial role in using PROMs, little is known about their perspective on its usefulness.Purpose: Explore the perspective of patients with musculoskeletal health problems on using PROMs for quality improvement in primary care physiotherapy practice, and determine what barriers and facilitators patients perceive.Methods: Semi-structured interviews were performed in 21 patients recruited from primary care physiotherapy practice and analyzed using theoretical thematic analysis. Barriers and facilitators on PROMs implementation were categorized into four predefined domains conform.Results: Across all domains, three major themes were identified: 1) Practicality; 2) Interaction with the physiotherapist for decision-making; and 3) Sharing information outside the clinical context. Generally, PROMs were perceived practically applicable instruments with added value to the interaction with the physiotherapist for shared decision-making and for stimulating quality improvement. The perceived barriers were: difficulties in administering PROMs for patients with poor computer skills, suboptimal efficiency when PROMs were administered at the expense of the consultation, the insufficient added value of PROMs for patients with recurrent health problems, and reluctance about sharing aggregated data for accountability purposes.Limitations: The dependence on the participating physiotherapists in patient recruitment might have resulted in selection bias.Conclusion: Patients perceive that using PROMs has an added value in primary care physiotherapy practice. Optimizing implementation using tailored implementation strategies related to the identified barriers in all four domains might further improve the use of PROMs in clinical practice.

The Remote Completion Rate of Electronic Patient-Reported Outcome Forms Before Scheduled Clinic Visits-A Proof-of-Concept Study Using Patient-Reported Outcome Measurement Information System Computer Adaptive Test Questionnaires

INTRODUCTION

Patient-Reported Outcome Measurement Information System (PROMIS) questionnaires are amenable to remote administration. This study sought to determine remote completion rates of PROMIS questionnaires before clinic visits.

METHODS

Patients were e-mailed a set of PROMIS forms. Completion rates were analyzed by visit type, provider seen, and patient demographics.

RESULTS

Seven hundred forty total appointments were included. Sixty-seven percent of encounters had previsit form completion. High completion rates were found for all visit types (74%, 67%, and 64% for new, return, and postoperative visits, respectively). Women had a higher completion rate than men (71% versus 64%; P = 0.031). White patients (72%; P = 0.001) and patients in the third median household income quartile ($53,725 to $83,088; 72%; P = 0.008) had higher completion rates than their respective counterparts.

CONCLUSION

Most patients remotely completed PROMIS forms. The efficiency and accessibility of PROMIS forms may help improve ease of collection of patient-reported outcomes.

Relationship Between Baseline Patient-reported Outcomes and Demographic, Psychosocial, and Clinical Characteristics: A Retrospective Study

Introduction

Alternative payment models in total lower extremity joint replacement (TJR) increasingly emphasize patient-reported outcomes (PROs) to link the latter to value-based payments. It is unclear to what extent demographic, psychosocial, and clinical characteristics are related to PROs measured preoperatively with the commonly used Hip/Knee Osteoarthritis Outcome Scores (HOOS/KOOS) and the Veterans RAND 12-Item Health Survey (VR-12) questionnaires. We aim to identify (1) the preoperative relationship between HOOS/KOOS and VR-12 scores and several demographic, psychosocial, and clinical patient characteristics and (2) the best modifiable factors for optimization, which may result in improved baseline PROs before TJR.

Methods

All TJR cases performed in 2017 at the two highest-volume hospitals within an urban academic health system were queried. Preoperative HOOS/KOOS and VR-12 surveys were administered through an e-collection platform. VR-12 physical and mental component scores (PCS, MCS) were generated. Patient information was extracted from the electronic health record. Bivariate and multivariate regression analyses were performed. Odds ratios (ORs) and 95% confidence intervals were reported.

Results

In univariate analysis, patients with HOOS/KOOS, VR-12 PCS, and MCS in the ≤25th percentile group were more likely to have an ASA score of ≥3 compared with those with higher scores. In multivariate analysis, increased and decreased odds of low HOOS/KOOS were associated with a one-unit increase in Charlson Comorbidity Index (OR, 1.16) and VR-12 MCS (OR, 0.97), respectively. Increased odds of low baseline VR-12 PCS and MCS were associated with ASA class ≥3 (OR, 1.65 and 1.40). Decreased odds of a low MCS were associated with an increase in HOOS/KOOS (OR, 0.98) (P ≤ 0.05 for all).

Conclusion

Of the factors that are associated with low baseline PRO scores, preoperatively addressing mismanaged comorbidities, mental health, and physical function were identified as the best modifiable factors for optimization, which may result in improved baseline PROs before TJR.

Improving the response rate of patient-reported outcome measures in an Australian tertiary metropolitan hospital

Background: The benefits of collecting patient-reported outcome measures (PROMs) for clinical care are widely accepted; however, the collection and response rate remain a significant barrier.

Objective: The objective of this study was to assess predictors of successful PROM response rate in an orthopedic outpatient setting at a public tertiary hospital.

Method: A prospective cohort study was conducted at a metropolitan hospital assessing the response rate after a number of interventions in the collection of PROMs in the orthopedic outpatient setting. All patients were invited to complete a PROM relevant to their presenting condition. Eight cohorts were studied, all different in the process of collection, the timing of collection and the physical environment of collection. Analysis was completed in Stata v14.1 with collin commands used to assess collinearity. A multiple logistic regression model and a mixed effect logistic regression model were performed and compared. The significance level of p<0.05 was used.

Results: During the trial period 2,338 patients were seen. Response rates as high as 81% were seen, which was significantly improved compared with the earliest six cohorts (p<0.01). Being younger; being a new patient; having a longer wait time; having an English-speaking background and being a pre- or post-operative patient were all associated with an increased response rate of PROMs. Gender, the patient’s pathology and the type of PROM did not significantly affect the response rate.

Conclusions: The method employed to invite and inform patients of the PROM collection, and the environment in which it is undertaken, significantly alter the response rate in the completion of PROMs. Being younger, being a new patient, having a longer wait time, being English speaking, being a pre-op or post-op patient were all associated with an increase in response rate.

Longitudinal changes in patient-reported outcome measures following total hip arthroplasty and predictors of deterioration during follow-up

Aims

The primary aim of this study was to quantify the improvement in patient-reported outcome measures (PROMs) following total hip arthroplasty (THA), as well as the extent of any deterioration through the seven-year follow-up. The secondary aim was to identify predictors of PROM improvement and deterioration.

Patients and Methods

A total of 976 patients were enrolled into a prospective, international, multicentre study. Patients completed a battery of PROMs prior to THA, at three months post-THA, and at one, three, five, and seven-years post-THA. The Harris Hip Score (HHS), the 36-Item Short-Form Health Survey (SF-36) Physical Component Summary (PCS), the SF-36 Mental Component Summary (MCS), and the EuroQol five-dimension three-level (EQ-5D) index were the primary outcomes. Longitudinal changes in each PROM were investigated by piece-wise linear mixed effects models. Clinically significant deterioration was defined for each patient as a decrease of one half of a standard deviation (group baseline).

Results

Improvements were noted in each PROM between the preoperative and one-year visits, with one-year values exceeding age-matched population norms. Patients with difficulty in self-care experienced less improvement in HHS (odds ratio (OR) 2.2; p = 0.003). Those with anxiety/depression experienced less improvement in PCS (OR -3.3; p = 0.002) and EQ-5D (OR -0.07; p = 0.005). Between one and seven years, obesity was associated with deterioration in HHS (1.5 points/year; p = 0.006), PCS (0.8 points/year; p < 0.001), and EQ-5D (0.02 points/year; p < 0.001). Preoperative difficulty in self-care was associated with deterioration in HHS (2.2 points/year; p < 0.001). Preoperative pain from other joints was associated with deterioration in MCS (0.8 points/year; p < 0.001). All aforementioned factors were associated with clinically significant deterioration in PROMs (p < 0.035), except anxiety/depression with regard to PCS (p = 0.060).

Conclusion

The present study finds that patient factors affect the improvement and deterioration in PROMs over the medium term following THA. Special attention should be given to patients with risk factors for decreased PROMs, both preoperatively and during follow-up. Cite this article: Bone Joint J 2019;101-B:768–778.

Preoperative Performance of PROMIS in Patients With Patellofemoral Malalignment and Chondral Disease

BACKGROUND

Use of the Patient-Reported Outcomes Measurement Information System (PROMIS) instrument has not yet been validated in patients undergoing operative treatment for patellofemoral malalignment and chondral disease.

PURPOSE

To evaluate the PROMIS Physical Function Computer Adaptive Testing (PF CAT) instrument in a population of patients with patellofemoral malalignment and chondral disease relative to established patient-reported outcome (PRO) instruments.

STUDY DESIGN

Cohort study (diagnosis); Level of evidence, 2.

METHODS

Eligible patients were prospectively enrolled at the time of indication for surgery and completed 5 PRO instruments preoperatively: 36-Item Short Form Health Survey (SF-36); Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC); Marx activity rating scale (Marx); EuroQol 5-dimension, 5-level instrument (EQ-5D-5L); and PROMIS PF CAT. Convergent and discriminant validity was assessed by measuring correlations between PROMIS PF CAT and other PRO instruments, including the Knee injury and Osteoarthritis Outcome Score (KOOS). Strength of correlation was measured by use of Spearman correlation coefficients.

RESULTS

In total, 37 patients (40 knees) were enrolled in the study. All knees underwent Fulkerson osteotomy and concomitant cartilage procedure (29 chondroplasty, 6 allograft, 5 microfracture). Mean patient age was 33.4 years, and 73% of knees were in female patients. Correlations (r) between PROMIS PF CAT and knee PRO instruments were as follows: SF-36 PF (r = 0.80; P < .01); KOOS Pain (r = 0.74; P < .01); KOOS Symptoms (r = 0.47; P < .01); KOOS Quality of Life (r = 0.68; P < .01); KOOS Sports and Recreation (r = 0.72; P < .01); KOOS Activities of Daily Living (ADL) (r = 0.80; P < .01); WOMAC Function (r = 0.80; P < .01); WOMAC Pain (r = 0.72; P < .01); WOMAC Stiffness (r = 0.38; P = .02); Marx (r = 0.22; P = .31); and EQ-5D-5L (r = 0.72; P < .01). Neither floor nor ceiling effects were observed in PROMIS PF CAT or KOOS ADL. Mean (±SD) question burden with PROMIS PF CAT was 5.6 ± 0.6 questions.

CONCLUSION

In patients with patellofemoral malalignment and chondral disease, PROMIS PF CAT is an efficient and reliable PRO instrument to preoperatively assess patients across a spectrum of knee function without floor or ceiling effects.

Preoperative Patient-Reported Outcomes and Clinical Characteristics as Predictors of 90-Day Cost/Utilization and Complications

BACKGROUND

With the advent of mandatory bundle payments for total joint arthroplasty (TJA), assessing patients' risk for increased 90-day complications and resource utilization is crucial. This study assesses the degree to which preoperative patient-reported outcomes predict 90-day complications, episode costs, and utilization in TJA patients.

METHODS

All TJA cases in 2017 at 2 high-volume hospitals were queried. Preoperative HOOS/KOOS JR (Hip Injury and Osteoarthritis Outcome Score/Knee Injury and Osteoarthritis Outcome Score) and Veterans RAND 12-item health survey (VR-12) were administered to patients preoperatively via e-collection platform. For patients enrolled in the Medicare bundle, cost data were extracted from claims. Bivariate and multivariate regression analyses were performed.

RESULTS

In total, 2108 patients underwent TJA in 2017; 1182 (56%) were missing patient-reported outcome data and were excluded. The final study population included 926 patients, 199 (21%) of which had available cost data. Patients with high bundle costs tended to be older, suffer from vascular disease and anemia, and have higher Charlson scores (P < .05 for all). These patients also had lower baseline VR-12 Physical Component Summary Score (PCS; 24 vs 30, P ≤ .001) and higher rates of extended length of stay, skilled nursing facility discharge, 90-day complications, and 90-day readmission (P ≤ .04 for all). In multivariate analysis, higher baseline VR-12 PCS was protective against extended length of stay, skilled nursing facility discharge, >75th percentile bundle cost, and 90-day bundle cost exceeding target bundle price (P < .01 for all). Baseline VR-12 Mental Component Summary Score and HOOS/KOOS JR were not predictive of complications or bundle cost.

CONCLUSION

Low baseline VR-12 PCS is predictive of high 90-day bundle costs. Baseline HOOS/KOOS JR scores were not predictive of utilization or cost. Neither VR-12 nor HOOS/KOOS JR was predictive of 90-day readmission or complications.

The "Auto-Constant": Can we estimate the Constant-Murley score with a self-administered questionnaire? A pilot study

INTRODUCTION

The Constant score, allows an objective and subjective assessment of the shoulder function. It has been proven to have a poor interobserver reliability for some of its aspects and is not usable as a remote assessment tool.

HYPOTHESIS

The Constant-Murley functional shoulder score can be assessed with a self-administered questionnaire.

METHODS

We conducted a prospective continuous study in a shoulder-specialized service. For each patient seen in consultation or hospitalized for a shoulder pathology, a self-administered questionnaire was delivered, and a clinical examination was performed by a surgeon. The questionnaire, in French language, was composed of checkboxes only, with pictures preferred over text for most items. Correlations with surgeon examination were assessed with the intraclass correlation coefficients, differences with the paired t-test.

RESULTS

One hundred consecutive patients were analyzed. Correlation between the two scores was excellent (0.87), as were the range of motion and the pain subscores (0.85 and 0.78), good for the activity (0.69) and fair for the strength (0.57). The mean total score was 3 points lower for the self-administered questionnaire (CI95 [-5; -1]; p<0.01). Activity and pain were not significantly different (-0.4/20 and -0.3/40; p>0.05) but pain and force were slightly different (+0.8/15; -3.0/25; p<0.01).

CONCLUSION

The Auto-Constant questionnaire in French is an excellent estimator of the Constant score, and of its pain and mobility sub-scores. It is less accurate for the evaluation of the strength, but differences between sub-scores compensate and allow its use in daily practice.

LEVEL OF PROOF

II, Prospective continuous clinical series.

Feasibility of PROMIS CAT Administration in the Ambulatory Sports Medicine Clinic With Respect to Cost and Patient Compliance: A Single-Surgeon Experience

Background:

Pay-for-performance reimbursement models are becoming increasingly popular, but the implementation of a routine patient-reported outcome (PRO) collection system places additional burden on both the patient and the provider. The Patient-Reported Outcomes Measurement Information System (PROMIS) was developed in an effort to make PRO collection more practical and efficient, but providers may be reluctant to embrace a transition to a PROMIS-based clinical outcome registry.

Hypothesis:

PROMIS can be successfully incorporated into daily clinical practice, with an overall patient compliance rate of 80%.

Study Design:

Cross-sectional study; Level of evidence, 3.

Methods:

As part of routine practice, all patients presenting to a single surgeon’s sports medicine clinic for an appointment were asked to complete a series of PROMIS computerized adaptive tests (CATs), including PROMIS Physical Function, Physical Function–Upper Extremity, Pain Interference, and Depression subscales. Overall compliance was calculated by dividing the number of survey sets completed by the number of eligible clinic visits. Compliance rates were further assessed by patient age, type of clinic visit, and location of injury. Costs associated with this system of routine PRO collection were categorized as start-up or maintenance costs.

Results:

From August 7, 2017, to December 8, 2017, there were 581 patients (1109 clinic encounters) who met inclusion criteria for the study. Of the 1109 clinic encounters, there was an overall compliance rate of 91.3% (1013/1109 visits during which the patient completed the entire PROMIS survey set). Overall, the full survey set consisted of a mean 15.3 questions and took a mean of 2.6 minutes to complete. Patients who were aged ≥62 years had a significantly lower compliance rate (81.8%; P < .0001) than each of the younger patient quartiles. When analyzing patients by the most common locations of injury (elbow, shoulder, hip, knee), the compliance rate for completing PROMIS was significantly higher for the hip than for the shoulder (95.1% vs 88.9%, respectively; P = .02). The cost of establishing a PROMIS-based registry using our project design and workflow was estimated at $2045, whereas the monthly maintenance cost was $1000.

Conclusion:

The routine electronic collection of PROMIS scores in the ambulatory orthopaedic clinic resulted in a compliance rate of over 90%, although older patients were generally less compliant than younger patients. Our system of data collection is practical and efficient in a high-volume orthopaedic clinic and places minimal financial burden on the provider.

The Responsiveness of Patient- Reported Outcome Tools in Shoulder Surgery Is Dependent on the Underlying Pathological Condition

BACKGROUND

Given the high number of available patient-reported outcome (PRO) tools for patients undergoing shoulder surgery, comparative information is necessary to determine the most relevant forms to incorporate into clinical practice.

PURPOSE

To determine the utilization and responsiveness of common PRO tools in studies involving patients undergoing arthroscopic rotator cuff repair or operative management of glenohumeral instability.

STUDY DESIGN

Systematic review.

METHODS

A systematic review of rotator cuff and instability studies from multiple databases was performed according to PRISMA guidelines. Means and SDs of each PRO tool utilized, study sample sizes, and follow-up durations were collected. The responsiveness of each PRO tool compared with other PRO tools was determined by calculating the effect size and relative efficiency (RE).

RESULTS

After a full-text review of 238 rotator cuff articles and 110 instability articles, 81 studies and 29 studies met the criteria for final inclusion, respectively. In the rotator cuff studies, 25 different PRO tools were utilized. The most commonly utilized PRO tools were the Constant (50 studies), visual analog scale (VAS) for pain (44 studies), American Shoulder and Elbow Surgeons (ASES; 39 studies), University of California, Los Angeles (UCLA; 20 studies), and Disabilities of the Arm, Shoulder and Hand (DASH; 13 studies) scores. The ASES score was found to be more responsive than all scores including the Constant (RE, 1.94), VAS for pain (RE, 1.54), UCLA (RE, 1.46), and DASH (RE, 1.35) scores. In the instability studies, 16 different PRO tools were utilized. The most commonly used PRO tools were the ASES (13 studies), Rowe (10 studies), Western Ontario Shoulder Instability Index (WOSI; 8 studies), VAS for pain (7 studies), UCLA (7 studies), and Constant (6 studies) scores. The Rowe score was much more responsive than both the ASES (RE, 22.84) and the Constant (RE, 33.17) scores; however, the ASES score remained more responsive than the Constant (RE, 1.93), VAS for pain (RE, 1.75), and WOSI (RE, 0.97) scores.

CONCLUSION

Despite being frequently used in the research community, the Constant score may be less clinically useful as it was less responsive. Additionally, it is a greater burden on the provider because it requires objective strength and range of motion data to be gathered by the clinician. In contrast, the ASES score was highly responsive after rotator cuff repair and requires only subjective patient input. Furthermore, separate PRO scoring methods appear to be necessary for patients undergoing rotator cuff repair and surgery for instability as the instability-specific Rowe score was much more responsive than the ASES score.

A preliminary investigation examining patient reported outcome measures for low back pain and utilisation amongst chiropractors in Australia: facilitators and barriers to clinical implementation

Background

The current utilisation of patient reported outcome measures (PROMs) for low back pain (LBP) within the Australian Chiropractic profession is unknown. The aims of this study were to determine the current utilisation of LBP PROMs amongst Chiropractors in Australia and to identify the potential barriers and facilitators of using PROMs for LBP in Chiropractic practice.

Methods

A cross sectional online survey was distributed to Chiropractors in Australia who were members of the Chiropractic Association of Australia (CAA) and Chiropractic Australia (CA) between June-August 2016. Three thousand fourteen CAA members and 930 CA members were invited to participate totaling 3944 potential participants.

Results

The findings from this survey provides baseline data for the prevalence of LBP PROMs within the Australian Chiropractic profession. A total of 558 participants completed the survey reflecting a response rate of 14.1%. 72.5% of respondents used LBP PROMs in clinical practice. PROMs were categorised into pain, function and health. At initial patient consultations the most commonly used pain PROMs were the pain diagram, Visual Analogue Scale and Numeric Rating Scale. Most commonly used functional LBP PROMs were the Oswestry Disability Index, Functional Rating Index and Roland Morris Questionnaire. The Health Status Questionnaire (HSQ) was the most commonly used health LBP PROM followed by RAND Health Questionnaires.

Conclusion

Most of the survey respondents use PROMs in clinical practice. The most common barrier chiropractors identified that prevent LBP PROM utilisation was the lack of operational definition surrounding PROMs, as well as how to use them and the perception that they are time consuming. Facilitatory factors to implement PROMs included using simple administration systems, utilising electronic forms and consistent implementation. This research indicates that there is a potential need to further educate the Chiropractic profession regarding PROMs.

Patient Adoption and Utilization of a Web-Based and Mobile-Based Portal for Collecting Outcomes After Elective Orthopedic Surgery

Health care increasingly collects patient-reported outcomes (PROs) via web-based platforms. The purpose of this study was to evaluate how patient age influences portal engagement. Patients undergoing elective surgery at a single multispecialty orthopedic practice from September 2014 to February 2017 had access to an online portal to complete PROs, message the clinic, and view physical therapy instructions. A mobile app was optionally available. Age, sex, log-in frequency, PRO completion rates, and number of messages sent were reviewed retrospectively. Message frequency, log-in rates, and PRO compliance were highest for patients aged 41 to 50, 51 to 60, and 61 to 70, respectively. Mobile app use decreased with age ( P = .002); yet, at all ages, the mobile app group was more engaged. In particular, for patients aged 18 to 30 years, log-in frequency increased 2.5-fold and PRO compliance improved 44% ( P < .001) in the mobile app group. This study demonstrates that portal interaction varies by age and that data capture is highest in patients who choose the mobile app.

Male Sex, Decreased Activity Level, and Higher BMI Associated With Lower Completion of Patient-Reported Outcome Measures Following ACL Reconstruction

Background:

Patient-reported outcome (PRO) surveys have become increasingly important in both improving patient care and assessing outcomes.

Purpose/Hypothesis:

The purpose of this study was to evaluate which variables are associated with compliance with completing PRO surveys in patients who have undergone anterior cruciate ligament reconstruction (ACLR). The authors hypothesized that older patient age and longer time since ACLR would be associated with lower completion rates of PRO surveys preoperatively and at postoperative time points.

Study Design:

Case series; Level of evidence, 4.

Methods:

All patients who underwent ACLR by a sports medicine fellowship–trained orthopaedic surgeon at a single institution and were electronically assigned PRO surveys through a data collection system preoperatively between December 2013 and March 2015 were included. Postoperatively, PRO surveys were sent to patients’ email addresses at 6, 12, and 24 months. Demographics, history, and operative and postoperative information were evaluated for an association with survey completion rates.

Results:

A total of 256 patients met the inclusion criteria. There were 140 (54.7%) male and 116 (45.3%) female patients, with an overall mean age of 28.6 ± 11.9 years. Only 19 (7.4%) patients completed all preoperative and postoperative surveys at all time points. Less than half of the patients (n = 104; 40.6%) completed both the preoperative survey and at least 1 postoperative survey. There was a steady decrease in the completion rate of PRO surveys postoperatively over time (Pearson r = –0.995, P = .005). Male patients had significantly worse compliance with completing PRO surveys preoperatively and at a minimum of 1 time point postoperatively (P = .044). Patients who did not identify as athletes or report frequent exercise (≥3 times/wk) had significantly worse compliance with completing any PRO surveys (P = .046). Lower body mass index was associated with greater odds of compliance with completing the preoperative survey and 24-month postoperative survey (odds ratio, 0.902; P = .029).

Conclusion:

An inverse relationship was found between the surgery-to-survey period and percentage of those completing PRO surveys, with poor overall compliance. Male sex and not self-identifying as an athlete or performing frequent physical exercise were associated with lower completion rates of PRO surveys, while lower body mass index was associated with a greater rate of completion.

Patient-Identified Barriers and Facilitators to Pre-Visit Patient-Reported Outcomes Measures Completion in Patients With Hip and Knee Pain

BACKGROUND

Although patient-reported outcomes measures (PROMs) provide valuable health information and aid medical decision making for patients with hip and knee arthritis, survey completion rates remain low. The purpose of this study is to elucidate patient preferences regarding location of completion, delivery method, and barriers or facilitators to pre-visit completion.

METHODS

Patients with hip and/or knee pain who were asked to complete pre-visit PROMs at 2 urban arthroplasty clinics were recruited. In-person, semi-structured, audio-recorded interviews were conducted, transcribed, and coded for thematic analysis. Codes were developed using a data-driven approach.

RESULTS

We analyzed 51 interviews. The mean age was 57 years, 57% were women, and 45% had private or Medicare insurance. Prevalent themes regarding location preferences were convenience and communication preferences. Thirty-four patients stated a preference for completing pre-visit PROMs at home, 19 for in-office completion, and 10 stated no preference. Prevalent themes around delivery methods included technology access and familiarity. Of the 43 patients asked to select their preferred pre-visit PROM delivery method (phone call, email, text message, or postal mail), 31 (72%) preferred email or text messaging. Barriers to completing pre-visit PROMs were technological issues, recognizing the message was healthcare-related, and being too busy or forgetting. Twenty patients identified no barriers.

CONCLUSION

Electronic PROM collection is favored by many patients, but alternative methods for patients without access to or familiarity with technology remain important. Clear recognition that the message is from a physician's office and physician communication of the utility of PROMs in clinical decision making may increase pre-visit completion.

Editorial Commentary: Is the Information Gathered From Patient-Reported Outcome Worth the Time and Effort? Electronic Patient-Reported Outcome Data Collection Systems Result in Poor Response Rate

There is an increasing demand for quality metrics and patient-reported outcomes from government agencies and insurance carriers. However, electronic patient-reported outcomes fail to achieve a significant response rate because they are too long and complicated. It is suggested that outcome scores for quality metrics need to be simplified to increase the response rate.

Technology assessment and cost-effectiveness in orthopedics: how to measure outcomes and deliver value in a constantly changing healthcare environment

PURPOSE OF REVIEW

The purpose of this study is to review the basic concepts of healthcare value, patient outcome measurement, and cost-effectiveness analyses as they relate to the introduction of new surgical techniques and technologies in the field of orthopedic surgery.

RECENT FINDINGS

An increased focus on financial stewardship in healthcare has resulted in a plethora of cost-effectiveness and patient outcome research. Recent research has made great progress in identifying orthopedic technologies that provide exceptional value and those that do not meet adequate standards for widespread adoption. As the pace of technological innovation advances in lockstep with an increased focus on value, orthopedic surgeons will need to have a working knowledge of value-based healthcare decision-making. Value-based healthcare and cost-effectiveness analyses can aid orthopedic surgeons in making ethical and fiscally responsible treatment choices for their patients.

E-mail reminders improve completion rates of patient-reported outcome measures

Background

Patient-reported outcome measures (PROMs) have become increasingly important in assessing clinical outcomes. However, acquisition of data at routine time intervals can be challenging. The ability of e-mail reminders to save follow-up intervals when office visits are missed is unknown.

Materials and Methods

A retrospective review of a consecutive series of 186 shoulder surgical patients who underwent surgery between October 2, 2012, and July 2, 2013, was conducted. Simple Shoulder Test and 12-Item Short Form Health Survey scores were completed at preoperative visits using office-based tablet surveys. Patients were observed for completeness of PROMs at expected routine follow-up of 1 year and 2 years. When office visits were missed, e-mail reminders with links to online surveys were sent to patients without further incentives. Improvement in data acquisition achieved using e-mail reminders when patient follow-up was missed was assessed. The influence of the procedure performed was further analyzed to determine whether patients treated with different surgical procedures would be more compliant with PROM completion.

Results

Use of e-mail reminders significantly increased the number of patients for whom complete follow-up data were obtained. Compared with tablet surveys completed during office visits alone, the addition of e-mail reminders increased the collection of complete PROM data (both 1- and 2-year follow-up) by 25.8% (P < .001). Similar findings were observed for total shoulder arthroplasty and arthroscopic rotator cuff repair patients (increased by 25.7% and 34.4%, respectively; P < .001).

Conclusion

E-mail reminders serve as a mechanism to increase the completeness of follow-up data in the absence of in-office patient evaluation.

Patient Reported Outcomes Measurement Information System (PROMIS) in the upper extremity: the future of outcomes reporting?

Patient reported outcomes (PROs) serve an integral role in clinical research by helping to determine the impact of clinical care as experienced by the patient. With recent initiatives in health care policy and pay for performance, outcome reporting is now recognized as a policy-driven requirement in addition to a clinical research tool. For outcome measures to satisfy these regulatory requirements and provide value in understanding disease outcomes, they must be responsive and efficient. Recent research has uncovered certain concerns regarding traditional PROs in patients with upper extremity disability and injury. These include lack of consensus regarding selection of PROs for a given diagnoses, inconsistent techniques of administration of the same PROs, and the administrative burden to patients and providers of completing these forms. To address these limitations, emphasis has been placed on streamlining the outcomes reporting process, and, as a result, the National Institutes of Health (NIH) created the Patient Reported Outcomes Measurement Information System (PROMIS). PROMIS forms were created to comprehensively and efficiently measure outcomes across multiple disease states, including orthopedics. These tools exist in computer adaptive testing and short forms with the intention of more efficiently measuring outcomes compared with legacy PROs. The goals of this review are to highlight the main components of PROMIS reporting tools and identify recent use of the scores in the upper extremity literature. The review will also highlight the research and health policy potentials and limitations of implementing PROMIS into everyday orthopedic practice.

The Use of Scoring Systems in Knee Arthroplasty: A Systematic Review of the Literature

BACKGROUND

The primary purpose of this systematic review was to clarify and quantify scoring system utilization in knee arthroplasty literature. In addition, the study considered the frequency and relationship of score use in articles published across a range of orthopedic journals, and the influence of study design, level of evidence, primary research topic, and study country of origin on the scoring system used.

METHODS

A systematic search of 8 electronic databases was performed to identify publications of clinical studies involving knee arthroplasty, in which a scoring system was used to assess patient outcomes.

RESULTS

Of the 1994 unique publications identified, 438 met the selection criteria. Identified articles reported a total of 86 scoring systems, 5 of which were reported in greater than 10.0% of included studies. The 1989 Knee Society Score was markedly the most utilized scoring system (58.7%). Use of the Knee Society Score was significantly associated with orthopedic journal impact factor (IF; P = .001), with greater use observed in journals of lower IF. Use of the Western Ontario and McMaster Universities Osteoarthritis Index escalated with increasing IF; however, no statistically significant association was observed. A preference for scoring systems developed in the country of residence of the first author was also identified.

CONCLUSIONS

A large number of scoring systems are used to assess knee arthroplasty patients; however, 5 scores are consistently reported. By identifying and quantifying scoring system use, this review hopes to stimulate regularity in score usage to allow for improvements in comparability of clinician and patient-reported outcome measures in the knee arthroplasty literature.

Measuring outcomes in orthopaedics: implementation of an outcomes program in an outpatient orthopaedic practice

With increased demand to provide quality care for patients, orthopaedic practices will need to develop ways to efficiently collect and manage data to support the care that they provide. An outcomes management program must be efficient and consistent to provide good data. This article describes the implementation of an outcomes program at one large private orthopaedic practice within an academic medical setting.

Socioeconomic deprivation and age are barriers to the online collection of patient reported outcome measures in orthopaedic patients

Introduction Questionnaires are used commonly to assess functional outcome and satisfaction in surgical patients. Although these have in the past been administered through written forms, there is increasing interest in the use of new technology to improve the efficiency of collection. The aim of this study was to assess the availability of internet access for a group of orthopaedic patients and the acceptability of online survey completion. Methods A total of 497 patients attending orthopaedic outpatient clinics were surveyed to assess access to the internet and their preferred means for completing follow-up questionnaires. Results Overall, 358 patients (72%) reported having internet access. Lack of access was associated with socioeconomic deprivation and older age. Multivariable regression confirmed increased age and greater deprivation to be independently associated with lack of internet access. Out of the total group, 198 (40%) indicated a preference for assessment of outcomes via email and the internet. Conclusions Internet access was not universal among the patients in our orthopaedic clinic. Reliance on internet collection of PROMs may introduce bias by not including results from patients in older age groups and those from the more deprived socioeconomic groups.

Does Surgical Approach Affect Patient-reported Function After Primary THA?

BACKGROUND

Total hip arthroplasty (THA) relieves pain and improves physical function in patients with hip osteoarthritis, but requires a year or more for full postoperative recovery. Proponents of intermuscular surgical approaches believe that the direct-anterior approach may restore physical function more quickly than transgluteal approaches, perhaps because of diminished muscle trauma. To evaluate this, we compared patient-reported physical function and other outcome metrics during the first year after surgery between groups of patients who underwent primary THA either through the direct-anterior approach or posterior approach.

QUESTIONS/PURPOSES

We asked: (1) Is a primary THA using a direct-anterior approach associated with better patient-reported physical function at early postoperative times (1 and 3 months) compared with a THA performed through the posterior approach? (2) Is the direct-anterior approach THA associated with shorter operative times and higher rates of noninstitutional discharge than a posterior approach THA?

METHODS

Between October 2008 and February 2010, an arthroplasty fellowship-trained surgeon performed 135 THAs. All 135 were performed using the posterior approach. During that period, we used this approach when patients had any moderate to severe degenerative joint disease of the hip attributable to any type of arthritis refractory to nonoperative treatment measures. Of the patients who were treated with this approach, 21 (17%; 23 hips) were lost to followup, whereas 109 (83%; 112 hips) were available for followup at 1 year. Between February and September 2011, the same surgeon performed 86 THAs. All 86 were performed using the direct-anterior approach. During that period, we used this approach when patients with all types of moderate to severe degenerative joint disease had nonoperative treatment measures fail. Of the patients who were treated with this approach, 35 (41%; 35 hips) were lost to followup, whereas 51 (59%; 51 hips) were available for followup at 1 year. THAs during the surgeon's direct-anterior approach learning period (February 2010 through January 2011) were excluded because both approaches were being used selectively depending on patient characteristics. Clinical outcomes included operative blood loss; allogeneic transfusion; adverse events; patient-reported Veterans RAND-12 Physical (PCS) and Mental Component Summary (MCS) scores, and University of California Los Angeles (UCLA) activity scores at 1 month, 3 months, and 1 year after surgery. Resource utilization outcomes included operative time, length of stay, and discharge disposition (home versus institution). Outcomes were compared using logistic and linear regression techniques.

RESULTS

After controlling for relevant confounding variables including age, sex, and BMI, the direct-anterior approach was associated with worse adjusted MCS changes 1 and 3 months after surgery (1-month score change, -9; 95% CI, -13 to -5; standard error, 2), compared with the posterior approach (3-month score change, -9; 95% CI, -14 to -3; standard error, 3) (both p < 0.001), while the direct-anterior approach was associated with greater PCS improvement at 3 months compared with the posterior approach (score change, 6; 95% CI, 2-10; standard error, 2; p = 0.008). There were no differences in adjusted PCS at either 1 month or 12 months, and no clinically important differences in UCLA scores. Although the PCS score differences are greater than the minimum clinically important difference of 5 points for this endpoint, the clinical importance of such a small effect is questionable. At 1 year after THA, there were no intergroup differences in self-reported physical function, although both groups had significant loss-to-followup at that time. Operative time (skin incision to skin closure) between the two groups did not differ (81 versus 79 minutes; p = 0.411). Mean surgical blood loss (403 versus 293 mL; p < 0.001; adjusted, 119 more mL; 95% CI, 79-160; p < 0.001) and in-hospital transfusion rates (direct-anterior approach, 20% [17/86] versus posterior approach, 10% [14/135], p = 0.050; adjusted odds ratio, 3.6; 95% CI, 1.3-10.1; p = 0.016) were higher in the direct-anterior approach group. With the numbers available, there was no difference in the frequency of adverse events between groups when comparing intraoperative complications, perioperative Technical Expert Panel complications, and other non-Technical Expert Panel complications within 1 year of surgery, although this study was not adequately powered to detect differences in rare adverse events.

CONCLUSIONS

With suitable experience, the direct-anterior approach can be performed with expected results similar to those of the posterior approach. There may be transient and small benefits to the direct-anterior approach, including improved physical function at 3 months after surgery. However, the greater operative blood loss and greater likelihood of blood transfusions, even when the surgeon is experienced, may be a disadvantage. Given some of the kinds of bias present that we found, including loss to followup, the conclusions we present should be considered preliminary, but it appears that any benefits that accrue to the patients who had the direct-anterior approach would be transient and modest. Prospective randomized studies on the topic are needed to address the differences between surgical approaches more definitively.

LEVEL OF EVIDENCE

Level III, therapeutic study.

Is it too early to move to full electronic PROM data collection?: A randomized controlled trial comparing PROM's after hallux valgus captured by e-mail, traditional mail and telephone

BACKGROUND

Patient reported outcome measures (PROM's) after hallux valgus surgery are used to rate the effectiveness as perceived by the patient. The interpretability of these PROM's is highly dependent on participation rate. Data capture method may be an important factor contributing to the response rate. We investigated the effect on response rate of traditional paper mail, telephone and e-mail PROM's after hallux valgus surgery.

METHODS

All consecutive patients operated between January and September 2013, were identified. Included patients were randomized by envelope in three groups: traditional pen and paper mail, e-mail and telephone. They were asked to fill in a FFI and EQ-5D. Two weeks later non-responders were sent a reminder.

RESULTS

Of the 73 included patients, 25 were approached by mail, 24 by e-mail and 24 patients by telephone. The response rate on traditional mail was highest (88%), while response on e-mail was lowest (33%). Response rate on telephone was also high (79%). Response rate on traditional mail and telephone was significantly higher (p<0.001) than response on e-mail.

CONCLUSIONS

Though electronic data collection has enormous potential, this study shows that e-mail yields unacceptable low response rates. It is too early to replace traditional pen-and-paper PROM's by electronic questionnaires.

The Knee Society Short Form Reduces Respondent Burden in the Assessment of Patient-reported Outcomes

BACKGROUND

The patient's own evaluation of function and satisfaction is a fundamental component of assessing outcomes after total knee arthroplasty (TKA). The new Knee Society Knee Score was introduced in 2012 and has been shown to be a valid and reliable instrument for measuring the outcome of TKA. This score combines an objective, physician-derived component and a patient-reported component to characterize the expectations, satisfaction, and functional activities of diverse lifestyles of contemporary patients undergoing TKA. However, in the routine clinical setting, the administration and scoring of outcome measures is often resource-intensive, as the expenditure of time and budget for outcome measurement increase with the length and complexity of the instrument used, and so a short-form assessment can help to reduce the burden the assessment of outcomes.

QUESTIONS/PURPOSES

The purposes of this study were (1) to develop a short-form version of the new Knee Society Knee Score; (2) to validate the short form against the full Knee Society Knee Score; and (3) to evaluate the responsiveness to treatment (TKA) of the new Knee Society short-form assessment.

METHODS

To develop the short form, data from the sample of 497 patients recruited during validation of the original long form the new Knee Society Knee Score were used. The multicenter study was approved by the institutional review boards at 15 participating medical institutions within the United States and Canada. An analytic item reduction approach was applied simultaneously but separately to preoperative and postoperative patient-reported data to select a subset of items from the original form that had good measurement properties and closely reflected the scores obtained using the original form.

RESULTS

Expectations and satisfaction were reflected by a single item in the newly developed short form compared with a total of five satisfaction and three expectation items in the long form. The functional activities subscale was reduced from 17 to six items. An excellent correlation was demonstrated between function scores derived from the functional activities subscale of the original long-form score (17 items) and the six-item short form (r = 0.97; p < 0.01). The sample mean difference between the two scores was less than 4 points with a SD of 6.7 points. The short form was capable of discriminating clinically different groups of patients before and after TKA with virtually the same estimated effect size as the original functional activities subscale of the new Knee Society Knee Score.

CONCLUSIONS

The Knee Society Knee Score long form is still recommended for research studies and for more sensitive measurement of the outcomes of individual patients. However, for general clinical use with large patient populations, the short form is expected to improve the rate of patient completion while also being easier to administer. In this study, we found the short-form version of the Knee Society Knee Score to be practical, valid, reliable, and responsive for assessing the functional outcome of TKA.

Collecting Patient-Reported Outcomes: Lessons from the California Joint Replacement Registry

CONTEXT

While patient-reported outcomes (PROs) have long been used for research, recent technology advancements make it easier to collect patient feedback and use it for patient care. Despite the promise and appeal of PROs, substantial barriers to widespread adoption remain-including challenges in interpreting privacy regulations, educating patients and physicians about the power that PRO collection can provide to patient-centered care.

CASE DESCRIPTION

This article describes lessons learned from the California Joint Replacement Registry's (CJRR) five-year effort to collect PROs from patients undergoing total hip and total knee replacement surgeries. CJRR is a voluntary, multi-institutional registry in California that collects clinical and device information, as well as PROs from patients undergoing total hip arthroplasty (THA) and total knee arthroplasty (TKA) surgeries.

PROPOSED SOLUTIONS

The CJRR encountered and developed solutions to overcome several key issues: (1) limitations of electronic PRO collection, (2) challenges in patient recruitment and tracking, (3) challenges in encouraging patients to complete PRO surveys, (4) real and perceived administrative burden to clinic and hospital staff, (5) surgeon engagement, and (6) survey costs.

CONCLUSION

The CJRR's field experience can inform growing numbers of providers and researchers who seek to more fully understand the impact of care from the patient's perspective. In addition, the authors believe that these challenges can best be addressed through a combination of policy changes and increased incentives.

Predictors of Low Patient-Reported Outcomes Response Rates in the California Joint Replacement Registry

Total joint arthroplasty registries are increasingly collecting Patient Reported Outcome Measures (PROM) to more directly measure clinical success after surgery. Obtaining these valuable, complete pre- and post-operative surveys is challenging. We sought to identify specific patient or provider characteristics that are associated with low-reporting of PROM surveys in the California Joint Replacement Registry (CJRR). All reported total hip and knee arthroplasties (n=6861) during 2011-2014 were retrospectively reviewed. PROMs were prospectively collected to determine factors associated with non-participation. The critical factor in predicting ongoing participation post-operatively was the collection of PROM surveys pre-operatively. Specific patient demographics (race, discharge disposition, occurrence of a complication) and surgeon volume were predictive of non-response and are potential targets for increasing reporting rates.

Translation and Validation of the Finnish Version of the Patient-Rated Wrist Evaluation Questionnaire (PRWE) in Patients with Acute Distal Radius Fracture

BACKGROUND AND AIMS

Patient-rated outcome measures have become increasingly important in clinical research. They provide research and clinical tools which can be utilized in the assessment of patient recovery and treatment efficacy. The purpose of our study was to translate and validate the original version of the PRWE form into Finnish.

MATERIAL AND METHODS

We conducted the translation of the PRWE questionnaire according to standardized guidelines. Patients (N = 119) with an acute distal radius fracture were recruited, and they completed the PRWE and QuickDASH questionnaires at 2 months and 4 months after the wrist injury.

RESULTS

The mean answering times were 52 days (standard deviation [SD] 9.8 days) and 116 days (standard deviation [SD] 14.8 days), respectively. Both the internal consistency (Cronbach's alpha) of 0.976 and the intraclass correlation coefficient (ICC) of 0.992 (95% CI 0.966-0.998) showed excellent reliability for the total PRWE score. The correlation coefficients between the total score, the subscales, and for improvement over time for PRWE and QuickDASH were excellent. The responsiveness was good with an effect size of 0.83 and a standard response mean of 1.22.

CONCLUSION

Our study shows that the Finnish version of the PRWE is reliable, valid, and responsive for the evaluation of pain and disability after distal radius fracture.

Responsiveness of patient reported outcome measures in total joint arthroplasty patients

This study reports the responsiveness to change and minimal clinically important difference (MCID) of three patient reported outcome measures following total hip arthroplasty (THA) and total knee arthroplasty (TKA). Patient-reported outcome measures were collected preoperatively and 3 months postoperatively for 391 patients enrolled in the California Joint Replacement Registry. Effect size, standardized response means, and MCID were calculated for each measure. The WOMAC and the SF12v2 physical component summary (PCS) score were the most responsive to perioperative changes. The MCID was 4.97 for the SF12v2 PCS and 10.21 for the WOMAC. THA patients were more likely to exhibit improvements above the MCID than TKA patients. The WOMAC and SF12v2 PCS are useful to measure health status changes in TJA patients.

LEVEL OF EVIDENCE

Prognostic Level II.

Diabetes as a risk factor for poorer early postoperative outcomes after shoulder arthroplasty

BACKGROUND

Although diabetes has been associated with increased perioperative morbidity and mortality after hip and knee arthroplasty, its impact on early postoperative outcomes after shoulder replacement remains relatively unexplored. The purpose of the study was to determine the association of diabetes with in-hospital death, complications, length of stay, non-homebound disposition, and cost in patients undergoing shoulder arthroplasty.

METHODS

By use of the Nationwide Inpatient Sample database for the year 2011, an estimated 66,485 patients having undergone shoulder arthroplasty were identified and separated into groups with (21%) and without (79%) diabetes mellitus. Comparisons of specific outcome measures between diabetic and nondiabetic cohorts were performed by bivariate and multivariable analyses with logistic regression modeling.

RESULTS

Diabetes mellitus was independently associated with in-hospital death, a number of perioperative complications, prolonged hospital stay, and increased non-homebound disposition after shoulder arthroplasty. The presence of diabetes was not associated with increased hospital cost.

CONCLUSION

Patients with preexisting diabetes are at higher risk for perioperative morbidity and mortality after shoulder arthroplasty. Future prospective research should explore in more detail the relationship between diabetes and shoulder arthroplasty outcomes.