Large-scale clinical implementation of PROMIS computer adaptive testing with direct incorporation into the electronic medical record

Are all cancer survivors included when using electronically administered patient reported outcomes in primary healthcare cancer rehabilitation? A cross-sectional study

BACKGROUND

Patient reported outcomes (PROs) are being used frequently in clinical practice. PROs often serve several purposes, such as increasing patient involvement, assessing health status, and monitoring and improving the quality-of-care at an aggregated level. However, the lack of representative PRO-data may have implications for all these purposes. This study aims to assess the association of non-administration of (not sending an electronic invite to PRO) and non-response to (not responding to PRO) electronically administered PROs with social inequality in a primary healthcare cancer rehabilitation setting. Furthermore, it examines whether the workflows surrounding PRO have an impact on non-administration and non-response.

METHODS

This is a cross sectional study using routinely collected data from electronic health records and registers including cancer survivors (CSs) over 18 years booked for an initial consultation in a primary healthcare cancer rehabilitation setting using PROs for systematic health status assessment. During the study period two different PRO platforms were used, each associated with different workflows. Non-administration and non-response rates were calculated for sociodemographic characteristics for each PRO platform. Crude and adjusted odds ratios were calculated using univariate and multivariate logistic regression.

RESULTS

In total, 1868 (platform 1) and 1446 (platform 2) CSCSs were booked for an initial consultation. Of these, 233 (12.5%) (platform 1) and 283 (19.6%) (platform 2) were not sent a PRO (non-administration). Among those who received a PRO, 157 (9.6%) on platform 1 and 140 (12.0%) on platform 2 did not respond (non-response). Non-administration of and non-response to PROs were significantly associated with lower socioeconomic status. Moreover, the workflows surrounding PROs seem to have an impact on non-inclusion in and non-response to PROs.

CONCLUSIONS

Non-administration of and non-response to PROs in clinical practice is associated with determinants of social inequality. Clinical workflows and the PRO platforms used may potentially worsen this inequality. It is important to consider these implications when using PROs at both the individual and aggregated levels. A key aspect of implementing PROs in clinical practice is the ongoing focus on representativeness, including a focus on monitoring PRO administration and response.

Enhancing the Evaluation of Physical Function Following Orthopaedic Trauma Care: Comparison of PROMIS Computerized Adaptive Testing and Short Musculoskeletal Function Assessment

OBJECTIVES

To compare measurement properties of Patient-Reported Outcomes Measurement Information System (PROMIS) (physical function [PF] and pain interference [PI]) computerized adaptive testing to traditional Short Musculoskeletal Function Assessment (SMFA) (dysfunction index [DI] and bother index [BI]). To explore factors associated with PROMIS scores.

METHODS

DESIGN

Cross-sectional study.

SETTING

Level I Trauma Center.

PATIENT SELECTION CRITERIA

Isolated upper/lower extremity fracture patients were recruited from the orthopaedic trauma outpatient clinic (October 1, 2021 to January 1, 2023).

OUTCOME MEASURES

Correlations (Pearson), reliability (standard error [SE] [T score]), efficiency (amount of information per item [1 - SE2/Nitems]), and floor/ceiling effects were assessed. An r > 0.7 represented high correlation, and SE ≤ 2.2 represented sufficient reliability. Factors associated with worse PROMIS scores were also identified.

RESULTS

In total, 202 patients completed PROMs at median 98 days follow-up. Correlations between PROMIS-PF and SMFA-DI, and PROMIS-PI and SMFA-BI were -0.84 and 0.65. Reliability was very high for both instruments (mean SE 2.0 [PROMIS-PF], SE 2.1 [PROMIS-PI], and SE 1.2 [SMFA-DI], SE 1.8 [SMFA-BI]). Relative efficiency for PROMIS-PF versus SMFA-DI, and PROMIS-PI versus SMFA-BI was 7.8 (SD 2.5) and 4.1 (SD 1.7), respectively. Neither PROMIS nor SMFA exhibited floor/ceiling effects. In the multivariable regression analyses, elevated levels of depression, among other factors, showed an (independent) association with worse PROMIS-PF and PROMIS-PI scores.

CONCLUSIONS

PROMIS-PF and PROMIS-PI CATs showed a (high and moderate) correlation with SMFA and hence measure a comparable construct of physical function and discomfort. As computerized adaptive tests are much more efficient to administer, they present a compelling alternative to SMFA for evaluating impact of fracture treatment. The relation between symptoms of depression and PROMIS scores emphasizes the importance of psychosocial aspects of health in orthopaedic trauma patients.

LEVEL OF EVIDENCE

Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence.

Using PROMIS Scores to Provide Cost-Conscious Follow-up After Foot and Ankle Surgery

BACKGROUND

National campaigns in the United States, such as Choosing Wisely, emphasize that decreasing low-value office visits maximizes health care value. Although patient-reported outcomes (PROs) are frequently used to quantify postoperative outcomes, they have not been assessed as a tool to help guide clinicians consider alternatives or discontinue in-person follow-up visits. The purpose of this study is to assess the frequency and cost of in-person follow-up visits after patients report substantial improvement defined as 2 consecutive improvements above preoperative Patient Reported Outcomes Measurement Information System (PROMIS) pain interference (PI) scores.

METHODS

Retrospective PROMIS PI data were obtained between 2015 and 2020 for common elective foot (n = 759) and ankle (n = 578) surgical procedures. Patients were divided into quartiles according to their preoperative PI score. Multivariable Cox proportional hazards models were used to investigate time to substantial improvement. Substantial improvement was defined as having 2 consecutive postoperative minimal clinically important differences (MCIDs) above preoperative PROMIS PI scores. MCID was measured using the distribution-based method. Multivariable negative binomial models were used to determine the number of visits and direct associated costs after substantial improvement. The cost to payors was estimated using reimbursement rates.

RESULTS

Within 3 months, 12% to 46% of foot and 16% to 61% of ankle patients achieved substantial improvement. Results vary by preoperative pain quartile, with patients who report higher preoperative pain scores achieving earlier improvement. After achieving substantial improvement, foot and ankle patients averaged 3.60 and 4.01 follow-up visits during the remaining 9 months of the year. Visit costs averaged $266 and $322 per foot and ankle patient respectively.

CONCLUSION

Postoperative follow-up visits are time-consuming and costly. Physicians might consider objective measures, such as PROMIS PI, to determine the need, timing, and alternatives for in-person follow-up visits for elective foot and ankle surgeries after patients demonstrate reliable clinical improvement.

LEVEL OF EVIDENCE

Level III, retrospective cohort study at a single institution.

Efficiency, Precision, Validity, and Reliability of GlauCAT-Asian Computerized Adaptive Tests in Measuring Glaucoma-Related Quality of Life

Purpose

To determine the efficiency, precision, and agreement of GlauCAT-Asian and its corresponding validity and reliability.

Methods

In this cross-sectional study, 219 participants (mean ± standard deviation age, 66.59 ± 8.61 years; 34% female) across the spectrum of glaucoma severity and 50 glaucoma suspects were recruited from glaucoma clinics in Singapore. Participants answered seven computerized adaptive testing (CAT) evaluations (Ocular Comfort, Activity Limitation, Lighting, Mobility, Concerns, Psychosocial, Glaucoma Management) and underwent eye examinations. Efficiency (mean number of items required for each CAT and time taken for CAT versus full item banks [IBs]), agreement (concordance between CATs and full IB person measures, henceforth referred to as scores), and precision (standard error of measurement [SE]) were evaluated. Other validity and reliability metrics were also assessed.

Results

The mean number of items administered ranged from 9 (Mobility/Glaucoma Management) to 12 (Ocular Comfort). Compared to answering the full IBs, CATs provided an average time saving of 38.3% (range, 10% to 70.6% for Lighting and Activity Limitation, respectively). Agreement between scores obtained by CAT versus full IB was high (intracorrelation coefficient ≥0.75), as was precision of score estimates (mean SE range: 0.35 for Psychosocial to 0.29 for Mobility). Scores from Activity Limitation, Mobility, Lighting, and Concerns decreased significantly as glaucoma severity increased (criterion validity; P-trend <0.05). All tests displayed good convergent/divergent validity and test-retest reliability.

Conclusions

GlauCAT-Asian provides efficient, precise, accurate, valid, and reliable measurement of the patient-centered impact of glaucoma.

Translational Relevance

GlauCAT-Asian may provide a valuable clinical tool for ophthalmologists to monitor impact of disease progression and the effectiveness of therapies.

Self-reported MeasUrement of Physical and PsychosOcial Symptoms Response Tool (SUPPORT-dialysis): systematic symptom assessment and management in patients on in-centre haemodialysis - a parallel arm, non-randomised feasibility pilot study protocol

INTRODUCTION

Patients with kidney failure experience symptoms that are often under-recognised and undermanaged. These symptoms negatively impact health-related quality of life and are associated with adverse clinical outcomes. Regular symptom assessment, using electronic patient reported outcomes measure (ePROMs) linked to systematic symptom management, could improve such outcomes. Clinical implementation of ePROMs have been successful in routine oncology care, but not used for patients on dialysis. In this study, we describe a pilot study of ePROM-based systematic symptom monitoring and management intervention in patients treated with in-centre haemodialysis.

METHODS AND ANALYSIS

This is a parallel-arm, controlled pilot of adult patients receiving in-centre maintenance haemodialysis. Participants in the intervention arm will complete ePROMs once a month for 6 months. ePROMs will be scored real time and the results will be shared with participants and with the clinical team. Moderate-severe symptoms will be flagged using established cut-off scores. Referral options for those symptoms will be shared with the clinical team, and additional symptom management resources will also be provided for both participants and clinicians. Participants in the control arm will be recruited at a different dialysis unit, to prevent contamination. They will receive usual care, except that they will complete ePROMs without the presentation of results to participants of the clinical team. The primary objectives of the pilot are to assess (1) the feasibility of a larger, randomised clinical effectiveness trial and (2) the acceptability of the intervention. Interviews conducted with participants and staff will be assessed using a content analysis approach.

ETHICS AND DISSEMINATION

Ethical approval for this study was obtained from the University Health Network (REB#21-5199) and the William Osler Health System (#23-0005). All study procedures will be conducted in accordance with the standards of University Health Network research ethics board and with the 1964 Helsinki declaration and its later amendments. Results of this study will be shared with participants, patients on dialysis and other stakeholders using lay language summaries, oral presentations to patients and nephrology professionals. We will also be publishing the results in a peer-reviewed journal and at scientific meetings.

PROTOCOL VERSION

4 (16 November 2022).

TRIAL REGISTRATION NUMBER

NCT05515991.

Seamless Integration of Computer-Adaptive Patient Reported Outcomes into an Electronic Health Record

BACKGROUND

Patient-reported outcome (PRO) measures have become an essential component of quality measurement, quality improvement, and capturing the voice of the patient in clinical care. In 2004, the National Institutes of Health endorsed the importance of PROs by initiating the Patient-Reported Outcomes Measurement Information System (PROMIS), which leverages computer-adaptive tests (CATs) to reduce patient burden while maintaining measurement precision. Historically, PROMIS CATs have been used in a large number of research studies outside the electronic health record (EHR), but growing demand for clinical use of PROs requires creative information technology solutions for integration into the EHR.

OBJECTIVES

This paper describes the introduction of PROMIS CATs into the Epic Systems EHR at a large academic medical center using a tight integration; we describe the process of creating a secure, automatic connection between the application programming interface (API) which scores and selects CAT items and Epic.

METHODS

The overarching strategy was to make CATs appear indistinguishable from conventional measures to clinical users, patients, and the EHR software itself. We implemented CATs in Epic without compromising patient data security by creating custom middleware software within the organization's existing middleware framework. This software communicated between the Assessment Center API for item selection and scoring and Epic for item presentation and results. The middleware software seamlessly administered CATs alongside fixed-length, conventional PROs while maintaining the display characteristics and functions of other Epic measures, including automatic display of PROMIS scores in the patient's chart. Pilot implementation revealed differing workflows for clinicians using the software.

RESULTS

The middleware software was adopted in 27 clinics across the hospital system. In the first 2 years of hospital-wide implementation, 793 providers collected 70,446 PROs from patients using this system.

CONCLUSION

This project demonstrated the importance of regular communication across interdisciplinary teams in the design and development of clinical software. It also demonstrated that implementation relies on buy-in from clinical partners as they integrate new tools into their existing clinical workflow.

State-of-the-art Applications of Patient-Reported Outcome Measures in Spinal Care

Patient-reported outcome measures (PROMs) assign objective measures to patient's subjective experiences of health, pain, disability, function, and quality of life. PROMs can be useful for providers in shared decision making, outcome assessment, and indicating patients for surgery. In this article, we provide an overview of the legacy PROMs used in spinal care, recent advancements in patient-reported outcomes, and future directions in PROMs. Recent advances in patient-reported outcome assessments have included standardization of measurement tools, integration of data collection into workflow, and applications of outcome measures in predictive models and decision-making tools. Continual appraisal of instruments and incorporation into artificial intelligence and machine learning analytics will continue to augment the delivery of high-value spinal care.

Operationalizing PROMs at the Musculoskeletal Practice and Policy Levels

There continues to be growing interest in patient-reported outcome measures (PROMs), especially as value-based healthcare initiatives gain more traction. Although it is well-established that PROMs can be useful in clinical research, how to operationalize PROMs in clinical care and policy initiatives remains a "work in progress." Following the design of a comprehensive PROM administration and routine collection system, orthopaedic surgeons and their patients can reap the benefits of PROMs in practice through improved shared clinical decision-making discussions at the individual patient level and closer symptom monitoring on a large scale, with improved resource allocation at the population health level. Although certain government and payer incentives exist to collect PROMs at present, it is reasonable to assume that future policy initiatives will begin to use the actual PROM scores to assess clinical outcomes. Orthopaedic surgeons with interest in this area should prioritize their involvement in policy discussion to ensure PROMs are being used appropriately in novel payment models and policy endeavors so that they are both evaluated and compensated fairly. Specifically, orthopaedic surgeons can help ensure appropriate risk adjustment of patients when this is being done. Undoubtedly, PROMs will only become a larger part of musculoskeletal care moving forward.

Utilization of PROMIS Neuropathic Pain Quality for Detection and Monitoring Neuropathic Pain in Heel Pain Patients

Background

Diagnosis and management of neuropathic pain (NP) in foot and ankle patients remain challenging. We investigated the plausibility of using Patient-Reported Outcomes Measurement Information System (PROMIS) Neuropathic Pain Quality (PQ-Neuro) as an initial screening tool to detect NP and track the treatment effects.

Methods

Patients with heel pain were prospectively recruited and grouped to no-NP, mild-NP, and severe-NP based on the initial PROMIS PQ-Neuro t scores. Pain Interference (PI), Physical Function (PF), and Self-Efficacy (SE) scores were evaluated at baseline, 30-day, and 90-day follow-up. Other factors such as age, smoking, body mass index (BMI), low back/neck pain, anxiety/depression, and medications were analyzed. Linear mixed modeling was used to assess the main effects of time and NP on PROMIS t scores, comparing minimal clinically important difference (MCID).

Results

Forty-eight patients with mean age of 52.4 years were recruited. Using the PROMIS PQ-Neuro as the assessment tool, 33 patients (69%) were detected to have NP at baseline-23 (48%) mild and 10 (21%) severe. BMI was the only independent factor associated with NP (P = .011). Higher baseline PQ-Neuro t score was significantly associated with higher follow-up PQ-Neuro (P < .001), PI (P = .005), and lower SE (P = .04) across time points. Patients with NP showed lower PF at baseline with significantly less improvement in PF (3 vs 9.9, P = .035) and did not meet MCID.

Conclusion

Baseline PROMIS PQ-Neuro ≥46 was significantly associated with worse PI and SE across all time points, with less clinically significant improvements in PF. Prevalence of NP in heel pain patients was high. The PROMIS PQ-Neuro may serve as a valuable tool for detection of NP and guiding clinical treatment decision pathways for heel pain patients.

Level of Evidence

Level III, prospective cohort study.

Older Patients Demonstrate PROMIS Outcomes Comparable to Younger Cohorts After Carpal Tunnel Release

BACKGROUND

The utility of Patient-Reported Outcomes Measurement Information System (PROMIS) in monitoring clinical progress after carpal tunnel release (CTR) in patients of different ages remains unknown. We sought to evaluate early PROMIS scores in elderly patients (ie, those aged ≥65 years) after CTR and compare those with all younger patients after CTR.

METHODS

Patients presenting to a single academic medical center for CTR between September 2018 and January 2020 completed PROMIS physical function (PF), pain interference (PI), and upper extremity (UE) computer adaptive tests and answered a single 5-point Likert-scale question evaluating subjective changes in their condition following CTR. Patients were divided into 3 age groups, and preoperative and postoperative PROMIS scores were compared.

RESULTS

In all, 214 patients fit inclusion criteria: 86 aged 18-54 years, 71 aged 55-64 years, and 57 aged ≥65 years. Subjective improvement was reported in 70.9% (n = 61), 84.5% (n = 60), and 71.9% (n = 41) of patients aged ≤54, 55-64, and ≥65 years, respectively. Patients aged ≤54 years showed significantly worse UE scores (P = .02), whereas those aged 55-64 years demonstrated significant worsening in all 3 PROMIS domains (P < .01). Patients aged ≥65 years who reported subjective improvement after CTR demonstrated significant improvement in PI scores (P = .03), whereas significant worsening of all PROMIS scores was observed in the subset of patients aged 55-64 years who reported subjective improvement (P < .01, .04, and .04 for PF, PI, and UE, respectively).

CONCLUSIONS

Younger patients showed worsening in PROMIS scores after CTR, whereas elderly patients did not show similar magnitude reductions in PROMIS scores. Moreover, the subset of elderly patients endorsing subjective improvement after CTR had reduced PI scores, consistent with less postoperative pain limitations.

Measuring What Matters: A Qualitative Study of the Relevance and Clinical Utility of PROMIS Surveys in Systemic Lupus Erythematosus

OBJECTIVE

To evaluate the relevance and clinical utility of the Patient-Reported Outcomes Measurement Information System (PROMIS) surveys in patients with systemic lupus erythematosus (SLE).

METHODS

Adults with SLE receiving routine outpatient care at a tertiary care academic medical center participated in a qualitative study. Patients completed PROMIS computerized adaptive tests (CATs) in 12 selected domains and rated the relevance of each domain to their experience with SLE. Focus groups and interviews were conducted to elucidate the relevance of the PROMIS surveys, identify additional domains of importance, and explore the utility of the surveys in clinical care. Focus group and interview transcripts were coded, and a thematic analysis was performed using an iterative inductive process.

RESULTS

Twenty-eight women and 4 men participated in 4 focus groups and 4 interviews, respectively. Participants endorsed the relevance and comprehensiveness of the selected PROMIS domains in capturing the effect of SLE on their lives. They ranked fatigue, pain interference, sleep disturbance, physical function, and applied cognition abilities as the most salient health-related quality of life (HRQOL) domains. They suggested that the disease-agnostic PROMIS questions holistically captured their lived experience of SLE and its common comorbidities. Participants were enthusiastic about using PROMIS surveys in clinical care and described potential benefits in enabling disease monitoring and management, facilitating communication, and empowering patients.

CONCLUSION

PROMIS includes the HRQOL domains that are of most importance to individuals with SLE. Patients suggest that these universal tools can holistically capture the impact of SLE and enhance routine clinical care.

Does Patient-Reported Outcome Measures Use at New Foot and Ankle Patient Clinic Visits Improve Patient Activation, Experience, and Satisfaction?

BACKGROUND

Patient-reported outcome measures (PROMs) can help predict clinical outcomes and improve shared clinical decision-making discussions. There remains a paucity of research assessing how the use of PROMs may drive improved patient experience and patient activation.

METHODS

New foot and ankle patients completed PROMIS physical function (PF), pain interference (PI), and depression assessments. Patients were then randomized to viewing and discussing their PROMIS scores with their surgeon or not. Following the clinic visit, patients completed a series of Clinician & Group Survey-Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) questions and the Patient Activation Measure (PAM). Responses to the CG-CAHPS questions and PAM were compared between the 2 groups and after clustering on surgeon. Potential interaction effects by social deprivation were also explored.

RESULTS

After enrolling patients but removing those lost to follow-up or with missing data, 97 and 116 patients remained in the intervention control cohorts, respectively. No difference was found in CG-CAHPS responses nor PAM scores between the 2 groups (P > .05). All surgeons were highly rated by all patients. When clustered by surgeon, intervention subjects were less likely to indicate "top box" scores for the understanding domain of the CG-CAHPS question (OR 0.51, P < .001) and had decreased odds of high patient activation compared to control subjects (OR 0.67; P = .005). Among the most socially disadvantaged patients, there was no difference in control and intervention subjects in their likelihood of having high patient activation (P = .09).

CONCLUSION

Highly rated foot and ankle surgeons who show and discuss PROM results may not improve patient experience or activation and may, in fact, decrease understanding or patient activation in select populations. Future work is needed to determine when PROM discussions are most beneficial and how best to present PROMs data, as we suspect that how the information was presented-and not the use of PROMs-resulted in our findings. Health literacy tools and/or communication training may better engage different patient groups regarding PROMs.

LEVEL OF EVIDENCE

Level I, randomized controlled trial.

Two-step screening for depressive symptoms in patients treated with kidney replacement therapies: a cross-sectional analysis

BACKGROUND

Systematic screening for depressive symptoms may identify patients who may benefit from clinical assessment and psychosocial support. Here we assess a two-step screening using ultrabrief pre-screeners [Edmonton Symptom Assessment Survey-revised Depression item (ESASr-D) or Patient Health Questionnaire-2 (PHQ-2)] followed by the Patient-Reported Outcomes Measurement Information System Depression questionnaire (PROMIS-D) to identify depressive symptoms in patients on kidney replacement therapies.

METHODS

We conducted a cross-sectional study of adults (kidney transplant recipients or treated with dialysis) in Toronto, ON, Canada. We simulated various two-step screening scenarios where only patients above a pre-screening cut-off score on the ESASr-D or PHQ-2 would move to step 2 (PROMIS-D). Screening performance was evaluated by sensitivity, specificity and positive and negative predictive values using the Patient Health Questionnaire-9 (PHQ-9) as the referent. The average number of items completed by patients in different scenarios was reported.

RESULTS

Of 480 participants, 60% were male with a mean age of 55 years. Based on PHQ-9, 19% of patients had moderate or severe depressive symptoms. Pre-screening with a PHQ-2 score ≥1 combined with a PROMIS-D score of ≥53 provided the best two-step results (sensitivity 0.81, specificity 0.84, NPV 0.95). Two-step screening also reduces question burden.

CONCLUSIONS

A two-step screening using a PHQ-2 score ≥1 followed by a PROMIS-D score ≥53 has good sensitivity and specificity for identifying potentially significant depressive symptoms among patients on kidney replacement therapies. This approach has lower question burden. Screened-in patients will need further clinical assessment to establish a diagnosis.

Facilitators and barriers to implementing electronic patient-reported outcome and experience measures in a health care setting: a systematic review

OBJECTIVE

This systematic literature review aimed to identify factors that influence the implementation of electronic patient-reported outcome measures (ePROMs) and patient-reported experience measures (ePREMs) in healthcare settings.

INTRODUCTION

Improvements in health care through increased patient engagement have gained traction in recent years. Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are tools used to improve the quality of care from the patient perspective. The influence of implementing PROMs and PREMs using electronic information systems (ePROMs and ePREMs) is not well understood.

INCLUSION CRITERIA

Studies with information related to the implementation of ePROMs and/or ePREMs with a focus on health-related services, irrespective of provider type, were included.

METHODS

A literature search of peer-reviewed databases was conducted on the 24th of January 2022 for articles about barriers and facilitators of the implementation of ePROMs/ePREMs in healthcare settings. Two reviewers independently extracted relevant findings from the included studies and performed a descriptive code-based synthesis before collaboratively creating a final consensus set of code categories, which were then mapped to the consolidated framework of implementation research (CFIR). Study quality was appraised using a mixed-methods appraisal tool (MMAT).

RESULTS

24 studies were eligible for inclusion in the screening of 626 nonduplicate studies. Quality assessment using the MMAT revealed that 20/24 studies met at least 60% of the MMAT criteria. Ninety-six code categories were identified and mapped to the constructs across all CFIR domains.

CONCLUSION

To guide the effective implementation of ePROMs/ePREMs in healthcare settings, factors shown to influence their implementation have been summarised as an implementation checklist for adoption and use by clinicians, organisations, and policymakers.

Inclusion of a core patient-reported outcomes battery in adolescent and young adult cancer clinical trials

Disparities in care, treatment-related toxicity and health-related quality of life (HRQoL) for adolescents and young adults (AYAs, aged 15-39 years) with cancer are under-addressed partly because of limited collection of patient-reported outcomes (PROs) in cancer clinical trials (CCTs). The AYA years include key developmental milestones distinct from younger and older patients, and cancer interrupts attainment of critical life goals. Lack of consensus on a standardized approach to assess HRQoL and treatment-related toxicity in AYA CCTs has limited the ability to improve patient outcomes. The National Cancer Institute's Clinical Trials Network AYA PRO Task Force was assembled to reach consensus on a core set of PROs and foster its integration into AYA CCTs. Eight key considerations for selecting the core PRO AYA battery components were identified: relevance to AYAs; importance of constructs across the age continuum; prioritization of validated measures; availability of measures without licensing fees; availability in multiple languages; applicability to different cancer types and treatments; ability to measure different HRQoL domains and toxicities; and minimized burden on patients and sites. The Task Force used a modified Delphi approach to identify key components of the PRO battery. The Patient-Reported Outcomes Measurement Information System (PROMIS) and the PRO Common Terminology Criteria for Adverse Events Measurement System met all criteria and were selected to assess HRQoL and treatment toxicity, respectively. Investigators are rapidly incorporating the recommendations of the Task Force into AYA trials. Inclusion of a standardized assessment of HRQoL and treatment toxicities in AYA CCTs is a vital first step to develop interventions to improve health outcomes for AYAs diagnosed with cancer.

Evaluation of Clinical Recovery After Surgical Treatment for Hand Ischemia From Vasospastic and Occlusive Disease Using PROMIS

BACKGROUND

There is a paucity of literature describing the recovery trajectory after surgery for upper extremity ischemia. Using Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF), Upper Extremity (UE), Pain Interference (PI), and Depression domains, we aimed to describe the postoperative recovery of such patients.

METHODS

We queried our PROMIS database for patients undergoing surgery for vasospastic or occlusive disease over a 4.5-year period. Inclusion criteria were preoperative, early (average 3 weeks) and late (average 6 months) postoperative PROMIS PF and/or UE, PI, and Depression scores. The change in PROMIS scores was calculated for each time point. Changes in PROMIS scores were compared with minimal clinically important difference estimates.

RESULTS

We identified 13 patients undergoing 13 surgical interventions that met inclusion criteria. More than one-half of our patients were men (n = 7 [54%]), and more than one-half of the surgeries (n = 7 [54%]) were for isolated occlusive diagnoses, with the remainder for vasospastic disease. At short-term postoperative follow-up, the change in PROMIS PF, UE, PI, and Depression scores was -6.34 (SD: 9.13), -6.81 (SD: 9.61), 3.16 (SD: 5.78), and -3.05 (SD: 8.37), respectively. At mid-term postoperative follow-up, the change in PROMIS PF, UE, PI, and Depression scores was 4.45 (SD: 10.33), 8.04 (SD: 13.84), -7.03 (SD: 7.06), and -12.27 (SD: 10.85), respectively.

CONCLUSIONS

Our findings suggest patients undergoing surgical treatment for upper extremity ischemia experience a worsening of functional symptoms initially, as expected, followed by notable improvement.

Clinical Improvement Following Operative Management of Ankle Fractures Among Patients With and Without Moderate to High Depressive Symptoms: An Analysis Using PROMIS

Background

Understanding the recovery trajectory following operative management of ankle fractures can help surgeons guide patient expectations. Further, it is beneficial to consider the impact of mental health on the recovery trajectory. Our study aimed to address the paucity of literature focused on understanding the recovery trajectory following surgery for ankle fractures, including in patients with depressive symptoms.

Methods

From February 2015 to March 2020, patients with isolated ankle fractures were asked to complete Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF), Pain Interference (PI), and Depression questionnaires as part of routine care at presentation and follow-up time points. Linear mixed effects regression models were used to evaluate the patient recovery pattern, comparing the preoperative time point to <3 months, 3-6 months, and >6 months across all patients. Additional models that included the presence of depression symptoms as a covariate were then used.

Results

A total of 153 patients met inclusion criteria. By 3-6 months, PROMIS PF (β: 9.95, 95% CI: 7.97-11.94, P < .001), PI (β: -10.30, 95% CI: -11.87 to -8.72, P < .001), and Depression (β: -5.60, 95% CI: -7.01 to -4.20, P < .001) improved relative to the preoperative time point. This level of recovery was sustained thereafter. When incorporating depressive symptoms into our model as a covariate, the moderate to high depressive symptoms were associated with significantly and clinically important worse PROMIS PF (β: -4.00, 95% CI: -7.00 to -1.00, P = .01) and PI (β: 3.16, 95% CI: -0.55 to 5.76, P = .02) scores.

Conclusion

Following ankle fracture surgery, all patients tend to clinically improve by 3-6 months postoperatively and then continue to appreciate this clinical improvement. Although patients with moderate to high depressive symptoms also clinically improve following the same trajectory, they tend to do so to a lesser level than those who have low depressive symptoms.

Level of Evidence

Level III, case-control study.

Using percentiles in the interpretation of Patient-Reported Outcomes Measurement Information System scores: Guidelines for autism

The objectives of this study were to (1) demonstrate the application of percentiles to advance the interpretation of patient-reported outcomes and (2) establish autism-specific percentiles for four Patient-Reported Outcomes Measurement Information System (PROMIS) measures. PROMIS measures were completed by parents of autistic children and adolescents ages 5-17 years as part of two studies (n = 939 parents in the first study and n = 406 parents in the second study). Data from the first study were used to develop autism-specific percentiles for PROMIS parent-proxy sleep disturbance, sleep-related impairment, fatigue, and anxiety. Previously established United States general population percentiles were applied to interpret PROMIS scores in both studies. Results of logistic regression models showed that parent-reported material hardship was associated with scoring in the moderate-severe range (defined as ≥75th percentile in the general population) on all four PROMIS measures (odds ratios 1.7-2.2). In the second study, the percentage of children with severe scores (defined as ≥95th percentile in the general population) was 30% for anxiety, 25% for sleep disturbance, and 17% for sleep-related impairment, indicating a high burden of these problems among autistic children. Few children had scores at or above the autism-specific 95th percentile on these measures (3%-4%), indicating that their scores were similar to other autistic children. The general population and condition-specific percentiles provide two complementary reference points to aid interpretation of PROMIS scores, including corresponding severity categories that are comparable across different PROMIS measures.

Capturing patient-reported outcomes: paper versus electronic survey administration

Objective: To compare the capture rates and costs of paper patient-reported outcomes (pPRO) administered in-clinic and electronic PROs (ePRO) collected through emails and texts. Design: Retrospective review. Setting: Level 1 trauma center. Patients/Participants: The pPRO program enrolled 2164 patients for postsurgical follow-up in 4 fracture types: ankle, distal radius, proximal humerus, and implant removal from 2012 to 2017. The ePRO program enrolled 3096 patients in 13 fracture types from 2018 to 2020. Among the patients enrolled in the ePRO program, 1296 patients were matched to the 4 original fracture types and time points. Main Outcome Measures: PRO capture rates in 4 fracture types by matched time point and estimated cost of each program per enrolled patient. Results: At first follow-up, pPRO provided a higher capture rate than ePRO for 3 of 4 fracture types except for implant removal (P < 0.05). However, at 6-month and 1-year follow-ups, ePRO demonstrated statistically significant higher capture rates when compared with pPRO for all applicable modules (P < 0.05). The average cost for the pPRO program was $171 per patient versus $56 per patient in the ePRO program. Patients were 1.19 times more likely to complete ePRO compared with pPRO (P = 0.007) after controlling for age, sex, fracture type, and time point. Conclusion: The electronic PRO service has improved long-term capture rates compared with paper PROs, while minimizing cost. A combined program that includes both in-clinic and out of clinic effort may be the ideal model for collection of PROs. Level of Evidence: Level 3.

Towards standardization of measuring anxiety and depression: Differential item functioning for language and Dutch reference values of PROMIS item banks

Introduction

The outcomes anxiety and depression are measured frequently by healthcare providers to assess the impact of a disease, but with numerous instruments. PROMIS item banks provide an opportunity for standardized measurement. Cross-cultural validity of measures and the availability of reference values are prerequisites for standardized measurement.

Methods

PROMIS Anxiety and Depression item banks were completed by 1002 representative Dutch persons. To evaluate cross-cultural validity, data from US participants in PROMIS wave 1 were used and differential item functioning (DIF) was investigated, using an iterative hybrid of logistic regression and item response theory. McFadden’s pseudo R²-change of 2% was the critical threshold. The impact of any DIF on full item banks and short forms was investigated. To obtain Dutch reference values, T-scores for anxiety and depression were calculated for the complete Dutch sample, and age-group and gender subpopulations. Thresholds corresponding to normal limits, mild, moderate and severe symptoms were computed.

Results

In both item banks, two items had DIF but with minimal impact on population level T-scores for full item banks and short forms. The Dutch general population had a T-score of 49.9 for anxiety and 49.6 for depression, similar to the T-scores of 50.0 of the US general population. T-scores for age-group and gender subpopulations were also similar to T-scores of the US general population. Thresholds for mild, moderate and severe anxiety and depression were set to 55, 60 and 70, identical to US thresholds.

Conclusions

The limited number of items with DIF and its minimal impact, enables the use of standard (US) item parameters and comparisons of scores between Dutch and US populations. The Dutch reference values provide an important tool for healthcare professionals and researchers to evaluate and interpret symptoms of anxiety and depression, stimulating the uptake of PROMIS measures, and contributing to standardized outcome measurement.

Implementation and Feasibility of an Electronic Health Record-Integrated Patient-Reported Outcomes Symptom and Needs Monitoring Pilot in Ambulatory Oncology

PURPOSE

Describe the feasibility and implementation of an electronic health record (EHR)-integrated symptom and needs screening and referral system in a diverse racial/ethnic patient population in ambulatory oncology.

METHODS

Data were collected from an ambulatory oncology clinic at the University of Miami Health System from October 2019 to January 2021. Guided by a Patient Advisory Board and the Exploration, Preparation, Implementation, and Sustainment model, My Wellness Check was developed to assess physical and psychologic symptoms and needs of ambulatory oncology patients before appointments to triage them to supportive services when elevated symptoms (eg, depression), barriers to care (eg, transportation and childcare), and nutritional needs were identified. Patients were assigned assessments at each appointment no more than once in a 30-day period starting at the second visit. Assessments were available in English and Spanish to serve the needs of the predominantly Spanish-speaking Hispanic/Latino population.

RESULTS

From 1,232 assigned assessments, more than half (n = 739 assessments; 60.0%) were initiated by 506 unique patients. A total of 65.4% of English and 49.9% of Spanish assessments were initiated. Among all initiated assessments, the majority (85.1%) were completed at home via the patient portal. The most common endorsed items were nutritional needs (32.9%), followed by emotional symptoms (ie, depression and anxiety; 27.8%), practical needs (eg, financial concerns; 21.7%), and physical symptoms (17.6%). Across the physical symptom, social work, and nutrition-related alerts, 77.1%, 99.7%, and 78.8%, were addressed, respectively, by the corresponding oncology health professional, social work team member, or nutritionist.

CONCLUSION

The results demonstrate encouraging feasibility and initial acceptability of implementing an EHR-integrated symptom and needs screening and referral system among diverse oncology patients. To our knowledge, this is the first EHR-integrated symptom and needs screening system implemented in routine oncology care for Spanish-speaking Hispanics/Latinos.

Effectiveness and cost-effectiveness of a web-based routine assessment with integrated recommendations for action for depression and anxiety (RehaCAT+): protocol for a cluster randomised controlled trial for patients with elevated depressive symptoms in rehabilitation facilities

INTRODUCTION

The integration of a web-based computer-adaptive patient-reported outcome test (CAT) platform with persuasive design optimised features including recommendations for action into routine healthcare could provide a promising way to translate reliable diagnostic results into action. This study aims to evaluate the effectiveness and cost-effectiveness of such a platform for depression and anxiety (RehaCAT+) compared with the standard diagnostic system (RehaCAT) in cardiological and orthopaedic health clinics in routine care.

METHODS AND ANALYSIS

A two-arm, pragmatic, cluster-randomised controlled trial will be conducted. Twelve participating rehabilitation clinics in Germany will be randomly assigned to a control (RehaCAT) or experimental group (RehaCAT+) in a 1:1 design. A total sample of 1848 participants will be recruited across all clinics. The primary outcome, depression severity at 12 months follow-up (T3), will be assessed using the CAT Patient-Reported Outcome Measurement Information System Emotional Distress-Depression Item set. Secondary outcomes are depression at discharge (T1) and 6 months follow-up (T2) as well as anxiety, satisfaction with participation in social roles and activities, pain impairment, fatigue, sleep, health-related quality of life, self-efficacy, physical functioning, alcohol, personality and health economic-specific general quality of life and socioeconomic cost and benefits at T1-3. User behaviour, acceptance, facilitating and hindering factors will be assessed with semistructured qualitative interviews. Additionally, a smart sensing substudy will be conducted, with daily ecological momentary assessments and passive collection of smartphone usage variables. Data analysis will follow the intention-to-treat principle with additional per-protocol analyses. Cost-effectiveness analyses will be conducted from a societal perspective and the perspective of the statutory pension insurance.

ETHICS AND DISSEMINATION

The study will be conducted according to the Declaration of Helsinki. The Ethics Committee of Ulm University, has approved the study (on 24 February 2021 ref. 509/20). Written informed consent will be obtained for all participants. Results will be published via peer-reviewed journals.

TRIAL REGISTRATION NUMBER

DRKS00027447.

A workplace wellness program at an academic health center influences employee health, satisfaction, productivity and the rate of workplace injury

PURPOSE

Workplace wellness (WP) programs are an employer strategy to improve employee health and satisfaction. Their impact on productivity and benefit expense remains unclear. This study examines the association of a voluntary WP at an academic health center with both employee metrics and employer costs.

METHODS

We retrospectively reviewed prospectively collected data from January 2016 to April 2018 for employees who voluntarily underwent screening for a WP at an academic medical center. We used their demographic, social, work, and clinical data to address the central research question. The primary outcomes included wellness measures from the Patient-Reported Outcomes Measurement Information System (PROMIS), secondary wellness outcomes such as body mass index, job-related outcomes such as job satisfaction, and workers' compensation metrics such as the claim amount. The key independent variables were whether an observation was from before or after the WP. For workers' compensation metrics, additional key independent variables were intervention/control group, and an interaction between the before/after and intervention/control variables. We conducted univariate and bivariate/unadjusted analyses, and estimated multivariable linear, logistic, and gamma regression models that also controlled for confounders.

RESULTS

The study included 370 employees. Participation in the program was associated with significant improvements in the PROMIS pain interference, fatigue and sleep quality domains. Hip circumference diminished, and functional movement outcomes were improved. Job satisfaction improved by 4.4 percentage points (95% Confidence Interval [CI]: 0.3-8.5, p = 0.04) and self-reported productivity by 14.5 percentage points (95% Confidence Interval [CI]: 9.5-19.5, p < 0.001). The likelihood of a new compensation claim during the 12-month follow-up period fell by 10.1% (95% Confidence Interval [CI]: - 15.5 to - 4.7, p < 0.001). However, the value of a new claim was unchanged.

CONCLUSION

Employees who completed a WP at an academic medical center demonstrated improvements in several recognized patient-reported outcome measures, in job satisfaction and self-reported productivity, a decrease in hip circumference, an improvement in functional motion and a decreased rate of compensable injury.

There are more things in physical function and pain: a systematic review on physical, mental and social health within the orthopedic fracture population using PROMIS

Background

The Patient-Reported Outcomes Information System (PROMIS®) is more and more extensively being used in medical literature in patients with an orthopedic fracture. Yet, many articles studied heterogeneous groups with chronic orthopedic disorders in which fracture patients were included as well. At this moment, there is no systematic overview of the exact use of PROMIS measures in the orthopedic fracture population. Therefore this review aimed to provide an overview of the PROMIS health domains physical health, mental health and social health in patients suffering an orthopedic fracture.

Methods

This systematic review was documented according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines. We searched Embase, Medline, Web of Science Core Collection, and Cochrane Central Register of controlled Trials, CINAHL and Google Scholar in December 2020 using a combination of MeSH terms and specific index terms related to orthopedic fractures and PROMIS questionnaires. Inclusion criteria were available full text articles that were describing the use of any PROMIS questionnaires in both the adult and pediatric extremity fracture population.

Results

We included 51 relevant articles of which most were observational studies (n = 47, 92.2%). A single fracture population was included in 47 studies of which 9 involved ankle fractures (9/51; 17.6%), followed by humeral fractures (8/51; 15.7%), tibia fractures (6/51; 11.8%) and radial -or ulnar fractures (5/51; 9.8%). PROMIS Physical Function (n = 32, 32/51 = 62.7%) and PROMIS Pain Interference (n = 21, 21/51 = 41.2%) were most frequently used questionnaires. PROMIS measures concerning social (n = 5/51 = 9.8%) and mental health (10/51 = 19.6%) were much less often used as outcome measures in the fracture population. A gradually increasing use of PROMIS questionnaires in the orthopedic fracture population was seen since 2017.

Conclusion

Many different PROMIS measures on multiple domains are available and used in previous articles with orthopedic fracture patients. With physical function and pain interference as most popular PROMIS measures, it is important to emphasize that other health-domains such as mental and social health can also be essential to fracture patients.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-022-00440-3.

Evaluating the Impact of Patient Social Deprivation on the Level of Symptom Severity at Carpal Tunnel Syndrome Presentation

Background: There is a paucity of research examining the impact of social deprivation on the level of symptom severity at presentation, including in common hand conditions like carpal tunnel syndrome. We aimed to determine whether patient deprivation is associated with worse Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity (UE), Physical Function (PF), Pain Interference (PI), and Depression scores. Methods: Patients presenting to an academic hand clinic from December 2016 to December 2018 for a new patient visit for carpal tunnel syndrome completed PROMIS UE, PF, PI, and Depression Computer Adaptive Tests. Bivariate analyses were done to compare patient variables between the least and most deprived thirds, as measured by Area Deprivation Index (ADI), at the state (New York) and national levels. Multivariable linear regression was used to determine whether there was an association between social deprivation and PROMIS UE, PF, PI, and Depression scores. Results: All PROMIS domain scores were significantly worse in the most deprived cohort at the national level (P < .05) but not at the state level (P > .05). In multivariable regression at the national level, ADI values were associated with PROMIS UE (β = -0.06, P < .01) and PROMIS PI (β = .05, P < .01) but not PROMIS PF or PROMIS Depression. In multivariable regression at the state level, ADI values were associated with PROMIS UE (β = -0.79, P = .03) and PROMIS PI (β = 0.58, P < .05) but not PROMIS PF or PROMIS Depression. Conclusions: Higher levels of social deprivation are associated with worse PROMIS UE and PROMIS PI scores on both the state and national levels when initially seeking care for carpal tunnel syndrome.

Implementation of an Online Glaucoma-Specific Quality of Life Computerized Adaptive Test System in a US Glaucoma Hospital

Purpose

The feasibility of implementing a computerized adaptive test (CAT) system in routine clinical care in ophthalmology has not been assessed. We evaluated the implementation of a glaucoma-specific CAT (GlauCAT) in outpatients at Massachusetts Eye and Ear Institute.

Methods

In this implementation study (July 2020–April 2021), 216 adults (mean ± SD age 64.8 ± 15.3 years; 56.0% women) completed six adaptive GlauCAT quality of life (QOL) tests on an internet-enabled tablet at the clinic. A real-time printable report summarizing domain scores was shared with physicians prior to consultation. The implementation was evaluated using Proctor's outcomes: acceptability (patient satisfaction); appropriateness (independent complete rate [%]); feasibility (acceptance rate [%]; completion time); and fidelity (percentage of patients discussing GlauCAT results with their physician). Physician barriers/facilitators were explored using open-ended questions.

Results

Patients’ mean ± SD satisfaction score was 3.5 ± 0.5 of 4, with >95% of patients willing to recommend it to others. Of the 216 (89.2%) patients accepting to participate, 173 (80%) completed GlauCAT independently. Patients took 8 minutes and 5 seconds (median) to complete all 6 GlauCAT tests. Almost two-thirds (n = 136/216) of the patients reported discussing their GlauCAT results with their doctor. Physicians described the GlauCAT summary report as helpful and user-friendly, although lack of time and uncertainty about how to action information were reported.

Conclusions

Pilot implementation of six GlauCAT QOL tests in glaucoma outpatient clinics was feasible and acceptable. Integration of GlauCAT with electronic medical records (EMRs) and evaluation of long-term implementation outcomes are needed.

Translational Relevance

GlauCAT's multiple outcomes and low test-taking burden makes it attractive for measuring glaucoma-specific QOL in routine clinical care.

The promise of computer adaptive testing in collection of orthopaedic outcomes: an evaluation of PROMIS utilization

Background

A crucial component to improving patient care is better clinician understanding of patients’ health-related quality of life (HRQoL). In orthopaedic surgery, HRQoL assessment instruments such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), provide surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s HRQoL. PROMIS has been demonstrated as a valuable instrument in many diseases; however, the extent to which orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research is unclear.

Methods

Systematic scoping methodology was used to investigate the characteristics of studies using PROMIS to assess HRQoL measures as orthopaedic surgical outcomes as well as studies validating computerized adaptive test (CAT) PROMIS physical health (PH) domains including: Physical Function (PF), Upper Extremity (UE), Lower Extremity (LE).

Results

A systematic search of PubMed identified 391 publications utilizing PROMIS in orthopaedics; 153 (39%) were PROMIS PH CAT validation publications. One-hundred publications were in Hand and Upper Extremity, 69 in Spine, 44 in Adult Reconstruction, 43 in Foot and Ankle, 43 in Sports, 37 in Trauma, 31 in General orthopaedics, and 24 in Tumor. From 2011 through 2020 there was an upward trend in orthopaedic PROMIS publications each year (range, 1–153) and an increase in studies investigating or utilizing PROMIS PH CAT domains (range, 1–105). Eighty-five percent (n = 130) of orthopaedic surgery PROMIS PH CAT validation publications (n = 153) analyzed PF; 30% (n = 46) analyzed UE; 3% (n = 4) analyzed LE.

Conclusions

PROMIS utilization within orthopaedics as a whole has significantly increased within the past decade, particularly within PROMIS CAT domains. The existing literature reviewed in this scoping study demonstrates that PROMIS PH CAT domains (PF, UE, and LE) are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. The expanded use of PROMIS CATs in orthopaedic surgery highlights the potential for improved quality of patient care. While challenges of integrating PROMIS into electronic medical records exist, expanded use of PROMIS CAT measurement instruments throughout orthopaedic surgery should be performed.

Plain english summary In orthopaedic surgery, health-related quality of life tools such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), offer patients an opportunity to better understand their medical condition and be involved in their own care. Additionally, PROMIS provides surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s functional status and quality of life. The efficacy of PROMIS has been demonstrated in many diseases; however, its application throughout orthopaedic care has yet to be depicted. This study sought to identify the extent to which all orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research in order to identify its potential as an applicable and valuable tool across specialties. We determined that PROMIS utilization has significantly increased within the past decade. The existing literature reviewed in this scoping study demonstrates that the PROMIS computerized adaptive test domains evaluating physical function status are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. Based on these results, this study recommends the expanded and more uniform use of PROMIS computerized adaptive test measurement instruments in the clinical care of orthopaedic patients.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-021-00407-w.

Validation of PROMIS-29 domain scores among adult burn survivors: A National Institute on Disability, Independent Living, and Rehabilitation Research Burn Model System Study

BACKGROUND

Patient-reported outcomes are important for understanding recovery after burn injury, benchmarking service delivery and measuring the impact of interventions. Patient-Reported Outcomes Measurement Information System (PROMIS)-29 domains have been validated for use among diverse populations though not among burn survivors. The purpose of this study was to examine validity and reliability of PROMIS-29 scores in this population.

METHODS

The PROMIS-29 scores of physical function, anxiety, depression, fatigue, sleep disturbance, ability to participate in social roles, and pain interference were evaluated for validity and reliability in adult burn survivors. Unidimensionality, floor and ceiling effects, internal consistency, and reliability were examined. Differential item functioning was used to examine bias with respect to demographic and injury characteristics. Correlations with measures of related constructs (Community Integration Questionnaire, Satisfaction with Life Scale, Post-Traumatic Stress Checklist-Civilian, and Veteran's Rand-12) and known-group differences were examined.

RESULTS

Eight hundred and seventy-six burn survivors with moderate to severe injury from 6 months to 20 years postburn provided responses on PROMIS-29 domains. Participants' ages ranged from 18 years to 93 years at time of assessment; mean years since injury was 3.4. All PROMIS domain scores showed high internal consistency (Cronbach's α = 0.87-0.97). There was a large ceiling effect on ability to participate in social roles (39.7%) and physical function (43.3%). One-factor confirmatory factor analyses supported unidimensionality (all comparative fit indices >0.95). We found no statistically significant bias (differential item functioning). Reliability was high (>0.9) across trait levels for all domains except sleep, which reached moderate reliability (>0.85). All known-group differences by demographic and clinical characteristics were in the hypothesized direction and magnitude except burn size categories.

CONCLUSION

The results provide strong evidence for reliability and validity of PROMIS-29 domain scores among adult burn survivors. Reliability of the extreme scores could be increased and the ceiling effects reduced by administering PROMIS-43, which includes six items per domain, or by administering by computerized adaptive testing.

LEVEL OF EVIDENCE

Diagnostic Test or Criteria, level III.

Patients With Preoperative Clinical Depression Symptomology Experience Significant Improvements in Postoperative Pain, Function, and Depressive Symptoms Following Rotator Cuff Repair

PURPOSE

To determine the impact of clinical depression on outcomes after rotator cuff repair (RCR), as measured by Patient-Reported Outcomes Measurement Information System (PROMIS) Computer Adaptive Test (CAT) health domains.

METHODS

RCR patients were given PROMIS CAT assessments for physical function (PROMIS UE), pain interference (PROMIS PI), and depression (PROMIS D) during preoperative and postoperative clinic visits. PROMIS D scores ≥55 correlate with mild clinical depression; thus patients with PROMIS D scores ≥ 55 were placed in the clinical depression (CD) group, whereas patients with scores <55 were placed in the "no clinical depression" (NCD) group. Categorical variables were compared at preoperative and postoperative (6 months and ≥1 year) timepoints using χ² tests. Continuous variables were compared using Student's t-tests.

RESULTS

Of the 340 RCR patients included in this study, 65 (19.1%) were found to have mild clinical depression preoperatively, with that number being reduced to 23 (6.8%) at 6 months and 19 (5.6%) at ≥1 year after surgery. Compared with preoperative PROMIS scores, CD patients had significant postoperative improvements at 6 months and ≥1 year in mean PROMIS UE (26.7 vs 35.5 vs 38.9; P < .001) and PROMIS PI (67.6 vs 56.7 vs 56.4; P < .001). NCD patients had similar postoperative improvements at 6 months and ≥1 year in mean PROMIS UE (30.8 vs 38.6 vs 46.9; P < .001) and PROMIS PI (61.7 vs 53.0 vs 47.6; P < .001). The improvement in PROMIS scores was similar for the CD and NCD groups in both PROMIS UE (12.2 vs 16.1, respectively) and PROMIS PI (-11.2 vs -14.1, respectively).

CONCLUSION

Despite starting with worse PROMIS UE and PROMIS PI scores, patients undergoing RCR with symptoms of CD experienced significant improvement in function, pain, and depressive symptoms. Preoperative depression should not be a contraindication to arthroscopic RCR in patients who are otherwise appropriate operative candidates.

LEVEL OF EVIDENCE

Level III, retrospective comparative trial.

Validation of PROMIS Physical Function for Evaluating Outcome After Acute Achilles Tendon Rupture

Background:

There is increased demand for valid, reliable, and responsive patient-reported outcome measures (PROMs) to evaluate treatment for Achilles tendon rupture, but not all PROMs currently in use are reliable and responsive for this condition.

Purpose:

To evaluate the measurement properties of the Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS PF) compared with other PROMs used after treatment for acute Achilles tendon rupture.

Study Design:

Cohort study (diagnosis); Level of evidence, 2.

Methods:

A retrospective cohort study with a follow-up questionnaire was performed. All adult patients with an acute Achilles tendon rupture between June 2016 and June 2018 with a minimum 12-month follow-up were eligible for inclusion. Functional outcome was assessed using the PROMIS PF computerized adaptive test (CAT), Foot and Ankle Ability Measure (FAAM) Activities of Daily Living (ADL), FAAM–Sports, and Achilles Tendon Total Rupture Score (ATRS). Pearson correlation (r) was used to assess the correlations between PROMs. Absolute and relative floor and ceiling effects were calculated.

Results:

In total, 103 patients were included (mean age, 44.7 years; 74% male); 82 patients (79.6%) underwent operative repair, while 21 patients (20.4%) underwent nonoperative management. The mean time between treatment and collection of PROMs was 25.3 months (range, 15-36 months). The mean scores were 55.4 ± 9.2 (PROMIS PF), 92.9 ± 12.2 (FAAM-ADL), 77.7 ± 22.9 (FAAM–Sports), and 83.0 ± 19.4 (ATRS). The ATRS was correlated with FAAM-ADL (r = 0.80; 95% CI, 0.72-0.86; P < .001) and FAAM–Sports (r = 0.86; 95% CI, 0.80-0.90; P < .001). The PROMIS PF was correlated with the FAAM-ADL (r = 0.66; 95% CI, 0.53-0.75; P < .001), FAAM–Sports (r = 0.65; 95% CI, 0.53-0.75; P < .001), and ATRS (r = 0.69; 95% CI, 0.58-0.78; P < .001). The PROMIS PF did not show absolute floor or ceiling effects (0%). The FAAM-ADL (35.9%), FAAM–Sports (15.8%), and ATRS (20.4%) had substantial absolute ceiling effects.

Conclusion:

The PROMIS PF, FAAM-ADL, and FAAM–Sports all showed a moderate to high mutual correlation with the ATRS. Only the PROMIS PF avoided substantial floor and ceiling effects. The results suggest that the PROMIS PF CAT is a valid, reliable, and perhaps the most responsive tool to evaluate patient outcomes after treatment for an Achilles tendon rupture.

Physical Function and Pain Interference Levels of Hallux Rigidus Patients Before and After Synthetic Cartilage Implant vs Arthrodesis Surgery

BACKGROUND

Hallux rigidus is a common and painful degenerative condition of the great toe limiting a patient's physical function and quality of life. The purpose of this study was to investigate pre- and postoperative physical function (PF) and pain interference (PI) levels of patients undergoing synthetic cartilage implant hemiarthroplasty (SCI) vs arthrodesis (AD) for treatment of hallux rigidus using the Patient-Reported Outcomes Measurement Information System (PROMIS).

METHODS

PROMIS PF and PI t scores were analyzed for patients who underwent either SCI or AD. Postoperative final PROMIS t scores were obtained via phone survey. Linear mixed model analysis was used to assess differences in PF and PI at each follow-up point. Final follow-up scores were analyzed using independent sample t tests.

RESULTS

Total 181 (59 SCI, 122 AD) operatively managed patients were included for analysis of PROMIS scores. Final phone survey was performed at a minimum of 14 (mean 33, range, 14-59) months postoperatively, with 101 patients (40 SCI, 61 AD) successfully contacted. The mean final follow-up was significantly different for SCI and AD: 27 vs 38 months, respectively (P < .01). The mean age of the SCI cohort was lower than the AD cohort (57.5 vs 61.5 years old, P = .01). Average PF t scores were higher in the SCI cohort at baseline (47.1 and 43.9, respectively, P = .01) and at final follow-up (51.4 vs 45.9, respectively, P < .01). A main effect of superior improvement in PF was noted in the SCI group (+4.3) vs the AD group (+2) across time intervals (P < .01). PI t scores were similar between the 2 procedures across time points.

CONCLUSION

The SCI cohort reported slightly superior PF t scores preoperatively and at most follow-up time points compared with the arthrodesis group. No differences were found for PI or complication rates between the 2 treatment groups during this study time frame.

LEVEL OF EVIDENCE

Level IV, case series.

What patient factors and Patient-Reported Outcomes Measurement Information System domains are associated with worse pain coping in pediatric orthopaedic patients in the United States?

We sought to better understand the relationship between Patient-Reported Outcomes Measurement Information System (PROMIS) mobility, pain interference (PI) and depressive symptoms scores, as well as determine what patient factors and PROMIS domains were associated with worse pain coping (PROMIS PI), in a pediatric orthopaedic population. Between 27 August 2015 and 30 April 2019, new pediatric orthopaedic patients 18 years or younger (or their guardians as a proxy) were asked to complete PROMIS mobility, PI and depressive symptoms domains at an academic medical center pediatric orthopaedic clinic. Pearson correlation coefficients (r) were calculated between each PROMIS domain. Linear multivariate regression analysis was used to determine patient characteristics and PROMIS domains associated with presenting PROMIS PI scores. There was a strong-moderate correlation between PROMIS mobility and PI (r = -0.66, P < 0.001), while the correlation between PROMIS mobility and depressive symptoms was moderate-poor (r = -0.38, P < 0.001). There was a moderate correlation between PROMIS depressive symptoms and PI (r = 0.54, P < 0.001). In multivariate linear regression analysis, female gender (β = 0.82, P < 0.001), self-reported black race (β = 0.94, P < 0.001), Medicaid insurance (β = 0.82, P < 0.001) and worsening depressive symptoms (β = 0.33, P < 0.001) were associated with worse pain coping mechanisms, while increasing mobility (β = -0.47, P < 0.001) was associated with better pain coping mechanisms. Poor mobility and worse depressive symptoms are associated with worse pain coping mechanisms. Additionally, Medicaid insurance status, black race and female gender are also associated with worse physical limitations secondary to pain.

Evaluating Immediate and Short-Term Postoperative Clinical Outcomes of Patients Undergoing Ulnar Shortening for Ulnar Impaction Syndrome Using PROMIS

Background  The early recovery trajectory of patients undergoing ulnar shortening for ulnar impaction syndrome using the Patient-Reported Outcomes Measurement Information System (PROMIS) is unknown. Questions/Purposes  Using PROMIS Upper Extremity (UE), Physical Function (PF), Pain Interference (PI), and Depression, we asked (1) do patients undergoing operative management for ulnar impaction syndrome present at their preoperative visit with notable impairment?; (2) At immediate follow-up, do patients present with a clinically appreciable change in symptom severity?; and (3) At short-term follow-up, do patients present with a clinically appreciable change in symptom severity? Materials and Methods  We identified patients from 01/2017 to 12/2019 at our institution undergoing ulnar shortening for ulnar impaction syndrome who completed all PROMIS domains at a preoperative visit and at least one postoperative time point (i.e., less than 4 weeks and/or greater than 12 weeks). Distribution- and anchor-based minimal clinically important difference estimates were used to evaluate clinically appreciable changes in symptoms over time. Results  A total of 38 patients met our inclusion criteria. The average change in PROMIS UE, PF, PI, and Depression scores from preoperative to immediate postoperative follow-up were -3.8, -4.3, 3.2, and 0.5, respectively. However, by short-term follow-up, the average change in PROMIS UE, PF, PI, and Depression scores were 3.7, 3.2, -4.7, and -3.9, respectively. Conclusions  Patients have worsening function at the immediate postoperative follow-up. By short-term postoperative follow-up, functional status and PI levels improve. Our findings can help hand surgeons provide evidence-based guidance on expected initial recovery following operative management for ulnar impaction syndrome. Level of Evidence  This is a level II, prognostic study.

Evaluation of PROMIS' Ability to Detect Immediate Postoperative Symptom Improvement Following Carpal Tunnel Release

PURPOSE

We sought to determine whether subjective clinical improvement immediately after carpal tunnel release (CTR) was captured by Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity (UE), Physical Function (PF), Pain Interference (PI), and Depression.

METHODS

Between September 2018 and January 2020, patients presenting to a single academic medical center hand clinic were asked to complete PROMIS UE, PF, PI, and Depression computer adaptive tests. In addition, patients who had CTR were asked to answer the following at their first postoperative clinic visit: "Since my last clinic visit, my condition is: (1) much better; (2) mildly better; (3) no change; (4) mildly worse; (5) much worse." For each patient, the last clinic visit was the final preoperative visit. The PROMIS domain scores were compared before and after surgery using paired t tests. The percentage of patients subjectively reporting better symptoms was calculated.

RESULTS

A total of 156 patients fit our inclusion criteria. The average number of days between the final preoperative visit and CTR was 7 (range, 0-30), and the average number of days between CTR and the first postoperative visit was 9 (range, 3-21). A total of 116 patients (74%) reported their carpal tunnel syndrome was better at their first postoperative visit. However, PROMIS UE, PF, and PI scores were significantly worse at the first postoperative visit, although not at clinically appreciable levels. There was no statistical or clinical difference in PROMIS Depression scores from pre- to postoperative time points.

CONCLUSIONS

Nearly 75% of patients subjectively report their carpal tunnel syndrome is better at their first follow-up visit within 3 weeks of CTR; however, PROMIS does not capture this improvement.

CLINICAL RELEVANCE

Hand surgeons evaluating patients shortly following CTR should be aware of the potential limitation of PROMIS to accurately capture immediate postoperative clinical outcomes. Disease-specific Patient-Reported Outcome Measures, such as the Boston Carpal Tunnel Questionnaire, may be preferred during this immediate postoperative timeframe.

Greater Socioeconomic Disadvantage Is Associated with Worse Symptom Severity at Initial Presentation in Patients Seeking Care for Lumbar Disc Herniation

STUDY DESIGN

Retrospective, observational study.

OBJECTIVE

To determine the association of patient socioeconomic disadvantage, insurance type, and other characteristics on presenting symptom severity in patients with isolated lumbar disc herniation.

SUMMARY OF BACKGROUND DATA

Little is known of the impact of socioeconomic disadvantage and other patient characteristics on the level of self-reported symptom severity when patients first seek care for lumbar disc herniation.

METHODS

Between April 2015 and December 2018, 734 patients newly presenting for isolated lumbar disc herniation who completed the Patient-Reported Outcomes Measurement Information System Physical Function (PF), Pain Interference (PI), and Depression Computer Adaptive Tests (CATs) were identified. Socioeconomic disadvantage was determined using the Area Deprivation Index, a validated measure of socioeconomic disadvantage at the census block group level (0-100, 100 = highest socioeconomic disadvantage). Bivariate analyses were used. Multivariable linear regression was used to determine if there was an association between socioeconomic disadvantage, insurance type, and other patient factors and presenting patient-reported health status.

RESULTS

Significant differences in age, insurance type, self-reported race, marital status, and county of residence were appreciated when comparing patient characteristics by socioeconomic disadvantage levels (all comparisons, P < 0.01). In addition, significant differences in age, insurance type, marital status, and county of residence were appreciated when comparing patient characteristics by self-reported race (all comparisons, P < 0.01). Being in the most socioeconomically disadvantaged cohort was associated with worse presenting Patient-Reported Outcomes Measurement Information System scores (Physical Function: β = -3.27 (95% confidence interval [CI]: -4.89 to -1.45), P < 0.001; Pain Interference: β = 3.20 (95% CI: 1.58-4.83), P < 0.001; Depression: β = 3.31 (95% CI: 1.08-5.55), P = 0.004.

CONCLUSION

The most socioeconomically disadvantaged patients with symptomatic lumbar disc herniations present with worse functional limitations, pain levels, and depressive symptoms as compared to patients from the least socioeconomically disadvantaged cohort when accounting for other key patient factors.Level of Evidence: 3.

Impact of Insurance Type on Self-Reported Symptom Severity at the Preoperative Visit for Carpal Tunnel Release

PURPOSE

Prior studies evaluated the impact of insurance type on access to hand care. However, there is limited literature quantifying whether patient symptoms are worse at the time of intervention. Our primary null hypothesis was that insurance type would not be associated with Patient-Reported Outcomes Measure Information System (PROMIS) Upper-Extremity (UE), Physical Function (PF), Pain Interference (PI), and Depression scores at the preoperative visit before carpal tunnel release (CTR).

METHODS

Between December 2016 and November 2018, patients with known carpal tunnel syndrome presenting to a tertiary academic hand clinic for the preoperative visit within 3 months of CTR, completed PROMIS UE, PF, PI, and Depression computer adaptive tests. Patient characteristics were recorded, including insurance type as commercial, Medicare, Medicaid, or workers' compensation. Multivariable linear regression was used to determine which variables were associated with PROMIS scores at the preoperative visit before CTR.

RESULTS

A total of 301 patients were included in the analysis. All PROMIS domains were significantly different by insurance type; Medicaid patients had the worst preoperative score for all domains in bivariate analysis. In multivariable linear regression modeling, commercial insurance was associated with better preoperative PROMIS UE, PF, PI, and Depression scores.

CONCLUSIONS

Commercial insurance is associated with significantly better preoperative PROMIS PF, PI, and Depression scores compared with other insurance types (ie, Medicaid, Medicare, and Workers' compensation). This may be the result of a number of factors, including differences in access to hand care or life circumstances that allow for only certain individuals to seek hand care early on in the disease process. However, further research is warranted to determine more definitively why this association exists.

TYPE OF STUDY/LEVEL OF EVIDENCE

Prognostic II.

URMC Universal Depression Screening Initiative: Patient Reported Outcome Assessments to Promote a Person-Centered Biopsychosocial Population Health Management Strategy

Background: Patient-reported outcomes (PROs) can promote person-centered biopsychosocial health care by measuring outcomes that matter to patients, including functioning and well-being. Data support feasibility and acceptability of PRO administration as part of routine clinical care, but less is known about its effects on population health, including detection of unmet healthcare needs. Our objectives were to examine differences in rates of clinically significant depression across sociodemographic groups and clinical settings from universal depression screens in a large health system, estimate the number of patients with untreated depression detected by screenings, and examine associations between biopsychosocial PROs-physical, psychological, and social health. Methods: We analyzed data from over 200,000 adult patients who completed depression screens-either PROMIS (Patient Reported Outcomes Measurement Information System) or PHQ-2/9-as part of routine outpatient care. Results: Depression screens were positive in 14.2% of the sample, with more positive screens among younger vs. older adults, women vs. men, non-White vs. White, and Hispanics vs. non-Hispanics. These same sociodemographic indicators, as well as completing screening in primary care (vs. specialty care) were also associated with greater likelihood of detected depression in the medical record. Discussion: Universal screening for depression symptoms throughout a large health system appears acceptable and has the potential to detect depression in diverse patient populations outside of behavioral health. Expanded delivery of PROs to include physical and social health as well as depression should be explored to develop a clinically-relevant model for addressing patients' biopsychosocial needs in an integrated fashion across the health system.

"Unspoken Questions": A Qualitative Study of Rheumatologists' Perspectives on the Clinical Implementation of Patient-reported Outcome Measures

OBJECTIVE

To identify rheumatologists' views on perceived barriers and facilitators to the clinical implementation of patient-reported outcome measures (PROM).

METHODS

Semistructured interviews were conducted with academically affiliated clinical rheumatologists. Interviews were audio-recorded and transcribed. Deidentified transcripts were independently coded and analyzed for themes.

RESULTS

Fifteen attending rheumatologists, 8 women (53%) and 7 men (47%) with a mean of 17.3 years in practice (range 5-43) at 2 urban academic medical centers, participated in interviews. Rheumatologists identified several barriers to integrating PROM in clinical care, highlighting physician buy-in and culture change as significant challenges beyond logistical considerations. They further underscored the lack of effective interventions and resources for addressing the domains of most interest to patients. Physicians also recognized significant benefits of PROM in clinical care, including contributing to the clinical impression by providing the patient perspective, and promoting agenda setting by uncovering "unspoken questions." They additionally noted that PROM could support treatment planning, build patient-physician relationships, and facilitate patient engagement. Participants suggested that technology, physician education, and team-based care could facilitate the effective implementation of PROM.

CONCLUSION

Rheumatologists identified multiple mechanisms through which PROM could augment clinical care, but also noted several obstacles to implementation, questioning the added value of PROM and the limited availability of interventions to improve patient-centered outcomes. Programs seeking to successfully integrate PROM to enhance patient-centered care and meet quality benchmarks should prioritize physician buy-in and training, and provide resources to address the outcomes that are measured.

Characteristics Associated With Depression, Anxiety, and Social Isolation in Adults With Spina Bifida

OBJECTIVE

To identify demographic and clinical characteristics associated with depression, anxiety, and social isolation among adults with spina bifida. We hypothesize that lower urinary tract dysfunction is associated with poor psychosocial outcomes.

METHODS

An anonymous survey was distributed via Facebook advertising to individuals with congenital urologic conditions. Adults with spina bifida were included in our analysis. Lower urinary tract dysfunction was assessed with the Neurogenic Bladder Symptom Score. Depression, anxiety, and social isolation T-scores were measured using Patient-Reported Outcome Measures Information System instruments. A composite depression-anxiety score was calculated. Separate adjusted linear models assessed the association between lower urinary tract dysfunction and depression, anxiety, composite depression-anxiety, and social isolation.

RESULTS

Around 195 participants were included. Rates of depression, anxiety, and social isolation were 48%, 47%, and 43%, respectively. Comorbid depression and anxiety occurred in 39% of subjects. On adjusted regression analysis, lower urinary tract dysfunction was associated with depression (P < 001), anxiety (P <.001), composite depression-anxiety (P <.001), and social isolation (P = .010).

CONCLUSION

Depression, anxiety, and social isolation are common in individuals with spina bifida relative to the general population, and associated with lower urinary tract dysfunction. Interventions focused on optimizing lower urinary tract symptoms and function, transition-age adults, group psychotherapy, and comorbid depression and anxiety may be of particular value in this population.

A Comparison of PROMIS Physical Function and Pain Interference Scores in Patients With Carpal Tunnel Syndrome: Research Collection Versus Routine Clinical Collection

Background: There is a concern that patients may answer patient-reported outcome (PRO) questionnaires differently depending on the purpose-clinical care or research (eg, "Hawthorne effect"). We sought to determine whether Patient-Reported Outcomes Management Information System (PROMIS) scores differ at the same clinic visit based on whether a patient was completing the PRO tool for study or clinical care purposes. Methods: Patients presenting to one surgeon at an academic medical center hand clinic were asked to complete PROMIS Physical Function (PF) and Pain Interference (PI) questionnaires as part of routine care. Those diagnosed with carpal tunnel syndrome from February 2015 to April 2017 were then asked to participate in a clinical research project, which had them complete PROMIS PF and PROMIS PI again. Data from those who completed both routine and research PROs at each visit were compared. Between the 2 settings, test-retest reliability was determined using Pearson correlation coefficients (r), and internal consistency was evaluated using Cronbach α. Results: A total of 128 unique office visits representing 67 patients fit our inclusion criteria. There was a strong correlation between PROMIS PF and PI in the research and patient care setting (PF: r = 0.82, P < .01; PI: r = 0.83, P < .01). Both domains had a Cronbach α of 0.90. The PROMIS PF scores were not different between the 2 groups (P = .19), but the PROMIS PI scores were slightly different (P < .01). Conclusions: Patients appear to be consistent when completing PROMIS for both clinical care and research, supporting the idea that data obtained in either setting are generalizable and appropriate for research purposes.

An analysis of missing items in real-world electronic patient reported outcomes data: implications for clinical care

PURPOSE

Utilization of electronic patient-reported outcomes (ePROs) in the clinic can improve quality of life and prolong survival in cancer care. However, there remain unanswered questions regarding trends in missing data and the potential effect on real-time patient care.

METHODS

This study utilized a prospectively collected dataset of ePROs from oncology clinics that administered the Patient Care Monitor 2.0 (PCM), a validated symptoms survey assessing 78 items for men, and 86 for women. We tabulated the frequency of missing items, by item and domain (emotional, functional and physical symptom-related), and examined these by age, gender, education, race and marital status.

RESULTS

Within 20,986 encounters, there were responses to at least 1 PCM item from 6933 unique patients. The highest frequency of missing answers occurred for: "attend a paid job" (10.7%), "reduced sexual enjoyment" (3.8%), and "run" (3.7%). By domain, 12.3% of functional, 8.4% of physical symptom-related, and 1.6% of emotional constructs contained at least one missing item. For functional and physical symptom-related items, missingness was most common in patients >60 years old.

CONCLUSION

The frequency of missingness was highest for functional items, like attending a paid job, suggesting that some respondents (e.g., retirees without a paid job) skipped questions that were less applicable to them. More universal issues for cancer patients, such as emotional well-being, had much lower frequencies of missingness. This suggests differential item completion that warrants further study to understand the inherent drivers. Identifying causes of missingness could improve the clinical utility of ePROs and highlight opportunities to personalize care.

Embedding and Sustaining a Focus on Function in Specialty Research and Care

Function and the independent performance of daily activities are of critical importance to older adults. Although function was once a domain of interest primarily limited to geriatricians, transdisciplinary research has demonstrated its value across the spectrum of medical and surgical care. Nonetheless, integrating a functional perspective into medical and surgical therapeutics has yet to be implemented consistently into clinical practice. This article summarizes the presentations and discussions from a workshop, "Embedding/Sustaining a Focus on Function in Specialty Research and Care," held on January 31 to February 1, 2019. The third in a series supported by the National Institute on Aging and the John A. Hartford Foundation, the workshop aimed to identify scientific gaps and recommend research strategies to advance the implementation of function in care of older adults. Transdisciplinary leaders discussed implementation of mobility programs and functional assessments, including comprehensive geriatric assessment; integrating cognitive and sensory functional assessments; the role of culture, environment, and community in incorporating function into research; innovative methods to better identify functional limitations, techniques, and interventions to facilitate functional gains; and the role of the health system in fostering integration of function. Workshop participants emphasized the importance of aligning goals and assessments and adopting a team science approach that includes clinicians and frontline staff in the planning, development, testing, and implementation of tools and initiatives. This article summarizes those discussions.

Applying Item Response Theory to the OPD Structure Questionnaire: Identification of a Unidimensional Core Construct and Feasibility of Computer Adaptive Testing

Recent developments in the dimensional assessment of personality functioning have made the implementation of latent measurement models increasingly attractive. In this study, we applied item response theory (IRT) to a well-established personality functioning instrument (the OPD Structure Questionnaire) to identify a unidimensional latent trait and to evaluate the feasibility of computer adaptive testing (CAT). We hypothesized that the use of IRT could reduce the test burden - compared to a fixed short form - while maintaining high precision over a wide range of the latent trait. The OPD-SQ was collected from 1235 patients in a psychosomatic clinic. IRT assumptions were fulfilled. A 9-factor model yielded sufficient fit and unidimensionality in exploratory factor analysis with bifactor rotation. Items were iteratively reduced, and a graded-response IRT model was fitted to the data. Simulations showed that a CAT with approximately 7 items was able to capture an OPD-SQ global severity score with an accuracy similar to that of a fixed 12-item short form. The final item bank and CAT yielded satisfactory content validity. Strong correlations with depression and anxiety replicated previous results on the OPD-SQ. We concluded that IRT applications could be useful to reduce the test burden of personality functioning instruments.

Time-Driven Activity-Based Costing: A Better Way to Understand the Cost of Caring for Hip Fractures

Geriatric hip fractures are a common and costly injury. They are expected to surge in incidence and economic burden as the population ages. With an increasing financial strain on the healthcare system, payors and providers are looking toward alternative, value-based models to contain costs. Value in healthcare is the ratio of outcomes achieved over costs incurred, and can be improved by reducing cost while maintaining or improving outcomes, or by improving outcomes while maintaining or reducing costs. Therefore, an understanding of cost, the denominator of the value equation, is essential to value-based healthcare. Because traditional hospital accounting methods do not link costs to conditions, there has been little research to date on the costs of treating geriatric hip fractures over the entire cycle of care. The aim of this article is to summarize existing costing methodologies, and in particular, to review the strengths and limitations of Time-Driven Activity-Based Costing (TDABC) in orthopaedic trauma, especially as it pertains to the needs and challenges unique to hip fracture care. TDABC determines costs at the patient-level over the entire care cycle, allowing for population variability, while simultaneously identifying cost drivers that might inform risk-stratification for future alternative payment models. Through process mapping, TDABC also reveals areas of variation or inefficiency that can be targeted for optimization, and empowers physicians by focusing on costs in the control of the provider. Although barriers remain, TDABC is well-positioned to provide transparent costing and targets to improve the value of hip fracture care.

Can Patient-Reported Outcomes Measurement Information System® (PROMIS) measures accurately enhance understanding of acceptable symptoms and functioning in primary care?

BACKGROUND

Value-based healthcare models will require prioritization of the patient's voice in their own care toward better outcomes. The Patient-Reported Outcomes Measurement Information System® (PROMIS) gives patients a voice and leads providers to actionable treatments across a broad range of diagnoses. However, better interpretation of PROMIS measures is needed. The purpose of this study was to evaluate the accuracy of PROMIS Physical Function (PF), Self-Efficacy for Managing Symptoms (SE), Pain Interference (PI), Fatigue, and Depression measures to discriminate patient acceptable symptom state (PASS) in primary care, determining if that accuracy is stable over time and/or retained when PROMIS score thresholds are set at either ½ or 1 SD worse than the reference population mean.

METHODS

Primary care patients completed the five PROMIS measures and answered the PASS yes/no question at intake (n = 360), 3-14 days follow-up (n = 230), and 45-60 days follow-up (n = 227). Thresholds (optimal, ½ SD, and 1 SD worse than reference values) for PROMIS T-scores associated with PASS were determined through receiver-operator curve analysis. Accuracy was calculated at the three time points for each threshold value. Logistic regression analyses were used to determine combinations of PROMIS measures that best predicted PASS.

RESULTS

PROMIS PF, SE, PI, and Fatigue optimal score thresholds (maximizing sensitivity and specificity) yielded area under the curve values of 0.77-0.85, with accuracies ranging from 71.7% to 79.1%. Accuracy increased minimally (1.9% to 5.5%) from intake to follow-ups. Thresholds of 1 SD worse than the mean for PROMIS PF and PI measures and ½ SD worse for SE and Fatigue overall retained accuracy versus optimal (+ 1.3% to - 3.6%). Regression models retained SE, PI, and Fatigue as independent predictors of PASS, and minimally increased accuracy to 83.1?%.

CONCLUSIONS

This study establishes actionable PROMIS score thresholds that are stable over time and anchored to patient self-reported health status, increasing interpretability of PF, SE, PI, and Fatigue scores. The findings support the use of these PROMIS measures in primary care toward improving provider-patient communication, prioritizing patient concerns, and optimizing clinical decision making.

Capturing the patient voice: implementing patient-reported outcomes across the health system

PURPOSE

Supporting the capture and use of patient-reported outcomes (PROs) at the point-of-care enriches information about important clinical and quality of life outcomes. Yet the ability to scale PROs across healthcare systems has been limited by knowledge gaps around how to manage the diversity of PRO uses and leverage health information technology. In this study, we report learnings and practice insights from UW Medicine's practice transformation efforts to incorporate patient voice into multiple areas of care.

METHODS

Using a participatory, action research approach, we engaged with UW Medicine clinical and administrative stakeholders experienced with PRO implementation to inventory PRO implementations across the health system, characterize common clinical uses for PROs, and develop recommendations for system-wide governance and implementation of PROs.

RESULTS

We identified a wide breadth of PRO implementations (n = 14) in practice and found that nearly half (47%) of employed PRO measures captured shared clinical domains (e.g., depression). We developed three vignettes (use cases) that illustrate how users interact with PROs, characterize common ways PRO implementations support clinical care across the health system (1) Preventive care, (2) Chronic/Specialty care, and (3) Surgical/Interventional care), and elucidate opportunities to enhance efficient PRO implementations through system-level standards and governance.

CONCLUSIONS

Practice transformation efforts increasingly require integration of the patient voice into clinical care, often through the use of PROs. Learnings from our work highlight the importance of proactively considering how PROs will be used across the layers of healthcare organizations to optimize the design and governance of PROs.