A comparison of computer adaptive tests (CATs) and short forms in terms of accuracy and number of items administrated using PROMIS profile

Utility of patient-reported outcomes measurement information system (PROMIS) physical function form in inflammatory myopathy

OBJECTIVE

Idiopathic inflammatory myopathies (IIM) are a group of diseases characterized by muscle weakness, which limit activities of daily living. Patient Reported Outcomes Measurement Information System (PROMIS) is a set of outcome measures developed using NIH funding, but has not yet been studied in adult IIM. Currently, the most commonly used PROs in IIM are Health Assessment Questionnaire (HAQ-DI) and SF-36 physical function-10 (PF10), both of which have several limitations. In this study, we investigated psychometric properties of PROMIS physical function-20 (PF-20) and compared to HAQ-DI and SF-36 PF10.

METHODS

Patients with IIM completed PROMIS PF-20 and six myositis core set measures [manual muscle testing (MMT), physician (MD-GDA), patient (PT-GDA) and extra-muscular global disease activity, HAQ-DI and creatine kinase], SF-36 PF10 and functional tests [six-minute walk, timed up-and-go and sit-to-stand tests] at monthly visits over 6-months. Total improvement score (TIS) using 2016 ACR/EULAR myositis response criteria was obtained as measures of change.

RESULTS

Fifty patients [mean age, 51.6; 60% females] were enrolled; 6 PM, 24 DM, 9 NM and 11 with AS. PROMIS PF-20 showed strong test-retest reliability when repeated in 1-month. PROMIS PF-20 had moderate-strong correlations with MD-GDA, PT-GDA, MMT, HAQ-DI, SF-36 PF10, and functional tests indicating good convergent validity. Change in PROMIS PF-20 strongly correlated with TIS demonstrating good responsiveness. HAQ-DI and SF-36 PF10 exhibited similar validity and responsiveness; HAQ-DI was found to have a ceiling effect.

CONCLUSION

PROMIS PF-20 demonstrates favorable psychometric properties in a large cohort of myositis patients and offers distinct advantages.

The factor structure and subscale properties of the pain catastrophizing scale: are there differences in the distinctions?

As presently constructed, the pain catastrophizing failed to discriminate effectively among levels of rumination, magnification, and helplessness in a sample of patients with chronic pain.

Increasingly, studies have documented the negative impact of pain catastrophizing on health outcomes. The Pain Catastrophizing Scale (PCS) has been the measure of choice for many of these studies. The PCS provides 3 subscales for measuring pain catastrophizing: rumination, magnification, and helplessness. Factor analytic investigations of these factors have been limited by the sample size and relevance, and results have been inconsistent. No study has directly estimated the added value of subscale scoring of the PCS compared with scoring it as a single measure.

Linking AM-PAC Mobility and Daily Activity to the PROMIS Physical Function Metric

OBJECTIVE

The purpose of this study was to link Activity Measure for Post-Acute Care (AM-PAC) Mobility and Daily Activity scales to the PROMIS Physical Function (PF) allowing for a common metric across scales.

METHODS

Cross-sectional study of patients 18 years and older presenting to 1 of 8 outpatient rehabilitation clinics in southwestern Pennsylvania. Patients completed one survey with questions from the AM-PAC Daily Activity and Mobility short forms, and the PROMIS PF item bank. Using item response theory, 2 rounds of fixed-parameter calibration were performed. In the first, the AM-PAC Daily Activity and Mobility items were calibrated with 27 fixed item parameters from the PROMIS PF. Second, the AM-PAC Daily Activity items were calibrated with 11 PROMIS Upper Extremity fixed item parameters. This process uses the construct of physical function and equates AM-PAC items on the same underlying measurement scale for the PROMIS PF.

RESULTS

Both scales measured a wide range of functioning and demonstrated good calibration. Data were appropriate for a fixed-parameter item response theory-based crosswalk. AM-PAC Daily Activity and Mobility raw scores were mapped onto the PROMIS PF metric. AM-PAC Daily Activity scores were also mapped onto the PROMIS PF Upper Extremity metric.

CONCLUSION

Question items from the AM-PAC Daily Activity, AM-PAC Mobility, and PROMIS PF similarly measure the construct of physical function. This consistency allows for a crosswalk of AM-PAC scores onto the PROMIS PF metric.

IMPACT

Crosswalk tables developed in this study allow for converting scores from the AM-PAC Daily Activity and Mobility scales to the PROMIS PF metric. This will facilitate monitoring of longitudinal change in function over time and across settings.

Southwest Harvest for Health: Adapting a mentored vegetable gardening intervention for cancer survivors in the southwest

Few diet and physical activity evidence-based interventions have been routinely used in community settings to achieve population health outcomes. Adapting interventions to fit the implementation context is important to achieve the desired results. Harvest for Health is a home-based vegetable gardening intervention that pairs cancer survivors with certified Master Gardeners from the Cooperative Extension Service with the ultimate goal of increasing vegetable consumption and physical activity, and improving physical functioning and health-related quality-of-life. Harvest for Health has potential for widespread dissemination since Master Gardener Programs exist throughout the United States. However, state- and population-specific adaptations may be needed to improve intervention adoption by other Master Gardener Programs. Our primary objective was to adapt this evidence-informed intervention that was initially incepted in Alabama, for the drastically different climate and growing conditions of New Mexico using a recommended adaptation framework. Our secondary objective was to develop a study protocol to support a pilot test of the adapted intervention, Southwest Harvest for Health. The adaptation phase is a critical first step towards widespread dissemination, implementation, and scale-out of an evidence-based intervention. This paper describes the adaptation process and outcomes, and the resulting protocol for the ongoing pilot study that is currently following 30 cancer survivors and their paired Extension Master Gardener mentors.

PROMIS is a Valid Patient-Reported Outcome Measure for Patients undergoing ACL Reconstruction with Multi-ligament Knee Reconstruction and Repair Procedures

BACKGROUND

This study aimed to (1) compare PROMIS with previously validated legacy instruments and (2) to assess between group differences of PROMIS PF-CAT [Physical Function Computer Adaptive Test] for patients undergoing isolated primary ACL reconstruction [ACLR] vs. primary ACL reconstruction with additional ligamentous intervention [MLIK].

LEVEL OF EVIDENCE

II; Prospective Cohort Study.

METHODS

At a single preoperative timepoint, 42 [MLIK] and 73[ACLR] patients completed: Short Form 36 Health Survey (SF-36) Mental (MCS) and Physical Component Summary (PCS), Knee Injury and Osteoarthritis Outcome Score (KOOS), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), EuroQol-5 dimensions (EQ-5D) and Marx Knee Scale. Spearman correlation coefficients (non-parametric data) assessed correlations between PROMIS PF-CAT and legacy PROs [Patient-Reported Outcome instruments]. Floor and ceiling effects were assessed using chi-square tests. Between group differences were assessed (Wilcoxon Rank sum test).

RESULTS

PROMIS PF-CAT for the MLIK cohort [Table 2] demonstrated an excellent-good correlation with SF-36 Physical Function (PCS; r = 0.64, p < 0.01), EQ-5D (r = 0.68, p < 0.01), and KOOS Quality of Life (QOL) (r = 0.68, p < 0.01); good correlation with KOOS ADL (r = 0.52, p = 0.01), KOOS Sports (r = 0.44, p < 0.01), KOOS Pain (r = 0.44, p < 0.01) and WOMAC Function (r = 0.52,p = 0.01). PROMIS PF-CAT scores differed for ACL vs. MLIK cohorts (41.9 ± 6.6 vs. 37.6 ± 9.0, p < 0.01). PROMIS PF-CAT demonstrated the fewest floor and ceiling effects [Table 4] versus legacy PRO instruments.

CONCLUSION

PROMIS PF-CAT demonstrated strong correlations with previously validated PRO instruments and offers a favorable alternative for patients undergoing ACLR with MLIK repair/reconstruction procedures. Preoperative PROMIS PF-CAT scores were greater for patients undergoing primary ACLR versus MLIK intervention.

Improving the utility of the European Health Literacy Survey Questionnaire: a computerized adaptive test for patients with stroke

PURPOSE

Health literacy among patients is crucial for effective stroke management. The European Health Literacy Survey Questionnaire is a theory-based measure that comprehensively captures 12 domains of health literacy. We aimed to develop a computerized adaptive test of the European Health Literacy Survey Questionnaire to efficiently assess health literacy among patients with stroke.

MATERIALS AND METHODS

The European Health Literacy Survey Questionnaire data of 311 patients and item parameters were retrieved from a Rasch validation study. Real data simulations were performed to develop a computerized adaptive test of the European Health Literacy Survey Questionnaire and explore its efficiency and reliability.

RESULTS

The computerized adaptive test of the European Health Literacy Survey Questionnaire displayed suitable reliability in all 12 domains (0.72-0.84) with a mean test length of 17 items (36.2% of the 47-item European Health Literacy Survey Questionnaire).

CONCLUSIONS

Our findings indicate that the computerized adaptive test of the European Health Literacy Survey Questionnaire, which assesses 12 domains of health literacy among patients with stroke in a timely and precise fashion, is efficient and reliable.Implications for rehabilitationThe computerized adaptive test of the European Health Literacy Survey Questionnaire assesses the subjective fit of personal health literacy competencies to environmental demands, providing insight into patient strengths and weaknesses when dealing with health tasks and interacting with health systems.The computerized adaptive test of the European Health Literacy Survey Questionnaire assesses the 12 domains of health literacy among patients with stroke in a timely and precise manner.Our study has demonstrated the utility of the computerized adaptive test of the European Health Literacy Survey Questionnaire in reducing the assessment burden of patients in clinical practice.Developing of the computerized adaptive test of the European Health Literacy Survey Questionnaire provided findings that may benefit researchers and clinicians interested in developing efficient outcome measures.

Association Between Patient Physical Function and Length of Stay After Thoracoscopic Lung Cancer Surgery

Patient-reported outcomes (PRO) are an ideal method for measuring patient functional status. We sought to evaluate whether preoperative PRO were associated with resource utilization. We hypothesize that higher preoperative physical function PRO scores, measured via the NIH-sponsored Patient Reported Outcome Measurement Information System (PROMIS), are associated with shorter length of stay (LOS). Preoperative physical function scores were obtained using NIH PROMIS in a prospective observational study of patients undergoing minimally invasive surgery for lung cancer. Poisson regression models were constructed to estimate the association between the length of stay and PROMIS physical function T-score, adjusting for extent of resection, age, gender, and race. Due to the significant interaction between postoperative complications and physical function T-score, the relationship between physical function and LOS was described separately for each complication status. A total of 123 patients were included; 88 lobectomy, 35 sublobar resections. Mean age was 67 years, 35% were male, 65% were Caucasian. Among patients who had a postoperative complication, a lower preoperative physical function T-score was associated with progressively increasing LOS (P  value = 0.006). In particular, LOS decreased by 18% for every 10-point increase in physical function T-score. Among patients without complications, T-score was not associated with LOS (P = 0.86). Preoperative physical function measured via PRO identifies patients who are at risk for longer LOS following thoracoscopic lung cancer surgery. In addition to its utility for preoperative counseling and planning, these data may be useful in identifying patients who may benefit from risk-reduction measures.

Principles for Guiding the Selection of Early Childhood Neurodevelopmental Risk and Resilience Measures: HEALthy Brain and Child Development Study as an Exemplar

The vast individual differences in the developmental origins of risk and resilience pathways combined with sophisticated capabilities of big data science increasingly point to the imperative of large, neurodevelopmental consortia to capture population heterogeneity and key variations in developmental trajectories. At the same time, such large-scale population-based designs involving multiple independent sites also must weigh competing demands. For example, the need for efficient, scalable assessment strategies must be balanced with the need for nuanced, developmentally sensitive phenotyping optimized for linkage to neural mechanisms and specification of common and distinct exposure pathways. Standardized epidemiologic batteries designed for this purpose such as PhenX (consensus measures for Phenotypes and eXposures) and the National Institutes of Health (NIH) Toolbox provide excellent "off the shelf" assessment tools that are well-validated and enable cross-study comparability. However, these standardized toolkits can also constrain ability to leverage advances in neurodevelopmental measurement over time, at times disproportionately advantaging established measures. In addition, individual consortia often expend exhaustive effort "reinventing the wheel," which is inefficient and fails to fully maximize potential synergies with other like initiatives. To address these issues, this paper lays forth an early childhood neurodevelopmental assessment strategy, guided by a set of principles synthesizing developmental and pragmatic considerations generated by the Neurodevelopmental Workgroup of the HEALthy Brain and Child Development (HBCD) Planning Consortium. These principles emphasize characterization of both risk- and resilience-promoting processes. Specific measurement recommendations to HBCD are provided to illustrate application. However, principles are intended as a guiding framework to transcend any particular initiative as a broad neurodevelopmentally informed, early childhood assessment strategy for large-scale consortia science.

Magnitude and Variability of Stroke Patient-Proxy Disagreement Across Multiple Health Domains

OBJECTIVES

To quantify the extent and variability of bias introduced when caregivers, or proxies, complete patient-reported outcome measures (PROM) on behalf of stroke patients.

DESIGN

Cross-sectional survey study conducted between July 2018 and November 2019.

SETTING

Ambulatory clinic of a cerebrovascular center or rehabilitation unit.

PARTICIPANTS

A consecutive sample of stroke patients (N=200) and their proxies who were able and willing to complete PROMs. Proxies completed PROMs as they believed the patient would answer.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

PROMs included Neuro-QoL cognitive function, PROMIS physical function, social role satisfaction, anxiety, fatigue, pain interference, sleep disturbance, Patient Health Questionnaire-9 translated to PROMIS Depression, and PROMIS Global Health.

RESULTS

The study included 200 stroke patients (age, 62.2±13.3; 41.5% women) and their proxies (age 56.5±13.9; 70% women, 72% spouses). Proxies reported worse functioning and more symptoms across all PROM domains compared with patients (average difference, 0.3-3.0 T score points). Reliability between dyad responses was moderate across all domains (intraclass correlation coefficients (2,1), 0.49-0.76) and effect sizes were small (d=0.04-0.35). Cognitive function, anxiety, and depression had the lowest agreement, whereas physical function, pain, and sleep had the highest agreement based on the Bland-Altman method. At the individual level, a large proportion of dyads had meaningfully different scores across domains (range, 40%-57%; dyads differed >5 T score points). Few predictors of disagreement were identified through multinomial regression models.

CONCLUSIONS

At the aggregate level, small differences were detected between stroke patient-proxy pairs, with lower agreement on more subjective domains. At the individual level, a large proportion of dyads reported meaningfully different scores on all domains, affecting the interpretability of proxy responses on PROMs in a clinical setting.

Trade-Offs in Quality-of-Life Assessment Between the Modified Rankin Scale and Neuro-QoL Measures

INTRODUCTION

We aimed to describe the physical and cognitive health of patients with differing levels of post-stroke disability, as defined by modified Rankin Scale (mRS) scores. We also compared cross-sectional correlations between the mRS and the Quality of Life in Neurological Disorders (Neuro-QoL) T-scores to longitudinal correlations of change estimates from each measure.

METHODS

Mean Neuro-QoL T-scores representing mobility, dexterity, executive function, and cognitive concerns were compared among mRS subgroups. Fixed-effects regression models with robust standard errors estimated correlations among mRS and Neuro-QoL domain scores and correlations among longitudinal change estimates. These change estimates were then compared to distribution-based estimates of minimal clinically important differences.

RESULTS

Seven hundred forty-five patients with ischemic stroke (79%) or transient ischemic attack (21%) were enrolled in this longitudinal observational study of post-stroke outcomes. Larger differences in cognitive function were observed in the severe mRS groups (ie, 4-5) while larger differences in physical function were observed in the mild-moderate mRS groups (ie, 0-2). Cross-sectional correlations among mRS and Neuro-QoL T-scores were high (r = 0.61-0.83), but correlations among longitudinal change estimates were weak (r = 0.14-0.44).

CONCLUSIONS

Findings from this study undermine the validity and utility of the mRS as an outcome measure in longitudinal studies in ischemic stroke patients. Nevertheless, strong correlations indicate that the mRS score, obtained with a single interview, is efficient at capturing important differences in patient-reported quality of life, and is useful for identifying meaningful cross-sectional differences among clinical subgroups.

Assessing meaning & purpose in life: development and validation of an item bank and short forms for the NIH PROMIS®

PURPOSE

A sense of meaning and purpose is important for people living with acute and chronic illness. It can buffer the effects of stress and facilitate adaptive coping. As part of the Patient-Reported Outcomes Measurement Information System (PROMIS), we developed and validated an item response theory (IRT)-based measure of meaning and purpose in life.

METHODS

Informed by a literature review and patient and content-expert input, we wrote 52 items to assess meaning and purpose and administered them to a general population sample (n = 1000) along with the Meaning in Life Questionnaire-Presence of Meaning Subscale (MLQ-Presence) and the Life Engagement Test (LET). We split the sample in half for exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA). IRT analyses included assessments of differential item functioning (DIF).

RESULTS

Participants had a mean age of 47.8 years and 50.3% were male. EFA revealed one dominant factor and CFA yielded a good fitting model for a 37-item bank (CFI = 0.962, TLI = 0.960, RMSEA = 0.085). All items were free of sex, age, education, and race DIF. Internal consistency reliability estimates ranged from α = 0.90 (4-item short form) to α = 0.98 (37-item bank). The 8-item Meaning and Purpose short form was correlated with the MLQ-Presence (r = 0.89), the LET (r = 0.79), and the full PROMIS Meaning and Purpose item bank (r = 0.98).

CONCLUSIONS

The PROMIS Meaning and Purpose measures demonstrated sufficient unidimensionality and displayed good internal consistency, model fit, and convergent validity. Further psychometric testing of the PROMIS Meaning and Purpose item bank and short forms in people with chronic diseases will help evaluate the generalizability of this new tool.