A comparison of computer adaptive tests (CATs) and short forms in terms of accuracy and number of items administrated using PROMIS profile

Electronic Patient-Reported Outcome-Driven Symptom Management by Oncology Pharmacists in a Majority-Minority Population: An Implementation Study

PURPOSE

There is a lack of systematic solutions to manage supportive care issues in racial/ethnic minorities (REM) receiving treatment for cancer. We developed and implemented an electronic patient-reported outcome (ePRO)-driven symptom management tool led by oncology pharmacists in a majority-minority cancer center located in Southern California. This study was designed to evaluate the implementation outcomes of our multilevel intervention.

METHODS

This was a prospective, pragmatic, implementation study conducted between July 2021 and June 2023. Newly diagnosed adult patients with cancer receiving intravenous anticancer therapies completed symptom screening using ePRO that consists of the Patient-Reported Outcomes Measurement Information System measures at each infusion visit during the study. ePRO results were presented to an oncologist pharmacist for personalized symptom management and treatment counseling. The RE-AIM framework was used to guide implementation outcomes. Differences in symptom trajectories and clinical outcomes between groups were tested using generalized estimating equations.

RESULTS

We screened 388 patients of whom 250 were enrolled (acceptance rate: 64.4%), with 564 assessments being completed. The sample consisted of non-Hispanic White (NHW, 42.4%), Hispanic/Latinx (H/L, 30.8%), and non-Hispanic Asian (20.4%), with one (21.6%) of five participants preferring speaking Spanish. Compared with NHW, H/L participants had greater odds of reporting mild to severe pain interference (odds ratio [OR], 1.91 [95% CI, 1.18 to 3.08]; P = .008) and nausea and vomiting (OR, 2.08 [95% CI, 1.21 to 3.58]; P = .008), and higher rates of urgent care utilization (OR, 1.92 [95% CI, 1.04 to 3.61]; P = .04) within 30 days. Nausea and vomiting (n = 131, 23.2%), pain (n = 91, 16.1%), and fatigue (n = 72, 12.8%) were most likely to be intervened, with 90% of the participants expressing satisfaction across all visits.

CONCLUSION

Our multilevel ePRO-driven intervention led by oncology pharmacists helps facilitate symptom assessments and management and potentially reduce health disparities among REM.

Single-center pilot study of remote therapeutic monitoring in patients with operative spinal pathologies

OBJECTIVES

Spine pathology affects a significant portion of the population, leading to neck and back pain, impacting quality of life, and potentially requiring surgical intervention. Current pre- and postoperative monitoring methods rely on patient reported outcome (PRO) measures and lack continuous objective data on patients' recoveries. Remote therapeutic monitoring (RTM) using wearable devices offers a promising solution to bridge this gap, providing real-time physical function data. This study aims to assess the feasibility and correlation between changes in physical function and daily activity levels using RTM for individuals with operative spinal pathologies.

METHODS

A single-center pilot study involving 21 participants with operative spinal pathologies was conducted at an academic hospital. Participants were provided Bluetooth-enabled Fitbit Inspire 2 activity trackers and asked to wear them daily for 100 days. The Healthcare Recovery Solutions (HRS) mobile application facilitated remote administration of the PROMIS - Physical Function Short Form 6b PROs questionnaire at days 1, 30, and 90. Linear regression, Students' paired T tests, and one-way ANOVA were used to analyze collected data.

RESULTS

Average compliance with RTM was found to be 82.4% compared to only 48% for PROMs. Changes in daily steps were moderately positively correlated with changes in PROs at both 30 and 90 days. Participant satisfaction with RTM was high, and responses indicated greater satisfaction with RTM compared to PROMs.

CONCLUSIONS

RTM offers continuous and objective data collection, presenting a potential solution to the limitations of intermittent clinical assessments and self-reported outcomes. The study demonstrated a moderate correlation between changes in activity levels and changes in PROs, suggesting that RTM data could serve as a surrogate for PROs. Participants' high compliance and satisfaction with RTM underscore its feasibility and potential clinical utility. This study lays the groundwork for larger future investigations into the clinical benefits and broader application of RTM in spine care.

Implementing Systematic Patient-Reported Measures for Chronic Conditions Through the Naveta Value-Based Telemedicine Initiative: Observational Retrospective Multicenter Study

BACKGROUND

Patient-reported outcome and experience measures can play a critical role in providing patient-centered and value-based health care to a growing population of patients who are chronically ill. Value-based telemedicine platforms such as the Naveta initiative may facilitate the effective integration of these tools into health care systems.

OBJECTIVE

This study aims to evaluate the response rate to electronic patient-reported outcome measures (ePROMs) and electronic patient-reported experience measures (ePREMs) among patients participating in the Naveta telemedicine initiative and its correlations with sociodemographic and clinical characteristics, as well as the evolution of the response rates over time.

METHODS

Between January 1, 2021, and June 30, 2023, a total of 53,364 ePREMs and ePROMs for 20 chronic conditions were administered through the Naveta-Phemium platform. Descriptive statistics were used to summarize continuous and categorical variables. Differences in response rates within each sociodemographic variable were analyzed using logistic regression models, with significance assessed via chi-square and post hoc Tukey tests. Two-way ANOVA was used to examine the interaction between time interval and disease type on response rate evolution.

RESULTS

A total of 3372 patients with severe chronic diseases from 64 public hospitals in Spain participated in the Naveta health questionnaire project. The overall response rate to ePROMs and ePREMs during the first 2.5 years of the Naveta initiative was 46.12% (24,704/53,364), with a baseline rate of 53.33% (7198/13,496). Several sociodemographic factors correlated with lower response rates, including male gender, older age, lower education level, frequent alcohol use, being a student, and not being physically active. There were also significant variations in response rates among different types of chronic conditions (P<.001), with the highest rates being for respiratory (433/606, 71.5%), oncologic (200/319, 62.7%), digestive (2247/3601, 62.4%), and rheumatic diseases (7506/12,982, 57.82%) and the lowest being for HIV infection (7473/22,695, 32.93%). During the first 6 months of follow-up, the response rates decreased in all disease types, except in the case of the group of patients with oncologic disease, among whom the response rate increased up to 100% (6/6). Subsequently, the overall response rate approached baseline levels.

CONCLUSIONS

Recognizing the influence of sociodemographic factors on response rates is critical to identifying barriers to participation in telemonitoring programs and ensuring inclusiveness in patient-centered health care practices. The observed decline in response rates at follow-up may be due to survey fatigue, highlighting the need for strategies to mitigate this effect. In addition, the variation in response rates across chronic conditions emphasizes the importance of tailoring telemonitoring approaches to specific patient populations.

PROMIS-29 in rheumatoid arthritis patients who screen positive or negative for fibromyalgia on MDHAQ FAST4 (fibromyalgia assessment screening tool) or 2011 fibromyalgia criteria

BACKGROUND

PROMIS-29 T-scores query health-related quality of life (HRQL) in 7 domains, physical function, pain, fatigue, anxiety, depression, sleep quality, and social participation, to establish population norms. An MDHAQ (multidimensional health assessment questionnaire) scores these 7 domains and includes medical information such as a FAST4 (fibromyalgia assessment screening tool) index. We analyzed PROMIS-29 T-scores in rheumatoid arthritis (RA) patients vs population norms and for positive vs negative fibromyalgia (FM) screens and compared PROMIS-29 T-scores to MDHAQ scores to assess HRQL.

METHODS

A cross-sectional study was performed at one routine visit of 213 RA patients, who completed MDHAQ, PROMIS-29, and reference 2011 FM Criteria. PROMIS-29 T-scores were compared in RA vs population norms and in FM+ vs FM- RA patients, based on MDHAQ/FAST4 and reference criteria. Possible associations between PROMIS-29 T-scores and corresponding MDHAQ scores were analyzed using Spearman correlations and multiple regressions.

RESULTS

Median PROMIS-29 T-scores indicated clinically and statistically significantly poorer status in 26-29% FM+ vs FM- RA patients, with larger differences than in RA patients vs population norms for 6/7 domains. MDHAQ scores were correlated significantly with each of 7 corresponding PROMIS-29 domains (|rho|≥0.62, p<0.001). Linear regressions explained 55-73% of PROMIS-29 T-score variation by MDHAQ scores and 56%-70% of MDHAQ score variation by PROMIS-29 T-scores.

CONCLUSIONS

Scores for 7 PROMIS-29 domains and MDHAQ were highly correlated. The MDHAQ is effective to assess HRQL and offers incremental medical information, including FAST4 screening. The results indicate the importance of assessing comorbidities such as fibromyalgia screening in interpreting PROMIS-29 T-scores.

Patient-Reported Outcome Measures for Patients With CKD: The Case for Patient-Reported Outcomes Measurement Information System (PROMIS) Tools

Chronic kidney disease (CKD), kidney failure, and kidney replacement therapies are associated with high symptom burden and impaired health-related quality of life (HRQOL). Symptoms change with disease progression or transition between treatment modalities and frequently go unreported and unmanaged. Tools that reliably monitor symptoms may improve the management of patients with CKD. Patient-reported outcome measures (PROMs) assess symptom severity; physical, psychological, social, and cognitive functioning; treatment-related side effects; and HRQOL. Systematic use of PROMs can improve patient-provider communication, patient satisfaction, clinical outcomes, and HRQOL. Potential barriers to their use include a lack of engagement, response burden, and limited guidance about PROM collection, score interpretation, and workflow integration. Well-defined, acceptable, and effective clinical response pathways are essential for implementing PROMs. PROMs developed by the Patient-Reported Outcomes Measurement Information System (PROMIS) address some challenges and may be suitable for clinical use among patients with CKD. PROMIS tools assess multiple patient-valued, clinically actionable symptoms and functions. They can be administered as fixed-length, customized short forms or computer adaptive tests, offering precise measurement across a range of symptom severities or function levels, tailored questions to individuals, and reduced question burden. Here we provide an overview of the potential use of PROMs in CKD care, with a focus on PROMIS.

Are Social Deprivation and Low Traditional Health Literacy Associated With Higher PROMIS CAT Completion in Orthopaedic Surgery?

BACKGROUND

The Patient-Reported Outcomes Measurement Information System® (PROMIS®) may be used to assess an individual patient's perspective of their physical, mental, and social health through either standard or computer adaptive testing (CAT) patient questionnaires. These questionnaires are used across disciplines; however, they have seen considerable application in orthopaedic surgery. Patient characteristics associated with PROMIS CAT completion have not been examined within the context of social determinants of health, such as social deprivation or health literacy, nor has patient understanding of the content of PROMIS CAT been assessed.

QUESTIONS/PURPOSES

(1) What patient demographics, including social deprivation, are associated with completion of PROMIS CAT questionnaires? (2) Is health literacy level associated with completion of PROMIS CAT questionnaires? (3) Do patients with lower health literacy have a higher odds of completing PROMIS CAT without fully understanding the content?

METHODS

Between June 2022 and August 2022, a cross-sectional study was performed via a paper survey administered to patients at a single, urban, quaternary academic medical center in orthopaedic subspecialty clinics of foot and ankle, trauma, and hand/upper extremity surgeons. We considered all English-speaking patients aged 18 or older, including those with limited reading and/or writing abilities, as eligible provided they received an iPad in clinic to complete the PROMIS CAT questionnaire as part of their routine standard clinical care or they completed the questionnaire via a patient portal before the visit. In all, 946 patients were considered eligible during the study period and a convenience sample of 36% (339 of 946) of patients was approached for inclusion due to clinic time constraints. Fifteen percent (52 of 339) declined to participate, leaving 85% (287 of 339) of patients for analysis here. Median (range) age of study participants was 49 years (35 to 64). Fifty-eight percent (167 of 287) of study participants self-identified as non-Hispanic Black or African American and 26% (75 of 287) as non-Hispanic White. Even proportions were observed across education levels (high school graduate or less, 29% [82 of 287]; some college, 25% [73 of 287]; college graduate, 25% [71 of 287]; advanced degree, 20% [58 of 287]). Eighteen percent (52 of 287) of patients reported an annual income bracket of USD 0 to 13,000, and 17% (48 of 287) reported more than USD 120,000. Forty-six percent (132 of 287) of patients worked full-time, 21% (59 of 287) were retired, and 23% (66 of 287) were unemployed or on disability. The primary outcome of interest was self-reported PROMIS CAT questionnaire completion grouped as: fully completed, partially completed, or no part completed. Overall, self-reported PROMIS CAT questionnaire completion proportions were: 80% (229 of 287) full completion, 13% (37 of 287) partial completion, and 7% (21 of 287) no part completed. We collected the National Area Deprivation Index (ADI) score and the Brief Health Literacy Screening Tool (BRIEF) as part of the study survey to associate with level of completion. Additionally, patient understanding of PROMIS CAT was assessed through Likert-scaled responses to a study survey question that directly asked whether the patient understood all of the questions on the PROMIS CAT questionnaire. Responses to this question may have been limited by social desirability bias, and hence may overestimate how many individuals genuinely understood the questionnaire content. However, the benefit of this approach was it efficiently allowed us to estimate the ceiling effect of patient comprehension of PROMIS CAT and likely had a high degree of specificity for detecting lack of comprehension.

RESULTS

ADI score adjusted for age was not associated with PROMIS CAT completion (partial completion OR 1.00 [95% CI 0.98 to 1.01]; p = 0.72, no part completed OR 1.01 [95% CI 0.99 to 1.03]; p = 0.45). Patients with lower health literacy scores, however, were more likely to not complete any part of their assigned questionnaires than patients with higher scores (no part completed OR 0.85 [95% CI 0.75 to 0.97]; p = 0.02). Additionally, 74% (26 of 35) of patients who did not fully understand all of the PROMIS CAT questionnaire questions still fully completed them-hence, 11% (26 of 229) of all patients who fully completed PROMIS CAT did not fully understand the content. Among patients self-reporting full completion of PROMIS CAT with health literacy data (99% [227 of 229]), patients with inadequate/marginal health literacy were more likely than patients with adequate health literacy to not fully understand all of the questions (21% [14 of 67] versus 8% [12 of 160], OR 3.26 [95% CI 1.42 to 7.49]; p = 0.005).

CONCLUSION

Within an urban, socioeconomically diverse, orthopaedic patient population, health literacy was associated with PROMIS CAT questionnaire completion. Lower health literacy levels increased the likelihood of not completing any part of the assigned PROMIS CAT questionnaires. Additionally, patients completed PROMIS CAT without fully understanding the questions. This indicates that patient completion does not guarantee comprehension of the questions nor validity of their scores, even more so among patients with low health literacy. This is a substantive concern for fidelity of data gathered from PROMIS CAT.

CLINICAL RELEVANCE

Clinical implementation of the PROMIS CAT in orthopaedic populations will benefit from further research into health literacy to increase questionnaire completion and to ensure that patients understand the content of the questions they are answering, which will increase the internal validity of the outcome measure.

The psychometric properties of the PROMIS® profile CAT in people with stroke

BACKGROUND

The Patient-Reported Outcomes Measurement Information System® (PROMIS) Profile Computer Adaptive Testing (CAT) consists of seven CATs and one single item measuring most relevant aspects of health-related quality of life (HRQoL). The aim of our study was to determine construct validity and floor and ceiling effects of the PROMIS Profile CAT in Dutch people with stroke.

METHODS

People with stroke receiving rehabilitation completed the PROMIS Profile CAT and the EuroQol-5 dimensions (EQ5D). Construct validity was evaluated with hypotheses testing based on expected correlations between the profile domains and the domains of the EQ5D. The proportion of participants with the lowest and highest scores were calculated for each profile domain to assess floor and ceiling effects.

RESULTS

160 participants were included (median age 61 years, 41.9% female). For the PROMIS Profile domains Physical Function, Anxiety, Depression, Sleep Disturbance, Pain Interference, and Pain Intensity > 75% of the results met our hypotheses. For Fatigue and Ability to Participate in Social Roles and Activities only 60% of hypotheses were met. No floor or ceiling effects were found, with the exception of a floor effect for Pain Intensity which probably indicates that many participants had no pain.

CONCLUSION

Most domains of the PROMIS Profile CAT showed sufficient construct validity and no problematic floor or ceiling effects in people with stroke. These CATs and the single item Pain Intensity can be used to efficiently measure HRQoL in people with stroke.

Which Clinical Measurement Tools for Atopic Dermatitis Severity Make the Most Sense in Clinical Practice?

Assessment of atopic dermatitis (AD) severity is essential for therapeutic decision making and monitoring treatment progress. However, there are a myriad of clinical measurement tools available, some of which are impractical for routine clinical use despite being recommended for clinical trials in AD. For measurement tools to be used in clinical practice, they should be valid, reliable, rapidly completed, and scored, and easily incorporated into existing clinic workflows. This narrative review addresses content, validity, and feasibility, and provides a simplified repertoire of assessments for clinical assessment of AD based on prior evidence and expert opinion. Tools that may be feasible for clinical practice include patient-reported outcomes (eg, dermatology life quality index, patient-oriented eczema measure, numerical rating scales for itch, pain, and sleep disturbance, AD Control Tool, and patient-reported global assessment), and clinician-reported outcomes (eg, body surface area and investigator's global assessment). AD is associated with variable clinical signs, symptoms, extent of lesions, longitudinal course, comorbidities, and impacts. Any single domain is insufficient to holistically characterize AD severity, select therapy, or monitor treatment response. A combination of these tools is recommended to balance completeness and feasibility.

Depressive Symptoms Associated With Social Participation in Older Adults Living With Mild Cognitive Impairment

Mild Cognitive Impairment (MCI) affects 15% of adults 50 years old and over. Individuals living with MCI have shown decreased social participation, a critical activity as it may delay cognitive decline. Depression may be a key factor in limiting participation. This study is a secondary data analysis of 30 older adults living with MCI, looking for associations with participation. Participation was examined using the Patient Reported Outcomes Measurement Information System (PROMIS®) Satisfaction with Participation in Social Roles Computer Adaptive Test (CAT) form. Depressive symptoms were reported using the PROMIS Quality of Life in Neurological Disorders Depression CAT form and the Patient Health Questionnaire (PhQ-9) form. Results showed that demographics (age, sex) were not significantly associated with participation, but depressive symptoms were significantly associated. This suggests that adults living with MCI who have higher levels of depressive symptoms may be a uniquely vulnerable population who benefit from interventions that support participation.

Establishing the interpretability and utility of the 4-item BriefPCS

To reduce the patient burden associated with completing the 13-item Pain Catastrophizing Scale (PCS), the 4-item "BriefPCS" was developed. To date, no crosswalk has been developed that associates scores on the BriefPCS with PCS scores. Further, no study has compared the use of BriefPCS and PCS scores in a randomized clinical trial (RCT). We aimed to: (1) establish the interpretability of BriefPCS scores in reference to PCS scores, (2) compare the concurrent validity between the BriefPCS and PCS, and (3) asssess the use of BriefPCS in an RCT. First, we conducted equipercentile linking, created a crosswalk that associated scores of BriefPCS with PCS, and calculated differences between PCS and crosswalked PCS scores. Secondly, we compared Bootstrap correlation coefficients between PCS and self-reported measures of other domains. Lastly, we compared results from an RCT using BriefPCS scores versus PCS scores. Findings indicated that the correlation coefficient estimates with the BriefPCS and PCS scores were not significantly different. BriefPCS and PCS scores had similar ability to detect treatment-related changes. The BriefPCS scores validly, reliably, and accurately distinguish levels of pain catastrophizing. Additionally, the BriefPCS scores are sensitive to changes after behavioral interventions, with less respondent burden compared to the PCS scores.

Influence of respondents' Differentiation of subjective response on water knowledge stock test scale: Evaluation based on two-parameter-multidimensional IRT model

Insufficient awareness of water issues is a crucial bottleneck restricting the sustainable utilization of water resources. To accurately measure citizens' water knowledge stock and overcome the differences between scales and respondents' characteristic levels on test results, the research focuses on developing and evaluating water knowledge stock test scales. The mechanism for identifying indicators is designed based on the grounded theory, and as a result, the water knowledge stock test indicator system is derived. The data was collected by the form of survey questionnaire developed with the test indicator system. A two-parameter multidimensional item response theoretical model is constructed based on item parameter estimation, data model fitting, and item information function. The survey data and optimization model are used to optimize the water knowledge stock test scale and verify the fitting degree with the characteristics of the respondents. The test information function and standard error function indicate that the scale is most informative for individuals with characteristic levels ranging from -2 to 3, resulting in a highly reliable test effect. The research has established a measurement indicator system, methodology, and presented results that serve as a foundation for measuring the stock of water knowledge.

Optimising HIV care using information obtained from PROMs: protocol for an observational study

INTRODUCTION

Successful antiviral therapy has transformed HIV infection into a chronic condition, where optimising quality of life (QoL) has become essential for successful lifelong treatment. Patient-reported outcome measures (PROMs) can signal potential physical and mental health problems related to QoL. This study aims to determine whether PROMs in routine clinical care improve quality of care as experienced by people with HIV (PWH).

METHODS AND ANALYSIS

We report the protocol of a multicentre longitudinal cohort studying PWH at Amsterdam University Medical Centres in the Netherlands. PROMs are offered annually to patients via the patient portal of the electronic health record. Domains include anxiety, depression, fatigue, sleep disturbances, social isolation, physical functioning, stigma, post-traumatic stress disorder, adherence, drug and alcohol use and screening questions for sexual health and issues related to finances, housing and migration status. Our intervention comprises (1) patients' completion of PROMs, (2) discussion of PROMs scores during annual consultations and (3) documentation of follow-up actions in an individualised care plan, if indicated. The primary endpoint will be patient-experienced quality of care, measured by the Patient Assessment of Chronic Illness Care, Short Form (PACIC-S). Patients will provide measurements at baseline, year 1 and year 2. We will explore change over time in PACIC-S and PROMs scores and examine the sociodemographical and HIV-specific characteristics of subgroups of patients who participated in all or only part of the intervention to ascertain whether benefit has been achieved from our intervention in all subgroups.

ETHICS AND DISSEMINATION

Patients provide consent for the analysis of data collected as part of routine clinical care to the AIDS Therapy Evaluation in the Netherlands study (ATHENA) cohort through mechanisms described in Boender et al. Additional ethical approval for the analysis of these data is not required under the ATHENA cohort protocol. The results will be presented at national and international academic meetings and submitted to peer-reviewed journals for publication.

Establishing a common metric for physical function: Linking SARC-F and PROMIS® physical function

INTRODUCTION

Aligned with the increasing need for standardized assessment of physical function in older individuals with cancer and other conditions, several patient-reported outcome measures (PROMs) have been developed and published. The aim of this study is to link the Strength, Assistance with walking, Rising from a chair, Climbing stairs, and Falls questionnaire (SARC-F), and the Patient-Reported Outcomes Measurement Information System® (PROMIS®) Physical Function Short Form 8c (PROMIS PF 8c), and make their scores convertible, in order to expand the use of both instruments in research and inform clinicians and researchers about the interchangeability of critical cut-off scores.

MATERIALS AND METHODS

The sample included 300 participants recruited from an online panel. Participants were included if they had received a cancer diagnosis from a clinician and reported receiving anti-cancer treatment. We conducted five linking procedures and selected an optimal one to generate the crosswalk table between the two measures.

RESULTS

The linked T scores of all five methods showed acceptably small mean differences from the observed T scores, and the standard deviation (SD), and root-mean-squared deviation (RMSD) of the differences were generally similar across all methods. After comparing across all statistics, the Stocking-Lord approach was considered as the optimal approach to compute the crosswalk table for converting SARC-F raw scores to PROMIS PF 8c scores. The crosswalk table shows that the SARC-F cut-off value of 4 between healthy versus symptomatic with a corresponding score of 37 fell in the range of moderate physical function limitation from 30 to 39 on the PROMI PF 8c T score metric.

DISCUSSION

The linkage in this study has potential for improving clinical and research activities for people with cancer and perhaps others with a similar range of physical function. It facilitates the interpretability in scores of both measures on a common metric anchored on general population for further group-level analysis. Researchers can use this crosswalk to harmonize data collected from either instrument without requiring all cohorts to administer the same instrument for a prospective data collection or retrospective data analysis purpose or for a cross-study effectiveness study.

Development of a Short Form Assessment Combining the Fugl-Meyer Assessment-Upper Extremity and the Wolf Motor Function Test for Evaluating Stroke Recovery

OBJECTIVE

To use Rasch methodologies to combine the items of the Fugl-Meyer Assessment-Upper Extremity (FMA-UE, motor skill) and the Wolf Motor Function Test (WMFT, motor function) onto a single measurement metric and create an FMA-UE+WMFT short form.

DESIGN

Secondary analysis of preintervention data from 2 upper extremity stroke rehabilitation trials. Confirmatory factor analysis and Rasch rating scale analysis were first applied to examine the properties of the pooled item bank and then item response theory methodologies were used to develop the short form. Confirmatory factor analysis and Rasch analysis were then applied to the short form to examine the dimensionality and measurement properties.

SETTING

Outpatient academic medical research center.

PARTICIPANTS

Data from 167 participants who completed the FMA-UE and WMFT (rating scale score) were pooled (N=167). Participants were eligible if they had a stroke ≥3 months prior and had upper extremity (UE) hemiparesis and excluded if they had severe UE hemiparesis, severe UE spasticity, or UE pain.

INTERVENTION

Not applicable.

MAIN OUTCOME MEASURES

The dimensionality and measurement properties of the pooled 30-item FMA-UE and the 15-item WMFT and short form were examined.

RESULTS

Five items from the pool of 45 items were misfit and were removed. The 40-item pool demonstrated adequate measurement properties. A 15-item short form was then developed and met rating diagnostic scale criteria. All items on the 15-item short form met the Rasch fit criteria, and the assessment met criteria for reliability (Cronbach alpha=.94), separation (person separation = 3.7), and strata (number of strata = 5).

CONCLUSIONS

Items from the FMA-UE and WMFT can be pooled to create a psychometrically sound 15-item short form.

Spontaneous self-affirmation: an adaptive coping strategy for people with chronic pain

OBJECTIVES

Self-affirmation may be a promising treatment strategy for improving clinical outcomes. This study examined the association between self-affirmation and self-reported health status among people with chronic pain.

METHODS

In this cross-sectional study, 768 treatment seeking people (female 67.2%, mean age=50.4 years with SD of 17.1, White/Caucasian 59.9%) completed surveys using a learning healthcare system. Measures included spontaneous self-affirmation (SSA) items, PROMIS® outcome measures, and Pain Catastrophizing Scale (PCS). Multiple regressions were conducted to examine if strength-based SSA, value-based SSA, and their interaction would predict perceived health status and pain coping strategy. Sensitivity analysis was done by performing additional regressions with covariates (age, sex, race/ethnicity, and education). Lastly, exploratory analysis examined if average SSA scores would have a linear relationship with perceived health status.

RESULTS

The strength x value-based SSA interaction significantly predicted the PROMIS-depression, anxiety, and social isolation T-scores (ps≤0.007), but not anger T-scores (p=0.067). Specifically, greater tendency to use both SSA styles predicted less symptoms of depression, anxiety and social isolation. This interaction remained significant when controlling for the covariates. The two SSA styles and their interaction did not significantly predict pain interference, sleep disturbance, fatigue, average pain rating and PCS scores (ps≥0.054). Exploratory analysis revealed SSA average scores did not have a significant linear relationship with perceived health status.

CONCLUSIONS

The current study showed self-affirmation as being associated with better psychosocial health, but not associated with physical health and pain catastrophizing among patients with chronic pain. Our findings suggested the potential benefit of incorporating strength- and value-based affirmations in pain intervention approaches.

Assessing Fatigue in Patients Receiving Kidney Replacement Therapy Using PROMIS Computer Adaptive Testing

RATIONALE & OBJECTIVE

Fatigue is a debilitating symptom for many patients receiving kidney replacement therapy (KRT). Patient-reported outcome measures can help clinicians identify and manage fatigue efficiently. We assessed the measurement characteristics of the Patient Reported Outcome Measurement Information System (PROMIS)-Fatigue Computer Adaptive Test (PROMIS-F CAT) in patients receiving KRT using the previously validated Functional Assessment of Chronic Illness Therapy-Fatigue (FACIT-F) questionnaire.

STUDY DESIGN

Cross-sectional study.

SETTING & PARTICIPANTS

198 adults treated with dialysis or recipients of a kidney transplant in Toronto, Canada.

PREDICTORS

Demographic data, FACIT-F scores, KRT type.

OUTCOME

Measurement properties of PROMIS-F CAT T scores.

ANALYTICAL APPROACH

Reliability and test-retest reliability were assessed using standard errors of measurement and intraclass correlation coefficient (ICC), respectively. Construct validity was assessed using correlation and comparisons across predefined groups expected to have different levels of fatigue. Receiver operating characteristic (ROC) curves were used to assess the discrimination of PROMIS-F CAT, with clinically relevant fatigue defined by a FACIT-F score of≤30.

RESULTS

Of the 198 participants, 57% were male, the mean±SD age was 57±14 years; 65% had received a kidney transplant. Based on the FACIT-F score, 47 patients (24%) had clinically relevant fatigue. PROMIS-F CAT and FACIT-F were strongly correlated (ρ =-0.80, P<0.001). PROMIS-F CAT had excellent reliability (>0.90 for 98% of sample), and good test-retest reliability (ICC=0.85). The ROC analysis demonstrated outstanding discrimination (area under ROC=0.93 [95%, CI 0.89-0.97]). A PROMIS-F CAT cutoff score of≥59 accurately identified most patients with clinically relevant fatigue (sensitivity=0.83; specificity=0.91).

LIMITATIONS

A convenience sample of clinically stable patients. FACIT-F items are a part of the PROMIS-F item bank, although there was minimal overlap with only 4 FACIT-F items completed in PROMIS-F CAT.

CONCLUSIONS

PROMIS-F CAT has robust measurement properties with low question burden to assess fatigue among patients with KRT.

Problem Solving and Emotion Coping Styles for Social Anxiety: A Meta-analysis of Chinese Mainland Students

Studies of how positive and negative coping styles affect social anxiety show mixed results. Hence, our two meta-analyses determined the overall effect sizes of problem solving-focused coping (PSC) styles and emotion-focused coping (EFC) styles on social anxiety in mainland China (PSC: k = 49 studies, N = 34,669; EFC: k = 52, N = 36,531). PSC was negatively linked to social anxiety (- .198), and EFC was positively linked to social anxiety (.223). In years with more national income, PSC's and EFC's effect sizes were larger. PSC's effect sizes were smaller among rural students (vs. urban students), larger among older students (university, high school, middle school), and larger in cross-sectional (vs. longitudinal) studies. When using SAD (vs. others) social anxiety measures, PSC effect sizes were larger, but EFC effect sizes were smaller. EFC effect sizes were larger in studies with convenience (vs. representative) samples. Gender, single child status, and coping style measurement showed no moderation effects. These findings suggest that using problem solving-focused coping styles rather than emotion-focused may reduce social anxiety, so future experimental studies can test this idea more rigorously.

Feasibility of PROMIS using computerized adaptive testing during inpatient rehabilitation

BACKGROUND

There has been an increased significance on patient-reported outcomes in clinical settings. We aimed to evaluate the feasibility of administering patient-reported outcome measures by computerized adaptive testing (CAT) using a tablet computer with rehabilitation inpatients, assess workload demands on staff, and estimate the extent to which rehabilitation inpatients have elevated T-scores on six Patient Reported Outcomes Measurement Information System® (PROMIS®) measures.

METHODS

Patients (N = 108) with stroke, spinal cord injury, traumatic brain injury, and other neurological disorders participated in this study. PROMIS computerized adaptive tests (CAT) were administered via a web-based platform. Summary scores were calculated for six measures: Pain Interference, Sleep Disruption, Anxiety, Depression, Illness Impact Positive, and Illness Impact Negative. We calculated the percent of patients with T-scores equivalent to 2 standard deviations or greater above the mean.

RESULTS

During the first phase, we collected data from 19 of 49 patients; of the remainder, 61% were not available or had cognitive or expressive language impairments. In the second phase of the study, 40 of 59 patients participated to complete the assessment. The mean PROMIS T-scores were in the low 50 s, indicating an average symptom level, but 19-31% of patients had elevated T-scores where the patients needed clinical action.

CONCLUSIONS

The study demonstrated that PROMIS assessment using a CAT administration during an inpatient rehabilitation setting is feasible with the presence of a research staff member to complete PROMIS assessment.

General population reference values for the Functional Assessment of Cancer Therapy-Lung and PROMIS-29

BACKGROUND

Therapeutic advances in lung cancer have turned attention toward patient-reported outcome measures (PROMs) as important clinical outcomes. The Functional Assessment of Cancer Therapy-Lung (FACT-L) is a common endpoint in lung cancer trials. This study calculated FACT-L reference values for the United States (US) general population.

METHODS

Adults from the US general population (N = 2001) were surveyed between September 2020 and November 2020. Surveys contained 126 questions, including the FACT-L [36 items; FACT-G and four subscales (Physical Well-Being [PWB], Social Well-Being [SWB], Emotional Well-Being [EWB], and Functional Well-Being [FWB]) and the Lung Cancer Subscale (LCS), and a Trial Outcome Index (TOI)]. Reference values for each FACT-L scale were calculated with means for the total sample and separately for participants with: no comorbidities, COVID-19 as only comorbidity, no COVID-19.

RESULTS

In the total sample, the reference scores were as follows: PWB = 23.1; SWB = 16.8; EWB = 18.5; FWB = 17.6; FACT-G = 76.0; LCS = 23.0, TOI = 63.7, and FACT-L Total = 99.0. Scores were lower for those reporting a prior diagnosis of COVID-19, especially for SWB (15.7) and FWB (15.3). SWB scores were lower than previous references values.

CONCLUSIONS

These data provide US general adult population reference value set for FACT-L. While some of the subscale results were lower than those found in the reference data for other PROMs, these data were obtained in a more contemporaneous time frame juxtaposed with the COVID-19 pandemic and may represent a new peri-pandemic norm. Thus, these reference values will be useful for future clinical research.

Two-step screening for depressive symptoms in patients treated with kidney replacement therapies: a cross-sectional analysis

BACKGROUND

Systematic screening for depressive symptoms may identify patients who may benefit from clinical assessment and psychosocial support. Here we assess a two-step screening using ultrabrief pre-screeners [Edmonton Symptom Assessment Survey-revised Depression item (ESASr-D) or Patient Health Questionnaire-2 (PHQ-2)] followed by the Patient-Reported Outcomes Measurement Information System Depression questionnaire (PROMIS-D) to identify depressive symptoms in patients on kidney replacement therapies.

METHODS

We conducted a cross-sectional study of adults (kidney transplant recipients or treated with dialysis) in Toronto, ON, Canada. We simulated various two-step screening scenarios where only patients above a pre-screening cut-off score on the ESASr-D or PHQ-2 would move to step 2 (PROMIS-D). Screening performance was evaluated by sensitivity, specificity and positive and negative predictive values using the Patient Health Questionnaire-9 (PHQ-9) as the referent. The average number of items completed by patients in different scenarios was reported.

RESULTS

Of 480 participants, 60% were male with a mean age of 55 years. Based on PHQ-9, 19% of patients had moderate or severe depressive symptoms. Pre-screening with a PHQ-2 score ≥1 combined with a PROMIS-D score of ≥53 provided the best two-step results (sensitivity 0.81, specificity 0.84, NPV 0.95). Two-step screening also reduces question burden.

CONCLUSIONS

A two-step screening using a PHQ-2 score ≥1 followed by a PROMIS-D score ≥53 has good sensitivity and specificity for identifying potentially significant depressive symptoms among patients on kidney replacement therapies. This approach has lower question burden. Screened-in patients will need further clinical assessment to establish a diagnosis.

What are the Minimum Clinically Important Difference Values for the PROMIS and QuickDASH After Carpal Tunnel Release? A Prospective Cohort Study

BACKGROUND

To better define the clinical significance of patient-reported outcomes, the concept of a minimum clinically important difference (MCID) exists. The MCID is the minimum change that a patient will perceive as meaningful. Prior attempts to determine the MCID after carpal tunnel release are limited by methodologic concerns, including the lack of a true anchor-based MCID calculation.

QUESTIONS/PURPOSES

To address previous methodologic concerns in existing studies, as well as establish a clinically useful value for clinicians, we asked: What are the MCID values for the Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity (UE), PROMIS Pain Interference (PI), and the QuickDASH after carpal tunnel release?

METHODS

We conducted a prospective cohort study at an urban, Midwest, multihospital, academic health system. One hundred forty-seven adult patients undergoing unilateral carpal tunnel release between September 2020 and February 2022 were identified. PROMIS UE, PI, and QuickDASH scores were collected preoperatively and 3 months postoperatively. We also collected responses to an anchor-based question: "Since your treatment, how would you rate your overall function?" (much worse, worse, slightly worse, no change, slightly improved, improved, or much improved). Patients who did not respond to the 3-month postoperative surveys were excluded. A total of 122 patients were included in the final analysis (83% response proportion [122 of 147]). The mean age was 57 years (range 23 to 87 years), and 68% were women. The MCID was calculated using both anchor-based and distribution-based methods. Although anchor-based calculations are generally considered more clinically relevant because they consider patients' perceptions of improvement, an estimation of the minimum detectable change (which represents measurement error) relies on a distribution-based calculation. We determined a range of MCID values to propose a final MCID value for all three instruments. A negative MCID value for the PROMIS PI instrument represents a decrease in pain, whereas a positive value for the PROMIS UE instrument represents an improvement in function. A negative value for the QuickDASH instrument represents an increase in function.

RESULTS

The final proposed MCID values were 6.2 (interquartile range [IQR] 5.4 to 9.0) for the PROMIS UE, -7.8 (IQR -6.1 to -8.5) for the PROMIS PI, and -18.2 (IQR -13.3 to -34.1) for the QuickDASH.

CONCLUSION

We recommend that clinicians use the following values as the MCID after carpal tunnel release: 6 for the UE, -8 for the PI, and -18 for the QuickDASH. Surgeons may find these values useful when counseling patients postoperatively regarding improvement. Future studies could examine whether a single MCID (or small range) for PROMIS instruments is applicable to a variety of conditions and interventions.

LEVEL OF EVIDENCE

Level II, therapeutic study.

Psychometric properties and reference values of the Patient-Reported Outcomes Measurement Information System (PROMIS) sleep item banks in the Dutch general population

Psychometric properties of the v1.0 Patient-Reported Outcomes Measurement Information System (PROMIS®) sleep disturbance (27 items) and sleep-related impairment (SRI; 16 items) item banks, short forms derived from the item bank, and simulated computerised adaptive test (CAT), were assessed in a representative sample of 1,006 adults from the Dutch general population. For sleep disturbance all items fitted the item response theory model. Four items showed differential item functioning (i.e., lack of measurement invariance) for age and two for language but the impact on scores (expressed as T-scores) was small. Reliable scores (r > 0.90) were found for 92.2%-96.3% of respondents with the full bank, short forms with six and eight items, and CAT, but for only 25.6% with the four-item short form. For SRI two items did not fit the item response theory model. Four items showed differential item functioning for language but the impact on T-scores was small. Reliable scores were found for 82.1% with the full bank, for 47.8%-69.5% with short forms and CAT. T-scores of 49.7 and 49.3 represent the average score of the Dutch general population for sleep disturbance and SRI, respectively. In conclusion, sufficient structural validity, reliability, and cross-cultural validity was found for the full banks but short forms of four items are not reliable enough for clinical practice. For SRI we recommend the full item bank if this is the primary outcome.

Is Cardiorespiratory Fitness Independently Associated with Fatigue in Patients with Transient Ischemic Attack or Minor Stroke?

Fatigue is a common complaint and a disabling symptom among patients following transient ischemic attack (TIA) or minor stroke. In patients with stroke, decreased cardiorespiratory fitness (CRF) is believed to be related to increased severity of post-stroke fatigue (PSF). However, this association between PSF and CRF in patients with TIA or minor stroke has been less investigated, and currently there is no proven treatment for PSF. We aimed to determine the association between PSF and CRF in patients with TIA or minor stroke and to find out whether this association was distorted by confounders. A cross-sectional association study was conducted among a total of 119 patients with TIA or minor stroke. PSF was measured by the Fatigue Severity Scale (FSS) and CRF was quantified by maximal exercise capacity (V̇O2max). The FSS showed a significant association with V̇O2max (ß = −0.061, SE: 0.022; p = 0.007). This association was confounded by anxiety (ß = −0.044, SE: 0.020; p = 0.028) and depression (ß = −0.030, SE: 0.022; p = 0.177) as measured by the subscales of the Hospital Anxiety and Depression Scale (HADS). After controlling for HADS scores on depression and anxiety, the univariate relationship between V̇O2max and FSS was no longer significant. These results suggest that the association between PSF and CRF in patients with TIA or minor stroke is weak and significantly confounded by the factors of depression and anxiety.

German translation of the PROMIS® pediatric anxiety, anger, depressive symptoms, fatigue, pain interference and peer relationships item banks

BACKGROUND

The present study aimed at the translation and cross-cultural adaptation of six PROMIS^® pediatric self- and proxy- item banks and short forms to universal German: anxiety (ANX), anger (ANG), depressive symptoms (DEP), Fatigue (FAT), pain interference (P) and peer relationships (PR).

METHODS

Using standardized methodology approved by the PROMIS Statistical Center and in line with recommendations of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) PRO Translation Task Force, two translators for each German-speaking country (Germany, Austria, and Switzerland) commented on and rated the translation difficulty and provided forward translations, followed by a review and reconciliation phase. An independent translator performed back translations, which were reviewed and harmonized. The items were tested in cognitive interviews with 58 children and adolescents from Germany (16), Austria (22), and Switzerland (20) for the self-report and 42 parents and other caregivers (Germany (12), Austria (17), and Switzerland (13)) for the proxy-report.

RESULTS

Translators rated the translation difficulty of most items (95%) as easy or feasible. Pretesting showed that items of the universal German version were understood as they were intended, as only 14 out of 82 items of the self-report and 15 out of 82 items of the proxy-report versions required minor rewording. However, on average German translators rated the items more difficult to translate (M = 1.5, SD = 0.20) than the Austrian (M = 1.3, SD = 0.16) and the Swiss translators (M = 1.2, SD = 0.14) on a three-point Likert scale.

CONCLUSIONS

The translated German short forms are ready for use by researchers and clinicians ( https://www.healthmeasures.net/search-view-measures ).

Comparison of Patient-Reported Outcomes Measurement Information System Computerized Adaptive Testing Versus Fixed Short Forms in Juvenile Myositis

OBJECTIVE

Patient-Reported Outcomes Measurement Information System (PROMIS) measures can be administered via computerized adaptive testing (CAT) or fixed short forms (FSFs), but the empirical benefits of CAT versus FSFs are unknown in juvenile myositis (JM). The present study was undertaken to assess whether PROMIS CAT is feasible, precise, correlated with FSFs, and less prone to respondent burden and floor/ceiling effects than FSFs in JM.

METHODS

Patients 8-17 years of age (self-report and parent proxy) and parents of patients 5-7 years of age (only parent proxy) completed PROMIS fatigue, pain interference, upper extremity function, mobility, anxiety, and depressive symptoms measures. Pearson correlations, paired t-tests, and Cohen's d were calculated between PROMIS CAT and FSFs. McNemar's test assessed floor/ceiling effects between CAT and FSFs. Precision and respondent burden were examined across the T score range.

RESULTS

Data from 67 patient-parent dyads were analyzed. CAT and FSF mean scores did not significantly differ except in parent proxy anxiety and fatigue (effect size 0.23 and 0.19, respectively). CAT had less pronounced floor/ceiling effects at the less symptomatic extreme in all domains except self-report anxiety. Increased item burden and higher SEs were seen in less symptomatic scorers for CAT. Modified stopping rules limiting CAT item administration did not decrease precision.

CONCLUSION

PROMIS CAT appears to be feasible and correlated with FSFs. CAT had less pronounced floor/ceiling effects, allowing detection of individual differences in less symptomatic patients. Modified stopping rules for CAT may decrease respondent burden. CAT can be considered for long-term follow-up of JM patients.

Development of a set of patient reported outcome measures for patients with benign liver tumours and cysts: patient focus groups and systematic review

BACKGROUND

Patient reported outcome measures (PROMs) may be useful for patients with benign liver tumours and cysts (BLTC) to evaluate the impact of treatment and/or guide shared decision making. Yet, a set of PROMs relevant to patients with BLTC is currently unavailable. In this study, we selected a PROMs set for patients with BLTC.

METHODS

Potentially relevant patient reported outcomes (PROs) were selected by psychologist-researchers based on keywords used or suggested by participants of two virtual focus groups meetings consisting of thirteen female BLTC patients with a median age of 50 years. Subsequently, patients were asked to report their most relevant PROs. PROMs identified by systematic literature review and computerized adaptive tests (CATs) in the Patient-Reported Outcomes Measurement Information System (PROMIS) were considered in selecting the final PROMs set to assess relevant outcomes.

RESULTS

The most important PROs were: insecurity/anxiety (11/12 patients), pain (9/12 patients), fatigue (8/12 patients), and limitations in daily life (5/12 patients). The literature review included 23 studies, which used various generic and disease-specific PROMs, often not measuring (all) relevant PROs. The final selected PROMs set included numerical rating scales for pain, two questions on overall health and quality of life and four PROMIS CATs.

CONCLUSIONS

A PROMs set generically and efficiently measuring outcomes relevant for patients with BLTC was developed and may be used in future research and clinical practice.

Using percentiles in the interpretation of Patient-Reported Outcomes Measurement Information System scores: Guidelines for autism

The objectives of this study were to (1) demonstrate the application of percentiles to advance the interpretation of patient-reported outcomes and (2) establish autism-specific percentiles for four Patient-Reported Outcomes Measurement Information System (PROMIS) measures. PROMIS measures were completed by parents of autistic children and adolescents ages 5-17 years as part of two studies (n = 939 parents in the first study and n = 406 parents in the second study). Data from the first study were used to develop autism-specific percentiles for PROMIS parent-proxy sleep disturbance, sleep-related impairment, fatigue, and anxiety. Previously established United States general population percentiles were applied to interpret PROMIS scores in both studies. Results of logistic regression models showed that parent-reported material hardship was associated with scoring in the moderate-severe range (defined as ≥75th percentile in the general population) on all four PROMIS measures (odds ratios 1.7-2.2). In the second study, the percentage of children with severe scores (defined as ≥95th percentile in the general population) was 30% for anxiety, 25% for sleep disturbance, and 17% for sleep-related impairment, indicating a high burden of these problems among autistic children. Few children had scores at or above the autism-specific 95th percentile on these measures (3%-4%), indicating that their scores were similar to other autistic children. The general population and condition-specific percentiles provide two complementary reference points to aid interpretation of PROMIS scores, including corresponding severity categories that are comparable across different PROMIS measures.

Comparison of raw and regression approaches to capturing change on patient-reported outcome measures

PURPOSE

Patient-reported outcome (PRO) analyses often involve calculating raw change scores, but limitations of this approach are well documented. Regression estimators can incorporate information about measurement error and potential covariates, potentially improving change estimates. Yet, adoption of these regression-based change estimators is rare in clinical PRO research.

METHODS

Both simulated and PROMIS® pain interference items were used to calculate change employing three methods: raw change scores and regression estimators proposed by Lord and Novick (LN) and Cronbach and Furby (CF). In the simulated data, estimators' ability to recover true change was compared. Standard errors of measurement (SEM) and estimation (SEE) with associated 95% confidence limits were also used to identify criteria for significant improvement. These methods were then applied to real-world data from the PROMIS® study.

RESULTS

In the simulation, both regression estimators reduced variability compared to raw change scores by almost half. Compared to CF, the LN regression better recovered true simulated differences. Analysis of the PROMIS® data showed similar themes, and change score distributions from the regression estimators showed less dispersion. Using distribution-based approaches to calculate thresholds for significant within-patient change, smaller changes could be detected using both regression estimators.

CONCLUSIONS

These results suggest that calculating change using regression estimates may result in more increased measurement sensitivity. Using these scores in lieu of raw differences can help better identify individuals who experience real underlying change in PROs in the course of a trial, and enhance the established methods for identifying thresholds for meaningful within-patient change in PROs.

Likely change indexes improve estimates of individual change on patient-reported outcomes

PURPOSE

Individual change on a patient-reported outcome (PRO) measure can be assessed by statistical significance and meaningfulness to patients. We explored the relationship between these two criteria by varying the confidence levels of the coefficient of repeatability (CR) on the Patient-Reported Outcomes Measurement Information System (R) Physical Function (PF) 10a (PF10a) measure.

METHODS

In a sample of 1129 adult cancer patients, we estimated individual-change thresholds on the PF10a from baseline to 6 weeks later with the CR at 50%, 68%, and 95% confidence. We also assessed agreement with group- and individual-level thresholds from anchor-based methods [mean change and receiver operating characteristic (ROC) curve] using a PF-specific patient global impression of change (PGIC).

RESULTS

CRs at 50%, 68%, and 95% confidence were 3, 4, and 7 raw score points, respectively. The ROC- and mean-change-based thresholds for deterioration were -4 and -6; for improvement they were both 2. Kappas for agreement between anchor-based thresholds and CRs for deterioration ranged between κ = 0.65 and 1.00, while for improvement, they ranged between 0.35 and 0.83. Agreement between the PGIC and all CRs always fell below "good" (κ < 0.40) for deterioration (0.30-0.33) and were lower for improvement (0.16-0.28).

CONCLUSIONS

In comparison to the CR at 95% confidence, CRs at 50% and 68% confidence (considered likely change indexes) have the advantage of maximizing the proportion of patients appropriately classified as changed according to statistical significance and meaningfulness.

A Patient Reported Outcome Ontology: Conceptual Issues and Challenges Addressed by the Patient-Reported Outcomes Measurement Information System® (PROMIS®)

We briefly review the history of measuring perceptions of health and quality of life, followed by an examination of conceptual issues related to terminology that have led to potentially conflicting ontologies. Then, we discuss challenges posed by the lack of consensus on common meaning and the proliferation of measures. Next, we suggest a solution grounded in an ontology adopted by the National Institutes of Health (NIH) funded Patient-Reported Outcomes Measurement Information System (PROMIS) project. We conclude by discussing issues associated with mapping the PROMIS domain framework onto other familiar ontologies and recommend a way forward for PROMIS to provide a sustainable ontological structure to enable coherent common measurement.

Symptoms of depression and catastrophic thinking attenuate the relationship of pain intensity and magnitude of incapability with fracture severity

OBJECTIVE

The relative association of pain intensity and magnitude of incapability with pathophysiology, accounting for psychological factors, is incompletely understood. Using moderation analysis, we assessed the association of pain intensity and magnitude of incapability (dependent variables) with fracture severity (independent variable) and the influence of symptoms of depression and catastrophic thinking (moderators) at early and later stages of recovery.

METHODS

A cohort of 731 patients recovering from a shoulder, elbow, or wrist fracture, completed self-reported measures of pain intensity, upper extremity capability, symptoms of depression, and catastrophic thinking between 2 and 4 weeks after injury and again between 6 and 9 months after injury. Fracture severity was rated by clinicians, and we used multivariable regression analysis to examine interaction effects of fracture severity, depression, catastrophic thinking, pain intensity, and magnitude of incapability at early and later stages of recovery.

RESULTS

Symptoms of depression and catastrophic thinking attenuate the relationship between pain intensity and fracture severity at earlier and later stages of recovery. Symptoms of depression and catastrophic thinking also attenuate the relationship between the magnitude of incapability and fracture severity, but only at early stages of recovery.

CONCLUSION

The relative divergence of pain intensity and magnitude of incapability from the level of fracture severity due to the moderating effects of unhelpful thinking and distress, signals a benefit to anticipating mental health opportunities during recovery after fracture. Fracture management can incorporate measures of unhelpful thinking and symptoms of distress to better address these opportunities and ensure comprehensive optimization of recovery.

LEVEL OF EVIDENCE

Level IIc, prognostic.

Measurement properties of the Dutch PROMIS-29 v2.1 profile in people with and without chronic conditions

PURPOSE

To investigate the structural validity, internal consistency, measurement invariance, and construct validity of the Dutch PROMIS-29 v2.1 profile, including seven physical (e.g., pain, physical function), mental (e.g., depression, anxiety), and social (e.g., role functioning) domains of health, in a Dutch general population sample including subsamples with and without chronic diseases.

METHODS

The PROMIS-29 was completed by 63,602 participants from the Lifelines cohort study. Structural validity of the PROMIS-29, including unidimensionality of each domain and the physical and mental health summary scores, was evaluated using factor analyses (criteria: CFI ≥ 0.95, TLI ≥ 0.95, RMSEA ≤ 0.06, SRMR ≤ 0.08). Internal consistency, measurement invariance (no differential item functioning (DIF) for age, gender, administration mode, educational level, ethnicity, chronic diseases), and construct validity (hypotheses on known-groups validity and correlations between domains) were assessed per domain.

RESULTS

The factor structure of the seven domains was supported (CFI = 0.994, TLI = 0.993, RMSEA = 0.046, SRMR = 0.031) as was unidimensionality of each domain, both in the entire sample and the subsamples. Model fit of the physical and mental health summary scores reached the criteria, and scoring coefficients were obtained. Cronbach's alpha for the seven PROMIS-29 domains ranged from 0.75 to 0.96 in the complete sample. No DIF was detected. Of the predefined hypotheses, 78% could be confirmed.

CONCLUSION

Sufficient structural validity, internal consistency and measurement invariance were found, both in the entire sample and in subsamples with and without chronic diseases. Requirements for sufficient evidence for construct validity were (almost) met for most subscales. Future studies should investigate test-retest reliability, measurement error, and responsiveness of the PROMIS-29.

Can Patient-Reported Outcome Measurement Information System Measures Differentiate Patients Who Will Undergo Hip and Knee Total Joint Arthroplasty: A Retrospective Case-Control Study

BACKGROUND

The Patient-Reported Outcome Measurement Information System (PROMIS) can be used to monitor patients in population-health-based programs. However, it is unknown which measures are most appropriate to differentiate patients who will undergo hip or knee total joint arthroplasty (TJA) in a cohort of patients with osteoarthritis.

METHODS

A retrospective cohort of new patients consulting for treatment from November 17, 2017 to April 20, 2020 (cases: hip: n = 157, knee: n = 112; randomly selected nonsurgical controls: hip: n = 314, knee: n = 224) was extracted from the electronic health record. We recorded demographics, comorbidity, and PROMIS scores for 8 domains (physical function, pain interference, pain intensity, anxiety, depression, sleep disturbance, ability to participate in social roles and activities, and fatigue). We performed descriptive statistics to characterize the cohorts and baseline PROMIS scores and conducted logistic regression models to determine which PROMIS domains differentiated patients undergoing hip and knee TJA.

RESULTS

In univariate comparisons of PROMIS domains, the hip and knee surgical cohorts differed from controls in physical function (P < .01), pain interference (P < .01), and ability to participate in social roles and activities (P < .02). In logistic regression models informed by univariate analyses, PROMIS physical function was the only PROMIS measure to differentiate undergoing surgery in both hip and knee cohorts (P < .01).

CONCLUSION

PROMIS physical function can differentiate TJA cases from nonsurgical controls in both hip and knee patients. These findings have implications for considering which PROMIS measures to administer in patients with hip and knee osteoarthritis.

Bringing PROMIS to Early Childhood: Introduction and Qualitative Methods for the Development of Early Childhood Parent Report Instruments

OBJECTIVE

Provide an overview of the Patient-Reported Outcomes Measurement Information System (PROMIS®) Early Childhood Parent Report measurement development project and describe its qualitative methods.

METHODS

The PROMIS Early Childhood (PROMIS EC) initiative used the PROMIS mixed-methods approach to patient-reported outcome development, with insight from the developmental specification framework to create parent report measures appropriate for assessing young children's health-related quality of life. Qualitative methods to develop these instruments included expert input, literature and measure review, and parent concept elicitation and cognitive interviews to confirm the measure frameworks, item understandability, and developmental appropriateness.

RESULTS

Twelve measures resulted from the PROMIS EC initiative. These parent report instruments cover young children's physical, mental, and social health.

CONCLUSIONS

The new PROMIS EC Parent Report instruments offer clinicians and researchers brief and psychometrically robust tools to evaluate young children's physical, mental, and social health outcomes. Aligned with the PROMIS Pediatric instruments, the early childhood versions enable coherent lifespan measurement starting at age 1 while maintaining developmental sensitivity.

The CLASS Study (Circadian Light in Adolescence, Sleep and School): protocol for a prospective, longitudinal cohort to assess sleep, light, circadian timing and academic performance in adolescence

BACKGROUND

During adolescence, sleep and circadian timing shift later, contributing to restricted sleep duration and irregular sleep-wake patterns. The association of these developmental changes in sleep and circadian timing with cognitive functioning, and consequently academic outcomes, has not been examined prospectively. The role of ambient light exposure in these developmental changes is also not well understood. Here, we describe the protocol for the Circadian Light in Adolescence, Sleep and School (CLASS) Study that will use a longitudinal design to examine the associations of sleep-wake timing, circadian timing and light exposure with academic performance and sleepiness during a critical stage of development. We also describe protocol adaptations to enable remote data collection when required during the COVID-19 pandemic.

METHODS

Approximately 220 healthy adolescents aged 12-13 years (school Year 7) will be recruited from the general community in Melbourne, Australia. Participants will be monitored at five 6 monthly time points over 2 years. Sleep and light exposure will be assessed for 2 weeks during the school term, every 6 months, along with self-report questionnaires of daytime sleepiness. Circadian phase will be measured via dim light melatonin onset once each year. Academic performance will be measured via national standardised testing (National Assessment Program-Literacy and Numeracy) and the Wechsler Individual Achievement Test-Australian and New Zealand Standardised Third Edition in school Years 7 and 9. Secondary outcomes, including symptoms of depression, anxiety and sleep disorders, will be measured via questionnaires.

DISCUSSION

The CLASS Study will enable a comprehensive longitudinal assessment of changes in sleep-wake timing, circadian phase, light exposure and academic performance across a key developmental stage in adolescence. Findings may inform policies and intervention strategies for secondary school-aged adolescents.

ETHICS AND DISSEMINATION

Ethical approval was obtained by the Monash University Human Research Ethics Committee and the Victorian Department of Education. Dissemination plans include scientific publications, scientific conferences, via stakeholders including schools and media.

STUDY DATES

Recruitment occurred between October 2019 and September 2021, data collection from 2019 to 2023.

The promise of computer adaptive testing in collection of orthopaedic outcomes: an evaluation of PROMIS utilization

Background

A crucial component to improving patient care is better clinician understanding of patients’ health-related quality of life (HRQoL). In orthopaedic surgery, HRQoL assessment instruments such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), provide surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s HRQoL. PROMIS has been demonstrated as a valuable instrument in many diseases; however, the extent to which orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research is unclear.

Methods

Systematic scoping methodology was used to investigate the characteristics of studies using PROMIS to assess HRQoL measures as orthopaedic surgical outcomes as well as studies validating computerized adaptive test (CAT) PROMIS physical health (PH) domains including: Physical Function (PF), Upper Extremity (UE), Lower Extremity (LE).

Results

A systematic search of PubMed identified 391 publications utilizing PROMIS in orthopaedics; 153 (39%) were PROMIS PH CAT validation publications. One-hundred publications were in Hand and Upper Extremity, 69 in Spine, 44 in Adult Reconstruction, 43 in Foot and Ankle, 43 in Sports, 37 in Trauma, 31 in General orthopaedics, and 24 in Tumor. From 2011 through 2020 there was an upward trend in orthopaedic PROMIS publications each year (range, 1–153) and an increase in studies investigating or utilizing PROMIS PH CAT domains (range, 1–105). Eighty-five percent (n = 130) of orthopaedic surgery PROMIS PH CAT validation publications (n = 153) analyzed PF; 30% (n = 46) analyzed UE; 3% (n = 4) analyzed LE.

Conclusions

PROMIS utilization within orthopaedics as a whole has significantly increased within the past decade, particularly within PROMIS CAT domains. The existing literature reviewed in this scoping study demonstrates that PROMIS PH CAT domains (PF, UE, and LE) are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. The expanded use of PROMIS CATs in orthopaedic surgery highlights the potential for improved quality of patient care. While challenges of integrating PROMIS into electronic medical records exist, expanded use of PROMIS CAT measurement instruments throughout orthopaedic surgery should be performed.

Plain english summary In orthopaedic surgery, health-related quality of life tools such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), offer patients an opportunity to better understand their medical condition and be involved in their own care. Additionally, PROMIS provides surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s functional status and quality of life. The efficacy of PROMIS has been demonstrated in many diseases; however, its application throughout orthopaedic care has yet to be depicted. This study sought to identify the extent to which all orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research in order to identify its potential as an applicable and valuable tool across specialties. We determined that PROMIS utilization has significantly increased within the past decade. The existing literature reviewed in this scoping study demonstrates that the PROMIS computerized adaptive test domains evaluating physical function status are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. Based on these results, this study recommends the expanded and more uniform use of PROMIS computerized adaptive test measurement instruments in the clinical care of orthopaedic patients.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-021-00407-w.

Use of the PROMIS Mobility score in assessing function in adolescents and adults previously affected by childhood hip disease

Aims

The Patient-Reported Outcomes Measurement Information System (PROMIS) has demonstrated faster administration, lower burden of data capture and reduced floor and ceiling effects compared to traditional Patient Reported Outcomes Measurements (PROMs). We investigated the suitability of PROMIS Mobility score in assessing physical function in the sequelae of childhood hip disease.

Methods

In all, 266 adolscents (aged ≥ 12 years) and adults were identified with a prior diagnosis of childhood hip disease (either Perthes’ disease (n = 232 (87.2%)) or Slipped Capital Femoral Epiphysis (n = 34 (12.8%)) with a mean age of 27.73 years (SD 12.24). Participants completed the PROMIS Mobility Computer Adaptive Test, the Non-Arthritic Hip Score (NAHS), EuroQol five-dimension five-level questionnaire, and the Numeric Pain Rating Scale. We investigated the correlation between the PROMIS Mobility and other tools to assess use in this population and any clustering of outcome scores.

Results

There was a strong correlation between the PROMIS Mobility and other established PROMs; NAHS (r_s = 0.79; p < 0.001). There was notable clustering in PROMIS at the upper end of the distribution score (42.5%), with less seen in the NAHS (20.3%). However, the clustering was broadly similar between PROMIS Mobility and the comparable domains of the NAHS; function (53.6%), and activity (35.0%).

Conclusion

PROMIS Mobility strongly correlated with other tools demonstrating convergent construct validity. There was clustering of physical function scores at the upper end of the distributions, which may reflect truncation of the data caused by participants having excellent outcomes. There were elements of disease not captured within PROMIS Mobility alone, and difficulties in differentiating those with the highest levels of function.

Cite this article: Bone Jt Open 2021;2(12):1089–1095.

Pet Ownership and Multiple Sclerosis during COVID-19

Background: Multiple sclerosis (MS) is associated with lower quality of life, reduced social participation, and decreased self-efficacy. The COVID-19 pandemic has had documented effects on the health and wellbeing of people with and without MS. Previous research has demonstrated the positive impact pets can have for people living with long-term conditions. Objectives: To explore the rates of pet ownership and pet attachment in people living with MS and pet ownership associations with quality of life, satisfaction with social roles, and self-efficacy scores; and to explore the effects of the COVID-19 outbreak on people’s perceived relationships with their pets. Materials and Methods: A postal questionnaire was distributed to members of a local MS Register and a control group of people without MS. The questionnaire assessed quality of life, satisfaction with social roles, self-efficacy, the perceived roles of pets, and pet-related concerns experienced during the COVID-19 pandemic. Results: No apparent difference in attachment to pets was found between the patient and control groups. Pet ownership and level of attachment were not associated with differences in quality of life or self-efficacy scores in people living with MS. Using multiple regression analysis, pet ownership was associated with a decrease in satisfaction with participation in social roles, but with the estimated effect being small compared to having a diagnosis of MS or being unemployed. Most participants reported that pets had positive roles during the pandemic, and the most reported pet-related concern was access to veterinary treatment. Conclusion: Pet owners both with and without MS reported subjective benefits to their wellbeing from pet ownership during COVID-19, although analysis suggested that pet ownership was associated with a reduction in satisfaction with social roles. The study had several limitations and suggestions are made for future work.

Time to Complete Legacy Patient-Reported Outcome Measures in Patients with Lumbar Decompression

INTRODUCTION

Patient-reported outcome measures (PROMs) are used to capture the true extent of postoperative improvement. Use of lengthier and repetitive PROMs can increase question burden on patients. This study aims to determine whether the length of time to complete (TTC) legacy PROMs has an impact on scores after lumbar decompression.

METHODS

A surgical database was retrospectively reviewed for patients who underwent primary, single-level lumbar decompression from 2013 to 2020. Demographic and perioperative characteristics were collected. Physical function (PF) was measured by 12-Item Short Form (SF-12), 12-Item Veterans RAND (VR-12), and Patient-Reported Outcomes Measurement Information System (PROMIS) and was collected preoperatively and postoperatively. TTC was calculated as the difference between start and ending times for each instance of survey completion. Improvements for PROMs and comparison of TTC between SF-12/VR-12 and PROMIS PF were evaluated using a t-test. Correlation between TTC and PROM scores was evaluated using the Pearson correlation. Impact of TTC on postoperative PROM scores was evaluated using linear regression.

RESULTS

A total of 216 patients, of which 68.1% were men, were included with a mean age of 45.8 years. Mean postoperative TTC for SF-12 and VR-12 was significantly longer than preoperative values (all P < 0.05). No notable difference in TTC was demonstrated for PROMIS PF. TTC PROMIS PF was significantly shorter than SF-12 and VR-12 from 12 weeks through 1 year (all P < 0.050). A low-strength negative correlation of TTC with SF-12 and VR-12 was observed at the preoperative, 6-week and 1-year timepoint whereas PROMIS PF had a low-strength positive correlation with TTC preoperatively and at 6 months (all P > 0.05).

CONCLUSION

Time spent completing PROMIS PF did not markedly differ postoperatively, but SF-12 and VR-12 required a longer TTC than PROMIS PF. Although insightful to patient improvement, SF-12 and VR-12 may increase the question burden placed on patients to complete surveys in a timely manner.

Linking AM-PAC Cognition to PROMIS Cognitive Function

OBJECTIVE

To link the Activity Measure for Post-Acute Care (AM-PAC) Applied Cognition to the Patient-Reported Outcomes Measurement Information System (PROMIS) Cognitive Function, allowing for a common metric across scales.

DESIGN

Cross-sectional survey study.

SETTING

Outpatient rehabilitation clinics.

PARTICIPANTS

Consecutive sample of 500 participants (N=500) aged ≥18 years presenting for outpatient therapy (physical, occupation, speech).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

AM-PAC Medicare and Generic Cognition short forms and PROMIS Cognitive Function items representing the PROMIS Cognitive Function item bank.

RESULTS

The calibration of 25 AM-PAC cognition items with 11 fixed PROMIS cognitive function item parameters using item-response theory indicated that items were measuring the same underlying construct (cognition). Both scales measured a wide range of functioning. The AM-PAC Generic Cognitive assessment showed more reliability with lower levels of cognition, whereas the PROMIS Cognitive Function full-item bank was more reliable across a larger distribution of scores. Data were appropriate for a fixed-anchor item response theory-based crosswalk and AM-PAC Cognition raw scores were mapped onto the PROMIS metric.

CONCLUSIONS

The crosswalk developed in this study allows for converting scores from the AM-PAC Applied Cognition to the PROMIS Cognitive Function scale.

Use of Patient-Reported Outcomes Measurement Information System (PROMIS) measures to characterise health status for patients seeking care from an orthopaedic provider: a retrospective cohort study

OBJECTIVES

Characterise the health status of patients newly consulting an orthopaedic specialist across eight clinical subspecialties.

DESIGN

Retrospective cohort.

SETTING

18 orthopaedic clinics, including 8 subspecialties (14 ambulatory and 4 hospital based) within an academic health system.

PARTICIPANTS

14 910 patients consulting an orthopaedic specialist for a new patient consultation who completed baseline Patient-Reported Outcomes Measurement Information System (PROMIS) measures associated with their appointment from 17 November 2017 to 13 May 2019. Patients were aged 55.72±5.8 years old, and 61.3% were female and 79.3% were Caucasian and 13.4% were black or African American. Patients who did not complete PROMIS measures or cancelled their appointment were excluded from the study.

PRIMARY OUTCOME

PROMIS domains of physical function, pain interference, pain intensity, depression, anxiety, fatigue, sleep disturbance and the ability to participate in social roles.

RESULTS

Mean PROMIS scores for physical function were (38.1±9.2), pain interference (58.9±8.1), pain intensity (4.6±2.5), depression (47.9±8.9), anxiety (49.9±9.5), fatigue (50.5±10.3), sleep disturbance (51.1±9.8) and ability to participate in social roles (49.1±10.3) for the entire cohort. Across the clinical subspecialties, neurosurgery, spine and trauma patients were most profoundly affected across almost all domains and patients consulting with a hand specialist reported the least limitations or symptoms across domains. There was a moderate, negative correlation between pain interference and physical functioning (r=-0.59) and low correlations between pain interference with anxiety (r=0.36), depression (r=0.39) as well as physical function and anxiety (r=-0.32) and depression(r=-0.30) and sleep (r=-0.31).

CONCLUSIONS

We directly compared clinically meaningful PROMIS domains across eight orthopaedic subspecialties, which would not have been possible with legacy measures alone. These results support PROMIS's utility as a common metric to assess and compare patient health status across multiple orthopaedic subspecialties.

Linking Scores with Patient-Reported Health Outcome Instruments:A VALIDATION STUDY AND COMPARISON OF THREE LINKING METHODS

The psychometric process used to establish a relationship between the scores of two (or more) instruments is generically referred to as linking. When two instruments with the same content and statistical test specifications are linked, these instruments are said to be equated. Linking and equating procedures have long been used for practical benefit in educational testing. In recent years, health outcome researchers have increasingly applied linking techniques to patient-reported outcome (PRO) data. However, these applications have some noteworthy purposes and associated methodological questions. Purposes for linking health outcomes include the harmonization of data across studies or settings (enabling increased power in hypothesis testing), the aggregation of summed score data by means of score crosswalk tables, and score conversion in clinical settings where new instruments are introduced, but an interpretable connection to historical data is needed. When two PRO instruments are linked, assumptions for equating are typically not met and the extent to which those assumptions are violated becomes a decision point around how (and whether) to proceed with linking. We demonstrate multiple linking procedures-equipercentile, unidimensional IRT calibration, and calibrated projection-with the Patient-Reported Outcomes Measurement Information System Depression bank and the Patient Health Questionnaire-9. We validate this link across two samples and simulate different instrument correlation levels to provide guidance around which linking method is preferred. Finally, we discuss some remaining issues and directions for psychometric research in linking PRO instruments.

Implications for research and clinical use from a Rasch analysis of the HOOS-12 and KOOS-12 instruments

OBJECTIVE

To evaluate the structural validity of the 12-item Hip disability and Osteoarthritis Outcome Score (HOOS-12) and 12-item Knee injury and Osteoarthritis Outcome Score (KOOS-12) using Rasch analysis and consider psychometric implications for research and clinical use.

METHOD

Individual-level HOOS-12 and KOOS-12 data from the Australian Orthopaedic Association National Joint Replacement Registry, collected before and after primary total hip and knee replacement, were used for this analysis. Using the Rasch analytic approach, overall model fit and item fit were examined, together with potential reasons for misfit including response threshold ordering, differential item functioning, internal consistency, unidimensionality and item targeting.

RESULTS

Overall misfit to the Rasch model was evident for both instruments. A degree of item misfit was also observed, although most items demonstrated logical sequencing of response options. Only two items (hip/knee pain frequency and awareness of hip/knee problems) displayed disordered response thresholds. The pain, function, and quality of life domains of the HOOS-12 and KOOS-12 demonstrated excellent internal consistency reliability (person separation index: 0.80-0.93) and unidimensionality. A mismatch between item difficulty and person ability scores at the highest end of the HOOS-12 and KOOS-12 scales contributed to post-operative ceiling effects (mean logit for HOOS-12: 3.57; KOOS-12: 2.58; ≈0 indicates well-targeted scale).

CONCLUSION

We found evidence to support the structural validity of the three HOOS-12 and KOOS-12 domains for evaluating joint replacement outcomes. However, there may be missing content in both instruments particularly for high-functioning patients. Minor refinement of some response options may be warranted to improve item performance.

Measurement properties of the 12-item Short Form Health Survey version 2 in Australians with lung cancer: a Rasch analysis

Background

The 12-item Short-Form Health Survey version 2 (SF-12v2), a widely used, generic patient-reported measure of health status that provides summary scores of physical and mental health. No study to date has examined the measurement properties of the SF-12v2 in patients with lung cancer using Rasch analysis. The aim of this study was to extend the psychometric evaluations of the SF-12 within the lung cancer population to ensure its validity and reliability to assess the health status in this population.

Methods

Participants in the Victorian Lung Cancer Registry (VLCR) who completed the SF-12v2 between 2012 and 2016 were included in this study. The structural validity of the SF-12v2 was assessed using Rasch analysis. Overall fit to the Rasch measurement model was examined as well as five key measurement properties: uni-dimensionality, response thresholds, internal consistency, measurement invariance and targeting.

Results

A total of 342 participants completed the SF-12v2 three months following their lung cancer diagnosis. The SF-12 Physical Component Score (PCS-12) did not fit the overall Rasch measurement model (χ² 107.0; p < 0.001). Three items deviated significantly from the Rasch model (item fit residual beyond ± 2.5) with signs of dependency between item responses and disordered thresholds. Nevertheless, the PCS-12 was uni-dimensional with good internal consistency (person separation index [PSI] 0.83) and reasonable targeting. In contrast, the SF-12 Mental Component Score (MCS-12) had good overall model fit (χ² 35.1; p = 0.07), reasonable targeting and good internal consistency (PSI 0.81).

Conclusions

Rasch analysis suggests that there is general support for the reliability of the SF-12v2 as a measure of physical and mental health in people with lung cancer. However, the appropriateness of some items (e.g. pain) in the PCS-12 is questionable and further refinement of the scale including changing the response options may be required to improve the ability of the SF-12v2 to more appropriately assess the health status of this population.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12955-021-01794-w.

Measurement properties of PROMIS short forms for pain and function in total hip arthroplasty patients

Introduction

While the Patient-Reported Outcomes Measurement Information System (PROMIS) is mainly designed for computer adaptive testing, its static short forms (SF) are used when a paper-pencil format is preferred or item banks are not yet translated into the target language. This study examined the measurement properties of the German PROMIS-SF for pain intensity (PAIN), pain interference (PI) and physical function (PF) in total hip arthroplasty (THA) patients.

Methods

SF were collected before and 12 months post-surgery. Higher scores indicate more PAIN, higher PI and better PF. Oxford Hip Score (OHS) was the main reference measure. Six months post-surgery, a subsample completed the SF twice within 14 days to test reliability.

Results

Of 172 eligible patients, 147 consented to participate and received questionnaires; 132 (74 males) returned baseline questionnaires (mean age 65.8 ± 10.2 years) and 116, 12-month questionnaires. Forty-five patients provided test-retest data.

Correlations of all SF with OHS were large (│r│ ≥ 0.7; confidence intervals did not include 0.50). Cronbach’s alpha values were: PAIN, 0.86; PI, 0.93; PF, 0.91. Intraclass correlation coefficients were: PAIN, 0.77; PI, 0.81; PF, 0.69. Standard errors of measurement were: PAIN, 3.8; PI, 2.8; PF, 3.6. Smallest detectable change thresholds were: PAIN, 8.8; PI, 6.6; PF, 8.4. Follow-up data showed a ceiling effect (best score) for PAIN (66%), PI (76%), and PF (66%). SF change scores showed large correlations with OHS change scores (│r│ > 0.6).

Conclusion

Our results provide some evidence of construct validity, and acceptable reliability and responsiveness of PROMIS-SF for pain and function in THA patients. These SF can thus be considered acceptable for use, although patients’ improvement in physical function might be underestimated due to the large follow-up PF score ceiling effects.

Measurement qualities of PROMIS instruments are mainly assessed for computer adaptive testing but not for non-adaptive short questionnaires. As these questionnaires are in use, their measurement properties must also be evaluated. Results from computer adaptive testing cannot simply be transferred.

We studied the measurement qualities of the German PROMIS short questionnaires for pain intensity, pain interference and physical function in patients undergoing hip replacement. We wanted to see how these questionnaires perform when compared to the Oxford Hip Score, a standard questionnaire commonly used to test hip-related disability in these patients.

The three questionnaires can be considered acceptable for use in hip replacement patients, but some limitations do exist. Patient improvement in physical function might be underestimated because many patients reach the highest possible score and further improvements cannot be measured. Also, any small but important improvement in physical function cannot be distinguished from measurement error in individual patients.

Utility of patient-reported outcomes measurement information system (PROMIS) physical function form in inflammatory myopathy

OBJECTIVE

Idiopathic inflammatory myopathies (IIM) are a group of diseases characterized by muscle weakness, which limit activities of daily living. Patient Reported Outcomes Measurement Information System (PROMIS) is a set of outcome measures developed using NIH funding, but has not yet been studied in adult IIM. Currently, the most commonly used PROs in IIM are Health Assessment Questionnaire (HAQ-DI) and SF-36 physical function-10 (PF10), both of which have several limitations. In this study, we investigated psychometric properties of PROMIS physical function-20 (PF-20) and compared to HAQ-DI and SF-36 PF10.

METHODS

Patients with IIM completed PROMIS PF-20 and six myositis core set measures [manual muscle testing (MMT), physician (MD-GDA), patient (PT-GDA) and extra-muscular global disease activity, HAQ-DI and creatine kinase], SF-36 PF10 and functional tests [six-minute walk, timed up-and-go and sit-to-stand tests] at monthly visits over 6-months. Total improvement score (TIS) using 2016 ACR/EULAR myositis response criteria was obtained as measures of change.

RESULTS

Fifty patients [mean age, 51.6; 60% females] were enrolled; 6 PM, 24 DM, 9 NM and 11 with AS. PROMIS PF-20 showed strong test-retest reliability when repeated in 1-month. PROMIS PF-20 had moderate-strong correlations with MD-GDA, PT-GDA, MMT, HAQ-DI, SF-36 PF10, and functional tests indicating good convergent validity. Change in PROMIS PF-20 strongly correlated with TIS demonstrating good responsiveness. HAQ-DI and SF-36 PF10 exhibited similar validity and responsiveness; HAQ-DI was found to have a ceiling effect.

CONCLUSION

PROMIS PF-20 demonstrates favorable psychometric properties in a large cohort of myositis patients and offers distinct advantages.

The factor structure and subscale properties of the pain catastrophizing scale: are there differences in the distinctions?

As presently constructed, the pain catastrophizing failed to discriminate effectively among levels of rumination, magnification, and helplessness in a sample of patients with chronic pain.

Increasingly, studies have documented the negative impact of pain catastrophizing on health outcomes. The Pain Catastrophizing Scale (PCS) has been the measure of choice for many of these studies. The PCS provides 3 subscales for measuring pain catastrophizing: rumination, magnification, and helplessness. Factor analytic investigations of these factors have been limited by the sample size and relevance, and results have been inconsistent. No study has directly estimated the added value of subscale scoring of the PCS compared with scoring it as a single measure.

Linking AM-PAC Mobility and Daily Activity to the PROMIS Physical Function Metric

OBJECTIVE

The purpose of this study was to link Activity Measure for Post-Acute Care (AM-PAC) Mobility and Daily Activity scales to the PROMIS Physical Function (PF) allowing for a common metric across scales.

METHODS

Cross-sectional study of patients 18 years and older presenting to 1 of 8 outpatient rehabilitation clinics in southwestern Pennsylvania. Patients completed one survey with questions from the AM-PAC Daily Activity and Mobility short forms, and the PROMIS PF item bank. Using item response theory, 2 rounds of fixed-parameter calibration were performed. In the first, the AM-PAC Daily Activity and Mobility items were calibrated with 27 fixed item parameters from the PROMIS PF. Second, the AM-PAC Daily Activity items were calibrated with 11 PROMIS Upper Extremity fixed item parameters. This process uses the construct of physical function and equates AM-PAC items on the same underlying measurement scale for the PROMIS PF.

RESULTS

Both scales measured a wide range of functioning and demonstrated good calibration. Data were appropriate for a fixed-parameter item response theory-based crosswalk. AM-PAC Daily Activity and Mobility raw scores were mapped onto the PROMIS PF metric. AM-PAC Daily Activity scores were also mapped onto the PROMIS PF Upper Extremity metric.

CONCLUSION

Question items from the AM-PAC Daily Activity, AM-PAC Mobility, and PROMIS PF similarly measure the construct of physical function. This consistency allows for a crosswalk of AM-PAC scores onto the PROMIS PF metric.

IMPACT

Crosswalk tables developed in this study allow for converting scores from the AM-PAC Daily Activity and Mobility scales to the PROMIS PF metric. This will facilitate monitoring of longitudinal change in function over time and across settings.