Country-specific reference values for PROMIS® pain, physical function and participation measures compared to US reference values

Extending the PROMIS item bank "ability to participate in social roles and activities": a psychometric evaluation using IRT

OBJECTIVE

Our objective was to explore whether the extension of the PROMIS item bank Ability to Participate in Social Roles and Activities (APSRA) with new items would result in more effective targeting (i.e., selecting items that are appropriate for each individual's trait level), and more reliable measurements across all latent trait levels.

METHODS

A sample of 1,022 Dutch adults completed all 35 items of the original item bank plus 17 new items (in Dutch). The new items presented in this publication have been translated provisionally from Dutch into English for presentation purposes. We evaluated the basic IRT assumptions unidimensionality, local independence, and monotonicity. Furthermore, we examined the item parameters, and assessed differential item functioning (DIF) for sex, education, region, age, and ethnicity. In addition, we compared the test information functions, item parameters, and θ scores, for the original and extended item bank in order to assess whether the measurement range had improved.

RESULTS

We found that the extended item bank was compatible with the basic IRT assumptions and showed good reliability. Moreover, the extended item bank improved the measurement in the lower trait range, which is important for reliably assessing functioning in clinical populations (i.e., persons reporting lower levels of participation).

CONCLUSION

We extended the PROMIS-APSRA item bank and improved its psychometric quality. Our study contributes to PROMIS measurement innovation, which allows for the addition of new items to existing item banks, without changing the interpretation of the scores and while maintaining the comparability of the scores with other PROMIS instruments.

Enhancing the Evaluation of Physical Function Following Orthopaedic Trauma Care: Comparison of PROMIS Computerized Adaptive Testing and Short Musculoskeletal Function Assessment

OBJECTIVES

To compare measurement properties of Patient-Reported Outcomes Measurement Information System (PROMIS) (physical function [PF] and pain interference [PI]) computerized adaptive testing to traditional Short Musculoskeletal Function Assessment (SMFA) (dysfunction index [DI] and bother index [BI]). To explore factors associated with PROMIS scores.

METHODS

DESIGN

Cross-sectional study.

SETTING

Level I Trauma Center.

PATIENT SELECTION CRITERIA

Isolated upper/lower extremity fracture patients were recruited from the orthopaedic trauma outpatient clinic (October 1, 2021 to January 1, 2023).

OUTCOME MEASURES

Correlations (Pearson), reliability (standard error [SE] [T score]), efficiency (amount of information per item [1 - SE2/Nitems]), and floor/ceiling effects were assessed. An r > 0.7 represented high correlation, and SE ≤ 2.2 represented sufficient reliability. Factors associated with worse PROMIS scores were also identified.

RESULTS

In total, 202 patients completed PROMs at median 98 days follow-up. Correlations between PROMIS-PF and SMFA-DI, and PROMIS-PI and SMFA-BI were -0.84 and 0.65. Reliability was very high for both instruments (mean SE 2.0 [PROMIS-PF], SE 2.1 [PROMIS-PI], and SE 1.2 [SMFA-DI], SE 1.8 [SMFA-BI]). Relative efficiency for PROMIS-PF versus SMFA-DI, and PROMIS-PI versus SMFA-BI was 7.8 (SD 2.5) and 4.1 (SD 1.7), respectively. Neither PROMIS nor SMFA exhibited floor/ceiling effects. In the multivariable regression analyses, elevated levels of depression, among other factors, showed an (independent) association with worse PROMIS-PF and PROMIS-PI scores.

CONCLUSIONS

PROMIS-PF and PROMIS-PI CATs showed a (high and moderate) correlation with SMFA and hence measure a comparable construct of physical function and discomfort. As computerized adaptive tests are much more efficient to administer, they present a compelling alternative to SMFA for evaluating impact of fracture treatment. The relation between symptoms of depression and PROMIS scores emphasizes the importance of psychosocial aspects of health in orthopaedic trauma patients.

LEVEL OF EVIDENCE

Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence.

Psychometrics of patient-reported outcomes measurement information system in von Willebrand disease, inherited platelet function disorders, and rare bleeding disorders

Background

Patient-reported outcomes measurement information system (PROMIS) measures can be used to measure patient-reported outcomes. PROMIS measures, including computer adaptive tests (CATs) and short forms, have demonstrated the ability to adequately assess outcomes in patients with hemophilia. It is, however, unclear if PROMIS measures are suitable for patients with von Willebrand disease (VWD), inherited platelet function disorders (IPFDs), and rare bleeding disorders (RBDs).

Objectives

To evaluate the feasibility, measurement properties, and relevance of PROMIS measures in adults with VWD, IPFDs, and RBDs.

Methods

In this cross-sectional multicenter study, adults with VWD, IPFDs, and RBDs completed 9 PROMIS measures and the Short Form-36 version 2 (SF-36v2) electronically. Feasibility was determined by the number of completed items and floor/ceiling effects. Measurement properties included construct validity based on a multitrait-multimethod analysis and reliability using the reliability coefficient and greatest lower bound. Relevance was evaluated based on comparison with the Dutch general population.

Results

In total, 111 patients (median age, 57 years [IQR, 44-67]; 60% VWD, 16% IPFD, 24% RBD) participated. Mean number of items answered varied from 5.3 to 8.7 (range, 4-12) per PROMIS CAT in patients with VWD. Construct validity was supported for all CATs and all instruments had a good reliability (≥0.70). The PROMIS measures had less ceiling effects than the SF-36v2.

Conclusion

The PROMIS measures are a feasible, valid, and reliable alternative for the SF-36v2 in patients with primarily nonsevere forms of VWD. The relevance of the selected measures was limited. Additional research is necessary to evaluate the PROMIS measures in adults with IPFDs and RBDs.

Translation and Cultural Adaptation into Arabic of Patient-Reported Outcome Measurement Information System® Item Banks: Cognitive Function Abilities and Physical Function for Samples with Mobility Aid Users

PURPOSE

This study aimed to provide Arabic-speaking individuals with tools to assess their cognitive abilities and physical function and to contribute to a better understanding of these capabilities in this population. Thus, the specific objective was to translate into Arabic and culturally adapt two Patient-Reported Outcome Measurement Information System (PROMIS) item banks: the Adult Cognitive Function Abilities and the Physical Function for Samples with Mobility Aid Users item banks. This study employed the Functional Assessment of Chronic Illness Therapy (FACIT) multilingual translation methodology to ensure cultural and linguistic relevance. The translation process included forward and back translations, expert reviews, and finalisation by a language coordinator. Cognitive debriefing interviews were conducted with 30 native healthy Arabic speakers to assess the clarity and comprehension of translated items. Most items were well understood, but two items related to cognitive ability and four related to physical functions required revision to address participant confusion. The translations were refined based on the participants' feedback and expert recommendations. This study followed a rigorous translation process and included cognitive debriefing interviews to ensure linguistic and cultural equivalence. The availability of these tools in Arabic enhances cross-cultural research and practice in healthcare and contributes to a global understanding of cognitive and physical functions.

The challenges of classical galactosemia: HRQoL in pediatric and adult patients

BACKGROUND

Classical galactosemia (CG), an inborn error of galactose metabolism, results in long-term complications including cognitive impairment and movement disorders, despite early diagnosis and dietary treatment. Two decades ago, lower motor-, cognitive- and social health related quality of life (HRQoL) was demonstrated in pediatric and adult patients. Since then, the diet has been relaxed, newborn screening was implemented and new international guidelines resulted in major changes in follow-up. The aim of this study was to assess HRQoL of CG by means of online self- and/or proxy-HRQoL-questionnaires focusing on the main areas of concern of CG (i.e. anxiety, depression, cognition, fatigue, social- and upper extremity function) within the patient-reported outcomes measurement information system (PROMIS®) and generic HRQoL-questionnaires (TAPQOL, TACQOL, TAAQOL).

RESULTS

Data of 61 Dutch patients (aged 1-52 years) were collected and compared to available Dutch or US reference populations. On the PROMIS-questionnaires, children reported more fatigue (P = 0.044), lower function in upper extremities (P = 0.021), more cognitive difficulties (P = 0.055, d = 0.56) and higher anxiety (P = 0.063, d = 0.52) than reference children although the latter findings remained non-significant. Parents of CG patients reported lower quality of peer relationships of their children (P < 0.001). Both children and parents reported lower cognitive functioning (P = 0.005, P = 0.010) on the TACQOL. Adults reported on PROMIS domains lower cognitive functioning (P = 0.030), higher anxiety (P = 0.004) and more fatigue (P = 0.026). Cognitive difficulties were reported on the TAAQOL by adults (P < 0.001), as well as physical-, sleeping and social difficulties.

CONCLUSIONS

CG remains to impact the HRQoL of pediatric and adult patients negatively on several domains including cognition, anxiety, motor function and fatigue. A lower social health was mainly reported by parents, and not by patients themselves. The Covid-19 pandemic might have amplified the results on anxiety although higher levels of anxiety fit pre-pandemic findings. The reported fatigue is a new finding in CG. Because the effect of lockdown fatigue could not be eliminated and fatigue is a frequent finding in patients with chronic disorders, future studies are warranted. Clinicians and researchers should be attentive to both pediatric and adult patients, and the age-dependent difficulties they might encounter.

Responsiveness and minimal important change of seven PROMIS computerized adaptive tests (CAT) in patients with advanced chronic kidney disease

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS®) has the potential to harmonize the measurement of health-related quality of life (HRQL) across medical conditions. We evaluated responsiveness and minimal important change (MIC) of seven Dutch-Flemish PROMIS computerized adaptive tests (CAT) in Dutch patients with advanced chronic kidney disease (CKD).

METHODS

CKD patients (eGFR < 30 ml/min.1.73m²) completed at baseline and after 6 months seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and ability to participate in social roles and activities), Short Form Health Survey 12 (SF-12), PROMIS Pain Intensity single item, Dialysis Symptom Index (DSI), and Global Rating Scales (GRS) of change. Responsiveness was assessed by testing predefined hypotheses about expected correlations among measures, area under the ROC Curve, and effect sizes. MIC was determined with predictive modelling.

RESULTS

207 patients were included; 186 (90%) completed the follow-up. Most results were in accordance with expectations (70-91% of hypotheses confirmed), with some exceptions for PROMIS Anxiety and Ability to Participate (60% and 42% of hypotheses confirmed, respectively). For PROMIS Anxiety and Depression correlations with the GRS were too low (0.04 and 0.20, respectively) to calculate a MIC. MIC values, representing minimal important deterioration, ranged from 0.4 to 2.5 T-score points for the other domains.

CONCLUSION

We found sufficient responsiveness of PROMIS CATs Physical Function, Fatigue, Sleep Disturbance, and Depression. The results for PROMIS CATs Pain Interference were almost sufficient, but some results for Anxiety and Ability to Participate in Social Roles and Activities were not as expected. Reported MIC values should be interpreted with caution because most patients did not change.