Grooming a CAT: customizing CAT administration rules to increase response efficiency in specific research and clinical settings

Psychometrics of the patient-reported outcomes measurement information system measures in hemophilia: the applicability of the pediatric item banks

Background

The use of patient-reported outcomes measures (PROMs) is important in hemophilia care, as it facilitates communication between patients and clinicians and promotes patient-centered care. Currently, a variety of PROMs with insufficient psychometric properties are used. Patient-reported outcomes measurement information system (PROMIS) measures, including Computer Adaptive Tests, were designed to measure generically and more efficiently and, therefore, are an alternative for the existing PROMs.

Objectives

To assess the feasibility, measurement properties, and outcomes of 8 PROMIS pediatric measures for boys with hemophilia.

Methods

In this multicenter study, boys with hemophilia completed 8 PROMIS measures and 2 legacy instruments. Feasibility was determined by the number of completed items and floor or ceiling effects (percentage of participants that achieved the lowest or highest possible score). Reliability was assessed as the percentage of scores with a SE ≤ 4.5. Construct validity was evaluated by comparing the PROMIS measures with the legacy instruments. Mean PROMIS T-scores were calculated and compared with the Dutch general population.

Results

In total, 77 boys with hemophilia participated. Reliability was good for almost all PROMIS measures and legacy instruments. The total number of completed items varied from 49 to 90 for the PROMIS pediatric measures, while the legacy instruments contained 117 to 130 items. Floor and ceiling effects were observed in both the PROMIS measures (0-39.5%) and legacy instruments (0-66.7%), but were higher for the legacy instruments.

Conclusions

The PROMIS pediatric measures are feasible to use for boys with hemophilia. With the use of the PROMIS measures in clinical care and research, a step toward worldwide standardization of PROM administration can be taken.

Comparison of Patient-Reported Outcomes Measurement Information System Computerized Adaptive Testing Versus Fixed Short Forms in Juvenile Myositis

OBJECTIVE

Patient-Reported Outcomes Measurement Information System (PROMIS) measures can be administered via computerized adaptive testing (CAT) or fixed short forms (FSFs), but the empirical benefits of CAT versus FSFs are unknown in juvenile myositis (JM). The present study was undertaken to assess whether PROMIS CAT is feasible, precise, correlated with FSFs, and less prone to respondent burden and floor/ceiling effects than FSFs in JM.

METHODS

Patients 8-17 years of age (self-report and parent proxy) and parents of patients 5-7 years of age (only parent proxy) completed PROMIS fatigue, pain interference, upper extremity function, mobility, anxiety, and depressive symptoms measures. Pearson correlations, paired t-tests, and Cohen's d were calculated between PROMIS CAT and FSFs. McNemar's test assessed floor/ceiling effects between CAT and FSFs. Precision and respondent burden were examined across the T score range.

RESULTS

Data from 67 patient-parent dyads were analyzed. CAT and FSF mean scores did not significantly differ except in parent proxy anxiety and fatigue (effect size 0.23 and 0.19, respectively). CAT had less pronounced floor/ceiling effects at the less symptomatic extreme in all domains except self-report anxiety. Increased item burden and higher SEs were seen in less symptomatic scorers for CAT. Modified stopping rules limiting CAT item administration did not decrease precision.

CONCLUSION

PROMIS CAT appears to be feasible and correlated with FSFs. CAT had less pronounced floor/ceiling effects, allowing detection of individual differences in less symptomatic patients. Modified stopping rules for CAT may decrease respondent burden. CAT can be considered for long-term follow-up of JM patients.

Customizing CAT Administration of the PROMIS Misuse of Prescription Pain Medication Item Bank for Patients with Chronic Pain

OBJECTIVE

The 22-item PROMIS®-Rx Pain Medication Misuse item bank (Bank-22) imposes a high response burden. This study aimed to characterize the performance of the Bank-22 in a computer adaptive testing (CAT) setting based on varied stopping rules.

METHODS

The 22 items were administered to 288 patients. We performed a CAT simulation using default stopping rules (CATPROMIS). In 5 other simulations, a "best health" response rule was added to decrease response burden. This rule stopped CAT administration when a participant selected "never" to a specified number of initial Bank-22 items (2-6 in this study, designated CATAlt2-Alt6). The Bank-22 and 7-item short form (SF-7) scores were compared to scores based on CATPROMIS, and the 5 CAT variations.

RESULTS

Bank-22 scores correlated highly with the SF-7 and CATPROMIS, Alt5, Alt6 scores (r=0.87-0.95) and moderately with CATAlt2- Alt4 scores (r=0.63-0.74). In all CAT conditions, the greatest differences with Bank-22 scores were at the lower end of misuse T-scores. The smallest differences with Bank-22 and CATPROMIS scores were observed with CATAlt5 and CATAlt6. Compared to the SF-7, CATAlt5 and CATAlt6 reduced overall response burden by about 42%. Finally, the correlations between PROMIS-Rx Misuse and Anxiety T-scores remained relatively unchanged across the conditions (r=0.31-0.43, Ps < .001).

CONCLUSIONS

Applying a stopping rule based on number of initial "best health" responses reduced response burden for respondents with lower levels of misuse. The tradeoff was less measurement precision for those individuals, which could be an acceptable tradeoff when the chief concern is in discriminating higher levels of misuse.

Patient-Reported Outcome Measures and Patient Activation: What Are Their Roles in Orthopedic Trauma?

The rise of patient-reported outcome (PRO) measurement across medicine has been swift and now extends to the world of orthopedic trauma. However, PRO measures (PROMs) applied to trauma patients pose special considerations; measuring "episodes of care" is less straightforward, injuries are heterogeneous in their severity, and the patient's initial visit is "postinjury." Obtaining baseline scores and assessing the impact of a traumatic event on mental health are key considerations. Currently, few, if any, trauma registries include PROs; though general and condition-specific PROMs plus the patient empowerment measure of Patient Activation represent meaningful inputs for the clinical decision-making process. To be useful in trauma care, PROMs should be psychometrically sound and validated, be used for capturing function, screen for mental state and substance use, and give the clinician a sense of the patient's "activation" (engagement in their own health). Although the implementation of routine PRO collection can seem daunting, clinicians can use a multitude of electronic resources to access validated measures and simplify the implementation process. Computer-adaptive testing has evolved to help minimize patient burden, and PROM collection must maximize efficiency. Once established as part of your practice, PROs become an important tool to track recovery, identify mental health issues, engage in the prevention of future injury, and enable care of the whole patient.