Do You Recall?: Results From a Within-Person Recall Study of the Patient-Reported Outcomes Measurement Information System (PROMIS) Short Form v2.0 - Physical Function 8c

Evaluating the agreement between different substance use recall periods in multiple HIV cohorts

BACKGROUND

This study aims to evaluate the agreement in substance use on both binary and ordinal scales between 3-month and 6-month recall periods with samples from different communities, demographic backgrounds, and HIV status.

METHODS

We administered the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) to 799 participants from three different North American cohorts focused on substance use and HIV. We conducted a within-person agreement analysis by calculating the agreement levels and Kappa statistic between data collected using the 3-month recall ASSIST and 6-month custom substance use surveys as well as different terminology for each substance in multiple cohorts.

RESULTS

For all drugs studied, the agreement on the binary use or ordinal frequency of use metrics showed a high agreement level between 80.4% and 97.9% and an adequate adjusted kappa value between 0.61 and 0.96, suggesting substantial agreement. According to the agreement criteria we proposed, substance use data collected using different recall periods and with variation in drug names can be harmonized across cohorts.

CONCLUSIONS

This study is the first to evaluate the feasibility of data harmonization of substance use by demonstrating high level of agreement between different recall periods in different cohorts. The results can inform data harmonization efforts in consortia where data are collected from cohorts using different questions and recall periods.

Establishing a common metric for physical function: Linking SARC-F and PROMIS® physical function

INTRODUCTION

Aligned with the increasing need for standardized assessment of physical function in older individuals with cancer and other conditions, several patient-reported outcome measures (PROMs) have been developed and published. The aim of this study is to link the Strength, Assistance with walking, Rising from a chair, Climbing stairs, and Falls questionnaire (SARC-F), and the Patient-Reported Outcomes Measurement Information System® (PROMIS®) Physical Function Short Form 8c (PROMIS PF 8c), and make their scores convertible, in order to expand the use of both instruments in research and inform clinicians and researchers about the interchangeability of critical cut-off scores.

MATERIALS AND METHODS

The sample included 300 participants recruited from an online panel. Participants were included if they had received a cancer diagnosis from a clinician and reported receiving anti-cancer treatment. We conducted five linking procedures and selected an optimal one to generate the crosswalk table between the two measures.

RESULTS

The linked T scores of all five methods showed acceptably small mean differences from the observed T scores, and the standard deviation (SD), and root-mean-squared deviation (RMSD) of the differences were generally similar across all methods. After comparing across all statistics, the Stocking-Lord approach was considered as the optimal approach to compute the crosswalk table for converting SARC-F raw scores to PROMIS PF 8c scores. The crosswalk table shows that the SARC-F cut-off value of 4 between healthy versus symptomatic with a corresponding score of 37 fell in the range of moderate physical function limitation from 30 to 39 on the PROMI PF 8c T score metric.

DISCUSSION

The linkage in this study has potential for improving clinical and research activities for people with cancer and perhaps others with a similar range of physical function. It facilitates the interpretability in scores of both measures on a common metric anchored on general population for further group-level analysis. Researchers can use this crosswalk to harmonize data collected from either instrument without requiring all cohorts to administer the same instrument for a prospective data collection or retrospective data analysis purpose or for a cross-study effectiveness study.

Recommendations on the use of item libraries for patient-reported outcome measurement in oncology trials: findings from an international, multidisciplinary working group

The use of item libraries for patient-reported outcome (PRO) measurement in oncology allows for the customisation of PRO assessment to measure key health-related quality of life concepts of relevance to the target population and intervention. However, no high-level recommendations exist to guide users on the design and implementation of these customised PRO measures (item lists) across different PRO measurement systems. To address this issue, a working group was set up, including international stakeholders (academic, independent, industry, health technology assessment, regulatory, and patient advocacy), with the goal of creating recommendations for the use of item libraries in oncology trials. A scoping review was carried out to identify relevant publications and highlight any gaps. Stakeholders commented on the available guidance for each research question, proposed recommendations on how to address gaps in the literature, and came to an agreement using discussion-based methods. Nine primary research questions were identified that formed the scope and structure of the recommendations on how to select items and implement item lists created from item libraries. These recommendations address methods to drive item selection, plan the structure and analysis of item lists, and facilitate their use in conjunction with other measures. The findings resulted in high-level, instrument-agnostic recommendations on the use of item-library-derived item lists in oncology trials.