Linking Scores with Patient-Reported Health Outcome Instruments:A VALIDATION STUDY AND COMPARISON OF THREE LINKING METHODS

Linking QuickDASH and PROMIS Upper-Extremity Computer-Adaptive Test Scores in Hand Surgery: A Crosswalk Study

PURPOSE

Assessment of patient-reported outcome measures (PROMs) for hand and upper-extremity surgery patients using measures such as the Quick Disabilities of the Arm, Shoulder, and Hand (qDASH), as well as general measures including the Patient-Reported Outcomes Measurement Information System Upper Extremity Physical Function domain via a Computer-Adaptive Test (PROMIS UE CAT), has become commonplace. The aim of this study was to link, for crosswalking, the qDASH measure to both versions of the PROMIS UE CAT (v1.2 and v2.0).

METHODS

We included 18,944 hand and upper-extremity patients who completed both versions of the PROMIS UE CAT and the qDASH at the same clinical encounter. Shoulder pathology was excluded. Score linkage was performed using the R package equate, and multiple equating models (linear regression, identity, mean, linear, equipercentile, and circle-arc models) were used to establish crosswalk tables.

RESULTS

Mean qDASH and PROMIS UE CAT v1.2 scores were 38.2 (SD = 23.1) and 36.6 (SD = 9.8), respectively. Mean qDASH and PROMIS UE CAT v2.0 scores were 37.3 (SD = 21.8) and 38.3 (SD = 10.4), respectively. Pearson correlations had very strong linear relationships between the qDASH and the PROMIS UE CAT v1.2 and PROMIS UE CAT v2.0 (r = -0.83 [-0.84, -0.92] and r = -0.80 [-0.81, -0.80], respectively). For the equipercentile equating models, the intraclass correlation coefficient (ICC) had very strong positive relationships to linking measures with ICC = 0.85 (0.84, 0.86) for the qDASH-UE CAT v1.2 crosswalk and ICC = 0.83 (0.82, 0.84) for the qDASH-UE CAT v2.0 crosswalk.

CONCLUSIONS

The linkages establish crosswalk tables using equipercentile equating models to convert the PROMIS UE CAT v1.2 and v2.0 scores to the qDASH and vice versa.

CLINICAL RELEVANCE

This study provides crosswalk tables for commonly collected PROMs in hand surgery, increasing the comparability of results between centers using different PROMs to study the same conditions or treatments.

Crosswalk between the PROMIS physical function CAT and PROMIS upper extremity CAT v1.2 in a hand surgery population

BACKGROUND

There is no gold standard patient-reported outcome measure (PROM) in hand surgery. As a result, a diverse array of PROM instruments have been utilized across centers over time. Lack of score interchangeability limits the ability to compare or conglomerate scores when new instruments are introduced. Our aim was to develop a linkage for the PROMIS UE CAT v1.2 and PROMIS PF CAT scores and develop crosswalk tables for interconversion between these PROMs.

METHODS

Retrospective review was conducted to identify adult (≥ 18y) patients seen by orthopaedic hand surgeons at a single academic tertiary care hospital who had completed PROMIS UE CAT v1.2 and PROMIS PF CAT score at the same visit. For those with multiple visits, only one randomly selected visit was included in the analyses. Pearson's correlation was calculated to determine the linear relationship between the scores. Linkage from PF to UE was performed utilizing several commonly utilized equating models (identity, mean, linear, equipercentile and circle-arc methods). The performance of the models was assessed using intraclass correlation (ICC) between observed PROMIS UE CAT v1.2 and estimated PROMIS UE CAT v1.2 scores generated using the model as well as Root Mean Square Error (RMSE). The model chosen as the 'best' was further assessed for population invariance using root expected mean squared difference (REMSD) where < 0.08 were considered good.

RESULTS

Of 10,081 included patients, mean age was 48.3 (SD = 17.0), and 54% were female (5,477/10,081). Mean UE CAT v1.2 and PF CAT scores were 37 (SD = 9.8) and 46 (SD = 10.0), respectively. There was a strong correlation between the scores (Pearson correlation r = 0.70). All methods performed acceptably (ICC ≥ 0.66 and RMSE < = 7.52 for all). The equipercentile method had the highest ICC (ICC = 0.70 (95% CI 0.69-0.71)) while the mean and circle arc methods had the lowest RMSE. The circle arc method is the most reliable with the smallest standard error and has satisfactory population invariance across age group (REMSD 0.065) and sex (REMSD 0.036).

CONCLUSIONS

Crosswalk tables to be used for bidirectional conversion between scores were created.

LEVEL OF EVIDENCE

III.

Equipercentile equating of scores from common patient-reported outcome measures of physical function in patients with cancer

OBJECTIVE

To provide equipercentile equating of physical function (PF) scores from frequently used patient-reported outcome measures (PROMs) in cancer patients to facilitate data pooling and comparisons.

STUDY DESIGN AND SETTING

Adult cancer patients from five European countries completed the European Organization for Research and Treatment of Cancer (EORTC) computer adaptive test (CAT) Core, EORTC Quality of Life Questionnaire Version 3.0 (QLQ-C30), Functional Assessment of Cancer Therapy - General (FACT-G), 36-item Short Form Health Survey (SF-36), and the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function 20a short form. The R package "equate" was used to establish conversion tables of PF scores on those measures with a bivariate rank correlation of at least 0.75.

RESULTS

In total, 953 patients with cancer (mean age 58.9 years, 54.7% men) participated. Bivariate rank correlations between PF scores from the EORTC CAT Core, EORTC QLQ-C30, SF-36, and PROMIS were all above 0.85, but below 0.69 for the FACT-G. Conversion tables were established for all measures but the FACT-G. These tables indicate which score from one PROM best matches the score from another PROM and provide standard errors of converted scores.

CONCLUSION

Our analysis indicates that linking of PF scores from both EORTC measures (CAT and QLQ-C30) with PROMIS and SF-36 is possible, whereas the physical domain of the FACT-G seems to be different. The established conversion tables may be used for comparing results or pooling data from clinical studies using different PROMs.

Establishing the interpretability and utility of the 4-item BriefPCS

To reduce the patient burden associated with completing the 13-item Pain Catastrophizing Scale (PCS), the 4-item "BriefPCS" was developed. To date, no crosswalk has been developed that associates scores on the BriefPCS with PCS scores. Further, no study has compared the use of BriefPCS and PCS scores in a randomized clinical trial (RCT). We aimed to: (1) establish the interpretability of BriefPCS scores in reference to PCS scores, (2) compare the concurrent validity between the BriefPCS and PCS, and (3) asssess the use of BriefPCS in an RCT. First, we conducted equipercentile linking, created a crosswalk that associated scores of BriefPCS with PCS, and calculated differences between PCS and crosswalked PCS scores. Secondly, we compared Bootstrap correlation coefficients between PCS and self-reported measures of other domains. Lastly, we compared results from an RCT using BriefPCS scores versus PCS scores. Findings indicated that the correlation coefficient estimates with the BriefPCS and PCS scores were not significantly different. BriefPCS and PCS scores had similar ability to detect treatment-related changes. The BriefPCS scores validly, reliably, and accurately distinguish levels of pain catastrophizing. Additionally, the BriefPCS scores are sensitive to changes after behavioral interventions, with less respondent burden compared to the PCS scores.

Common measures or common metrics? the value of IRT-based common metrics

There is a clear need to harmonize outcome measurement. Some authors propose to express scores as T scores to facilitate interpretation of PROM results in clinical practice. While this is a step in the right direction, there are important limitations to the acceptance of the T score metric as a common metric when T scores are based on raw sum scores of ordinal items: Such T scores of different instruments are not exactly comparable because they are not interval scaled; T scores of different measures are only on the same scale if exactly the same reference group is used; and the T sore metric cannot be maintained because it is reference population-dependent and needs to be updated regularly. These limitations can be overcome by using an item response theory (IRT)-based metric. Items from different measures can be placed on the same IRT metric to make scores comparable on an interval scale. The PROMIS initiative used IRT to develop item banks for measuring various health outcomes. Other PROMs have been linked to the PROMIS metric. Although PROMIS uses a T-score metric for practical reasons, the underlying PROMIS metric is actually an IRT metric. An IRT approach also enables further development of an item bank while preserving the underlying metric. Therefore, IRT-based metrics should be considered as common metrics for the future.

Establishing a common metric for physical function: Linking SARC-F and PROMIS® physical function

INTRODUCTION

Aligned with the increasing need for standardized assessment of physical function in older individuals with cancer and other conditions, several patient-reported outcome measures (PROMs) have been developed and published. The aim of this study is to link the Strength, Assistance with walking, Rising from a chair, Climbing stairs, and Falls questionnaire (SARC-F), and the Patient-Reported Outcomes Measurement Information System® (PROMIS®) Physical Function Short Form 8c (PROMIS PF 8c), and make their scores convertible, in order to expand the use of both instruments in research and inform clinicians and researchers about the interchangeability of critical cut-off scores.

MATERIALS AND METHODS

The sample included 300 participants recruited from an online panel. Participants were included if they had received a cancer diagnosis from a clinician and reported receiving anti-cancer treatment. We conducted five linking procedures and selected an optimal one to generate the crosswalk table between the two measures.

RESULTS

The linked T scores of all five methods showed acceptably small mean differences from the observed T scores, and the standard deviation (SD), and root-mean-squared deviation (RMSD) of the differences were generally similar across all methods. After comparing across all statistics, the Stocking-Lord approach was considered as the optimal approach to compute the crosswalk table for converting SARC-F raw scores to PROMIS PF 8c scores. The crosswalk table shows that the SARC-F cut-off value of 4 between healthy versus symptomatic with a corresponding score of 37 fell in the range of moderate physical function limitation from 30 to 39 on the PROMI PF 8c T score metric.

DISCUSSION

The linkage in this study has potential for improving clinical and research activities for people with cancer and perhaps others with a similar range of physical function. It facilitates the interpretability in scores of both measures on a common metric anchored on general population for further group-level analysis. Researchers can use this crosswalk to harmonize data collected from either instrument without requiring all cohorts to administer the same instrument for a prospective data collection or retrospective data analysis purpose or for a cross-study effectiveness study.

Overcoming floor and ceiling effects in knee arthroplasty outcome measurement

Aims

To map the Oxford Knee Score (OKS) and High Activity Arthroplasty Score (HAAS) items to a common scale, and to investigate the psychometric properties of this new scale for the measurement of knee health.

Methods

Patient-reported outcome measure (PROM) data measuring knee health were obtained from the NHS PROMs dataset and Total or Partial Knee Arthroplasty Trial (TOPKAT). Assumptions for common scale modelling were tested. A graded response model (fitted to OKS item responses in the NHS PROMs dataset) was used as an anchor to calibrate paired HAAS items from the TOPKAT dataset. Information curves for the combined OKS-HAAS model were plotted. Bland-Altman analysis was used to compare common scale scores derived from OKS and HAAS items. A conversion table was developed to map between HAAS, OKS, and the common scale.

Results

We included 3,329 response sets from 528 patients undergoing knee arthroplasty. These generally met the assumptions of unidimensionality, monotonicity, local independence, and measurement invariance. The HAAS items provided more information than OKS items at high levels of knee health. Combining both instruments resulted in higher test-level information than either instrument alone. The mean error between common scale scores derived from the OKS and HAAS was 0.29 logits.

Conclusion

The common scale allowed more precise measurement of knee health than use of either the OKS or HAAS individually. These techniques for mapping PROM instruments may be useful for the standardization of outcome reporting, and pooling results across studies that use either PROM in individual-patient meta-analysis.

A systematic review of health-related quality of life outcomes in psychosocial intervention trials for adolescent and young adult cancer survivors

BACKGROUND

The National Cancer Institute has catalyzed research in adolescent and young adult (AYA) oncology by identifying the need for supportive care intervention studies and psychometrically robust health-related quality of life (HRQOL) measures. We evaluated progress toward these goals (1) examining changes in the number of registered psychosocial intervention trials being conducted with AYAs over time; (2) determining what domains of HRQOL were assessed across these intervention trials; and (3) identifying the most frequently used measures of HRQOL.

METHODS

We conducted a systematic review of psychosocial intervention trials for AYAs registered on ClinicalTrials.gov from 2007 to 2021. Following identification of relevant trials, we extracted the outcome measures and determined whether they were measures of HRQOL and which HRQOL domains were evaluated. Descriptive statistics were used to summarize trial and outcome characteristics.

RESULTS

We identified 93 studies that met our inclusion criteria and 326 HRQOL outcomes across studies. The average number of clinical trials conducted annually has increased from 2 (SD = 1) during the years of 2007-2014 to 11 (SD = 4) during the years of 2015-2021. 19 trials (20.4%) did not include a measure of HRQOL. HRQOL measures varied widely, and most evaluated psychological and physical domains. Of the 9 measures used 5 + times, none were developed to cover the full AYA age spectrum.

CONCLUSIONS

This review demonstrated that the number of AYA psychosocial intervention trials conducted annually has increased. However, it also revealed several important areas for additional work including: (1) ensuring psychosocial trials include HRQOL measures; (2) increasing the frequency of evaluation of underrepresented domains of HRQOL (e.g., body image, fertility/sexuality and spiritual); and (3) improving the validity and standardization of measures used to evaluate domains of HRQOL across AYA-focused trials to improve the field's ability to compare the impact of different psychosocial interventions on HRQOL outcomes.

Physical performance tasks were linked to the PROMIS physical function metric in patients undergoing hemodialysis

OBJECTIVES

To investigate whether a multi-item performance outcome measure, the physical performance test (PPT), can be calibrated to a common scale with patient-reported outcome measures, using the Patient-Reported Outcomes Measurement Information System (PROMIS) physical function (PF) metric.

STUDY DESIGN AND SETTING

We analyzed baseline data (N = 1,113) from the CONVINCE study, an international trial in end-stage kidney disease patients comparing high-dose hemodiafiltration with high-flux hemodialysis. Assumptions of item response theory (IRT) modelling were investigated for the combined set of the nine-item PPT and a four-item PROMIS PF short form (PROMIS-PF4a). We applied unidimensional IRT linking for calibrating the PPT to the PROMIS PF metric.

RESULTS

Although some evidence for multidimensionality was found, classical test statistics (Cronbach's Alpha = 0.93), Mokken (Loevinger's H = 0.50), and bifactor analysis (explained common variance = 0.65) indicated that PPT and PROMIS-PF4a items can be used to assess a common PF construct. On the group level, the agreement between PROMIS-PF4a and linked PPT scores was stable across several subsamples. On the individual level, scores differed considerably.

CONCLUSION

We found preliminary evidence that the PPT can be linked to the PROMIS PF metric in hemodialysis patients, enabling group comparisons across patient-reported outcome and performance outcome measures. Alternative linking methods should be applied in future studies using a more comprehensive PROMIS PF item set.

Patient-reported outcome measures for physical function in cancer patients: content comparison of the EORTC CAT Core, EORTC QLQ-C30, SF-36, FACT-G, and PROMIS measures using the International Classification of Functioning, Disability and Health

BACKGROUND

Patient-reported physical function (PF) is a key endpoint in cancer clinical trials. Using complex statistical methods, common metrics have been developed to compare scores from different patient-reported outcome (PRO) measures, but such methods do not account for possible differences in questionnaire content. Therefore, the aim of our study was a content comparison of frequently used PRO measures for PF in cancer patients.

METHODS

Relying on the framework of the International Classification of Functioning, Disability and Health (ICF) we categorized the item content of the physical domains of the following measures: EORTC CAT Core, EORTC QLQ-C30, SF-36, PROMIS Cancer Item Bank for Physical Function, PROMIS Short Form for Physical Function 20a, and the FACT-G. Item content was linked to ICF categories by two independent reviewers.

RESULTS

The 118 items investigated were assigned to 3 components ('d - Activities and Participation', 'b - Body Functions', and 'e - Environmental Factors') and 11 first-level ICF categories. All PF items of the EORTC measures but one were assigned to the first-level ICF categories 'd4 - Mobility' and 'd5 - Self-care', all within the component 'd - Activities and Participation'. The SF-36 additionally included item content related to 'd9 - Community, social and civic life' and the PROMIS Short Form for Physical Function 20a also included content related to 'd6 - domestic life'. The PROMIS Cancer Item Bank (v1.1) covered, in addition, two first-level categories within the component 'b - Body Functions'. The FACT-G Physical Well-being scale was found to be the most diverse scale with item content partly not covered by the ICF framework.

DISCUSSION

Our results provide information about conceptual differences between common PRO measures for the assessment of PF in cancer patients. Our results complement quantitative information on psychometric characteristics of these measures and provide a better understanding of the possibilities of establishing common metrics.

Equity-Driven Implementation of Patient-Reported Outcome Measures in Musculoskeletal Care: Advancing Value for All

ABSTRACT

The clinical use of patient-reported outcome measures (PROMs) in musculoskeletal care is expanding, encompassing both individual patient management and population-level applications. However, without thoughtful implementation, we risk introducing or exacerbating disparities in care processes or outcomes. We outline examples of opportunities, challenges, and priorities throughout PROM implementation to equitably advance value-based care at both the patient and population level. Balancing standardization with tailored strategies can enable the large-scale implementation of PROMs while optimizing care processes and outcomes for all patients.

Development of a set of patient reported outcome measures for patients with benign liver tumours and cysts: patient focus groups and systematic review

BACKGROUND

Patient reported outcome measures (PROMs) may be useful for patients with benign liver tumours and cysts (BLTC) to evaluate the impact of treatment and/or guide shared decision making. Yet, a set of PROMs relevant to patients with BLTC is currently unavailable. In this study, we selected a PROMs set for patients with BLTC.

METHODS

Potentially relevant patient reported outcomes (PROs) were selected by psychologist-researchers based on keywords used or suggested by participants of two virtual focus groups meetings consisting of thirteen female BLTC patients with a median age of 50 years. Subsequently, patients were asked to report their most relevant PROs. PROMs identified by systematic literature review and computerized adaptive tests (CATs) in the Patient-Reported Outcomes Measurement Information System (PROMIS) were considered in selecting the final PROMs set to assess relevant outcomes.

RESULTS

The most important PROs were: insecurity/anxiety (11/12 patients), pain (9/12 patients), fatigue (8/12 patients), and limitations in daily life (5/12 patients). The literature review included 23 studies, which used various generic and disease-specific PROMs, often not measuring (all) relevant PROs. The final selected PROMs set included numerical rating scales for pain, two questions on overall health and quality of life and four PROMIS CATs.

CONCLUSIONS

A PROMs set generically and efficiently measuring outcomes relevant for patients with BLTC was developed and may be used in future research and clinical practice.

Can a linking crosswalk table be applied to a different population? An independent validation study for a crosswalk between BSI depression and PROMIS depression scales

A linking procedure establishes a "bridge" between the scores from different patient-reported outcome (PRO) instruments that measure similar constructs. After developing a linking relationship however, it is critical to evaluate whether this relationship can be generalized to different groups. Our study aims to validate a published crosswalk for score conversion between the Brief Symptom Inventory Depression subscale and the Patient-Reported Outcomes Measurement Information System Depression 8a using an independent sample. Data were from a sample of young men who have sex with men (MSM), which differs in terms of participant age, race, and ethnicity from the sample used to develop the existing crosswalk. The validity of the newly derived crosswalk was evaluated in terms of the correlation, mean difference and standard deviation between the observed and the linked scores. The two crosswalks were further compared to evaluate if the difference was within an acceptable range. More than half of the item parameters obtained from the two samples were found to overlap in their confidence intervals. Differences between each pair of scores in the two crosswalks was within three T-score points, well within the range of each crosswalk score's standard error. This study concludes that an existing crosswalk is replicable on a sample that differs from that used for crosswalk development, but future research should continue to examine the generalizability of the linked parameters and evaluate the reproducibility of this crosswalk to other populations.

Head-to-head comparison of somatic symptom scales: The Patient Health Questionnaire (PHQ-15) and the somatization scale of the Four-Dimensional Symptom Questionnaire (4DSQ-S)

OBJECTIVE

The goal of this study was to compare the 15-item Patient Health Questionnaire (PHQ-15) and the somatization subscale of the Four-Dimensional Symptoms Questionnaire (4DSQ-S) with respect to their latent structure and reliability, and to examine whether their scores are affected by age and gender, and whether the scales measure the same construct(s).

METHODS

The study population consisted of individuals with a tendency to experience persistent somatic symptoms, recruited in multiple healthcare settings, who completed the PHQ-15 and 4DSQ-S concurrently. We analyzed the scales' latent factor structure using confirmatory factor analysis (CFA), the scales' reliability, and differential item functioning (DIF) due to age and gender. We performed a head-to-head comparison by fitting structural equation models of the questionnaires' factors.

RESULTS

We included 234 participants. CFA showed that both questionnaires fitted a bifactor model with a general factor and four specific factors, three of which (labeled "musculoskeletal", "gastrointestinal", and "cardiopulmonary") were substantively similar. Both scales were essentially unidimensional. The reliability of the PHQ-15 and 4DSQ-S was equally high (omega 0.933 and 0.942, respectively). DIF-analysis showed minor DIF for age in one item of each questionnaire, with negligible impact on the scale score. Head-to-head comparison showed that the PHQ-15 and 4DSQ-S measured the same constructs. We present PHQ-15 - 4DSQ-S cross-walk tables.

CONCLUSIONS

Both questionnaires mainly measure a single somatic symptom burden dimension of which all symptoms (covered by the questionnaires) are adequate indicators. They do so equally accurately and they behave the same across gender and age categories.

Analyses of Cross-Sectional Data to Link the PEG With the Patient Reported Outcomes Measurement and Information System (PROMIS) Global Physical Health Scale

It is challenging to synthesize findings across studies of pain impact. This study develops a link to estimate the Patient-Reported Outcomes Measurement Information System (PROMIS) global health measure from the 3-item Pain intensity, interference with Enjoyment of life, interference with General activity (PEG) scale. The PROMIS and PEG items were administered to 795 adults (average age = 51; 54% female, 79% White). We estimated correlations among the PEG and PROMIS items and conducted factor analysis to identify the best subset of PROMIS items for linking to the PEG. An item response theory graded response model was estimated to link the PEG with the 4-item PROMIS global physical health scale. A categorical single-factor model and a bifactor model provided support for a single dimension for the PEG and PROMIS global physical health items. The product-moment correlation between estimated PROMIS global physical health scale from the PEG and the actual global physical health score was .74. The mean difference between estimated PROMIS global physical health scale score from the PEG and the observed global physical health score was less than a T-score point. This study makes it possible to estimate the average global physical health for group-level comparisons in research that includes the PEG. PERSPECTIVE: This article describes an empirical link of the PEG to the PROMIS global physical health scale that makes it possible to estimate the average global physical health in studies that include the PEG. This link can facilitate comparisons among studies that have not administered the PEG or the PROMIS global health scale.

A Patient Reported Outcome Ontology: Conceptual Issues and Challenges Addressed by the Patient-Reported Outcomes Measurement Information System® (PROMIS®)

We briefly review the history of measuring perceptions of health and quality of life, followed by an examination of conceptual issues related to terminology that have led to potentially conflicting ontologies. Then, we discuss challenges posed by the lack of consensus on common meaning and the proliferation of measures. Next, we suggest a solution grounded in an ontology adopted by the National Institutes of Health (NIH) funded Patient-Reported Outcomes Measurement Information System (PROMIS) project. We conclude by discussing issues associated with mapping the PROMIS domain framework onto other familiar ontologies and recommend a way forward for PROMIS to provide a sustainable ontological structure to enable coherent common measurement.

Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS®) using Computerized Adaptive Testing (CAT) in patients with advanced chronic kidney disease

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS®) has been recommended for computerized adaptive testing (CAT) of health-related quality of life (HRQOL). This study compared the content, validity and reliability of seven PROMIS CATs to the 12-item Short-Form Health Survey (SF-12) in patients with advanced chronic kidney disease (CKD).

METHODS

Adult CKD patients with an eGFR < 30 ml/min.1.73m2 not receiving dialysis treatment completed seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and ability to participate in social roles and activities), the SF-12 and, additionally, the PROMIS Pain Intensity single item and Dialysis Symptom Index (DSI) at inclusion and 2-weeks. A content comparison was performed between PROMIS CATs and SF-12. Construct validity of PROMIS CATs was assessed using Pearson's correlations. Test-retest reliability of all patient-reported outcome measures (PROMs) was assessed by calculating the intra-class correlation coefficient (ICC) and minimal detectable change (MDC).

RESULTS

In total, 207 patients participated in the study. A median of 45 items (10 minutes) was completed for PROMIS CATs. All PROMIS CATs showed evidence for sufficient construct validity. PROMIS CATs, most SF-12 domains and summary scores, and DSI showed sufficient test-retest reliability (ICC ≥ 0.70). PROMIS CATs had a lower MDC compared to the SF-12 (5.7-7.4 compared to 11.2-21.7 across domains, respectively).

CONCLUSION

PROMIS CATs showed sufficient construct validity and test-retest reliability in patients with advanced CKD. PROMIS CATs required more items but showed better reliability than the SF-12. Future research is needed to investigate the feasibility of PROMIS CATs for routine nephrology care.

Linking the KOOS-PS to PROMIS Physical Function in Knee Patients Evaluated for Surgery

INTRODUCTION

The Knee Injury and Osteoarthritis Outcome Score-Physical Function Short-form and the Patient-Reported Outcomes Measurement Information System Physical Function are widely used patient-reported outcome measures in orthopaedic practice and research. It would be helpful for clinicians and researchers to compare scores obtained on one instrument with those collected on another. To achieve this goal, this study conducted a linking analysis and computed a crosswalk table between these two scales.

DATA

The data of this study were collected as part of the clinical care of total knee arthroplasty patients in a large urban and suburban health system. The sample was a mix of responses from nonsurgical (no surgery performed), preoperative (before surgical intervention), and postoperative (after surgical intervention) groups.

METHODS

This study applied five linking methods: the item response theory (IRT)-based linking methods including fixed-parameter calibration, separate-parameter calibration with Stocking-Lord constants, and calibrated projection; and the equipercentile methods with log-linear smoothing and nonsmoothing approaches. Before conducting the linking analysis, we checked the linking assumptions including the similar content of the two scales, the unidimensionality of the combined scales, and the population invariance. The results of the five linking methods were evaluated by mean difference, SD, root-mean-squared deviation, intraclass correlation coefficient of the observed T scores and the crosswalk-derived T scores.

RESULTS

The linking assumptions were all met. T scores generated from the Stocking-Lord crosswalk had the smallest mean difference (= -0.03) and relatively small SD (= 4.91) and root-mean-squared deviation (= 4.91) among the five linking methods. We validated this crosswalk in a larger sample with the nonsurgical, preoperative, and postoperative groups and in an external sample.

DISCUSSION

This study provides clinicians and researchers a practical tool (ie, a crosswalk table) to link scores from two popular physical function measures. Given the diversity of patient-reported outcome measures in use for knee conditions, these crosswalk tables would accelerate clinical and research interpretation of aggregating functional outcomes among the patients evaluated for knee surgery each year.

Multidimensional Computerized Adaptive Testing: A Potential Path Toward the Efficient and Precise Assessment of Applied Cognition, Daily Activity, and Mobility for Hospitalized Patients

OBJECTIVE

To develop and evaluate an efficient and precise variable-length functional assessment of applied cognition, daily activity, and mobility to inform mobility preservation and rehabilitation service delivery among hospitalized patients.

DESIGN

A multidimensional item bank tapping into these dimensions was developed, with all items calibrated using a multidimensional graded response model. The items were adaptively selected from the item banks to maximize the test information, and the test ended when a joint stopping rule was satisfied. A simulation study was conducted based on the completed instrument, the Functional Assessment in Acute Care Multidimensional Computerized Adaptive Test (FAMCAT), to compare its measurement precision and efficiency capabilities relative to conventional unidimensional computerized adaptive testing. Precision was measured by the bias and root mean squared error between the estimated and true (ie, simulated) θ estimates, whereas efficiency was measured by average test length. Data were collected by an interviewer reading questions from a tablet computer and entering patients' responses.

SETTING

A large Midwestern hospital.

PARTICIPANTS

A total of 4143 patients hospitalized with medical diagnosis and/or surgical complications, with 2060 in the calibration sample and 2083 in the validation cohort.

INTERVENTION

Not applicable.

RESULTS

Among the 2083 patients in the validation sample, FAMCAT administration required an average of 6 (SD=3.11) minutes. Ninety-six percent had their tests terminated by the standard error rule after responding to an average of 22.05 (SD=7.98) items, whereas 15 were terminated by the change in θ rule, with an average test length of 45.27 (SD=11.49). The remaining 76 responded until reaching the maximum test length of 60 items.

CONCLUSIONS

The FAMCAT has the potential to satisfy the need for structured, frequent, and precise assessment of functional domains among hospitalized patients with medical diagnosis and/or surgical complications. The results are promising and may be informative for others who wish to develop similar instruments when concurrent assessment of correlated domains is required.

Common measures or common metrics? A plea to harmonize measurement results

OBJECTIVE

There is a great variety of measurement instruments to assess similar constructs in clinical research and practice. This complicates the interpretation of test results and hampers the implementation of measurement-based care.

METHOD

For reporting and discussing test results with patients, we suggest converting test results into universally applicable common metrics. Two well-established metrics are reviewed: T scores and percentile ranks. Their calculation is explained, their merits and drawbacks are discussed, and recommendations for the most convenient reference group are provided.

RESULTS

We propose to express test results as T scores with the general population as reference group. To elucidate test results to patients, T scores may be supplemented with percentile ranks, based on data from a clinical sample. The practical benefits are demonstrated using the published data of four frequently used instruments for measuring depression: the CES-D, PHQ-9, BDI-II and the PROMIS depression measure.

DISCUSSION

Recent initiatives have proposed to mandate a limited set of outcome measures to harmonize clinical measurement. However, the selected instruments are not without flaws and, potentially, this directive may hamper future instrument development. We recommend using common metrics as an alternative approach to harmonize test results in clinical practice, as this will facilitate the integration of measures in day-to-day practice.

Health-Related Quality of Life Measurement in Public Health

Patient-reported outcomes are recognized as essential for the evaluation of medical and public health interventions. Over the last 50 years, health-related quality of life (HRQoL) research has grown exponentially from 0 to more than 17,000 papers published annually. We provide an overview of generic HRQoL measures used widely in epidemiological studies, health services research, population studies, and randomized clinical trials [e.g., Medical Outcomes Study SF-36 and the Patient-Reported Outcomes Measurement Information System (PROMIS^®)-29]. In addition, we review methods used for economic analysis and calculation of the quality-adjusted life year (QALY). These include the EQ-5D, the Health Utilities Index (HUI), the self-administered Quality of Well-being Scale (QWB-SA), and the Health and Activities Limitation Index (HALex). Furthermore, we consider hybrid measures such as the SF-6D and the PROMIS-Preference (PROPr). The plethora of HRQoL measures has impeded cumulative science because incomparable measures have been used in different studies. Linking among different measures and consensus on standard HRQoL measurement should now be prioritized. In addition, enabling widespread access to common measures is necessary to accelerate future progress. Expected final online publication date for the Annual Review of Public Health, Volume 43 is April 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Solving the Tower of Babel Problem for Patient-Reported Outcome Measures : Comments on: Linking Scores with Patient-Reported Health Outcome Instruments: A Validation Study and Comparison of Three Linking Methods

The PROsetta Stone Project, summarized in this issue by Schalet et al. (Psychometrika 86, 2021), is a major step forward in enabling comparability between different patient-reported outcomes measures. Schalet et al. clearly describe the psychometric methods used in the PROsetta Stone project and other projects from the Patient-Reported Outcomes Measurement Information System (PROMIS): linking based on unidimensional item response theory (IRT), equipercentile linking, and calibrated projection based on multidimensional IRT. Analyses in a validation data set and simulation studies provide strong support that the linking methods are robust when basic assumptions are fulfilled. The links already established will be of great value to the field, and the methodology described by Schalet et al. will hopefully inspire the next series of linking studies. Among potential improvements that should be considered by new studies are: (1) a thorough evaluation of the content of the measures to be linked to better guide the evaluation of measurement assumptions, (2) improvements in the design of linking studies such as selection of the optimal sample to provide data in the score ranges where linking precision is most critical and using counterbalanced designs to control for order effects. Finally, it may be useful to consider how the linking algorithms are used in subsequent data analyses. Analytic strategies based on plausible values or latent regression IRT models may be preferable to the simple transformation of scores from one patient at the time.