Accuracy and Validity of Computer Adaptive Testing for Outcome Assessment in Patients Undergoing Total Knee Arthroplasty

Establishing language and ethnic equivalence for health-related quality of life item banks and testing their efficiency via computerised adaptive testing simulations

PURPOSE

We aimed to (1) establish linguistic and ethnic equivalence (i.e. lack of bias) for the items in the English and Chinese versions of the Singapore Health and Well Being (SHAWS) Physical Functioning (PF), Positive Mindset (PM) and Social Relationship (SR) item banks (IBs); and (2) evaluate the preliminary efficiency of these IBs using Computer Adaptive Testing (CAT) simulations.

METHODS

In this cross-sectional study, 671, 670, and 672 subjects answered 55, 48 and 30 items of the PF, PM, and SR IBs, respectively. Rasch analysis was conducted to assess each IB's psychometric properties, particularly the presence of differential item functioning (DIF) for language and ethnicity. A set of performance criteria related to removing items that displayed notable DIF were employed. CAT simulations determined the mean number of items for high, moderate, and moderate-low measurement precisions (stopping rule: SEM 0.300, 0.387. 0.521, respectively).

RESULTS

Half of subjects were >50 years old (40.9% PF, 42.1% PM, 41.4% SR), Chinese (50.7% PF, 51.0% PM, 50.6% SR) and female (50.0% PF. 49.4% PM, 52.8% SR) respectively. Rasch analysis revealed 4 items with DIF for the PF IB, 9 items with DIF for the PM IB and 2 items with DIF for the SR IB. In CAT simulations, the mean number of items administered was 8.5, 21.6 and 14.5 for the PF, PM and SR IBs, respectively (SEM 0.300), 5.1, 13.0, 8.0 for PF, PM and SR IBs, respectively (SEM 0.387) and 3.1, 5.3 and 4.1 for PF, PM and SR IBs, respectively (SEM 0.521).

CONCLUSION

The PF, PM and SR IBs to measure health-related quality of life revealed minimal DIF for language and ethnicity after remedial efforts. CAT simulations demonstrated that these IBs were efficient, especially when the stopping rule was set at moderate precision, and support the implementation of the SHAWS IBs into routine clinical care.

Cross-cultural adaptation and validation of the KOOS, JR questionnaire for assessing knee osteoarthritis in Spanish-speaking patients

PURPOSE

The present study aims to translate, adapt and validate a Spanish version of the Knee Injury and Osteoarthritis Outcome Score, Joint Replacement (KOOS, JR), including a reliability and validity analysis in patients with knee osteoarthritis (OA).

METHODS

This study conducted a prospective validation study following the six stages of the "Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures". Psychometric testing was conducted in patients with knee osteoarthritis. Subjects answered the Spanish KOOS, JR (S-KOOS, JR) and a validated Spanish Oxford Knee Score (S-OKS). Retest was conducted at 10 days. Acceptability, floor and ceiling effect, internal consistency (Cronbach's α), reproducibility (mixed-effect model coefficient [MEMC]) and construct validity (Spearman's correlation; p = 0.05) were assessed.

RESULTS

Forty-one patients (mean age: 65.6 ± 5.39; 48.8% female) participated in the study. All patients (100%) answered both scores during the first assessment and 38 (92.7%) during the second assessment. All patient-reported outcomes measures were answered completely (100%). The S-KOOS, JR resulted in 100% acceptability when answered. There were no ceiling or floor effects detected. The Cronbach's α for the S-KOOS, JR was 0.927 and its MEMC was 0.852 (CI 95% 0.636-1.078). The Spearman's correlation between the S-KOOS, JR and the S-OKS was 0.711 (CI 0.345-0.608; p < 0.001) and 0.870 (CI 0.444-0.651; p < 0.001) for the first and second assessments, respectively.

CONCLUSION

The S-KOOS, JR has very high internal consistency and reproducibility, with a high correlation with the S-OKS; it is a reliable and valid instrument for characterising Spanish-speaking patients suffering from knee OA.

LEVEL OF EVIDENCE

IV.

Economic and Humanistic Burden of Osteoarthritis: An Updated Systematic Review of Large Sample Studies

OBJECTIVE

A previous systematic literature review demonstrated a significant economic and humanistic burden on patients with osteoarthritis (OA). The aim of this study was to systematically review and update the burden of OA reported by large sample studies since 2016.

METHODS

We searched Medline (via Ovid) and Embase using the updated search strategy based on the previous review. Those studies with a sample size ≥ 1000 and measuring the cost (direct or indirect) or health-related quality of life (HRQL) of OA were included. Pairs of reviewers worked independently and in duplicate. An arbitrator was consulted to resolve discrepancies between reviewers. The Kappa value was calculated to examine the agreement between reviewers. All costs were converted to 2021 US dollars according to inflation rates and exchange rates.

RESULTS

A total of 1230 studies were screened by title and abstract and 159 by full text, and 54 studies were included in the review. The Kappa value for the full-text screening was 0.71. Total annual OA-related direct costs ranged from US$326 in Japan to US$19,530 in the US. Total annual all-cause direct costs varied from US$173 in Italy to US$41,433 in the US. The annual indirect costs ranged from US$736 in the US to US$18,884 in the Netherlands. Thirty-four studies reported HRQL, with EQ-5D (13, 38%) and Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) (6, 18%) being the most frequently used instruments. The EQ-VAS and utility scores ranged from 41.5 to 81.7 and 0.3 to 0.9, respectively. The ranges of WOMAC pain (range 0-20, higher score for worse health), stiffness (range 0-8), and physical functioning (range 0-68) were 2.0-3.0, 1.0-5.0, and 5.8-42.8, respectively.

CONCLUSION

Since 2016, the ranges of direct costs of OA became wider, while the HRQL of patients remained poor. More countries outside the US have published OA-related disease burden using registry databases.

The Application of Computerized Adaptive Testing to the International Knee Documentation Committee Subjective Knee Evaluation Form

BACKGROUND

Patient-reported outcome measures (PROMs) are commonly used to monitor functional outcomes for clinical and research purposes; unfortunately, many PROMs include redundant, burdensome questions for patients. The use of predictive models to implement computerized adaptive testing (CAT) offer a potential solution to reduce question burden in outcomes research.

PURPOSE

To validate the usage of an appropriate CAT system to improve the efficiency of the International Knee Documentation Committee (IKDC) Subjective Knee Form.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 2.

METHODS

Validation was based on electronically collected patient responses from 2 separate orthopaedic sports medicine clinics. Diagnoses included, but were not limited to, meniscal lesions, ligamentous injuries, and chondral defects. The CAT system was previously developed through analysis of an electronic knee PROM database that did not contain any of these cases.

RESULTS

A total of 2173 patient responses (1229 patients) were collected. The CAT model was able to reduce the question burden by a mean of 9.33 questions (45.1%). Higher CAT-predicted scores correlated strongly with higher actual scores (r = 0.99; intraclass correlation coefficient = 0.99). The mean difference between the CAT-predicted score and the actual PROM score was 0.48 of a point on a scale of 0 to 100.

CONCLUSION

The use of CAT systems, in conjunction with electronic PROMs, can accurately predict outcome scores for IKDC PROMs, while dramatically decreasing the number of questionnaire items needed for any given patient. By decreasing questionnaire burden, clinicians and researchers can potentially increase patient participation and follow-up in both clinical assessments and research trials.