Cross-Cultural and Construct Validity of the Animated Activity Questionnaire

Effect of Context Specificity on Response to the Shortened WOMAC Function Scale in Patients Undergoing Total Knee Arthroplasty

OBJECTIVE

To determine, in patients undergoing total knee arthroplasty (TKA), whether increasing context specificity of selected items of the shortened version of the Western Ontario and McMaster Universities Osteoarthritis Index function (WOMAC-F) scale (ShortMAC-F) (1) enhanced the convergent validity of the ShortMAC-F with performance-based mobility measures (ii) affected mean scale score, structural validity, reliability, and interpretability.

DESIGN

Secondary analysis of randomized clinical trial data.

SETTING

A tertiary teaching hospital.

PARTICIPANTS

Patients undergoing TKA (N=114).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

The ShortMAC-F was modified by specifying the "ascending stairs" and "rising from sitting" items to enquire about difficulty in performing the tasks without reliance on compensatory strategies, whereas the modified "level walking" item enquired about difficulty in walking 400 m. Before and 12 weeks after TKA, patients completed the WOMAC-F questionnaire, modified ShortMAC-F questionnaire, knee pain scale questionnaire, sit-to-stand test, fast gait speed test, and stair climb test. Interpretability was evaluated by calculating anchor-based substantial clinical benefit estimates.

RESULTS

The modified ShortMAC-F correlated significantly more strongly than ShortMAC-F or WOMAC-F with pooled performance measures (differences in correlation values, 0.12-0.14). Increasing item context specificity of the ShortMAC-F did not influence its psychometric properties of unidimensionality (comparative fit and Tucker-Lewis indices, >0.95; root mean square error of approximation, 0.05-0.08), reliability (Cronbach's α, 0.75-0.83), correlation with pain intensity (correlation values, 0.48-0.52), and substantial clinical benefit estimates (16 percentage points); however, it resulted in lower mean score (4.5-4.8 points lower).

CONCLUSIONS

The modified ShortMAC-F showed sufficient measurement properties for clinical application, and it seemed more adept than WOMAC-F at correlating with performance-based measures in TKA.

Establishing language and ethnic equivalence for health-related quality of life item banks and testing their efficiency via computerised adaptive testing simulations

PURPOSE

We aimed to (1) establish linguistic and ethnic equivalence (i.e. lack of bias) for the items in the English and Chinese versions of the Singapore Health and Well Being (SHAWS) Physical Functioning (PF), Positive Mindset (PM) and Social Relationship (SR) item banks (IBs); and (2) evaluate the preliminary efficiency of these IBs using Computer Adaptive Testing (CAT) simulations.

METHODS

In this cross-sectional study, 671, 670, and 672 subjects answered 55, 48 and 30 items of the PF, PM, and SR IBs, respectively. Rasch analysis was conducted to assess each IB's psychometric properties, particularly the presence of differential item functioning (DIF) for language and ethnicity. A set of performance criteria related to removing items that displayed notable DIF were employed. CAT simulations determined the mean number of items for high, moderate, and moderate-low measurement precisions (stopping rule: SEM 0.300, 0.387. 0.521, respectively).

RESULTS

Half of subjects were >50 years old (40.9% PF, 42.1% PM, 41.4% SR), Chinese (50.7% PF, 51.0% PM, 50.6% SR) and female (50.0% PF. 49.4% PM, 52.8% SR) respectively. Rasch analysis revealed 4 items with DIF for the PF IB, 9 items with DIF for the PM IB and 2 items with DIF for the SR IB. In CAT simulations, the mean number of items administered was 8.5, 21.6 and 14.5 for the PF, PM and SR IBs, respectively (SEM 0.300), 5.1, 13.0, 8.0 for PF, PM and SR IBs, respectively (SEM 0.387) and 3.1, 5.3 and 4.1 for PF, PM and SR IBs, respectively (SEM 0.521).

CONCLUSION

The PF, PM and SR IBs to measure health-related quality of life revealed minimal DIF for language and ethnicity after remedial efforts. CAT simulations demonstrated that these IBs were efficient, especially when the stopping rule was set at moderate precision, and support the implementation of the SHAWS IBs into routine clinical care.

Virtual performance measure in osteoarthritis: An innovative transformation of patient care

Objectives

The purpose of this study was to develop and establish reliability and validity of a virtual performance measure (VPM) score that encompassed 10 videos in patients with osteoarthritis of the knee joint. Patients' experience and satisfaction were documented.

Design

Forty videos were chosen for 10 functional tasks, with four videos showing increasing difficulty for each task. Patients were requested to choose the video that best reflected their own situation. Clinical and radiological findings and self-report and performance measures were completed.

Results

Data of 100 patients, 70 (70%) females, mean age: 65 ​± ​9 were examined. The Cronbach's alpha coefficient that examined internal consistency of the VPM score was 0.92. The intraclass correlation value of 0.82 was obtained for test-retest reliability. Factor analysis showed three distinct domains. There was moderate correlations between the VPM score and the self-report and actual performance measures ranging from r ​= ​0.46 to 0.66. The VPM summated score of 10 activities was able to differentiate between candidates and non-candidates for knee arthroplasty, with the area under the curve value of 0.90 indicating excellent predictive validity. The overall patient experience and satisfaction was positive with 67% of participants feeling that virtual care could have an impact on minimizing physical presence in the clinic or hospital.

Conclusions

The VPM is a reliable and valid outcome measure in patients with osteoarthritis of the knee joint. This digital tool has the potential to transform osteoarthritis care by providing a valid remote measurement of real-life functional limitations and reduce the burden of time consuming in-person tests.

Cross-cultural validity of the Animated Activity Questionnaire for patients with hip and knee osteoarthritis: a comparison between the Netherlands and Brazil

BACKGROUND

The Animated Activity Questionnaire (AAQ) was developed in the Netherlands to assess activity limitations in individuals with hip/knee osteoarthritis (HKOA). The AAQ is easy to implement and minimizes the disadvantages of questionnaires and performance-based tests by closely mimicking real-life situations. The AAQ has already been cross-culturally validated in six other countries.

OBJECTIVE

To assess the cross-cultural validity, the construct validity, the reliability of the AAQ in a Brazilian sample of individuals with HKOA, and the influence of formal education on the construct validity of the AAQ.

METHODS

The Brazilian sample (N = 200), mean age 64.4 years, completed the AAQ and the Western Ontario and McMaster Universities Index (WOMAC). A subgroup of participants performed physical function tests and completed the AAQ twice with a one-week interval. The Dutch sample (N = 279) was included to examine Differential Item Functioning (DIF) between the scores obtained in the Netherlands and Brazil. For this purpose, ordinal regression analyses were used to evaluate whether individuals with the same level of activity limitations from the two countries (the Dutch as the reference group) scored similarly in each AAQ item. To evaluate the construct validity, correlation coefficients were calculated between the AAQ, the WOMAC domains, and the performance-based tests. To evaluate reliability, the Cronbach's alpha coefficient, the intraclass correlation coefficient, and the standard error of measurement (SEM) were calculated.

RESULTS

The AAQ showed significant correlations with all the WOMAC domains and performance-based tests (rho=0.46-0.77). The AAQ showed high internal consistency (Cronbach's alpha=0.94), excellent test-retest reliability (ICC_2,1 = 0.98), and small SEM (2.25). Comparing to the scores from the Netherlands, the AAQ showed DIF in two items, however, they did not impact on the total AAQ score (rho=0.99).

CONCLUSION

Overall, the AAQ showed adequate cross-cultural validity, construct validity, and reliability, which enables its use in Brazil and international/multicenter studies.

Brazilian version of the Self-Estimated Functional Inability because of Pain questionnaire for musculoskeletal injuries relating to dance and sport: translation and cross-cultural adaptation

BACKGROUND

Self-Estimated Functional Inability because of Pain (SEFIP) is a questionnaire specifically designed to measure musculoskeletal pain or discomfort.

OBJECTIVE

To perform translation and cross-cultural adaptation of the SEFIP for dancers (SEFIP-dance), for use in Brazilian Portuguese. In addition, as a secondary objective, we adapted the translated version of SEFIP-dance for use among athletes or exercise practitioners (SEFIP-sport).

DESIGN AND SETTING

Questionnaire translation and cross-cultural adaptation study conducted at a public university.

METHODS

The Brazilian version of the SEFIP-dance questionnaire was developed following the processes of translation (involving two translators with Brazilian Portuguese as their mother tongue and fluency in English), backtranslation (involving two translators with English as their mother tongue and fluency in Brazilian Portuguese), committee review and pre-testing. SEFIP-sport was developed following the processes of content and face validation.

RESULTS

SEFIP-dance was applied to 30 dancers, of mean age 22.38 years (standard deviation [SD] = 3.41), among whom 14 were men (46.66%). The participants understood 100% of the SEFIP-dance items and alternatives. SEFIP-sport was applied to 30 athletes or physical exercise practitioners, of mean age 25.09 years (SD = 8.93), among whom 25 were men (86.33%). The participants understood 100% of the -SEFIP-sport items and alternatives.

CONCLUSION

The Brazilian Portuguese versions of SEFIP-dance, translated and cross-culturally adapted for dancers, and SEFIP-sport, adapted for athletes or physical exercise practitioners, were shown to have adequate levels of understanding.

Responsiveness and interpretability of the Animated Activity Questionnaire for assessing activity limitations of patients with hip or knee osteoarthritis

PURPOSE

The aim of the study was to determine the responsiveness and interpretability of the Animated Activity Questionnaire (AAQ), an online questionnaire in which osteoarthritis patients select animations that best match their performance of daily activities.

METHODS

A longitudinal study was carried out, in which 94 patients with hip or knee osteoarthritis were assessed at baseline, and 3 and 6 months after treatment (conservative and surgical). Responsiveness was assessed by means of testing hypotheses about expected correlations between change in AAQ, a Global Rating Scale of change (GRS) and change in the Activities of Daily Living subscale of the Hip disability or Knee injury and Osteoarthritis Outcome Score (H/KOOS), and a combination of performance-based tests (the 30 s chair-stand test, the timed up-and-go test and the nine-step stair climbing test). The minimal important change (MIC) was estimated by means of the receiving operating characteristics (ROC) method.

RESULTS

The correlations of the AAQ with the H/KOOS were as expected, but other correlations were lower than anticipated. The area under the ROC curve was 0.74 at 6 months. At 3 months' follow-up, the correlations were too low to calculate a MIC. A total of 20% of the results at 3 months and 80% of the results at 6 months were in accordance with the hypotheses. The MIC was 9 points at 6 months.

CONCLUSIONS

The AAQ was sufficiently responsive at the six-months follow-up, but not at the three-month follow-up. The MIC at the 6-month follow-up (9 points) was slightly lower than the smallest detectable change of 14 points found in a previous study.

Comparison of a video versus paper questionnaire on functional limitation in lower limb osteoarthritis

INTRODUCTION

The video Animated Activity Questionnaire (AAQ) was developed to assess the impact of lower limb osteoarthritis (OA) on daily functional activities. The objective of the study was to compare the video and the HOOS/KOOS paper questionnaires and to assess the effect of order of administration.

MATERIAL AND METHODS

Patients recruited in the KHOALA cohort were randomized in two groups: AAQ questionnaire first (AAQ-first group) and HOOS (hip)/KOOS (knee) questionnaire first (H/KOOS-first group). Within group differences between AAQ and HOOS/KOOS scores were compared using a Student t-test. The Spearman correlation coefficient between AAQ score and HOOS/KOOS score was calculated in each group then compared, using Fisher z-transformation.

RESULTS

Among 200 randomized patients, 188 (65.8 years, 66.0% women) completed the questionnaires: 99 in the AAQ-first group and 89 in the H/KOOS-first group. The AAQ score was 85.9 (SD: 13.7) in the AAQ-first versus 87.8 (SD: 13.1) in the H/KOOS-first group (p = 0.34). The H/KOOS score was 72.5 (SD: 21.2) in the AAQ-first versus 73.5 (SD: 18.4) in the H/KOOS-first group (p = 0.71). The Spearman correlation coefficient between AAQ and H/KOOS in the AAQ-first was 0.84[0.77-0.89] and 0.73[0.61-0.81] in H/KOOS-first group. These correlations differed between groups significantly (p = 0.02).

CONCLUSION

This study found video AAQ and paper HOOS/KOOS questionnaire highly correlated, with a moderate but significant effect of order administration of video and paper questionnaires evidencing a stronger correlation when the videos were viewed first.

Reliability of the Animated Activity Questionnaire for assessing activity limitations of patients with hip and knee osteoarthritis

OBJECTIVE

The aim of the study was to determine the internal consistency, test-retest reliability and measurement error of the Animated Activity Questionnaire (AAQ) for assessing activity limitations in hip and knee osteoarthritis (HKOA) patients.

METHODS

A total of 1,177 patients, from six countries (the Netherlands, UK, France, Denmark, Italy and Spain), completed the AAQ, a questionnaire consisting of videos displaying 17 activities with 3-5 levels of performance, from which patients choose the video that best matches their own performance. Unidimensionality was assessed by means of confirmatory factor analysis (CFA), using the following fit indices: the Tucker-Lewis index (TFI) >0.95, comparative fit index (CFI) >0.95, and root mean square error of approximation (RMSEA) <0.06. Cronbach's alpha was computed. In 238 patients who completed the AAQ twice, the intra-class correlation coefficient (ICC) was calculated for test-retest reliability. The standard error of measurement (SEM) and the smallest detectable change (SDC) were calculated as parameters of measurement error.

RESULTS

The fit indices for unidimensionality were CFI 0.957, TLI 0.950, and RMSEA 0.144. Cronbach's alpha was 0.95. ICC for test-retest reliability was 0.93 (95% confidence interval 0.91 to 0.95), ranging from 0.85 to 0.98 across countries. SEM and SDC were 4.9 and 13.6, respectively, on a scale from 0 to 100, and ranging from 2.7 to 6.7, and from 7.5 to 18.4, respectively, across countries. The AAQ appeared to measure slightly more precisely in patients with knee problems and patients without prosthesis.

CONCLUSION

The AAQ seemed to be unidimensional, and showed good internal consistency and test-retest reliability. The SDC indicated that changes in scores of at least 14% indicate real improvement in activity limitations.

EFAS Score - Multilingual development and validation of a patient-reported outcome measure (PROM) by the score committee of the European Foot and Ankle Society (EFAS)

BACKGROUND

A scientifically sound validated foot and ankle specific score validated ab initio for different languages is missing. The aim of a project of the European Foot and Ankle Society (EFAS) was to develop, validate, and publish a new score(the EFAS-Score) for different European languages.

METHODS

The EFAS Score was developed and validated in three stages: (1) item (question) identification, (2) item reduction and scale exploration, (3) confirmatory analyses and responsiveness. The following score specifications were chosen: scale/subscale (Likert 0-4), questionnaire based, outcome measure, patient related outcome measurement. For stage 3, data were collected pre-operatively and at a minimum follow-up of 3 months and mean follow-up of 6 months. Item reduction, scale exploration, confirmatory analyses and responsiveness were executed using analyses from classical test theory and item response theory.

RESULTS

Stage 1 resulted in 31 general and 7 sports related questions. In stage 2, a 6-item general EFAS Score was constructed using English, German, French and Swedish language data. In stage 3, internal consistency of the scale was confirmed in seven languages: the original four languages, plus Dutch, Italian and Polish (Cronbach's Alpha >0.86 in all language versions). Responsiveness was good, with moderate to large effect sizes in all languages, and significant positive association between the EFAS Score and patient-reported improvement. No sound EFAS Sports Score could be constructed.

CONCLUSIONS

The multi-language EFAS Score was successfully validated in the orthopaedic ankle and foot surgery patient population, including a wide variety of foot and ankle pathologies. All score versions are freely available at www.efas.co.