How to translate and locally adapt a PROM. Assessment of cross‐cultural differential item functioning

Use of patient-reported outcome measures after breast reconstruction in low- and middle-income countries: a scoping review

BACKGROUND

Patient-reported outcome measures (PROMs) are increasingly administered in high-income countries to monitor health-related quality of life of breast cancer patients undergoing breast reconstruction. Although low- and middle-income countries (LMICs) face a disproportionate burden of breast cancer, little is known about the use of PROMs in LMICs. This scoping review aims to examine the use of PROMs after post-mastectomy breast reconstruction among patients with breast cancer in LMICs.

METHODS

MEDLINE, Embase, Web of Science, CINAHL, and PsycINFO were searched in August 2022 for English-language studies using PROMs after breast reconstruction among patients with breast cancer in LMICs. Study screening and data extraction were completed. Data were analyzed descriptively.

RESULTS

The search produced 1024 unique studies, 33 of which met inclusion criteria. Most were observational (48.5%) or retrospective (33.3%) studies. Studies were conducted in only 10 LMICs, with 60.5% in China and Brazil and none in low-income countries. Most were conducted in urban settings (84.8%) and outpatient clinics (57.6%), with 63.6% incorporating breast-specific PROMs and 33.3% including breast reconstruction-specific PROMs. Less than half (45.5%) used PROMs explicitly validated for their populations of interest. Only 21.2% reported PROM response rates, ranging from 43.1 to 96.9%. Barriers and facilitators of PROM use were infrequently noted.

CONCLUSIONS

Despite the importance of PROM collection and use in providing patient-centered care, it continues to be limited in middle-income countries and is not evident in low-income countries after breast reconstruction. Further research is necessary to determine effective methods to address the challenges of PROM use in LMICs.

Validation of the psychosocial consequences of screening in lung cancer questionnaire in the international lung screen trial Australian cohort

BACKGROUND

Evaluation of psychosocial consequences of lung cancer screening with LDCT in high-risk populations has generally been performed using generic psychometric instruments. Such generic instruments have low coverage and low power to detect screening impacts. This study aims to validate an established lung cancer screening-specific questionnaire, Consequences Of Screening Lung Cancer (COS-LC), in Australian-English and describe early results from the baseline LDCT round of the International Lung Screen Trial (ILST).

METHODS

The Danish-version COS-LC was translated to Australian-English using the double panel method and field tested in Australian-ILST participants to examine content validity. A random sample of 200 participants were used to assess construct validity using Rasch item response theory models. Reliability was assessed using classical test theory. The COS-LC was administered to ILST participants at prespecified timepoints including at enrolment, dependent of screening results.

RESULTS

Minor linguistic alterations were made after initial translation of COS-LC to English. The COS-LC demonstrated good content validity and adequate construct validity using psychometric analysis. The four core scales fit the Rasch model, with only minor issues in five non-core scales which resolved with modification. 1129 Australian-ILST participants were included in the analysis, with minimal psychosocial impact observed shortly after baseline LDCT results.

CONCLUSION

COS-LC is the first lung cancer screening-specific questionnaire to be validated in Australia and has demonstrated excellent psychometric properties. Early results did not demonstrate significant psychosocial impacts of screening. Longer-term follow-up is awaited and will be particularly pertinent given the announcement of an Australian National Lung Cancer Screening Program.

TRIAL REGISTRATION

NCT02871856.

Functional performance tests, clinical measurements, and patient-reported outcome measures do not correlate as outcomes 1 year after anterior cruciate ligament reconstruction

PURPOSE

The results after anterior cruciate ligament reconstruction (ACLR) are evaluated by laxity measures, functional tests, and patients' perception by patient-reported outcome measures (PROMs). It is not known, if one of these evaluation instruments is representative or if outcome scores from all must be reported to obtain a full evaluation of the condition. The aim was to study the correlations between these three types of outcomes 1 year after primary ACLR.

METHOD

All adult patients (range 18-45 years) who had an ACLR between 1.1.2019 and 31.12.2021 were offered 1-year follow-up by an independent observer. Preoperative information about knee laxity and peroperative information about the condition of menisci and cartilage were registered. At 1-year follow-up clinical and instrumented knee stability and function assessed by four different hop tests were registered. Patients completed four PROMs (the Subjective International Knee Documentation Committee (IKDC) score, the Knee Numeric-Entity Evaluation Score (KNEES-ACL), the Knee injury and Osteoarthritis Outcome Score (KOOS) and the Lysholm score) and Tegner activity scale and answered anchor questions regarding satisfaction and willingness to repeat the operation.

RESULTS

A total of 190 adults attended the 1-year follow-up and 151 had all assessments. There were only a few positive and weak correlations between performance tests and PROMS and between clinical measurements and PROMS (r = 0.00-0.38), and the majority were of negligible strength. Tegner score had in general the highest correlation (low to moderate). The highest correlation was 0.53 (moderate) between the anchor question about patient satisfaction and Lysholm/IKDC scores. There was no difference in the correlations depending on meniscal condition.

CONCLUSIONS

In ACLR patients there was no clinically relevant correlation between scores obtained by PROMs, a battery of functional performance tests and instrumented laxity of the knee at 1-year follow-up. Therefore, one type of outcome cannot represent the others. This is an argument for always to include and report all three types of outcomes, and conclusions based on one type of outcome may not be sufficient.

LEVEL OF EVIDENCE

II.

Fixing the Leaky Pipe: How to Improve the Uptake of Patient-Reported Outcomes-Based Prognostic and Predictive Models in Cancer Clinical Practice

PURPOSE

This discussion paper outlines challenges and proposes solutions for successfully implementing prediction models that incorporate patient-reported outcomes (PROs) in cancer practice.

METHODS

We organized a full-day multidisciplinary meeting of people with expertise in cancer care delivery, PRO collection, PRO use in prediction modeling, computing, implementation, and decision science. The discussions presented here focused on identifying challenges to the development, implementation and use of prediction models incorporating PROs, and suggesting possible solutions.

RESULTS

Specific challenges and solutions were identified across three broad areas. (1) Understanding decision making and implementation: necessitating multidisciplinary collaboration in the early stages and throughout; early stakeholder engagement to define the decision problem and ensure acceptability of PROs in prediction; understanding patient/clinician interpretation of PRO predictions and uncertainty to optimize prediction impact; striving for model integration into existing electronic health records; and early regulatory alignment. (2) Recognizing the limitations to PRO collection and their impact on prediction: incorporating validated, clinically important PROs to maximize model generalizability and clinical engagement; and minimizing missing PRO data (resulting from both structural digital exclusion and time-varying factors) to avoid exacerbating existing inequalities. (3) Statistical and modeling challenges: incorporating statistical methods to address missing data; ensuring predictive modeling recognizes complex causal relationships; and considering temporal and geographic recalibration so that model predictions reflect the relevant population.

CONCLUSION

Developing and implementing PRO-based prediction models in cancer care requires extensive multidisciplinary working from the earliest stages, recognition of implementation challenges because of PRO collection and model presentation, and robust statistical methods to manage missing data, causality, and calibration. Prediction models incorporating PROs should be viewed as complex interventions, with their development and impact assessment carried out to reflect this.

Initial Psychometric Evaluation of the Portuguese Version of the Canine Orthopedic Index

OBJECTIVE

 The aim of this study was to perform the initial psychometric evaluation of the Portuguese version of the Canine Orthopaedic Index (COI).

STUDY DESIGN

 In a prospective, randomized study, a group of 50 police working dogs with bilateral hip osteoarthritis was assessed. A copy of the translated Portuguese version of the COI was completed by canine handlers, native Portuguese speakers. This result was compared with that of 50 sound dogs. Construct validity was determined by comparing sound dogs and dogs with osteoarthritis scores with the Mann-Whitney test. Additionally, the Kaiser-Meyer-Olin measure of sampling adequacy, eigenvalue, and scree-plot analysis were performed. Internal consistency was tested with Cronbach's α.

RESULTS

 A significant difference was observed between osteoarthritis and sound dogs in all dimensions of the COI (p < 0.01 for all), indicating construct validity. Two factors accounted for 87.8% of the total variance. Cronbach's α was 0.98, with a high interitem correlation, accounting for strong internal consistency.

CONCLUSION

 We presented criterion and construct validity of the Portuguese version of the COI. It is a step in providing clinicians with a validated and accessible tool to evaluate orthopaedic patients. Further studies are required.

Danish Linguistic Validation and Cultural Adaptation of the LIMB-Q Kids

(1) Background: Lower Limb deformities include many conditions where pain and physical limitations negatively impact the health-related quality of life (HRQL) of children. The ideal way to assess this impact is by using a Patient Reported Outcome Measure (PROM). Such a condition-specific PROM is under development, called LIMB-Q Kids. This study aimed to perform a translation and cultural adaption (TCA) of the LIMB-Q Kids for use in Danish-speaking children. (2) Methods: TCA guidelines established by the World Health Organization (WHO) and the Professional Society for Health Economics and Outcomes Research (ISPOR) were followed. This process consisted of two independent forward translations, a reconciliation meeting, a backward translation with an assessment, an expert meeting, cognitive interviews with patients, editing based on the interviews, and proofreading. (3) Results: The TCA process contributed to the Danish version of LIMB-Q Kids. The reconciliation meeting resulted in a reconciled Danish version. The revision of the backward translation led to 16 corrections, and after the expert panel meeting, 26 changes were made. Twelve cognitive interviews led to nine changes, which were validated by two further interviews. Proofreading led to no further comments. (4) Conclusions: The TCA process led to a linguistically validated and culturally adapted Danish version of LIMB-Q Kids. This version is being used in the international field test study.

Cross-Culturally Adapted Versions of Patient Reported Outcome Measures for the Lower Extremity

Background

A large number of patient reported outcome measures (PROMs) have been developed in the English language for various lower extremity orthopaedic pathologies. Twenty different PROMs were recommended for 15 specific musculoskeletal lower extremity pathologies or surgeries. However, the availability of cross-culturally adapted versions of these recommended PROMs is unknown.

Purpose

The purpose of this study was to identify the cross-culturally adapted versions of recommended PROMs for individuals experiencing orthopedic lower extremity pathologies or undergoing surgeries, and to identify the psychometric evidence that supports their utilization.

Study design

Literature Review.

Methods

PubMed, Embase, Medline, Cochrane, CINAHL, SPORTDisucs and Scopus were searched for cross-culturally adapted translated studies through May 2022. The search strategy included the names of the 20 recommended PROMs from previous umbrella review along with the following terms: reliability, validity, responsiveness, psychometric properties and cross-cultural adaptation. Studies that presented a non-English language version of the PROM with evidence in at least one psychometric property to support its use were included. Two authors independently evaluated the studies for inclusion and independently extracted data.

Results

Nineteen PROMS had cross-culturally adapted and translated language versions. The KOOS, WOMAC, ACL-RSL, FAAM, ATRS, HOOS, OHS, MOXFQ and OKS were available in over 10 different language versions. Turkish, Dutch, German, Chinese and French were the most common languages, with each language having more than 10 PROMs with psychometric properties supporting their use. The WOMAC and KOOS were both available in 10 languages and had all three psychometric properties of reliability, validity, and responsiveness supporting their use.

Conclusion

Nineteen of the 20 recommended instruments were available in multiple languages. The PROM most frequently cross-culturally adapted and translated were the KOOS and WOMAC. PROMs were most frequently cross-culturally adapted and translated into Turkish. International researchers and clinicians may use this information to more consistently implement PROMs with the most appropriate psychometric evidence available to support their use.

Level of evidence

3a.

Assessment of structural and cross-cultural validity of the Disabilities of the Arm, Shoulder and Hand questionnaire: a scoping review

Introduction

The Disabilities of the Arm, Shoulder and Hand (DASH) Questionnaire is a patient-reported outcome measure (PROM) that has been translated and cross-culturally adapted to at least 50 languages. Since the measure was developed in 1996, many researchers have reported on the construct validity (including structural and cross-cultural validity) of this instrument following translation and cross-cultural adaptation. The aim of this scoping review was to identify the methods used for the psychometric evaluation of structural and cross-cultural validity of the DASH questionnaire.

Methods

The updated methodological guidance for the conduct of scoping reviews and the PRISMA Extension for scoping reviews checklist was utilised. EBSCOHost (Academic Search Premier, Africa Wide, CINAHL, E-Journals and Medline), PubMed and Google Scholar were searched for articles (published between 1996-2022) and considered against the eligibility criteria.

Results

The scoping review collated evidence across 50 articles (37 language versions) of the evaluation of structural and cross-cultural validity of the DASH questionnaire. Three articles conducted confirmatory factor analysis (CFA) to assess structural validity, and none performed Multiple Group Confirmatory Factor Analysis (MGCFA) to assess cross-cultural validity.

Conclusion

The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) taxonomy propose that structural validity is best evaluated through CFA, with prior evidence of dimensionality. Additionally, cross-cultural validity (measurement invariance) is to be evaluated through MGCFA. This review identified that CFA is utilised infrequently and that to date cross-cultural validity has not been appropriately assessed for translations of the DASH questionnaire.

Structural and cross-cultural validity of the Afrikaans for the Western Cape Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire

BACKGROUND

The Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire has been translated and cross-culturally adapted to Afrikaans for the Western Cape, within the public health service context of South Africa. The aim of this study was to evaluate structural validity, internal consistency, and cross-cultural validity/measurement invariance of this new translation to increase applicability and clinical utility in a public health service context.

METHODS

During this cross-sectional study, exploratory factor analysis (EFA) was conducted with parallel analysis and oblimin rotation. Confirmatory factor analysis (CFA) and multiple group confirmatory factor analysis (MGCFA) to assess cross-cultural validity/measurement invariance, was employed to test model fit with X² goodness-of-fit statistic, root mean square error of approximation (RMSEA), standardized root mean square residual (SRMR) and comparative fit index (CFI). Internal consistency was calculated using Cronbach's alpha.

RESULTS

109 women and 110 men (n = 219) completed the Afrikaans for the Western Cape and the South African English DASH questionnaire, used during the analysis. Unidimensionality of the Afrikaans for the Western Cape DASH questionnaire was not supported in the 218 questionnaires eligible for inclusion in the analysis [X² (df) = 1799.10 (405); p value = < 0.01; RMSEA (90% CI) = 0.126 (0.120-0.132); SRMR = 0.09 and CFI = 0.984]. EFA revealed a two-factor structure with Eigenvalues exceeding one explaining 55% and 7% of the variance. The two-factor structure of the Afrikaans for the Western Cape DASH questionnaire was supported during CFA. Cronbach's alpha revealed good internal consistency of both factors [factor 1 = 0.97 (0.96, 0.97) and factor 2 = 0.92 (0.90, 0.94)]. MGCFA conducted between 218 Afrikaans for the Western Cape DASH and 219 South African English DASH questionnaires (N = 437) revealed that the data supports configural, metric and scalar invariance models during initial model fit assessment. Subsequent hypotheses testing comparing the nested models revealed that scalar invariance holds.

CONCLUSION

The Afrikaans for the Western Cape DASH questionnaire revealed a two-factor structure with good internal consistency across the two factors and demonstrated measurement invariance with the South African English DASH questionnaire.

LIMB-Q Kids—German Translation and Cultural Adaptation

(1) Purpose: Lower limb deformities can have a severe impact on health-related quality of life (HRQL). LIMB-Q Kids is a new patient-reported outcome measure (PROM) aiming to elucidate the experience of 8–18-year-old patients before, during and after treatment, and to measure the different aspects of HRQL. The aim of this study was to translate and culturally adapt LIMB-Q Kids to German. (2) Methods: The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) guidelines were followed. Three forward translations, a backward translation, an expert panel meeting with eight participants, and twenty cognitive debriefing interviews led to the final German version of LIMB-Q Kids. (3) Results: In the forward translations, 4/159 items were difficult to translate, and 2/159 items in the backward translation differed from the original English version. Cognitive debriefing interviews with 20 patients identified 7/159 items that were difficult to comprehend/answer, and 2 of these items were changed. (4) Conclusions: Lower limb deformities can have a great impact on children, and it is important to measure and consider the impact on HRQL. In order to be able to use PROMs in different countries, conceptually equivalent translations and cultural adaptations should be performed in order to ensure comprehensibility. The final German version of LIMB-Q Kids is ready for use in an international field test.

Dual-panel translation to Danish and Rasch validation of the Foot and Ankle Ability Measure (FAAM-DK)

BACKGROUND

The Foot and Ankle Ability Measure (FAAM) was developed by involvement of patients with chronic ankle instability (CAI) and has acceptable measurement properties, but is not available in Danish.

METHODS

FAAM was translated and culturally adapted into Danish, and its measurement properties were assessed using Rasch analyses.

RESULTS

A Danish version was produced with small adaptations, and content relevance was confirmed by Danish patients. The 21-item ADL domain showed misfit to the Rasch model, but after removing six items, the resulting 15-item scale displayed adequate fit. The Sports domain also exhibited misfit, but after removing one item and adjusting due to differential item functioning related to age for another item, a 7-item scale showed good fit. This resulted in a 22-item 2-dimensional Danish version of FAAM.

CONCLUSION

The 22-item Danish FAAM exhibits robust measurement properties for patients with various conditions of the lower leg, ankle, and foot, including CAI.

Systematic review on the measurement properties of diabetes-specific patient-reported outcome measures (PROMs) for measuring physical functioning in people with type 2 diabetes

We aimed to systematically assess the measurement properties of diabetes-specific patient-reported outcome measures (PROMs) for measuring physical functioning, one of the core outcomes, in adults with type 2 diabetes.We performed a systematic literature search for PROMs or subscales measuring physical function that were validated to at least some extent in EMBASE and MEDLINE. Measurement properties were evaluated according to the COSMIN guideline for systematic reviews of PROMs.In total 21 articles were included, describing 12 versions of 7 unique diabetes-specific PROMs or subscales measuring physical functioning. In general, there were few high-quality studies on measurement properties of PROMs measuring physical functioning in adults with type 2 diabetes. The Dependence/Daily Life subscale of the Diabetic Foot Ulcer Scale-Short Form (DFS-SF) and the Impact of Weight on Activities of Daily Living Questionnaire (IWADL) were most extensively evaluated. Both had sufficient ratings for aspects of content validity, although with mostly very low-quality evidence. Sufficient ratings for structural validity, internal consistency, and reliability were also found for both instruments, but responsiveness was rated inconsistent for both instruments. The other PROMs or subscales often had insufficient aspects of content validity, or their unidimensionality could not be confirmed.This systematic review showed that the Dependence/Daily Life subscale of the DFS-SF and the IWADL could be used to measure physical functioning in people with type 2 diabetes in research or clinical practice, while keeping the limitations of these instruments in mind. The measurement properties that have not been evaluated extensively for these PROMs should be evaluated in future studies.The study protocol was registered in the PROSPERO database, number CRD42021234890.

Validation of the Copenhagen Hip and Groin Outcome Score (HAGOS) using modern test theory across different cultures and languages: a cross-sectional study of 452 male athletes with groin pain

BKGROUND

No studies have tested the validity of the Copenhagen Hip and Groin Outcome Score (HAGOS) using modern test theory, across different cultures and languages.

OBJECTIVE

To validate the Danish, English and Norwegian versions of HAGOS and its six subscales (Symptoms (S, Item 1-7), Pain (P, Item 1-10), activities of daily living (Item 1-5), Sport and recreation (Sport/rec, Item 1-8), Participation in physical activity (item 1-2) and quality of life (item 1-5)) by evaluating differential item functioning (DIF) and measurement invariance across the three language versions in male multidirectional team athletes with groin pain. Second, to modify subscales depending on goodness-of-fit to the item response theory models and calculate conversion tables if language DIF was observed.

METHODS

We included individual responses to the Danish (n=157), English (n=146) and Norwegian (n=149) language versions of HAGOS from 452 athletes (median age 24 years old, range 20-28) with groin pain. Overall fit, model fit, individual item fit, local response dependence and measurement invariance was examined using confirmatory factor analysis and graphical Rasch models.

RESULTS

The removal of seven misfitting items (S2, P1, P2, A4, SP1, SP5, Q3) resulted in 6 HAGOS subscales with acceptable psychometric properties. For the Symptoms, Pain and Sports subscales evidence of DIF was disclosed between the three different language-versions of HAGOS and conversion tables were created.

CONCLUSIONS

A revised HAGOS derived using modern test theory provides valid measurements for male multidirectional athletes with groin pain across different cultures and languages. Conversion tables must be applied to compare HAGOS scores from Danish, Norwegian and English language versions.

Work Climate Scale in Emergency Services: Abridged Version

This study is based on a 40-item work climate scale in hospital emergency services (WCSHES). Teams working in these emergency services experience a heavy workload and have a limited amount of time with each patient. COVID-19 has further complicated these existing issues. Therefore, we believed it would be helpful to draft an abridged version of the 40-item WCSHES, considering both validity and reliability criteria, but giving greater weight to validity. One hundred and twenty-six workers between the ages of 20 to 64 (M = 32.45; standard deviation (SD = 9.73)) years old participated voluntarily in the study. The validity, reliability, and fit model were evaluated in an iterative process. The confirmatory factor analysis yielded appropriate global fit indices in the abridged 24-item version (Χ²(248) = 367.84; p < 0.01, RMSEA = 0.06 with an interval of 90% from 0.05 to 0.07, SRMR = 0.08, GFI = 0.9, AGFI = 0.96, CFI = 0.98, NFI = 0.95, and NNFI = 0.98), along with test criteria validity (ρ_XY = 0.68, p < 0.001) and excellent reliability (α = 0.94 and ω = 0.94), maintaining the same conceptualization and usefulness of the original scale. The abridged 24-item version was used to measure four work climate factors (work satisfaction, productivity/achievement of aims, interpersonal relations, and performance at work). Evidence of the usefulness of the new abridged scale is provided along with a description of our study limitations and future areas for development.

Patient perceptions of outcome measures in chronic inflammatory demyelinating polyneuropathy: A study of the Inflammatory Rasch-built Overall Disability Scale

BACKGROUND

Patients' perceptions of outcome measures used in chronic inflammatory demyelinating polyneuropathy (CIDP) are unknown.

METHODS

We performed a cross-sectional evaluation of patient perceptions of the Inflammatory Rasch-built Overall Disability Scale (I-RODS) from 41 subjects with CIDP through a structured questionnaire. We assessed perceived hesitation to provide a response, item importance and relevance, understanding of specific items and factors affecting responses.

RESULTS

Hesitation to provide a categorical answer was reported by 20% of subjects or more, for 5/24 (20.8%) items. Uncertainty was most frequent for "travel by public transport" (22.4%) and "catch an object (e.g., ball)" (24%). Six of 24 (25%) items were perceived as unimportant to their disease by at least a third of participants. Items most commonly perceived as unimportant were "travel by public transport" in 53.7%, "catch an object (e.g., ball)" in 61% and "dance" in 65.9%. Several items were frequently perceived as irrelevant. These included "move a chair" (39%), "do the dishes" (46.3%), "catch an object (e.g., ball)" (61%), "travel by public transport" (68.3%) and "stand for hours" (82.9%). The understanding of multiple items such as "read a book", "sit on a toilet" and "take a shower" was found to be highly variable. Fatigue was perceived more commonly than mood (53.7% vs. 17.1%, p = 0.001), and more commonly in younger subjects (p = 0.037), as influencing responses to the I-RODS.

CONCLUSIONS

Patient-perceived uncertainty, unimportance, irrelevance and poor understanding of items, as well as fatigue and mood, impact on the value of the I-RODS. Greater emphasis on individualized disability assessments requires consideration in future.

Choosing the most appropriate PROM for clinical studies in sports medicine

Choosing the most appropriate patient-reported outcome measure (PROM) for a clinical study is essential in order to achieve trustworthy results. This choice will depend on (a) the objective of the study and hence the research question; (b) the choice of a theoretical framework, such as the World Health Organization's International Classification of Functioning, Disability, and Health (ICF); (c) whether there currently is a PROM that possesses high content validity and high construct validity for the specific patient group and objective, and if not; (d) the decision on whether to use a suboptimal PROM or develop and validate a new PROM. This paper presents the steps that should be followed in order to assess the relevance of PROMs and suggests ways to enhance the choice depending on the goal of the study.