Cross-cultural adaptation of the Health Education Impact Questionnaire: experimental study showed expert committee, not back-translation, added value

Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context

OBJECTIVE

to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools.

METHOD

this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis.

RESULTS

the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group.

CONCLUSION

a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola.

Social Role Participation Questionnaire for patients with ankylosing spondylitis: translation into Dutch, reliability and construct validity

OBJECTIVE

The Social Role Participation Questionnaire (SRPQ) assesses the influence of health on participation in 11 specific and one general participation role across 4 participation dimensions: 'importance', 'satisfaction with time', 'satisfaction with performance' and 'physical difficulty'. This study aimed to translate the SRPQ into Dutch, and assess the clinimetric properties and aspects of its validity among patients with ankylosing spondylitis (AS).

METHODS

Translation was performed using the dual panel approach. For each participation dimension, internal consistency, test-retest reliability (n=31), and construct validity were assessed in 246 patients with AS.

RESULTS

The translation required only minor adaptations. Cronbach αs were α≥0.7. A strong correlation was present between satisfaction with 'time' and 'performance'(r=0.85). Test-retest reliability was satisfactory (κ=0.79-0.95). Correlations with participation domains of the Short-Form Health Survey 36 (SF-36), the WHO Disease Assessment Score II, and generic as well as disease-specific health outcomes (Physical and Mental component scale of the SF-36, Satisfaction With Life Scale, Bath Ankylosing Spondylitis Disease Index (BASDAI), Bath Ankylosing Spondylitis Functioning Index (BASFI)) were at least moderate (r=-0.41 to 0.75) for all dimensions except for 'role importance' where correlations were weak (r≤40). Discriminative ability across 5 self-reported health states was good for all dimensions (p<0.01). The 'general participation' role showed similar reliability and validity for each dimension, as the average of the all 11 roles.

CONCLUSIONS

The Dutch version of the SRPQ is available to help understand social role participation of patients with AS. The dimension 'role importance' measures a distinct aspect of participation. The general participation item was a good global measure of participation.

Transcultural Adaptation of Questionnaire to Evaluate Drug Use Among Students: The Use of the EU-Dap European Questionnaire in Brazil

BACKGROUND

Social and cultural differences between countries stress the need for adapting existent instruments for adequately comparing epidemiological results. However, there are controversies in literature on how to carry out this process.

OBJECTIVES

This study aimed to describe the process of cultural adaptation and evaluation of the Brazilian Portuguese language of the European Drug Addiction Prevention Trial (EU-Dap) questionnaire to identify alcohol, tobacco, and other drug use among adolescents.

METHODS

The cross-sectional study took place in 16 public schools in three Brazilian cities during the year 2013 in a sample of 2,969 adolescents between the ages of 11 and 16. Operating steps involved analysis of qualitative data collected through student's focus group and field notes by interviewers and quantitative data from test-retest evaluation and nonresponse to item.

RESULTS

The results revealed moderate reliability for the primary outcomes and high levels of nonresponse, mainly in the 2/3 final questions. Focus group provided high-quality information about misconception for the semantic and structure of the questionnaire. Participatory observation helped researchers to tap into the main difficulties of the application context.

CONCLUSIONS

Sociocultural issues related to Brazilian students, the application context, and the structure of the original questionnaire contributed to the unsatisfactory results of the transcultural adaptation process. The results further highlighted the challenge of adapt questionnaires investigating sensitive issues in an age group particularly influenced by educational factors, especially when the countries have different standards of achievement in education.

Cross-cultural equivalence in translations of the oral health impact profile

The Oral Health Impact Profile (OHIP) has been translated for comparisons across cultural boundaries. This report on a systematic search of literature published between 1994 and 2014 aims to identify an acceptable method of translating psychometric instruments for cross-cultural equivalence, and how they were used to translate the OHIP. An electronic search used the keywords 'cultural adaptation', 'validation', 'Oral Health Impact Profile' and 'OHIP' in MEDLINE and EMBASE databases supplemented by reference links and grey literature. It included papers on methods of cross-cultural translation and translations of the OHIP for dentulous adults and adolescents, and excluded papers without translational details or limited to specific disorders. The search identified eight steps to cross-cultural equivalence, and 36 (plus three supplemental) translations of the OHIP. The steps involve assessment of (i) forward/backward translation by committee, (ii) constructs, (iii) item interpretations, (iv) interval scales, (v) convergent validity, (vi) discriminant validity, (vii) responsiveness to clinical change and (viii) pilot tests. Most (>60%) of the translations involved forward/backward translation by committee, item interpretations, interval scales, convergence, discrimination and pilot tests, but fewer assessed the underlying theory (47%) or responsiveness to clinical change (28%). An acceptable method for translating quality of life-related psychometric instruments for cross-cultural equivalence has eight procedural steps, and most of the 36 OHIP translations involved at least five of the steps. Only translations to Saudi Arabian Arabic, Chinese Mandarin, German and Japanese used all eight steps to claim cultural equivalence with the original OHIP.

Toward Ensuring Health Equity: Readability and Cultural Equivalence of OMERACT Patient-reported Outcome Measures

OBJECTIVE

The goal of the Outcome Measures in Rheumatology (OMERACT) 12 (2014) equity working group was to determine whether and how comprehensibility of patient-reported outcome measures (PROM) should be assessed, to ensure suitability for people with low literacy and differing cultures.

METHODS

The English, Dutch, French, and Turkish Health Assessment Questionnaires and English and French Osteoarthritis Knee and Hip Quality of Life questionnaires were evaluated by applying 3 readability formulas: Flesch Reading Ease, Flesch-Kincaid grade level, and Simple Measure of Gobbledygook; and a new tool, the Evaluative Linguistic Framework for Questionnaires, developed to assess text quality of questionnaires. We also considered a study assessing cross-cultural adaptation with/without back-translation and/or expert committee. The results of this preconference work were presented to the equity working group participants to gain their perspectives on the importance of comprehensibility and cross-cultural adaptation for PROM.

RESULTS

Thirty-one OMERACT delegates attended the equity session. Twenty-six participants agreed that PROM should be assessed for comprehensibility and for use of suitable methods (4 abstained, 1 no). Twenty-two participants agreed that cultural equivalency of PROM should be assessed and suitable methods used (7 abstained, 2 no). Special interest group participants identified challenges with cross-cultural adaptation including resources required, and suggested patient involvement for improving translation and adaptation.

CONCLUSION

Future work will include consensus exercises on what methods are required to ensure PROM are appropriate for people with low literacy and different cultures.

Validation of a French-language version of the health education impact Questionnaire (heiQ) among chronic disease patients seen in primary care: a cross-sectional study

Background

The Health Education Impact Questionnaire (heiQ) allows for the evaluation of the effects of education interventions provided to patients with chronic diseases. This study describes the process for the cross-cultural adaptation and validation of the heiQ into French (heiQ-Fv).

Methods

We undertook a systematic translation process followed by a validation study based on the secondary analysis of cross-sectional data from a longitudinal study. Participants in the validation study were adult patients from primary care clinics in Quebec, Canada, with one or more of the following diseases: diabetes, asthma, chronic obstructive pulmonary disease, cardiovascular disease; or one or more risk factors for these diseases. Main outcomes of the study were the French version of the heiQ-Fv and the validation analyses that included internal consistency, test-retest reliability, confirmatory factor analysis (CFA) and concomitant validity.

Results

The validation analysis was conducted on results from 332 participants. Cronbach’s alphas (internal consistency) for seven domains of the heiQ-Fv varied from 0.80 to 0.89; one domain scored 0.69. The test-retest analysis (n = 50) yielded intra-class correlation coefficients from 0.66 to 0.86. The CFA of the eight heiQ domains with the hypothesis of no correlation between the domains yielded a model that did not exhibit acceptable fit values. A model with the hypothesis of all domains correlated exhibited acceptable fit values (scaled chi-square = 1210.15, degrees of freedom = 712, p < 0.001; CFI = 0.98; RMSEA = 0.06; SRMR = 0.065). Results show a moderate correlation (concomitant validity) between five domains of the heiQ-Fv and the Self-Efficacy for Managing Chronic Diseases. We also found a moderate to strong correlation between the Emotional Wellbeing domain of the heiQ and the Kessler Psychological Distress Scale (K6) (r = 0.61; 95 % CI: 0.52 –0.69, p < 0.01).

Conclusions

The heiQ was translated into French using a rigorous translation process; the French-language version showed good psychometric properties. Health professionals and researchers in primary care settings may use the heiQ-FV to evaluate the impact of educational programs on patients with chronic diseases.

Electronic supplementary material

The online version of this article (doi:10.1186/s12955-015-0254-0) contains supplementary material, which is available to authorized users.

Factor structure and measurement invariance of the Health Education Impact Questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences?

OBJECTIVE

On-going evidence is required to support the validity of inferences about change and group differences in the evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.

METHODS

An archived dataset of responses to the most recent version of the English-language Health Education Impact Questionnaire that uses four rather than six response options (N = 3221) was analysed using exploratory structural equation modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum constraints necessary for model identification.

RESULTS

The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).

CONCLUSION

The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre-post evaluation designs and system-level monitoring and evaluation.

Individual prevention courses for occupational skin diseases: changes in and relationships between proximal and distal outcomes

BACKGROUND

To treat people with occupational contact dermatitis, the German Accident Prevention and Insurance Association in the Health and Welfare Services offers 2-day individual prevention (IP) seminars.

OBJECTIVES

We investigated whether there are short-term and medium-term changes in proximal (e.g. behaviour) and distal (e.g. symptoms) outcomes after an IP seminar, whether changes in proximal outcomes are associated with changes in distal outcomes, and whether subgroups can be identified that benefit in particular.

PATIENTS/MATERIALS/METHODS

In a prospective study, 502 participants of 85 IP courses completed the health education impact questionnaire (heiQ™) and skin symptom questionnaire (Skindex-29) at the start of the course, immediately thereafter, and after 6 months. Change was assessed according to standardized effect size. Regression techniques were used to analyse associations between proximal and distal outcomes.

RESULTS

After 6 months, participants showed improved self-management skills and preventive behaviour, and less fear of job loss, disease-related symptoms, and emotional distress. Significant associations between proximal and distal outcomes were found. Participants who felt more limited by their skin disease showed greater effects.

CONCLUSIONS

The results are consistent with the assumption that IP courses provide a range of benefits for people with occupational contact dermatitis. Changes in distal outcomes may be influenced by changes in proximal outcomes.

Adaptação transcultural de instrumentos de medida do cuidado centrado na família

Objetivo Realizar a adaptação transcultural para a língua portuguesa brasileira de dois instrumentos de medida do cuidado centrado na família, um para pais e outro para profissionais da equipe de saúde. Métodos Estudo metodológico de adaptação transcultural seguindo as etapas de tradução, retrotradução, análise de especialistas, pré-teste, teste-reteste e análise psicométrica após aplicação do instrumento com 100 pais de crianças hospitalizadas e 100 profissionais de unidades pediátricas de um hospital universitário. Resultados A avaliação por especialistas de ambos os instrumentos apresentaram Kappa de 0,85 e 0,93 respectivamente. No pré-teste, os participantes não sugeriram alterações. No teste-reteste houve bons índices de estabilidade em ambos. A análise fatorial explicou 43,9% da variância total no instrumento pais e 43,4% no instrumento equipe. O coeficiente Alpha de Cronbach foi 0,723 no instrumento pais e 0,781 no instrumento equipe. Conclusão Os instrumentos adaptados para a cultura brasileira apresentaram confiabilidade, estabilidade e boa consistência interna com potencial para ser utilizado na pratica clinica pediátrica.

Measurement invariance of English and French Health Education Impact Questionnaire (heiQ) empowerment scales validated for cancer

PURPOSE

If measurement invariance (MI) is demonstrated for a scale completed by respondents from two different language groups, it means that the scale measures the same construct in the same way in both groups. We assessed MI of the French- and English-language versions of the five Health Education Impact Questionnaire (heiQ) empowerment scales validated for the cancer setting.

METHODS

Data came from two cross-sectional studies of Canadian cancer survivors (704 English, 520 French). Single-group confirmatory factor analysis (CFA) was used to test whether the hypothesized factor structure of the French-language heiQ empowerment scales fit the data. Multi-group CFAs were conducted to assess different levels of MI conditions (configural, metric, scalar, strict, as well as MI of factor variances, covariances, and latent means) of the French- and English-language heiQ empowerment scales.

RESULTS

The correlated five-factor model showed good fit in both language groups (goodness-of-fit indices: CFI ≥ .97; RMSEA ≤ .07). Goodness-of-fit indices and tests of differences in fit between models supported MI of the five-factor model across the two language groups (∆CFI ≤ -.010 combined with ∆RMSEA ≤ .015).

CONCLUSIONS

The French- and English-language heiQ empowerment scales measure the same five dimensions of empowerment in the same way across both language groups. Thus, any observed similarities or differences between French- and English-speaking respondents completing these scales are valid and reflect similarities or differences in empowerment across language groups, not measurement artifact. Consequently, heiQ empowerment data from English- and French-speaking respondents can be directly pooled or contrasted in data analyses.

Inernational research in health care management: its need in the 21st century, methodological challenges, ethical issues, pitfalls, and practicalities

PURPOSE

This commentary argues in favor of international research in the 21st century. Advances in technology, science, communication, transport, and infrastructure have transformed the world into a global village. Industries have increasingly adopted globalization strategies. Likewise, the health sector is more internationalized whereby comparisons between diverse health systems, international best practices, international benchmarking, cross-border health care, and cross-cultural issues have become important subjects in the health care literature. The focus has now turned to international, collaborative, cross-national, and cross-cultural research, which is by far more demanding than domestic studies. In this commentary, we explore the methodological challenges, ethical issues, pitfalls, and practicalities within international research and offer possible solutions to address them.

DESIGN/METHODOLOGY/APPROACH

The commentary synthesizes contributions from four scholars in the field of health care management, who came together during the annual meeting of the Academy of Management to discuss with members of the Health Care Management Division the challenges of international research.

FINDINGS

International research is worth pursuing; however, it calls for scholarly attention to key methodological and ethical issues for its success.

ORIGINALITY/VALUE

This commentary addresses salient issues pertaining to international research in one comprehensive account.

Cross-cultural adaptation of instruments assessing breastfeeding determinants: a multi-step approach

Background

Cross-cultural adaptation is a necessary process to effectively use existing instruments in other cultural and language settings. The process of cross-culturally adapting, including translation, of existing instruments is considered a critical set to establishing a meaningful instrument for use in another setting. Using a multi-step approach is considered best practice in achieving cultural and semantic equivalence of the adapted version. We aimed to ensure the content validity of our instruments in the cultural context of KwaZulu-Natal, South Africa.

Methods

The Iowa Infant Feeding Attitudes Scale, Breastfeeding Self-Efficacy Scale-Short Form and additional items comprise our consolidated instrument, which was cross-culturally adapted utilizing a multi-step approach during August 2012. Cross-cultural adaptation was achieved through steps to maintain content validity and attain semantic equivalence in the target version. Specifically, Lynn’s recommendation to apply an item-level content validity index score was followed. The revised instrument was translated and back-translated. To ensure semantic equivalence, Brislin’s back-translation approach was utilized followed by the committee review to address any discrepancies that emerged from translation.

Results

Our consolidated instrument was adapted to be culturally relevant and translated to yield more reliable and valid results for use in our larger research study to measure infant feeding determinants effectively in our target cultural context.

Conclusions

Undertaking rigorous steps to effectively ensure cross-cultural adaptation increases our confidence that the conclusions we make based on our self-report instrument(s) will be stronger. In this way, our aim to achieve strong cross-cultural adaptation of our consolidated instruments was achieved while also providing a clear framework for other researchers choosing to utilize existing instruments for work in other cultural, geographic and population settings.

Measurement of stable changes of self-management skills after rehabilitation: a latent state-trait analysis of the Health Education Impact Questionnaire (heiQ™)

PURPOSE

To assess stable effects of self-management programs, measurement instruments should primarily capture the attributes of interest, for example, the self-management skills of the measured persons. However, measurements of psychological constructs are always influenced by both aspects of the situation (states) and aspects of the person (traits). This study tests whether the Health Education Impact Questionnaire (heiQ™), an instrument assessing a wide range of proximal outcomes of self-management programs, is primarily influenced by person factors instead of situational factors. Furthermore, measurement invariance over time, changes in traits and predictors of change for each heiQ™ scale were examined.

METHODS

Subjects were N = 580 patients with rheumatism, asthma, orthopedic conditions or inflammatory bowel disease, who filled out the heiQ™ at the beginning, the end of and 3 months after a disease-specific inpatient rehabilitation program in Germany. Structural equation modeling techniques were used to estimate latent trait-change models and test for measurement invariance in each heiQ™ scale. Coefficients of consistency, occasion specificity and reliability were computed.

RESULTS

All scales showed scalar invariance over time. Reliability coefficients were high (0.80-0.94), and consistency coefficients (0.49-0.79) were always substantially higher than occasion specificity coefficients (0.14-0.38), indicating that the heiQ™ scales primarily capture person factors. Trait-changes with small to medium effect sizes were shown in five scales and were affected by sex, age and diagnostic group.

CONCLUSION

The heiQ™ can be used to assess stable effects in important outcomes of self-management programs over time, e.g., changes in self-management skills or emotional well-being.