Challenges When Translating and Culturally Adapting a Measurement Instrument: The Suitability and Comprehensibility of Materials (SAM+CAM)

Content validation of educational materials on maternal depression in Nigeria

Background

This study describes the content validation process of the already developed English and Yoruba (poster and leaflet) and Yoruba (song) maternal depression educational materials in Nigeria.

Methods

This study is a cross sectional study which is a part of a larger study on training and supervision of Primary health care workers. Study utilized health professionals’ judgement for content validation, and maternal-child health clients’ evaluation for face validation with the use of Suitability Assessment of Materials (SAM). Six bilingual professionals validated both English and Yoruba version of materials (Song has only Yoruba version) and 50 clients evaluated each Yoruba material. Validity Index was calculated by formula and inter-rater agreement using intra-class coefficient (ICC) was analyzed on Professionals’ ratings. ICC, ‵t′ test and Pearson correlation were analyzed on professionals’ rating versus randomly selected six clients’ rating. Descriptive statistics, and fisher exact test were used for other statistical analysis with SPSS version 25.

Results

The mean age of the professionals for poster was 44.3 ± 6.0 years, for leaflet 39.8 ± 7.2 years, for song 43.8 ± 8.4 years. For maternal child health clients, mean age is: 30.7 ± 5.4 years for poster; 31.3 ± 5.2 for leaflet and 29.0 ± 5.1 for song. Outcomes of bilingual professionals’ validation are validity index: English {leaflet (0.94), poster (0.94)}, and Yoruba {leaflet (0.94) poster (0.94) and song (1.00)}. More than 80% clients rated the suitability of each material as superior. There is no significant relationship between clients’ sociodemographic characteristics and their ratings across content, literacy demand and cultural appropriateness domains of the three materials on fisher exact test. The inter-rater agreement among the professionals is excellent on leaflet and song ICC > 0.8, but it is weak on the poster ICC < 0.6. There is no inter-rater agreement on all the three Yoruba materials, but a negative linear correlation was found on the leaflet between the professionals’ ratings and the randomly selected clients’ ratings. ‵t′ test found no statistical difference in the ratings of the professionals and clients only on song material.

Conclusion

This study shows the process of validation of the English and Yoruba versions of the educational materials. This process should be leveraged in the content validation of other maternal-child health education materials in Africa.

Proportionate translation of study materials and measures in a multinational global health trial: methodology development and implementation

OBJECTIVES

Current translation guidelines do not include sufficiently flexible translation approaches for different study materials. We aimed to develop a proportionate methodology to inform translation of all types of study materials in global health trials.

DESIGN

The design included three stages: (1) categorisation of study materials, (2) integration of existing translation frameworks and (3) methodology implementation (Germany, India, Israel, Tanzania and Uganda) and refinement.

PARTICIPANTS

The study population comprised 27 mental health service users and 27 mental health workers who were fluent in the local language in stage 7 (pretesting), and 54 bilingual mental health service users, aged 18 years or over, and able to give consent as judged by a clinician for step 9 (psychometric evaluation).

SETTING

The study took place in preparation for the Using Peer Support in Developing Empowering Mental Health Services (UPSIDES) randomised controlled trial (ISRCTN26008944).

PRIMARY OUTCOME MEASURE

The primary outcome measure was the Social Inclusion Scale (SIS).

RESULTS

The typology identifies four categories of study materials: local text, study-generated text, secondary measures and primary measure. The UPSIDES Proportionate Translation Methodology comprises ten steps: preparation, forward translation, reconciliation, back translation, review, harmonisation, pretesting, finalisation, psychometric evaluation and dissemination. The translated primary outcome measure for the UPSIDES Trial (SIS) demonstrated adequate content validity (49.3 vs 48.5, p=0.08), convergent validity and internal consistency (0.73), with minimal floor/ceiling effects.

CONCLUSION

This methodology can be recommended for translating, cross-culturally adapting and validating all study materials, including standardised measures, in future multisite global trials. The methodology is particularly applicable to multi-national studies involving sites with differing resource levels. The robustness of the psychometric findings is limited by the sample sizes for each site. However, making this limitation explicit is preferable to the typical practice of not reporting adequate details about measure translation and validation.

TRAIL REGISTRATION NUMBER

ISRCTN26008944.