Insufficient cross-cultural adaptations and psychometric properties for many translated health assessment scales: A systematic review

Cross-Cultural Adaptation of the Neck Bournemouth Questionnaire: A Methodological Systematic Review

OBJECTIVE

Neck pain is a common musculoskeletal disorder, and it affects the quality of life of patients. As an effective and reliable multidimensional measurement tool for neck pain, the Neck Bournemouth Questionnaire (NBQ) has been cross-culturally adapted into multiple languages for clinical practice. The aim of this study was to evaluate the translation procedures and measurement properties of cross-cultural adaptations of the NBQ.

METHODS

Searches were conducted in the databases PubMed, Web of Science, Embase and Scopus using the keywords: "the Neck Bournemouth Questionnaire," "NBQ," "cross-cultural," and "adaptation." Methodological quality of cross-cultural adaptation processes and measurement properties were comprehensively assessed by the guidelines for Cross-cultural Adaptation Process of Self-Reporting Measures and the Consensus-based Standards for the Selection of Health Measurement Instruments.

RESULTS

There were 12 adaptations of NBQ in 10 different languages, including Dutch, simplified Chinese, and German. Among these studies, 11 adaptations completed all cross-cultural adaptation procedures. However, significant variations existed in the specific implementation plans, particularly regarding translator selection and expert committee composition. Most cross-cultural adaptations reported internal consistency, reliability, and construct validity. Only one study conducted factor analysis and hypothesis testing. Five adaptations examined floor and ceiling effects with one reporting a floor effect. A few studies reported protocol responsiveness and interpretability.

CONCLUSIONS

The Dutch, German, and Urdu adaptations demonstrate comparatively higher quality than other adaptations. Further research should comprehensively evaluate the measurement properties of the NBQ in the French, Portuguese-Brazilian, and Turkish adaptations.

Translation, Cross-Cultural Adaptation, and Validation of Measurement Instruments: A Practical Guideline for Novice Researchers

Cross-cultural validation of self-reported measurement instruments for research is a long and complex process, which involves specific risks of bias that could affect the research process and results. Furthermore, it requires researchers to have a wide range of technical knowledge about the translation, adaptation and pre-test aspects, their purposes and options, about the different psychometric properties, and the required evidence for their assessment and knowledge about the quantitative data processing and analysis using statistical software. This article aimed: 1) identify all guidelines and recommendations for translation, cross-cultural adaptation, and validation within the healthcare sciences; 2) describe the methodological approaches established in these guidelines for conducting translation, adaptation, and cross-cultural validation; and 3) provide a practical guideline featuring various methodological options for novice researchers involved in translating, adapting, and validating measurement instruments. Forty-two guidelines on translation, adaptation, or cross-cultural validation of measurement instruments were obtained from "CINAHL with Full Text" (via EBSCO) and "MEDLINE with Full Text". A content analysis was conducted to identify the similarities and differences in the methodological approaches recommended. Bases on these similarities and differences, we proposed an eight-step guideline that includes: a) forward translation; 2) synthesis of translations; 3) back translation; 4) harmonization; 5) pre-testing; 6) field testing; 7) psychometric validation, and 8) analysis of psychometric properties. It is a practical guideline because it provides extensive and comprehensive information on the methodological approaches available to researchers. This is the first methodological literature review carried out in the healthcare sciences regarding the methodological approaches recommended by existing guidelines.

Cross-cultural validation and measurement invariance of anxiety and depression symptoms: A study of the Brief Symptom Inventory (BSI) in 42 countries

BACKGROUND

Depression and anxiety are among the most prevalent mental health issues experienced worldwide. However, whereas cross-cultural studies utilize psychometrically valid and reliable scales, fewer can meaningfully compare these conditions across different groups. To address this gap, the current study aimed to psychometrically assess the Brief Symptomatology Index (BSI) in 42 countries.

METHODS

Using data from the International Sex Survey (N = 82,243; Mage = 32.39; SDage = 12.52; women: n = 46,874; 57 %), we examined the reliability of depression and anxiety symptom scores of the BSI-18, as well as evaluated evidence of construct, invariance, and criterion-related validity in predicting clinically relevant variables across countries, languages, genders, and sexual orientations.

RESULTS

Results corroborated an invariant, two-factor structure across all groups tested, exhibiting excellent reliability estimates for both subscales. The 'caseness' criterion effectively discriminated among those at low and high risk of depression and anxiety, yielding differential effects on the clinical criteria examined.

LIMITATIONS

The predictive validation was not made against a clinical diagnosis, and the full BSI-18 scale was not examined (excluding the somatization sub-dimension), limiting the validation scope of the BSI-18. Finally, the study was conducted online, mainly by advertisements through social media, ultimately skewing our sample towards women, younger, and highly educated populations.

CONCLUSIONS

The results support that the BSI-12 is a valid and reliable assessment tool for assessing depression and anxiety symptoms across countries, languages, genders, and sexual orientations. Further, its caseness criterion can discriminate well between participants at high and low risk of depression and anxiety.

Validation and Clinical Application of the Japanese Version of the Patient-Reported Experience Measures for Intermediate Care Services: A Cross-Sectional Study

Older adult patients account for 70% of all hospitalized patients in Japan, and intermediate care based on patient-centered care (PCC) that ensures continuity and quality of care at the interface between home services and acute care services and restores patient's independence and confidence is necessary for them to continue living independently. At present, no concept of intermediate care is established in Japan, and the implementation of PCC has been delayed. Thus, in this study, a Japanese version of the intermediate care evaluation index (patient-reported experience measure (PREM)) was created on the basis of the original PREM developed in the UK, and data in wards with intermediate care functions in Japan were collected to confirm internal consistency and validity from 2020 to 2022. The Japanese version of PREM was found to have a factor structure with two potential factors. Given the clear correlation with the shared decision-making evaluation index, which is the pinnacle of PCC, the theoretical validity of the Japanese version of PREM, which is based on PCC as a theoretical basis, was confirmed.

Consensus of the definitions of the OMERACT glucocorticoid impact core domain set for people with rheumatic and musculoskeletal diseases

BACKGROUND

The Outcome Measures in Rheumatology (OMERACT) Glucocorticoid (GC) Impact Working Group has been working to develop a core domain set to measure the impact of GCs on patients living with rheumatic and musculoskeletal diseases. The mandatory domains previously identified for inclusion in all clinical trials measuring the GC effects include infection, bone fragility, mood disturbance, hypertension, diabetes, weight, fatigue, and mortality. Before progressing to instrument selection, the Working Group sought to establish precise definitions of all mandatory domains within the core domain set.

METHODS

OMERACT methodology was applied with the use of evidence and consensus-based decision making of all stakeholder groups (patient research partners, health care professionals, clinician researchers, industry members and methodologists) to develop detailed definitions for the broad domain, target domain and domain components, taking into consideration sources of variability that could affect measurement of the domain.  The working group synthesized prior qualitative studies, quantitative work, and results from Delphi rounds, to develop a rich definition of 'what' is to be measured.

RESULTS

Between 2021 and 2023, the OMERACT Working Group on GC Impact conducted virtual meetings to establish domain definitions. First, we mapped each domain onto an OMERACT Core Area. All domains were primarily represented within the Pathophysiological Manifestations Core Area, except from Fatigue which was primarily Life Impact and Weight which spanned both Core Areas. Sources of variability included cultural factors, age, gender, education level, socioeconomic status, personal experiences, emotional state, and language barriers. The domain definitions will form the foundation for instrument selection and the initial step of domain / concept match and content validity in the OMERACT pillar of 'truth' before moving on to feasibility and discrimination.

CONCLUSION

The OMERACT GC Impact Working Group has developed and agreed upon detailed domain definitions for core domains. Future steps of the working group are to select instruments and develop the core outcome measurement set for clinical trials measuring the impact of GC on patients with rheumatic and musculoskeletal diseases.

Developing a research tool to detect iatrogenic adverse events in psychiatric health care by involving service users and health professionals

WHAT IS KNOWN ON THE SUBJECT

Most health professionals working in psychiatric care will experience adverse events (AE) such as service user suicide or violence, during their career Norway lacks measures to capture potential iatrogenic injuries, such as risk assessment measures, to evaluate patient records for AEs in both inpatient and outpatient psychiatric clinics in hospitals WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE: We have described an approach to the validation of a research tool between different national contexts; a process that went beyond language translation We have incorporated the understanding of health professionals and service users; to bring together the lifeworld of the patient with the professional definition of AEs, triggers and risk areas of AEs in a psychiatric context. The service users' experiences resulted in modifications to the tool.

WHAT ARE THE IMPLICATIONS FOR NURSES

Applying the 'Global Trigger Tool-Psychiatry' in Norway and Sweden can help mental health nurses to prevent iatrogenic harm and reduce the occurrence of AEs through the identification of potential triggers. Implementing 'Global Trigger Tool-Psychiatry' might help mental health nurses to improve patient safety in Norway and Sweden.

ABSTRACT

INTRODUCTION: There is little consensus on cross-cultural and cross-national adaptation of research instruments.

AIM/QUESTION

To translate and validate a Swedish research tool (GTT-P) to detect iatrogenic adverse events in psychiatric health care by involving service users and health professionals in the process.

METHOD

The GTT-P, designed to identify events in patient records that were triggers for adverse events, was translated to Norwegian using a cross-cultural adaptation approach. This involved two focus groups with clinical staff, one of which involved service users, and a joint discussion at a Dialogue Conference to generate consensus on the definition of the triggers of potential adverse events identifiable in patient records.

RESULTS

We highlight both the differences and commonalities in defining the nature of risks, the adverse events and the triggers of such events. The Dialogue Conference resulted in three modifications of the tool, based on service users' experiences. Service user involvement and co-production was essential for both the translation and adaptation of the research instrument.

DISCUSSION

We have described an approach to the validation of a research tool between different national contexts; a process that went beyond language translation. This approach enables a more nuanced understanding of potential risks within a psychiatric context as it engages differences in the care delivery. Applying the GTT-P in hospital-based psychiatric care might help to identify processes that need to be changed in order to promote patient safety and a safer work environment for mental health nurses.

IMPLICATIONS FOR PRACTICE

When translating and validating the GTT-P from Swedish to Norwegian, we have considered the knowledge and experiences of both service users and health professionals. The application of the GTT-P can promote greater patient safety in hospital settings.

English translation and cross-cultural validation of the patient-reported outcome measurement-haemorrhoidal impact and satisfaction score (PROM-HISS)

AIM

The aim of this study was to translate the Dutch patient-reported outcome measure-haemorrhoidal impact and satisfaction score (PROM-HISS) to English and perform a cross-cultural validation.

METHOD

The ISPOR good practice guidelines for the cross-cultural validation of PROMs were followed and included two steps: (1) Two forward and two backward translations. The forward translation concerned the translation from the source language (Dutch) to the target language (English), performed by two independent English speakers, one medical doctor and one nonmedical. Subsequently, a discussion about discrepancies in the reconciled version was performed by a stakeholder group. (2) Cognitive interviews were held with patients with haemorrhoidal disease (HD), probing the comprehensibility and comprehensiveness of the PROM-HISS.

RESULTS

Discrepancies in the reconciled forward translation concerned the terminology of HD symptoms. Furthermore, special attention was paid to the response options, ranging from "not at all", indicating minor symptoms, to "a lot", implying many symptoms. Consensus among the stakeholder group about the final version of the translated PROM-HISS was reached. Interviews were conducted with 10 native English-speaking HD patients (30% female), with a mean age of 44 years (24-83) and primarily diagnosed with grade II HD (80%). The mean time to complete the PROM-HISS was 1 min 43 s. Patients showed a good understanding of the questions and response options, found all items relevant and did not miss important symptoms or topics.

CONCLUSION

The translated English language PROM-HISS is a valid tool to assess symptoms of HD, its impact on daily activities and patient satisfaction with HD treatment.

Reliability and validity of the Sidaamu Afoo version of the pelvic organ prolapse symptom score questionnaire

BACKGROUND

Both for clinical and research purposes, it is critical that clinicians and researchers use a tool that is trans-culturally adapted and tested for its psychometric properties. The English version of the Pelvic Organ Prolapse Symptom Score (POP-SS) questionnaire was developed in 2000. Since then it has been translated into other languages and verified. However, the tool has not been adapted for use in Sidaamu Afoo language in the Sidama Region of Ethiopia.

OBJECTIVE

This study aimed to translate and adapt the Pelvic Organ Prolapse Symptom Score questionnaire into Sidaamu Afoo and evaluate its psychometric properties.

METHODS

A total of 100 women with symptomatic prolapse completed version-2 of the POP-SS questionnaire during the first round of interviews, and 61 of them completed the questionnaire during the second round of interviews (to establish the test-retest reliability). We adapted the scale translation process recommended by Beaton and his colleagues. The content validity was assessed using the content validity index and the construct validity was done based on exploratory factor analysis using the principal component analysis model. The criterion validity was evaluated by using the Kruskal-Wallis test based on stages of the prolapse established via pelvic examination. The internal consistency reliability of the scale was assessed using Cronbach's alpha value, and test-retest reliability was evaluated using the intraclass correlation coefficient.

RESULTS

The questionnaire was successfully translated to Sidaamu Afoo, and achieved a good content validity index (0.88), high internal consistency (Cronbach's alpha of 0.79), and test-retest reliability (an intraclass correlation coefficient of 0.83). The exploratory factor analysis revealed two factors based on an eigenvalue of 1. The two factors explained 70.6% of the common variance, and each item loaded well (0.61 to 0.92) to its corresponding factor. There is a significant difference in the median score of prolapse symptoms across different stages of prolapse (Kruskal-Wallis χ², 17.5, p < 0.001).

CONCLUSION

The Sidaamu Afoo version of the POP-SS tool is valid and reliable. Further studies that involve a balanced number of women in each stage of prolapse are needed to avoid the ceiling and floor effects.

Cross-cultural adaptation, translation, and validation of a Spanish version of the Westmead Post-traumatic Amnesia Scale for use following a traumatic brain injury

Health professionals need linguistically and culturally correct tools with proven validity to effectively assess people in their native language. This study aimed to translate and validate the Westmead Post-traumatic Amnesia Scale (WPTAS) into a Spanish version to measure the progression and duration of post-traumatic amnesia (PTA) in Spanish-speaking populations. Seven native Spanish and English translators, 11 therapists and 15 people with a traumatic brain injury (TBI) and nine people with non-traumatic acquired brain injury participated in the forward-backward translation method to adapt the WPTAS. Participants with a TBI in PTA (n = 20), out of PTA (n = 21), and controls without cognitive impairment (n = 21) participated in the validation test phase by completing the WPTAS, Selective Reminding Test, Short Portable Metal Status Questionnaire, Digit Span, and Agitated Behaviour Scale. The translated version of the WPTAS produced consistent responses and appropriate errors (2%) among all pre-test participants. Results from the validation phase showed that participants in PTA scored significantly lower in all tests (p < .05) when compared with those out of PTA and controls. The Spanish version of the WPTAS created and tested in this study is culturally and linguistically appropriate as well as valid for use with Spanish speakers.

Translation, reliability, and validity of Amharic versions of the Pelvic Floor Distress Inventory (PFDI-20) and Pelvic Floor Impact Questionnaire (PFIQ-7)

Purpose

Pelvic Floor Disorders (PFDs) affects many women and have a significant impact on their quality of life. Pelvic Floor Impact Questionnaire (PFIQ-7) and Pelvic Floor Distress Inventory (PFDI-20) help to assess PFDs; however, both are not culturally translated into the Amharic-language. Hence, we aimed to translate the English versions of short forms of the PFDI-20 and PFIQ-7 into Amharic-language and evaluate their psychometric properties in Amharic-speaking Ethiopian women with symptomatic PFDs.

Methods

The PFDI-20 and PFIQ-7 were translated into Amharic language using standard procedures. The Amharic versions were completed by 197 patients (response rate 92%) with PFDs from University of Gondar specialized and comprehensive Hospital. Internal consistency and test-retest reliability were examined through Cronbach’s alpha and Intraclass correlation coefficients (ICC). A relative criterion standard, POP-SS-7 score, was correlated with total PFDI-20 and subscale POPDI-6 scores using spearman’s rank order correlation (SCC). Construct validity was evaluated by known group validity using the Mann–Whitney U test.

Results

Both instruments were successfully translated and adapted with an excellent content validity (> 0.90). The Amharic versions of the PFDI-20 and PFIQ-7 showed excellent internal consistency and test-retest reliability in both summary and subscales (Cronbach’s alpha: 0.92 for PFDI-20 and 0.91 for PFIQ-7; and ICC: 0.97 for PFDI-20 and 0.86 for PFIQ-7). Criterion validity was good for POPDI-6 (SCC = 0.71; p < 0.001). Moreover, construct validity was acceptable, showing significant differences among groups of PFDs in the PFDI-20 and PFIQ-7 scores (Mann–Whitney U Test; p < 0.001).

Conclusions

The Amharic versions of the PFDI-20 and PFIQ-7 are comprehensible, reliable, valid, and feasible in Ethiopian Amharic-speaking women with PFDs to evaluate symptoms and its impact during research and clinical practice. However, further studies are needed to evaluate the responsiveness.

Psychometrics, diagnostics and usability of Italian tools assessing behavioural and functional outcomes in neurological, geriatric and psychiatric disorders: a systematic review

Background

Psychometric instruments assessing behavioural and functional outcomes (BFIs) in neurological, geriatric and psychiatric populations are relevant towards diagnostics, prognosis and intervention. However, BFIs often happen not to meet methodological-statistical standards, thus lowering their level of recommendation in clinical practice and research. This work thus aimed at (1) providing an up-to-date compendium on psychometrics, diagnostics and usability of available Italian BFIs and (2) delivering evidence-based information on their level of recommendation.

Methods

This review was pre-registered (PROSPERO ID: CRD42021295430) and performed according to PRISMA guidelines. Several psychometric, diagnostic and usability measures were addressed as outcomes. Quality assessment was performed via an ad hoc checklist, the Behavioural and Functional Instrument Quality Assessment.

Results

Out of an initial N = 830 reports, 108 studies were included (N = 102 BFIs). Target constructs included behavioural/psychiatric symptoms, quality of life and physical functioning. BFIs were either self- or caregiver-/clinician-report. Studies in clinical conditions (including neurological, psychiatric and geriatric ones) were the most represented. Validity was investigated for 85 and reliability for 80 BFIs, respectively. Criterion and factorial validity testing were infrequent, whereas content and ecological validity and parallel forms were almost never addressed. Item response theory analyses were seldom carried out. Diagnostics and norms lacked for about one-third of BFIs. Information on administration time, ease of use and ceiling/floor effects were often unreported.

Discussion

Several available BFIs for the Italian population do not meet adequate statistical-methodological standards, this prompting a greater care from researchers involved in their development.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10072-022-06300-8.

Assessing meaning violations in Syrian refugees: A mixed-methods cross-cultural adaptation of the Global Meaning Violations Scale-ArabV

Refugees are disproportionately affected by extreme traumatic events that can violate core beliefs and life goals (i.e., global meaning) and cause significant distress. This mixed-methods study used an exploratory sequential design to assess meaning violations in a sample of Syrian refugees living in Portugal. For this purpose, we cross-culturally adapted the Global Meaning Violations Scale (GMVS) for use with Arabic-speaking refugees. In total, 43 war-affected Syrian adults participated in the two-phase study. Participants completed measures of trauma and narrated violations as they filled out the newly adapted GMVS-ArabV. GMVS-ArabV validity evidence based on response processes was investigated through Phase 1 focus groups (FGs; n = 2), whereas data from Phase 2 cognitive interviews (n = 38) were used to preliminarily explore the measure's internal structure through descriptive statistics as well as culture- and trauma-informed content evidence through thematic analysis. The results suggested highest goal (M = 3.51, SD = 1.46) and lowest belief (M = 2.38, SD = 1.59) violations of educational goals and religious beliefs, respectively. Themes related to stressors, item formulation, response scale, and the global meaning construct suggested that (a) beliefs and goals can be differentially violated by different stressors; (b) much like war trauma, including torture, daily stressors can additionally shatter pretrauma global meaning; and (c) refugees reappraise meaning and suffer violations anew throughout their migration journeys. The GMVS-ArabV offers a promising tool for exploring shattered cognitions in refugees and informs evidence-based approaches to trauma recovery and psychological adjustment in postmigration settings (the Arabic abstract and keywords are available in the Supplementary Materials).

The critical role of mixed methods research in developing valid and reliable patient-reported outcome measures

Randomised controlled clinical trials provide the gold standard for evidence underpinning clinical guidelines and patient centred care. However, this is only true when they are robustly designed, conducted and reported and then only if they include outcomes that are important to patients and clinicians. Important outcomes include those that measure impact on patient experience, quality of life, overall well-being, and physical, social, cognitive and emotional functioning, all of which require patient reported outcome measures (PROMs). Patient centred care must be underpinned by objective evidence of the effect of interventions on outcomes that are important to patients. Evidence for patient reported outcomes must be supported by valid and reliable PROMs. Importantly the PROM must reflect patient experience of the impact of the intervention on the outcome and enable quantitative evaluation of that impact. The purpose of this paper is to highlight the critical role of mixed methods research in developing PROMs that are valid (measure what they purport to measure), acceptable to those reporting the outcome and able to reliably detect meaningful differences between individuals with different conditions or severity and with time. This can only be achieved through a structured mixed methods program combining qualitative and quantitative research techniques.

Genes To Mental Health (G2MH): A Framework to Map the Combined Effects of Rare and Common Variants on Dimensions of Cognition and Psychopathology

Rare genomic disorders (RGDs) confer elevated risk for neurodevelopmental psychiatric disorders. In this era of intense genomics discoveries, the landscape of RGDs is rapidly evolving. However, there has not been comparable progress to date in scalable, harmonized phenotyping methods. As a result, beyond associations with categorical diagnoses, the effects on dimensional traits remain unclear for many RGDs. The nature and specificity of RGD effects on cognitive and behavioral traits is an area of intense investigation: RGDs are frequently associated with more than one psychiatric condition, and those studied to date affect, to varying degrees, a broad range of developmental and cognitive functions. Although many RGDs have large effects, phenotypic expression is typically influenced by additional genomic and environmental factors. There is emerging evidence that using polygenic risk scores in individuals with RGDs offers opportunities to refine prediction, thus allowing for the identification of those at greatest risk of psychiatric illness. However, translation into the clinic is hindered by roadblocks, which include limited genetic testing in clinical psychiatry, and the lack of guidelines for following individuals with RGDs, who are at high risk of developing psychiatric symptoms. The Genes to Mental Health Network (G2MH) is a newly funded National Institute of Mental Health initiative that will collect, share, and analyze large-scale data sets combining genomics and dimensional measures of psychopathology spanning diverse populations and geography. The authors present here the most recent understanding of the effects of RGDs on dimensional behavioral traits and risk for psychiatric conditions and discuss strategies that will be pursued within the G2MH network, as well as how expected results can be translated into clinical practice to improve patient outcomes.

The prevalence of loneliness across 113 countries: systematic review and meta-analysis

OBJECTIVES

To identify data availability, gaps, and patterns for population level prevalence of loneliness globally, to summarise prevalence estimates within World Health Organization regions when feasible through meta-analysis, and to examine temporal trends of loneliness in countries where data exist.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

Embase, Medline, PsycINFO, and Scopus for peer reviewed literature, and Google Scholar and Open Grey for grey literature, supplemented by backward reference searching (to 1 September 2021) ELIGIBILITY CRITERIA FOR SELECTING STUDIES: Observational studies based on nationally representative samples (n≥292), validated instruments, and prevalence data for 2000-19. Two researchers independently extracted data and assessed the risk of bias using the Joanna Briggs Institute checklist. Random effects meta-analysis was conducted in the subset of studies with relatively homogeneous research methods by measurement instrument, age group, and WHO region.

RESULTS

Prevalence data were available for 113 countries or territories, according to official WHO nomenclature for regions, from 57 studies. Data were available for adolescents (12-17 years) in 77 countries or territories, young adults (18-29 years) in 30 countries, middle aged adults (30-59 years) in 32 countries, and older adults (≥60 years) in 40 countries. Data for all age groups except adolescents were lacking outside of Europe. Overall, 212 estimates for 106 countries from 24 studies were included in meta-analyses. The pooled prevalence of loneliness for adolescents ranged from 9.2% (95% confidence interval 6.8% to 12.4%) in South-East Asia to 14.4% (12.2% to 17.1%) in the Eastern Mediterranean region. For adults, meta-analysis was conducted for the European region only, and a consistent geographical pattern was shown for all adult age groups. The lowest prevalence of loneliness was consistently observed in northern European countries (2.9%, 1.8% to 4.5% for young adults; 2.7%, 2.4% to 3.0% for middle aged adults; and 5.2%, 4.2% to 6.5% for older adults) and the highest in eastern European countries (7.5%, 5.9% to 9.4% for young adults; 9.6%, 7.7% to 12.0% for middle aged adults; and 21.3%, 18.7% to 24.2% for older adults).

CONCLUSION

Problematic levels of loneliness are experienced by a substantial proportion of the population in many countries. The substantial difference in data coverage between high income countries (particularly Europe) and low and middle income countries raised an important equity issue. Evidence on the temporal trends of loneliness is insufficient. The findings of this meta-analysis are limited by data scarcity and methodological heterogeneity. Loneliness should be incorporated into general health surveillance with broader geographical and age coverage, using standardised and validated measurement tools.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42019131448.

The Montreal Cognitive Assessment (MoCA): updated norms and psychometric insights into adaptive testing from healthy individuals in Northern Italy

Background

The availability of fine-grained, culture-specific psychometric outcomes can favor the interpretation of scores of the Montreal Cognitive Assessment (MoCA), the most frequently used instrument to screen for mild cognitive dysfunctions in both instrumental and non-instrumental domains. This study thus aimed at providing: (i) updated, region-specific norms for the Italian MoCA, by also (ii) comparing them to pre-existing ones with higher geographical coverage; (iii) information on sensitivity and discriminative capability at the item level.

Methods

Five hundred and seventy nine healthy individuals from Northern Italy (208 males, 371 females; age: 63.4 ± 15, 21–96; education: 11.3 ± 4.6, 1–25) were administered the MoCA. Item Response Theory (IRT) was adopted to assess item difficulty and discrimination. Normative values were derived by means of the Equivalent Scores (ESs) method, applied to the MoCA and its sub-scales. Average ESs were also computed. Agreement with previous ESs classification was assessed via Cohen’s k.

Results

Age and education significantly predicted all MoCA measures except for Orientation, which was related to age only. No sex differences were detected when tested along with age and education. Substantial disagreements with previous ESs classifications were detected. Several items proved to be scarcely sensitive, especially the place item from Orientation and the letter detection task. Memory items showed high discriminative capability, along with certain items assessing executive functions and orientation.

Discussion

Item-level information herewith provided for the Italian MoCA can help interpret its scores by Italian practitioners. Italian practitioners should consider an adaptive use of region-specific norms for the MoCA.

Knowledge About Dementia Among Family Caregivers With a Turkish or Moroccan Immigrant Background: Development and Validation of a Dementia Knowledge Scale

Objective:

To describe the development and validation of the Dementia Knowledge Scale (DKS) among family caregivers with a Turkish or Moroccan immigrant background.

Methods:

The 11 items of the DKS, selected by professionals and people with a Turkish or Moroccan background, were translated and adapted in Turkish and Dutch. The feasibility, comprehensibility and appropriateness of the 2 language versions were examined. Subsequently, both languages were assessed among caregivers from these groups. The internal consistency of both language versions was determined by calculating Cronbach’s α. The known group validity was determined by comparing mean scores between subgroups.

Results:

Both language versions of the DKS were considered feasible, comprehensible, and appropriate. A total of 117 caregivers with a Turkish background completed the Turkish version of the DKS and 110 with a Moroccan background the Dutch version. The Turkish version showed adequate internal consistency but the Dutch version did not. No differences were found in mean scores between those with a low level of education versus those with a higher level; those who frequently provided care versus those who did so less frequently; and those who lived together with a person with dementia versus those who did not.

Conclusions:

The DKS is feasible, comprehensible and reliable and can be used among groups with an immigrant background.

Practice Implications:

The DKS provides insight into various aspects of dementia knowledge, including knowledge about risk factors and symptoms, among caregivers with a Turkish or Moroccan background, and thereby supports the development of tailored education for these groups.

Psychometrics and diagnostics of Italian cognitive screening tests: a systematic review

BACKGROUND

Cognitive screening tests (CSTs) are crucial to neuropsychological diagnostics, and thus need to be featured by robust psychometric and diagnostic properties. However, CSTs happen not to meet desirable statistical standards, negatively affecting their level of recommendations and applicability. This study aimed at (a) providing an up-to-date compendium of available CSTs in Italy, (b) report their psychometric and diagnostic properties, and (c) address related limitations.

METHODS

This review was implemented by consulting Preferred Reporting Items for Systematic Reviews and Meta-Analyses and pre-registered on the International Prospective Register of Systematic Reviews. Standardization and usability studies focusing on norms, validity, reliability, or sensitivity/specificity (and derived metrics) in adults were considered for eligibility. Quality assessment was performed by means of an ad hoc checklist collecting information on sampling, psychometrics/diagnostics, norming, and feasibility.

RESULTS

Sixty studies were included out of an initial N = 683. Identified CSTs (N = 40) were classified into general, domain-, and disease-specific (N = 17, 7, and 16, respectively), the latter being less statistically robust than remaining categories. Validity and reliability evidence was provided for 29 and 26 CSTs, respectively, sensitivity/specificity for 20 and norms for 33. Prevalence- and post-test-based diagnostic metrics were seldomly represented; factorial structures, ceiling/floor effects, and acceptability rarely investigated; content, face, and ecological validity never assessed.

DISCUSSION

Although available Italian CSTs overall met basic psychometric/diagnostic requirements, their statistical profile often proved to be poor on several properties that are desirable for clinical applications, with a few exceptions among general and domain-specific ones.

Adult oral health-related quality of life instruments: A systematic review

OBJECTIVES

To identify the existing OHRQoL instruments for adults, describe their scope (generic or specific), theoretical background, validation type and cross-cultural adaptation.

METHODS

A systematic search was conducted, and articles presenting validation of OHRQoL instruments in adults were included. Data were collected about the validation type: external validation (correlations/associations); or internal validation (factor analysis/principal components analysis, item response theory); and cross-cultural adaptation.

RESULTS

Of 3730 references identified, 326 were included reporting 392 studies. Forty-two original instruments were found among 74 different versions, 40 generic and 34 condition-specific. Locker's theoretical framework was the predominant model. The oral health impact profile (OHIP) presented 20 versions, with OHIP-14 being the most frequent (26.8%), followed by geriatric oral assessment index (GOHAI) (14.0%), OHIP-49 (11.7%) and oral impacts on daily performances (OIDP) (9.7%). Most studies focused on external validation (65.3%), while internal validation was reported in 24.8% (n = 26) of OHIP-14 studies, 50.9% (n = 28) of GOHAI and 21.1% (n = 8) of OIDP studies. Most internal validation studies were conducted in English-speaking countries (n = 33), and cross-cultural adaptation was mostly in non-English-speaking European countries (n = 40).

CONCLUSIONS

Many generic and condition-specific instruments were found, but few have gone through a rigorous internal validation process or have undergone cross-cultural adaptation. This, in turn, makes it difficult for researchers to choose an appropriate measure based on known psychometric properties. OHIP-14, OIDP and GOHAI seem to be the most widely validated instruments. Equalizing measurement properties for comparability are challenging due to theoretical heterogeneity. Future studies should assess psychometric properties, explore the factorial structure and work towards a consensus on critical issues.

Cultural adaptation and validation of the Attribution Questionnaire for stigma towards disability pension applicants for use among psychiatrists and general practitioners in Sweden

Background

This study aimed to culturally translate the Attribution Questionnaire (AQ) to the Swedish language and examine the reliability and validity of the new Swedish version to measure stigma towards disability pension applicants in the Swedish context among psychiatrists and general practitioners.

Methods

The AQ was translated from the original English version into Swedish using the recommended guidelines for cultural translation of questionnaires. Steps included forward/back-translation, use of expert committee and pretesting. Cronbach’s alpha was used to determine internal consistency and structural equation modelling (SEM) was used to test the responsibility model of stigma compared to the original English version.

Results

1,414 physicians completed the questionnaire (23.6%). Cultural translation resulted in many modifications to the original questionnaire to increase the external validity. Internal reliability of the AQ Swedish version (AQ-S) was 0.733 and is considered acceptable. Pity and Segregation-coercion sub-scales showed limited consistency. SEM findings show that the responsibility model of stigma is an acceptable fit for the Swedish setting.

Conclusion

Findings show that the AQ-S is comparable to the other versions of the AQ and is a reliable measure to assess and monitor stigma among physicians in the Swedish setting. Our study shows that cultural translation does not significantly impact the validity of the questionnaire.

Mind Over Matter: Mindfulness, Income, Resilience, and Life Quality of Vocational High School Students in China

Many social welfare programs focus on the provision of cash assistance and cash transfers to improve the quality of life (QoL) of those living in low-income households. While there is literature to support a positive relationship between income and QoL, studies have shown that QoL is impacted by non-income-related factors. This study examined the effects of income and mindfulness on QoL through a mediator, resilience, and attempts to answer the question of how important income is to QoL, relative to a non-income-based determinant, mindfulness. Using a sample of 905 emerging adults from the senior class of a secondary vocational high school based in an impoverished county of China, we studied two key determinants of QoL, income and mindfulness, as well as respective pathways, during a particularly critical stage of life. The results indicated that mindfulness had strong direct and indirect effects on QoL via resilience, while income had only limited indirect effects on QoL via resilience. Policy implications were discussed.

The Vietnamese Version of the Brief Illness Perception Questionnaire and the Beliefs about Medicines Questionnaire: Translation and Cross-cultural Adaptation

OBJECTIVE

To translate and cross-culturally adapt the Brief Illness Perception Questionnaire (BIPQ) and the Beliefs about Medicines Questionnaire (BMQ) into Vietnamese.

METHODS

We followed the guideline by Beaton et al. (2000 & 2007). Stage I: two translators (informed and uninformed) translated the questionnaires. Stage II: the translations were synthesised. Stage III: back translation was performed by two translators fluent in both Vietnamese and English but naïve to the outcome measurement. Stage IV: seven experts reached consensus on the pre-final Vietnamese version (BIPQ-V and BMQ-V). Stage V: field test of the questionnaires on 16 twelve-year-old students and 31 Vietnamese patients. In addition, we determined the internal consistency and test-retest reliability of the questionnaires in 34 Vietnamese patients with acute coronary syndrome.

RESULTS

All experts agreed that there was semantic, idiomatic, experiential and conceptual equivalence between the original and pre-final Vietnamese versions of the BIPQ and BMQ. Cronbach's alpha coefficients of the internal consistency were acceptable for the BMQ-V Specific-Necessity (0.64), BMQ-V Specific-Concerns (0.62) and BMQ-V General-Harm (0.60), with the exception of BMQ-V General-Overuse (0.27). Intra-class correlation coefficients of the test-retest reliability were acceptable for the subscales of BMQ-V (range: 0.77-0.86), and BIPQ-V items (range: 0.62-0.85) with the exception of BIPQ-V 1 (0.44, 95% CI -014 to 0.72) and BIPQ-V 4 (0.57, 95% CI 0.22-0.81).

CONCLUSIONS

The Vietnamese version of BIPQ and BMQ are reliable tools to assess illness perceptions and beliefs about medicines of patients with acute coronary syndrome. Psychometric properties of these questionnaires should be tested in different patient populations.

English-to-Spanish Translation of the Nijmegen Professionalism Scale

BACKGROUND AND PURPOSE

The aim of this investigation was to perform the cross-cultural and linguistic translation and adaptation of the Nijmegen Professionalism Scale for Spanish nursing. Originally designed by Tromp et al. (2010) for its use by general practitioners, the new Spanish version of this tool assesses professional commitment, allowing for the comparison, prevention, association, and longitudinal monitoring of commitment among nursing professionals.

METHODS

The linguistic translation from English to Spanish was performed using the translation-back-translation method; the process of cross-cultural adaptation to the Spanish nursing context was carried out following the recommendations given by a panel of experts comprised of 24 practicing nurses with different professional backgrounds. The data for the feasibility study were collected between December 2015 and January 2016.

RESULTS

The original English version of the instrument contains 106 items and was originally developed for assessing professional behavior of general practitioner trainees; the new version, with a significant reduction in the initial number of items, comprises 49 items and is now ready for pilot testing and validation in our context.

IMPLICATIONS FOR PRACTICE

The Nijmegen Professionalism Scale in its Spanish version will act not only as a tool for measuring professional commitment among Spanish nurses but also as a motivational resource and means for reflection which will, in turn, increase the quality of the care provided by these professionals.

Translation and Adaption of Questionnaires: A Nursing Challenge

Background

Translation of previously developed questionnaires has often been the choice when addressing research to groups whose language is not English. In the translation of health-related questionnaires, it is highly important to assure congruency between the words and their true meaning in the language to which the questionnaire is translated.

Aim

To describe the semantic problems encountered in translating a standardized questionnaire from English (the Identity and Experiences Scale) to Norwegian according to the World Health Organizations translation protocol.

Design

A mixed-method study was used with the formation of four focus groups and a postal survey.

Data sources

Eighteen respondents from a nursing college in Oslo, an aged community in northeast Norway, and a community organization of retired persons in southeast Norway were focus group participants. In sum, 141 persons participated in the postal survey.

Findings

A number of semantical challenges in relation to interpretation and understanding of the meaning and use of words in the Identity and Experiences Scale were found.

Discussion

Words bearing emotional weight and connected to complex operational concepts were found to be problematic. Various American-English colloquial expressions also caused semantical challenges. Other problems were related to sentence structure and grammar form.

Conclusion

Translation, adaptation, and validation of questionnaires or scales for practice and research are very time-consuming and require careful planning and the adoption of rigorous methodological approaches to derive a reliable and valid measure of the concept of interest in the target population.

Implications for nursing

Translation quality is a methodological issue that nurses need to take seriously. It is highly recommended that nurses follow and document steps in a procedure of forward translation, qualitative reviews of translated items with regard to clarity, common language and conceptual adequacy, back translation, testing on lay panels, and committee review, or a probable variation of this procedure.

Translation, cultural adaptation, and validation of Cognistat for its use in Arabic-speaking population with acquired brain injury

BACKGROUND

The use of cognitive assessment tools is central to the detection of cognitive impairment in acquired brain injury patients. Cognistat is a commonly used cognitive screening tool that can detect cognitive deficits among patients with neurological and psychiatric conditions. Cognistat examines different major ability areas including level of language, construction, memory, calculation, reasoning, consciousness, orientation and attention. To date, Cognistat has not been translated/adapted for use in Arabic-speaking countries.

AIM

The aim of this paper is to provide normative data for the use of Cognistat in Arabic-speaking populations with acquired brain injury.

DESIGN

Cross-cultural validation study.

SETTING

Inpatient TBI and stroke rehabilitation ward in a rehabilitation hospital.

POPULATION

A total of 107 healthy Arabic-speaking adults and 62 acquired brain injury patients were involved in the study.

METHODS

After the completion of the cross-cultural adaptation process, psychometric properties of the adapted cognitive tool were evaluated.

RESULTS

The Arabic version of Cognistat was found to have acceptable internal consistency, and the test-retest reliability showed high stability of scores over time. For concurrent validity, patients' performance on the Arabic version of Cognistat and the Mini-Mental State Examination were compared with excellent correlations overall. Significant differences between the performance of patients and the control group were found on all sub-tests.

CONCLUSIONS

The Arabic version of Cognistat appears to be a valid and reliable cognitive screening tool. It is anticipated that the Arabic version of Cognistat will be widely used in the Arabic-speaking countries, allowing for a very precise evaluation of cognitive deficits in acquired brain injury patients.

CLINICAL REHABILITATION IMPACT

As part of the rehabilitation process, health care professionals are regularly required to test patients' cognitive abilities using appropriate measures. The findings of the study provide key solutions for the clinical assessment of Arabic populations: such cognitive tools could help improve the cognitive rehabilitation practice for the Arabic population by offering validated, reliable, and culturally adapted tests in the Arabic language.

Chronic condition self-management support for Aboriginal people: Adapting tools and training

PROBLEM

Chronic conditions are major health problems for Australian Aboriginal people. Self-management programs can improve health outcomes. However, few health workers are skilled in self-management support and existing programs are not always appropriate in Australian Aboriginal contexts.

DESIGN

The goal was to increase the capacity of the Australian health workforce to support Australian Aboriginal people to self-manage their chronic conditions by adapting the Flinders Program of chronic condition self-management support for Australian Aboriginal clients and develop and deliver training for health professionals to implement the program.

STRATEGIES FOR CHANGE

Feedback from health professionals highlighted that the Flinders Program assessment and care planning tools needed to be adapted to suit Australian Aboriginal contexts. Through consultation with Australian Aboriginal Elders and other experts, the tools were condensed into an illustrated booklet called 'My Health Story'. Associated training courses and resources focusing on cultural safety and effective engagement were developed.

EFFECTS OF CHANGE

A total of 825 health professionals  across Australia was trained and 61 people qualified as accredited trainers in the program, ensuring sustainability.

LESSONS LEARNT

The capacity and skills of the Australian health workforce to engage with and support Australian Aboriginal people to self-manage their chronic health problems significantly increased as a result of this project. The adapted tools and training were popular and appreciated by the health care organisations, health professionals and clients involved. The adapted tools have widespread appeal for cultures that do not have Western models of health care and where there are health literacy challenges. My Health Story has already been used internationally.

Dementia in Eastern Mediterranean countries: A systematic review

Globally, there is an increase in the older population, whose lives are affected by local cultural norms. In Eastern Mediterranean countries, dementia is conventionally hidden from view with few dedicated services or recognition for diagnosis. The aim of this systematic review is to explore the limited literature on dementia and cognitive impairment among older people in Eastern Mediterranean countries to present an evaluation of current practices and to consolidate knowledge for future planning. Thirty-three studies were identified for inclusion in the review, and four themes were apparent. Firstly, prevalence, comorbidity and gender: In Eastern Mediterranean countries, many studies identify that the prevalence of dementia is high. As is the case elsewhere, many older adults in Eastern Mediterranean countries have at least one coexisting long-term condition, and some experience low life-satisfaction. Secondly, culture: In Eastern Mediterranean countries, the older adult is highly respected, and placement outside of the family home is considered an abandonment of family duty. The term dementia carries stigma, and it is widely believed that dementia is caused by ‘fate’. Thirdly, recognition and tools: There is a lack of verified assessment instruments to assess for dementia. Despite concerns about the cultural appropriateness of the Mini-Mental State Exam, particularly for people who have low literacy levels, and low literacy being the norm in Eastern Mediterranean countries, the Mini-Mental State Examination is the main assessment instrument. Translation and transition of non-Arabic assessment instruments and tools with psychometric properties presents a challenge for clinicians. Finally, workforce issues: health care workers lack knowledge about dementia, as dementia care is a relatively recent addition to the nursing and medical syllabi. While there were some inconsistencies in the papers published, many of the articles call for increasing educational programmes and health and social care policies to promote improved and practical gerontological nursing and medicine. Health care professionals need education about sociocultural, religious, and language needs to deliver improved culturally sensitive care.

Construct Validity and Reliability of the Beliefs Toward Mental Illness Scale for American, Japanese, and Korean Women

PURPOSE

The aim of this study was to evaluate the psychometric properties of the Beliefs Toward Mental Illness Scale (BMI) across women from the United States, Japan, and South Korea.

METHODS

A cross-sectional study design was employed. The sample was 564 women aged 21-64 years old who were recruited in the United States and Korea (American = 127, Japanese immigrants in the United States = 204, and Korean = 233). We carried out item analysis, construct validity by confirmatory factor analysis (CFA), and internal consistency using SPSS Version 22 and AMOS Version 22.

RESULTS

An acceptable model fit for a 20-item BMI (Beliefs Toward Mental Illness Scale-Revised [BMI-R]) with 3 factors was confirmed using CFA. Construct validity of the BMI-R showed to be all acceptable; convergent validity (average variance extracted [AVE] ≥0.5, construct reliability [CR] ≥0.7) and discriminant validity (r = .65-.89, AVE >.79). The Cronbach's alpha of the BMI-R was .92.

CONCLUSION

These results showed that the BMI was a reliable tool to study beliefs about mental illness across cultures. Our findings also suggested that continued efforts to reduce stigma in culturally specific contexts within and between countries are necessary to promote help-seeking for those suffering from psychological distress.

Turkish adaptation of the Pelvic Organ Prolapse Symptom Score and its validity and reliability

INTRODUCTION AND HYPOTHESIS

The purpose of this study was to adapt the Pelvic Organ Prolapse Symptom Score (POP-SS) into Turkish and evaluate its reliability and validity.

METHODS

The POP-SS was adapted into Turkish by following the steps of the intercultural adaptation process. One hundred and three women with symptomatic or asymptomatic pelvic organ prolapse (POP) completed the Turkish POP-SS and other valid and reliable Turkish tools for POP: Pelvic Organ Prolapse Distress Inventory 6 (POPDI-6), Colorectal-Anal Distress Inventory 8 (CRADI-8), Urinary Distress Inventory 6 (UDI-6), Pelvic Floor Distress Inventory 20 (PFDI-20), and Pelvic Organ Prolapse Impact Questionnaire 7 (POPIQ-7). Pelvic Organ Prolapse Quantification (POP-Q) system was also used to assess pelvic support, and patients were divided into three groups based on POP-Q scores. Cronbach's alpha was used to determine internal consistency, and intraclass correlation coefficient (ICC) was estimated for test-retest reliability. POP-SS validity was assessed by using the Spearman rank correlation and Kruskal-Wallis analyses. The underlying scale structure was determined by exploratory factor analysis.

RESULTS

The POP-SS scale had high internal consistency (Cronbach's alpha = 0.705) and test-retest reliability (ICC = 0.981; p < 0.001). Among groups, there was statistically significant differences in POP-SS scores. POP-SS scores were also significantly correlated with POPDI-6 (r = 0.830), CRADI-8 (r = 0.525), UDI-6 (r = 0.385), PFDI-20 (r = 0.752), and POPIQ-7 (r = 0.690) (p < 0.001). Two factors were identified by exploratory factor analysis.

CONCLUSIONS

The Turkish version of POP-SS is a valid and reliable tool for Turkish women with POP.

COMPI Fertility Problem Stress Scales is a brief, valid and reliable tool for assessing stress in patients seeking treatment

STUDY QUESTION

Are the Copenhagen Multi-Centre Psychosocial Infertility research program Fertility Problem Stress Scales (COMPI-FPSS) a reliable and valid measure across gender and culture?

SUMMARY ANSWER

The COMPI-FPSS is a valid and reliable measure, presenting excellent or good fit in the majority of the analyzed countries, and demonstrating full invariance across genders and partial invariance across cultures.

WHAT IS KNOWN ALREADY

Cross-cultural and gender validation is needed to consider a measure as standard care within fertility. The present study is the first attempting to establish comparability of fertility-related stress across genders and countries.

STUDY DESIGN SIZE, DURATION

Cross-sectional study. First, we tested the structure of the COMPI-FPSS. Then, reliability and validity (convergent and discriminant) were examined for the final model. Finally, measurement invariance both across genders and cultures was tested.

PARTICIPANTS/MATERIALS, SETTING, METHODS

Our final sample had 3923 fertility patients (1691 men and 2232 women) recruited in clinical settings from seven different countries: Denmark, China, Croatia, Germany, Greece, Hungary and Sweden. Participants had a mean age of 34 years and the majority (84%) were childless.

MAIN RESULTS AND THE ROLE OF CHANCE

Findings confirmed the original three-factor structure of the COMPI-FPSS, although suggesting a shortened measurement model using less items that fitted the data better than the full version model. While data from the Chinese and Croatian subsamples did not fit, all other counties presented good fit (χ²/df ≤ 5.4; comparative fit index ≥ 0.94; root-mean-square error of approximation ≤ 0.07; modified expected cross-validation index ≤ 0.77). In general, reliability, convergent validity, and discriminant validity were observed in all subscales from each country (composite reliability ≥ 0.63; average variance extracted ≥ 0.38; squared correlation ≥ 0.13). Full invariance was established across genders, and partial invariance was demonstrated across countries.

LIMITATIONS REASONS FOR CAUTION

Generalizability regarding the validation of the COMPI-FPSS cannot be made regarding infertile individuals not seeking treatment, or non-European patients. This study did not investigate predictive validity, and hence the capability of this instrument in detecting changes in fertility-specific adjustment over time and predicting the psychological impact needs to be established in future research.

WIDER IMPLICATIONS OF THE FINDINGS

Besides extending knowledge on the psychometric properties of one of the most used fertility stress questionnaire, this study demonstrates both research and clinical usefulness of the COMPI-FPSS.

STUDY FUNDING/COMPETING INTERESTS

This study was supported by European Union Funds (FEDER/COMPETE-Operational Competitiveness Program, and by national funds (FCT-Portuguese Foundation for Science and Technology) under the projects PTDC/MHC-PSC/4195/2012 and SFRH/BPD/85789/2012). There are no conflicts of interest to declare.

TRIAL REGISTRATION NUMBER

N/A.

Translating patient reported outcome measures: methodological issues explored using cognitive interviewing with three rheumatoid arthritis measures in six European languages

OBJECTIVE

Cross-cultural translation of patient-reported outcome measures (PROMs) is a lengthy process, often performed professionally. Cognitive interviewing assesses patient comprehension of PROMs. The objective was to evaluate the usefulness of cognitive interviewing to assess translations and compare professional (full) with non-professional (simplified) translation processes.

METHODS

A full protocol used for the Bristol RA Fatigue Multi-dimensional Questionnaire and Numerical Rating Scale (BRAF-MDQ, BRAF-NRS) was compared with a simplified protocol used for the RA Impact of Disease scale (RAID). RA patients in the UK, France, the Netherlands, Germany, Spain and Sweden completed the PROMs during cognitive interviewing (BRAFs in the UK were omitted as these were performed during development). Transcripts were deductively analysed for understanding, information retrieval, judgement and response options. Usefulness of cognitive interviewing was assessed by the nature of problems identified, and translation processes by percentage of consistently problematic items (⩾40% patients per country with similar concerns).

RESULTS

Sixty patients participated (72% women). For the BRAFs (full protocol) one problematic item was identified (of 23 items × 5 languages, 1/115 = 0.9%). For the RAID (simplified protocol) two problematic items were identified (of 7 items × 6 languages, 2/42 = 4.8%), of which one was revised (Dutch). Coping questions were problematic in both PROMs.

CONCLUSION

Conceptual and cultural challenges though rare were important, as identified by formal evaluation, demonstrating that cognitive interviewing is crucial in PROM translations. Proportionately fewer problematic items were found for the full than for the simplified translation procedure, suggesting that while both are acceptable, professional PROM translation might be preferable. Coping may be a particularly challenging notion cross-culturally.

Linguistic validation and reliability properties are weak investigated of most dementia-specific quality of life measurements-a systematic review

OBJECTIVE

For people with dementia, the concept of quality of life (Qol) reflects the disease's impact on the whole person. Thus, Qol is an increasingly used outcome measure in dementia research. This systematic review was performed to identify available dementia-specific Qol measurements and to assess the quality of linguistic validations and reliability studies of these measurements (PROSPERO 2013: CRD42014008725).

STUDY DESIGN AND SETTING

The MEDLINE, CINAHL, EMBASE, PsycINFO, and Cochrane Methodology Register databases were systematically searched without any date restrictions. Forward and backward citation tracking were performed on the basis of selected articles.

RESULTS

A total of 70 articles addressing 19 dementia-specific Qol measurements were identified; nine measurements were adapted to nonorigin countries. The quality of the linguistic validations varied from insufficient to good. Internal consistency was the most frequently tested reliability property. Most of the reliability studies lacked internal validity.

CONCLUSION

Qol measurements for dementia are insufficiently linguistic validated and not well tested for reliability. None of the identified measurements can be recommended without further research. The application of international guidelines and quality criteria is strongly recommended for the performance of linguistic validations and reliability studies of dementia-specific Qol measurements.

Translation of questionnaires measuring health related quality of life is not standardized: a literature based research study

Introduction

There is growing awareness of the need to explore patient reported outcomes in clinical trials. In the Scandinavian Surgical Outcomes Research Group we are conducting several clinical trials in cooperation between Danish and Swedish surgical researchers, and we use questionnaires aimed at patients from both countries. In relation to this and similar international cooperation, the validity and reliability of translated questionnaires are central aspects.

Main Objectives

The purpose of this study was to explore which methodological measures were used in studies reporting translation of questionnaires. Furthermore, we wanted to make some methodological suggestions for clinical researchers who are faced with having to translate a questionnaire.

Material and Methods

We designed a research study based on a survey of the literature and extracted data from published studies reporting the methodological process when translating questionnaires on health related quality of life for different diseases.

Results

We retrieved 187 studies and out of theses we included 52 studies. The psychometric properties of the translated versions were validated using different tests. The focus was on internal validity (96%), reliability (67%) criterion validity (81%), and construct validity (62%). For internal validity Cronbach's alpha was used in 94% of the studies.

Conclusions

This study shows that there seems to be a consensus regarding the translation process (especially for internal validity) although most researchers did not use a translation guide. Moreover, we recommended that clinical researchers should consider three steps covering the process of translation, the qualitative validation as well as the quantitative validation.

Validation of the simplified Chinese version of the functional rating index for patients with nonspecific neck pain in mainland China

STUDY DESIGN

Validation of a self-report questionnaire, Functional Rating Index (FRI).

OBJECTIVE

To evaluate the psychometric properties of the simplified Chinese (SC) version of FRI in patients with nonspecific neck pain (NP).

SUMMARY OF BACKGROUND DATA

FRI has been cross-culturally validated in few languages with excellent reliability, validity, and clinical utility when it is applied in patients with low back pain. Recently, it has been pointed out that FRI can be employed to assess patients with NP. However, FRI has not been validated in patients with NP in China.

METHODS

The cross-culturally adapted 10-item SC-FRI was completed by 122 patients with nonspecific NP, along with the Neck Disability Index, Neck Pain and Disability Scale, 36-Item Short Form Health Survey, and Pain Visual Analogue Scale. Psychometric evaluation included score distribution, internal consistency, test-retest reliability, and construct validity.

RESULTS

SC-FRI attained a high completion rate (96.9%). Each item was scored with a normal distribution without any floor and ceiling effects. The internal consistency and test-retest reliability were good to excellent (Cronbach α coefficient = 0.86; intraclass r = 0.97). Construct validity was confirmed by a strong correlation with Neck Disability Index, Neck Pain and Disability Scale, and Visual Analogue Scale (r = 0.77, 0.78, and 0.86, respectively, all P < 0.0001), and with the physical functioning and bodily pain domains (r = -0.69 and -0.66, respectively, both P < 0.0001), and by a weak correlation with the vitality, role-emotional, and mental health domains of 36-Item Short Form Health Survey.

CONCLUSION

SC-FRI showed satisfactory clinical utility, internal consistency, test-retest reliability, and construct validity in Chinese-speaking patients with nonspecific NP.

LEVEL OF EVIDENCE

3.

[Using the MMSE as a cognitive screener among Turkish and Moroccan migrants]

The Dutch population of first generation Turkish and Moroccan migrants is ageing. Among them hypertension and diabetes mellitus are frequent findings, which will probably cause an increased incidence of dementia. The language barrier, low education and cultural differences make the diagnosis more difficult. To what extent the MMSE can be used as a cognitive screener in this population will be investigated in this retrospective study.Patients received standard diagnostics, a professional translator addressed the language barrier. Correspondence was scored on characteristics of dementia, a procedure was used to diagnose without including the MMSE score. The optimal cut-off was calculated with the Youden Index and Area under the ROC (AUROC).106 patients were included, 61% had no education. Average MMSE-score was 16, with dementia 12, without 19. The AUROC was 0.85, optimal cut-off was 18 with a Youden index of 0.61.By using a professional translator the MMSE can possibly be used as a cognitive screener in this population. However, the cognitive skills addressed by the MMSE require an education and language skills. Developing a test that is independent of education and language barrier will probably be better.

A comparison of the quality of care in accident and emergency departments in England and the Netherlands as experienced by patients

BACKGROUND

Measuring patients' experiences to determine health-care performance and quality of care from their perspective can provide valuable evidence for international improvements in the quality of care. We compare patients' experiences in Accident & Emergency departments (A&E) in England and the Netherlands and discuss the usefulness of this comparison.

METHODS

A cross-sectional survey was conducted among patients attending A&Es aged 18 years and older. In England, 134 A&Es were surveyed. In the Netherlands, nine hospitals participated in the study. Main outcome measures were patients' experiences represented by six domain scores aggregated on the country level or on the A&E level.

RESULTS

In England, 43 892 completed questionnaires were received (40%). In the Netherlands, 1865 completed questionnaires were received (42%). Three of six domain scores were significantly higher for patients in the Netherlands: 'waiting time' [mean scores of 73.8 (NL) versus 67.2 (ENG)], 'doctors and nurses' [mean scores of 85.7 (NL) versus 80.6 (ENG)] and 'your care and treatment' [mean scores of 82.6 (NL) and 80.2 (ENG)]. The variance among the English A&Es was large. The best and worst practices on five domains were English.

CONCLUSIONS

The mean quality of care in the A&E appeared to be better in the Netherlands on three domains, but the best practices were English A&Es. The within-country differences between A&Es were much larger than differences between countries. Healthcare performance in the A&E can be compared between countries by surveying patients' experiences, and there seems much to learn across A&Es both within and among countries.

Transcultural adaptation and initial validation of Brazilian-Portuguese version of the Basel assessment of adherence to immunosuppressive medications scale (BAASIS) in kidney transplants

Background

Transplant recipients are expected to adhere to a lifelong immunosuppressant therapeutic regimen. However, nonadherence to treatment is an underestimated problem for which no properly validated measurement tool is available for Portuguese-speaking patients. We aimed to initially validate the Basel Assessment of Adherence to Immunosuppressive Medications Scale (BAASIS^®) to accurately estimate immunosuppressant nonadherence in Brazilian transplant patients.

Methods

The BAASIS^® (English version) was transculturally adapted and its psychometric properties were assessed. The transcultural adaptation was performed using the Guillemin protocol. Psychometric testing included reliability (intraobserver and interobserver reproducibility, agreement, Kappa coefficient, and the Cronbach’s alpha) and validity (content, criterion, and construct validities).

Results

The final version of the transculturally adapted BAASIS^® was pretested, and no difficulties in understanding its content were found. The intraobserver and interobserver reproducibility variances (0.007 and 0.003, respectively), the Cronbach’s alpha (0.7), Kappa coefficient (0.88) and the agreement (95.2%) suggest accuracy, preciseness and reliability. For construct validity, exploratory factorial analysis demonstrated unidimensionality of the first three questions (r = 0.76, r = 0.80, and r = 0.68). For criterion validity, the adapted BAASIS^® was correlated with another self-report instrument, the Measure of Adherence to Treatment, and showed good congruence (r = 0.65).

Conclusions

The BAASIS^® has adequate psychometric properties and may be employed in advance to measure adherence to posttransplant immunosuppressant treatments. This instrument will be the first one validated to use in this specific transplant population and in the Portuguese language.