How Factor Analysis Results May Change Due to Country Context

Review: application of the Safety Attitudes Questionnaire (SAQ) in primary care - a systematic synthesis on validity, descriptive and comparative results, and variance across organisational units

Patient safety research has focused mostly on the hospital and acute care setting whereas assessments of patient safety climate in primary health care settings are warranted. Valid questionnaires as e.g., the Safety Attitudes Questionnaire (SAQ) may capture staff perceptions of patient safety climate but until now, an overview of the use of SAQ in primary care has not been systematically presented. Thus, the aim of this systematic review is to present an overview of SAQ used in primary care.Methods The electronic databases: PubMed, Embase, Cinahl, PsycInfo and Web of Science were used to find studies that used any version of SAQ in primary care. Studies were excluded if only abstract or poster was available, as the information in abstract and posters was deemed insufficient. Commentaries and nonempirical studies (e.g., study protocols) were excluded. Only English manuscripts were included.Results A total of 43 studies were included and 40 of them fell into four categories: 1) validation analysis, 2) descriptive analysis, 3) variance assessment and 4) intervention evaluation and were included in further analyses. Some studies fell into more than one of the four categories. Seventeen studies aimed to validate different versions of SAQ in a variety of settings and providers. Twenty-five studies from fourteen different countries reported descriptive findings of different versions of SAQ in a variety of settings. Most studies were conducted in primary health care centres, out-of-hours clinics, nursing homes and general practice focusing on greatly varying populations. One study was conducted in home care. Three studies investigated variance of SAQ scores. Only five studies used SAQ to assess the effects of interventions/events. These studies evaluated the effect of electronic medical record implementation, a comprehensive Unit-based Safety Program or COVID-19.Conclusion The synthesis demonstrated that SAQ is valid for use in primary care, but it is important to adapt and validate the questionnaire to the specific setting and participants under investigation. Moreover, differences in SAQ factor scores were related to a variety of descriptive factors, that should be considered in future studies More studies, especially variance and intervention studies, are warranted in primary care.Trial registration This systematic review was not registered in any register.

Validation and Measurement of Psychometric Properties of the "Nursing Work Environment Questionnaire" (NWE-q) in Italian Nurses

Background

Evidence suggests that an optimal workplace is a physical, chemical, biological, organizational, social, and cultural condition in which each element contributes to the employer's condition.

Purpose

To develop a nursing work environment questionnaire (NWE-Q).

Patients and Methods

Convergent validity was measured using Pearson's correlation test. Internal consistency for each dimension of the Nursing Work Environment questionnaire (NWE-q) was performed thanks to the Cronbach's alpha coefficient. Construct validity and factor structure of the data were also assessed. Reliability was evaluated by measuring internal consistency. Interclass correlation coefficient and convergent validity were also assessed. Group validity was evaluated according to the sociodemographic characteristics collected using an independent t-test.

Results

376 nurses participated in this study. Both Kaiser-Meyer-Olkin measures of sampling adequacy were, and the Bartlett test of sphericity showed very strong evidence. Owing to oblique rotation, three main sub-dimensions were defined with good internal consistency for all items of the NWE-q (27 items), and each sub-dimension was registered. Very strong interclass correlations were assessed for the NWE-q total scores and for each sub-dimension, with the exception of the system dimensions, in which the interclass correlation showed a weak relationship. Strong positive evidence was found between the NWE-q for both the total and each sub-dimension correlated with the items of both the individual and organizational validated nursing performance questionnaires. Strong evidence was observed for both the organizational and system subdimensions according to shift and gender.

Conclusion

The NWE-q was promptly completed in the online mode, and its scoring characteristics seemed to be more accessible and simpler to adopt.

Translations of the Practice Environment Scale of the Nursing Work Index: A systematic review

Since 2002, the Practice Environment Scale of the Nursing Work Index has been used worldwide to evaluate nurse work environments. High quality translations in different languages can help advance science and inform practice globally. The study purposes were to conduct a systematic review of published translations of the instrument and to assess their linguistic equivalence and psychometric performance. We conducted a comprehensive search, a quality assessment and synthesis of linguistic equivalence, reliability, and validity data. Studies published through July 2021 were identified in the CINAHL, LILACS, EMCare, and Scopus databases. Thirty-eight publications were selected, comprising 46 translations into 24 languages and 15 language variants, and 35 countries. Translations are in predominantly European, Southeast Asian, and Middle Eastern languages. Two-thirds of the translations reflected medium to high fulfillment of translation quality criteria. The GRADE ratings, reflecting satisfactory fulfillment of cross-cultural equivalence and psychometric properties, were predominantly high (n = 23), then low (n = 15), then moderate (n = 8). The identified translations will support the advancement of global science and the improvement of nurses' work environments.

How nurses' job characteristics affect their self-assessed work environment in hospitals- Slovenian use of the practice environment scale of the nursing work index

BACKGROUND

Nurses' work environment influences nursing practice. Inappropriate working conditions are the result of underdeveloped workplace infrastructure, poor work organisation, inadequate education, and inappropriate staffing norms. The aim of this study was to describe and examine the predictors that affect nurses' work environment using the Practice Environment Scale of the Nursing Work Index (PES-NWI).

METHODS

The validation of the PES-NWI was made. Nurse-reported job characteristics were used as independent variables. The sample included 1,010 nurses from adult surgical and medical units at 10 Slovenian hospitals. The Nurse Forecasting (RN4CAST) protocol was used. Permission to conduct the study was obtained from the National Medical Ethics Committee.

RESULTS

The PES-NWI mean (2.64) was low, as were job and career satisfaction at 2.96 and 2.89, respectively. The PES-NWI can be explained in 48% with 'Opportunities for advancement', 'Educational opportunities', 'Satisfaction with current job', 'Professional status', 'Study leave', and 'Level of education'. A three-factor solution of PES-NWI yielded eight distinct variables.

CONCLUSIONS

The obtained average on the Nursing Work Index was one of the lowest among previously conducted surveys. Nurses should be recognized as equals in the healthcare workforce who need to be empowered to develop the profession and have career development opportunities. Inter-professional relations and equal involvement of nurses in hospital affairs are also very important.

TRIAL REGISTRATION

This is a non-intervention study - retrospectively registered.

Validation of the Psychometric Properties of the Practice Environment Scale of Nursing Work Index in Primary Health Care in Portugal

Studies related to the work environment in primary health care are scarce in the literature. The present study aimed to validate the psychometric properties of the Practice Environment Scale of Nursing Work Index (PES-NWI) in primary health care (PHC) and to evaluate its construct validity through exploratory and confirmatory factor analyses in a sample of Portuguese nurses. A quantitative, cross-sectional, and validation study design was implemented. Methods: The sample consisted of 1059 nurses from the PHC units of all 55 health center groups (HCGs) in mainland Portugal, 15 health centers in the Autonomous Region of Madeira, and 6 health centers in the Autonomous Region of the Azores. The study tested different structural models using exploratory and confirmatory factor analysis techniques. The reliability of the scale was tested by determining Cronbach’s alpha coefficient. Results: The internal consistency of the PES-NWI was 0.91. Exploratory and confirmatory factor analyses were performed on the PES-NWI model in PHC with five factors: NPOA, NFQC, NMALSN, SRA, and CNPR. The results show that the scale presents acceptable fit quality indexes in the final factorial solution and adequate convergent validity. Conclusion: The PES-NWI in PHC has an adequate, robust, and reliable five-factor structure. The scale is valid and can be used in clinical practice, nursing management, and PHC research.

Cultural adaptation of the Safety Attitudes Questionnaire - Short Form (SAQ-SF) in Poland

Background

It is essential to provide safe healthcare in complex, difficult, and quickly changing conditions. The quality of healthcare services directly influences the safety of both the patients and staff. Understanding healthcare staff attitudes toward safety in the healthcare delivery context is foundational for building a culture of safety.

Aim of the work

To adapt, via a structured translation methodology, the Safety Attitudes Questionnaire–Short Form (SAQ-SF), which assesses how employees of the health care sector perceive the safety climate in their workplace, to the Polish context.

Methods

Using a content validation approach to structure the translation process, we tested and psychometrically analysed the translated SAQ-SF. The sample comprised 322 employees of a district hospital (second referral level, which ensures 24/7 emergency care services) in Poland.

Results

The reliability of the sub-scales of the Polish version of the SAQ-SF ranged from 0.66 to 0.95. The discriminatory power of particular SAQ items ranged between 0.02 and 0.90. For 6 out of the 8 scale dimensions, the questions with the highest factor loadings were those measuring the same dimensions of the safety climate, according to the original scale.

Conclusions

The Polish version of the SAQ-SF (SAQ-SF-PL) meets the criteria of psychometric and functional validation as well as demonstrates good reliability as a measure of patient safety culture in the Polish context. The SAQ-SF-PL is an instrument that enable a valid and reliable assessment of patient safety climate in the Polish healthcare facilities and identify opportunities for improvement. International comparisons will also become easier.

Content Validation of the Arabic Translation of the Practice Environment Scale of the Nursing Work Index-Revised

BACKGROUND AND PURPOSE

There is no reliable and valid version of the Practice Environment Scale of the Nursing Work Index-Revised (PES-NWI-R) in Arabic. The purpose of this study was to describe the systematic instrument translation and validation of the PES-NWI-R.

METHODS

Using the Content Validity Indexing-based approach, 32 expert nurses from four countries in the Eastern Mediterranean Region (Jordan, Oman, Saudi Arabia, and United Arab Emirates) participated in the validation of this translation.

RESULTS

The content validity index score of the overall scale was excellent (0.87 for the relevancy, and 0.95 for the quality of Arabic translation).

CONCLUSION

Our study supported the content validity of the Arabic version of the instrument which provided the first valid Arabic translation of the instrument.

Strategies for overcoming language barriers in research

AIM

This paper seeks to describe best practices for conducting cross-language research with individuals who have a language barrier.

DESIGN

Discussion paper.

DATA SOURCES

Research methods papers addressing cross-language research issues published between 2000-2017.

IMPLICATIONS FOR NURSING

Rigorous cross-language research involves the appropriate use of interpreters during the research process, systematic planning for how to address the language barrier between participant and researcher and the use of reliably and validly translated survey instruments (when applicable). Biases rooted in those who enter data into "big data" systems may influence data quality and analytic approaches in large observational studies focused on linking patient language preference to health outcomes.

CONCLUSION

Cross-language research methods can help ensure that those individuals with language barriers have their voices contributing to the evidence informing healthcare practice and policies that shape health services implementation and financing. Understanding the inherent conscious and unconscious biases of those conducting research with this population and how this may emerge in research studies is also an important part of producing rigorous, reliable, and valid cross-language research.

IMPACT

This study synthesized methodological recommendations for cross-language research studies with the goal to improve the quality of future research and expand the evidence-base for clinical practice. Clear methodological recommendations were generated that can improve research rigor and quality of cross-language qualitative and quantitative studies. The recommendations generated here have the potential to have an impact on the health and well-being of migrants around the world.

Development, adaptation and psychometric assessment of the extended brisbane practice environment measure for nursing homes (B-PEM-NH) for use in the Norwegian setting

Care workers' work environment is known to be associated with patient and nurse outcomes. To our knowledge no questionnaire is available for assessing this environment for all care workers in the Norwegian nursing-home setting. This paper describes the development, adaptation and assessment of such a questionnaire: the extended Norwegian version of the Brisbane Practice Environment Measure for Nursing Homes (B-PEM-NH). This version was developed and assessed using semistructured interviews, a reference group meeting, translation, adaptation, and pretesting, and psychometric assessment including exploratory and confirmatory factor analyses, and retest. We tested hypotheses to assess relations to other variables. The final factor solution comprised 41 items and 9 factors: interpersonal leadership, professional development, resources, professional leadership, input and acknowledgement, patient and next-of-kin focus, multidisciplinary collaboration, language misunderstandings, and feeling unsafe. The assessment showed that the B-PEM-NH had good psychometric properties, suggesting that the questionnaire is suitable for application in similar settings.

Practice environment scale of the nursing work index: Portuguese version and psychometric properties

AIM

To assess the psychometric properties regarding the Portuguese version of the Practice Environment Scale of the Nursing Work Index.

BACKGROUND

The Practice Environment Scale of the Nursing Work Index is the most widely used measure for assessing the practice environment. A model with a higher number of factors appears to be more adequate to Portuguese settings.

METHOD

A confirmatory factor analysis was performed to the Practice Environment Scale of the Nursing Work Index using a sample of 850 Portuguese nurses. Three models were tested: the original model, a seven-factor model and a higher-order model. An analysis of invariance was performed in two subsets to confirm the stability of the solution.

RESULTS

The seven-factor model fit better to the data than the original model. After refinement, this solution showed suitability and a stable factor structure. Reliability, convergent validity and discriminant validity were confirmed. A second-order factor solution also showed suitability.

CONCLUSION

The seven-factor structure of the Practice Environment Scale of the Nursing Work Index showed a better goodness-of-fit to Portuguese settings than the original structure. The second-order factor solution allows an overall assessment of practice environments.

IMPLICATIONS FOR NURSING MANAGEMENT

The Portuguese version of the Practice Environment Scale of the Nursing Work Index is a valuable tool for assessing Portuguese nursing practice environments. The seven-factor solution of the Practice Environment Scale of the Nursing Work Index showed high specificity.

A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS)

BACKGROUND

Social support (SS) has been identified as an essential buffer to stressful life events. Consequently, there has been a surge in the evaluation of SS as a wellbeing indicator. The Multidimensional Perceived Social Support Scale (MSPSS) has evolved as one of the most extensively translated and validated social support outcome measures. Due to linguistic and cultural differences, there is need to test the psychometrics of the adapted versions. However, there is a paucity of systematic evidence of the psychometrics of adapted and translated versions of the MSPSS across settings.

OBJECTIVES

To understand the psychometric properties of the MSPSS for non-English speaking populations by conducting a systematic review of studies that examine the psychometric properties of non-English versions of the MSPSS.

METHODS

We searched Africa-Wide Information, CINAHL, Medline and PsycINFO, for articles published in English on the translation and or validation of the MSPSS. Methodological quality and quality of psychometric properties of the retrieved translations were assessed using the COSMIN checklist and a validated quality assessment criterion, respectively. The two assessments were combined to produce the best level of evidence per language/translation.

RESULTS

Seventy articles evaluating the MSPSS in 22 languages were retrieved. Most translations [16/22] were not rigorously translated (only solitary backward-forward translations were performed, reconciliation was poorly described, or were not pretested). There was poor evidence for structural validity, as confirmatory factor analysis was performed in only nine studies. Internal consistency was reported in all studies. Most attained a Cronbach's alpha of at least 0.70 against a backdrop of fair methodological quality. There was poor evidence for construct validity.

CONCLUSION

There is limited evidence supporting the psychometric robustness of the translated versions of the MSPSS, and given the variability, the individual psychometrics of a translation must be considered prior to use. Responsiveness, measurement error and cut-off values should also be assessed to increase the clinical utility and psychometric robustness of the translated versions of the MSPSS.

TRIAL REGISTRATION

PROSPERO - CRD42016052394.

The Female Self-Advocacy in Cancer Survivorship Scale: A validation study

AIM

To develop and psychometrically test the validity of the Female Self-Advocacy in Cancer Survivorship Scale.

BACKGROUND

Female cancer survivors need to self-advocate to overcome challenges associated with cancer yet no valid measure of self-advocacy exists.

DESIGN

Instrument development. Mixed-mode cross-sectional survey design.

PARTICIPANTS

We recruited adult females (18+ years; N = 317) with a history of invasive cancer from local and national tumour registries and advocacy organizations to complete online or paper questionnaires.

METHODS

Between July 2014 - March 2015 to evaluate the construct validity based on evidence of the scale's: (1) internal structure consistent with the underlying model of self-advocacy; (2) sensitivity to differences between groups known to differ in self-advocacy skills; (3) relationships between self-advocacy and key potential predictors (openness and conscientiousness; information engagement; social support) and outcomes (symptom burden and healthcare utilization); (4) relationships between self-advocacy and related concepts (patient activation; self-advocacy within another patient population); and (5) relationships between self-advocacy and criterion measures. Analyses included an exploratory factor analysis, t tests, and bivariate correlations using validated, reliable measures for constructs.

RESULTS

Evidence from all five hypotheses supported the construct validity of the Female Self-Advocacy in Cancer Survivorship Scale. The factor analysis confirmed the three underlying dimensions of self-advocacy resulting in a 20-item measure with strong internal consistency that explained almost half of response variance.

CONCLUSION

The Female Self-Advocacy in Cancer Survivorship Scale is a valid, reliable measure of how well adult female cancer survivors can get their needs met in the face of adversity.

Measuring nurses' perception of work environment: a scoping review of questionnaires

Background

Nurses’ work environment has been shown to be associated with quality of care and organizational outcomes. In order to monitor the work environment, it is useful for all stakeholders to know the questionnaires that assess or evaluate conditions for delivering nursing care. The aim of this article is: to review the literature for assessed survey questionnaires that measure nurses’ perception of their work environment, make a brief assessment, and map the content domains included in a selection of questionnaires.

Methods

The search included electronic databases of internationally published literature, international websites, and hand searches of reference lists. Eligible papers describing a questionnaire had to be; a) suitable for nurses working in direct care in general hospitals, nursing homes or home healthcare settings; and b) constructed to measure work environment characteristics that are amenable to change and related to patient and organizational outcomes; and c) presented along with an assessment of their measurement properties.

Results

The search yielded 5077 unique articles. For the final synthesis, 65 articles met inclusion criteria, consisting of 34 questionnaires measuring nursing work environments in different settings. Most of the questionnaires that we found were developed, and tested, for registered nurses in a general hospital setting. Six questionnaires were developed specifically for use in nursing home settings and one for home healthcare. The content domains covered by the questionnaires were both overlapping and unique and the terminology in use was inconsistent. The most common content domains in the work environment questionnaires were supportive managers, collaborative relationships with peers, busyness, professional practice and autonomy.

Conclusions

The findings from this review enhance the understanding of how “work environment” can be measured by an overview of existing questionnaires and domains. Our results indicate that there are very many work environment questionnaires with varying content.

Electronic supplementary material

The online version of this article (10.1186/s12912-017-0256-9) contains supplementary material, which is available to authorized users.

Cross-Validation of the Minnesota Living With Heart Failure Questionnaire

PURPOSE

The Minnesota Living With Heart Failure Questionnaire (MLHFQ) is the leading method for assessing quality of life in patients with heart failure (HF) around the world. However, unique, culture-specific variations in factorial structure have been identified. The current study examined the cross-cultural equivalence of an Italian version of the MLHFQ.

DESIGN

Cross-sectional assessment as part of an HF study in Italy. Patients (n = 1,192; mean age = 72 years, SD = 11) completed demographics, the MLHFQ, and the Short-Form 12 (SF-12).

METHODS

A series of exploratory and confirmatory factor analyses were used to develop an appropriate factor model in the current sample.

FINDINGS

We initially fit a confirmatory factor analysis based on published psychometric work validating the MLHFQ. This did not provide adequate fit, and the sample was then randomly split into equivalent subsets to conduct factor analyses with cross-validation. In the first subsample, an exploratory factor analysis uncovered slight modifications to the proposed factor structure that resulted in much improved model fit. The final model included a higher order factor and three subscales: physical, emotional, and social. A cross-validation confirmatory factor analysis using this structure was conducted in the remaining subset to ensure broader applicability of the results. Correlations with the SF-12 were consistent with previous work using these measures.

CONCLUSIONS

Some items of the MLHFQ are sensitive to differences across cultures, and factor structures vary based on where the scale is administered. In spite of these differences, the total score remains a valid and reliable indicator of quality of life in HF patients across cultures.

CLINICAL RELEVANCE

Cultural influences on quality of life are important to consider when assessing patients' well-being in HF.