German translation of the Alberta Context Tool and two measures of research use: methods, challenges and lessons learned

The Association of Nursing Homes' Organizational Context With Care Aide Empowerment: A Cross-Sectional Study

BACKGROUND AND OBJECTIVES

Organizational context is thought to influence whether care aides feel empowered, but we lack empirical evidence in the nursing home sector. Our objective was to examine the association of features of nursing homes' unit organizational context with care aides' psychological empowerment.

RESEARCH DESIGN AND METHODS

This cross-sectional study analyzed survey data from 3765 care aides in 91 Western Canadian nursing homes. Random-intercept mixed-effects regressions were used to examine the associations between nursing home unit organizational context and care aides' psychological empowerment, controlling for care aide, care unit, and nursing home covariates.

RESULTS

Organizational (IVs) culture, social capital, and care aides' perceptions of sufficient time to do their work were positively associated with all four components of psychological empowerment (DVs): competence (0.17 [0.13, 0.21] for culture, 0.18 [0.14, 0.21] for social capital, 0.03 [0.01, 0.05] for time), meaning (0.21 [0.18, 0.25] for culture, 0.19 [0.16, 0.23] for social capital, 0.03 [0.01, 0.05 for time), self-determination (0.38 [0.33, 0.44] for culture, 0.17 [0.12, 0.21] for social capital, 0.08 [0.05, 0.11] for time), and impact (0.26 [0.21, 0.31] for culture, 0.23 [0.19, 0.28] for social capital, 0.04 [0.01, 0.07] for time).

DISCUSSION AND IMPLICATIONS

In this study, modifiable elements of organizational context (i.e., culture, social capital, and time) were positively associated with care aides' psychological empowerment. Future interventions might usefully target these modifiable elements of unit level context in the interest of assessing their effects on staff work attitudes and outcomes, including the quality of resident care.

Measuring working alliance and technical alliance from the perspective of healthcare professionals working with people with mild intellectual disabilities: adaptation, factor structure and reliability

BACKGROUND

The establishment of a valuable and meaningful working alliance between people with mild intellectual disabilities (IDs) and healthcare professionals is critically important for improving both the quality of life and impact of therapy for people with mild IDs. Measuring the working alliance as a treatment or support component is therefore of utmost relevance. In light of the increased use of eHealth tools, it is also essential to measure the alliance using these tools, which is referred to as technical alliance. There was a lack of validation of these two measurements for healthcare professionals working with people with mild IDs, which this study sought to address.

METHOD

Both the validated Working Alliance Inventory - Short Form - MID (WAI-SF-MID) and Technical Alliance Inventory - Short Form - MID (TAI-SF-MID) for general patient populations were adapted for healthcare professionals working with people with mild IDs. A two-step approach was conducted to systematically adapt both measurements with an expert group of healthcare professionals. Confirmatory factor analysis was conducted to test a three-factor structure for both the WAI-SF-MID (N = 199) and the TAI-SF-MID (N = 139), and internal consistency was determined for both scales.

RESULTS

An acceptable-to-good model fit was found for both the WAI-SF-MID and the TAI-SF-MID; confirmatory factor analysis confirmed a three-factor model for both measurements. Cronbach's alpha and McDonald's omega were excellent for both total scales (≥0.90) and acceptable to good for sub-scales of both versions.

CONCLUSION

Both the WAI-SF-MID and the TAI-SF-MID are promising measurements for determining healthcare professionals' perspective on the (digital) working alliance with people with mild IDs.

Six Honest Serving Matters, Teaching Us All We Need to Know About Context in Knowledge Implementation? Comment on "Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-country Analysis"

While context is a vital factor in any attempt to study knowledge translation or implement evidence in healthcare, there is a need to better understand the attributes and relations that constitute context. A recent study by J. Squires et al investigates such attributes and definitions, based on 39 stakeholder interviews across Australia, Canada, the United Kingdom, and the United States. Sixteen attributes, comprising 30 elements suggested as new findings, are proposed as the basis for a framework. This commentary argues for the need to incorporate more perspectives but also suggests an initial taxonomy rather than a framework, comprising a wider range of stakeholders and an enhanced understanding of how context elements are related at different levels and how this affects implementation processes. Aligning with person-centred care, this must include not only professionals but also patients and their next of kin, as partners in shaping more evidence-based healthcare.

Psychometric Properties of Disaster Preparedness Tools in Nurses: A Systematic Literature Review

INTRODUCTION

There is no widely-recommended standardized and valid measurement tool for evaluating the disaster preparedness of nurses. This study aims to assess the psychometric properties of scales developed or adapted to evaluate the sudden-impact natural disaster preparedness of nurses.

METHODS

This study is a systematic literature review for the psychometric properties of disaster preparedness tools. Studies published from 2010 through June 2021 were identified from a systematic search of five databases, including Web of Science, PubMed, CINAHL, Scopus, and ProQuest. The Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist was used for the systematic review and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline for reporting. The World Health Organization's (WHO) report on the Development of a Disaster Preparedness Tool Kit for Nursing and Midwifery was used to evaluate scale contents.

RESULTS

Six articles were identified that met the inclusion criteria. The scales generally had a multi-dimensional structure and used Likert scoring with internal consistency coefficients ranging from 0.785 to 0.97. All scales were rated sufficient in content validity, structural validity, and cross-cultural validity. One scale was rated sufficient in criterion validity while the others were rated indeterminate. One scale was rated insufficient in reliability and internal consistency while the others were rated sufficient.

CONCLUSION

The findings suggest improving the psychometric properties of scales of nurses' disaster preparedness according to COSMIN, expanding their content scope, and developing new scales. The study will provide beneficial data to users and researchers regarding the need for a comprehensive assessment tool in determining the disaster preparedness of nurses.

[Translation and culture sensitive adaptation of the PELI ("Preferences for Everyday Living Inventory") for nursing settings]

Translation and culture sensitive adaptation of the PELI ("Preferences for Everyday Living Inventory") for nursing settings Abstract. Background: The consideration of individual preferences of people with care needs in the sense of person-centred care requires a systematic recording of preferences related to everyday living. Therefore, the Preferences for Everyday Living Inventory (PELI) was developed in the USA. Aim: The aim was to translate the current version of the PELI-NH^© (Nursing Home), into German (PELI-D) and to adapt this version in a culturally sensitive manner home care, adult day care and nursing home. Methods: The German translation of the PELI-NH^© was carried out in eleven steps according to the ISPOR principles. Central steps were the forward translations, the expert panel, the cognitive debriefing and the backward translations. Results: As result of the translation the PELI-D (72 items) is the first comprehensive instrument in German language to assess everyday preferences of people with care needs in home care (55 items), adult day care (54 items) und nursing home (65 items). Conclusion: The selected procedure supports a critical reflection of the translation process and ensures the culturally sensitive comparability of the source language and the target language. The practicability of three setting specific versions of PELI-D needs be examined in further studies.

Measuring nurses' perceptions of their work environment and linking with behaviour change theories and implementation strategies to support evidence based practice change

PURPOSE

Survey tools, such as the Alberta Context Tool, reliably measure context but researchers have no process to map context to clinician behaviour and develop strategies to support practice change. Therefore, we aimed to map the Alberta Context Tool to the Theoretical Domains Framework and the Behaviour Change Wheel.

METHOD

The multi-centre study used the Alberta Context Tool to collect data from a convenience sample of nurses working in two emergency departments. These findings were categorised as barriers and enablers, and then mapped to the Theoretical Domains Framework to examine for behavioural domains. Using the Behaviour Change Wheel functions, strategies were developed to target clinician behaviour change.

RESULTS

Survey response rate was 42% (n = 68). Nurses perceived a positive work environment in the dimensions of Social Capital (median 4.00, IQR 0.33), Culture (median 3.83, IQR 1.16) and Leadership (median 3.60, IQR 1.1). Low scoring dimensions included Formal Interactions (median 2.75, IQR 1.00); Time (median 2.60, IQR 1.00) Staffing (median 3.0, IQR 2.00) and Space (median 3.0, IQR 2.00). Enablers (n = 77) and barriers (n = 25) were identified in both sites. The Theoretical Domains Framework was mapped to Alberta Context Tool barriers and enablers. The behaviour change strengths included: social and professional role; beliefs about capability; goals; and emotions. Using the Behaviour Change Wheel functions, 67 strategies were developed to address barriers and enablers.

CONCLUSIONS

The Alberta Context Tool successfully measured two emergency environments identifying barriers and enablers. This approach enabled environment dimensions to be targeted with practical solutions to support evidence-based practice implementation.

Preferences for everyday living inventory (PELI): study protocol for piloting a culture-sensitive and setting-specific translated instrument in German care settings (PELI-D)

INTRODUCTION

Regardless of the healthcare setting, person-centred care and its implementation in caring for older people are a central issue for those who are responsible as professional caregivers and for those in need of care within the care process. Both aspects encompass the possibility of recognising personal preferences. To provide person-centred care, professional caregivers need to know about the individual preferences of the persons being cared for. Therefore, the PELI (an acronym for 'Preferences for Everyday Living Inventory') instrument was developed at the Polisher Research Institute (USA) for the systematic recording of individual preferences of older people in need of care. There is currently no comparable instrument available in the German language.

METHODS

As part of the proposed project PELI-D, all versions of the original PELI instrument (nursing home version) were (1) culture-sensitively translated into German and will be (2) examined in a pilot study for their reliability, feasibility and practicability. For the project PELI-D, we worked together with our practice partners in Germany (Diaconia and Caritas in North Rhine-Westphalia) and collaborated with our partners in the USA who developed the PELI instrument. This study protocol focuses on the pilot study, which will be conducted by the German Center for Neurodegenerative Diseases (DZNE) (site Witten).

ETHICS AND DISSEMINATION

This study was approved by the internal quality control committee of the DZNE (ID number: WI029 PELI-D) and by the ethics committee of the German Society of Nursing Science Duisburg branch office (ID number: 18-010). All personal information will be deidentified with a specific identification code and stored in a secured location apart from the rest of the study data. Only qualified and study-related staff will be allowed access to the data. The results of the study will be distributed nationally and internationally through peer-reviewed journals, conferences and journals for nursing care practice.

[Systematic translation and cross-validation of defined implementation outcomes in health care services]

OBJECTIVE

To validate a German translation of construct-validated implementation outcomes of Proctor et al. (2011).

METHODS

A systematic translation process and a cross-validation based on Beaton et al. (2000) were performed.

RESULTS

Semantic challenges arose regarding the definitions of "adoption" and "fidelity". Consistent formulation was established.

CONCLUSION

The validated definitions are a starting point for developing a comprehensive concept to measure implementation effectiveness and efficacy of interventions in health services research.

Nurse Competence Scale: a systematic and psychometric review

AIM

The aim of this study was to report a systematic and psychometric review.

BACKGROUND

The Nurse Competence Scale is currently the most widely used generic instrument to measure Registered Nurses' competence in different phases of their careers. Based on a decade of research, this review provides a summary of the existing evidence.

DESIGN

A systematic literature review of research evidence and psychometric properties.

DATA SOURCES

Nine databases from 2004 - October 2015.

REVIEW METHODS

We retrieved scientific publications in English and Finnish. Two researchers performed data selection and appraised the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments checklist.

RESULTS

A total of 30 studies reported in 43 publications were included. These consisted of over 11,000 competence assessments. Twenty studies were from Europe and 10 from outside Europe. In addition to experienced nurses, the Nurse Competence Scale has been used for the competence assessment of newly graduated nurses and nursing students, mainly in hospital settings. Length of work experience, age, higher education, permanent employment and participation in educational programmes correlated positively with competence. Variables including empowerment, commitment, practice environment, quality of care and critical thinking were also associated with higher competence. The Nurse Competence Scale has demonstrated good content validity and appropriate internal consistency.

CONCLUSION

The value of Nurse Competence Scale has been confirmed in determining relationships between background variables and competence. The instrument has been widely used with experienced and newly graduated nurses and their managers. Cross-cultural validation must be continued using rigorous methods.

Factor Structure, Reliability and Measurement Invariance of the Alberta Context Tool and the Conceptual Research Utilization Scale, for German Residential Long Term Care

We translated the Canadian residential long term care versions of the Alberta Context Tool (ACT) and the Conceptual Research Utilization (CRU) Scale into German, to study the association between organizational context factors and research utilization in German nursing homes. The rigorous translation process was based on best practice guidelines for tool translation, and we previously published methods and results of this process in two papers. Both instruments are self-report questionnaires used with care providers working in nursing homes. The aim of this study was to assess the factor structure, reliability, and measurement invariance (MI) between care provider groups responding to these instruments. In a stratified random sample of 38 nursing homes in one German region (Metropolregion Rhein-Neckar), we collected questionnaires from 273 care aides, 196 regulated nurses, 152 allied health providers, 6 quality improvement specialists, 129 clinical leaders, and 65 nursing students. The factor structure was assessed using confirmatory factor models. The first model included all 10 ACT concepts. We also decided a priori to run two separate models for the scale-based and the count-based ACT concepts as suggested by the instrument developers. The fourth model included the five CRU Scale items. Reliability scores were calculated based on the parameters of the best-fitting factor models. Multiple-group confirmatory factor models were used to assess MI between provider groups. Rather than the hypothesized ten-factor structure of the ACT, confirmatory factor models suggested 13 factors. The one-factor solution of the CRU Scale was confirmed. The reliability was acceptable (>0.7 in the entire sample and in all provider groups) for 10 of 13 ACT concepts, and high (0.90-0.96) for the CRU Scale. We could demonstrate partial strong MI for both ACT models and partial strict MI for the CRU Scale. Our results suggest that the scores of the German ACT and the CRU Scale for nursing homes are acceptably reliable and valid. However, as the ACT lacked strict MI, observed variables (or scale scores based on them) cannot be compared between provider groups. Rather, group comparisons should be based on latent variable models, which consider the different residual variances of each group.

Validity and Reliability of Persian Version of HIV/AIDS Related Stigma Scale for People Living With HIV/AIDS in Iran

OBJECTIVE

To assess the perceived HIV/AIDS related stigma a comprehensive and well developed stigma instrument is necessary. This study aimed to assess validity and reliability of the Persian version of HIV/AIDS related stigma scale which was developed by Kang et al for people living with HIV/AIDS in Iran.

MATERIALS AND METHODS

Thescale was forward translatedby two bilingual academic members then both translations were discussed by expert team. Back-translation was done by two other bilingual translators then we carried out discussion with both of them. To evaluate understandability the scale was administered to 10 Persons Living with HIV/AIDS (PLWHA). Final Persian version was administered to 80 PLWHA in Qom, Iran in 2014. Test-retest reliability was assessed in a sample of 20 PLWHA after a week by intra-class correlation coefficient (ICC).

RESULTS

Cronbach's alpha coefficient for overall scale was 0.85. Also Cronbach's alpha coefficients for the five subscales were as follows: social rejection (9 items, α = 0.84), negative self-worth (4 items, α = 0.70), perceived interpersonal insecurity (2 items, α = 0.57), financial insecurity (3 items, α = 0.70), discretionary disclosure (2 items, α = 0.83). Test-retest reliability was also approved with ICC = 0.78. Correlation between items and their hypothesized subscale is greater than 0.5. Correlation between an item and its own subscale was significantly higher than its correlation with other subscales.

CONCLUSION

This study demonstrate that the Persian version of HIV/AIDS related stigma scale is valid and reliable to assess HIV/AIDS related stigma perceived by people living whit HIV/AIDS in Iran.

Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care

Background

To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks’ Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity–an initial stage of validity, necessary before more advanced validity assessment.

Methods

We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants’ answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants.

Results

Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups.

Conclusion

Cognitive debriefing is essential to detect and respond to problematic instrument items, particularly when translating instruments for heterogeneous, less well educated provider groups such as HCAs. Cognitive debriefing is an important step in research tool development and a vital component of establishing response process validity evidence. Publishing cognitive debriefing results helps researchers to determine potentially critical elements of the translated tools and assists with interpreting scores.