Measures of evidence-informed decision-making competence attributes: a psychometric systematic review

'Capacity building skills in the implementation of evidence-based practice for community health nurses: an exploratory descriptive cohort study'

Background: While nurses are strategically placed to support the achievement of universal health, their practice may not always be informed by evidence, especially in a context where research evidence is not commonly used to inform practice.Objective/Aim/Hypothesis: Improve management of clients with CNCDs in Caribbean community through evidence-based practice (EBP) capacity building workshops.Design/Methods: A descriptive, quantitative design was used for this study. Participants included Community Based Nurses who attended an initial and recall workshop on EBP in a Caribbean island. All participants were included as the sample. Data were collected as a Pre-Test and Post Test before the initial workshop and at the recall workshop. Analysis was done quantitatively. Since the sample was small, only descriptive statistics were used.Results: Data showed 64% of participants had no experience with EBP, 55% needed more essential resources to participate in EBP and 55% recognized a need to include EBP to change their clinical practice effectively.Conclusions: The nurses and district supervisors observed a high level of interest and commitment to initiating and completing EBP projects. However, the reality of significant workplace demands, and limitations in consistent logistical and supervisory support impacted long-term sustainability.

Professional Values and Self-Reported Clinical Competence of Acute Care Nurses in Saudi Arabia: A Cross-Sectional Study

BACKGROUND

Professional values are the foundation of nursing practice. Current research evidence on the influence of professional values on clinical competence among acute care nurses in the clinical area is lacking.

PURPOSE

The purpose of this study was to examine the professional values and self-reported clinical competence among acute care nurses.

METHODS

This quantitative study used a cross-sectional, correlational design. A convenience sample of 403 nurses was recruited to answer the survey utilizing the Nurses Professional Values Scale-3 and the Nurse Competence Scale. The Pearson correlation coefficient was computed to test the relationship between study variables, and a stepwise multiple regression analysis was then performed to investigate the predictors of nurses' professional values and clinical competence.

RESULTS

The professional value of "caring" received the highest mean score, followed by "professionalism", while the factor "activism" was rated the lowest. Education was a significant predictor of all three factors of professional values. For clinical competence, "managing situations" was rated as the highest dimension, while "ensuring quality" was rated as the lowest. Moderate positive correlations were revealed between the three factors of professional values and all dimensions of nurses' clinical competence. Area of practice and "activism" were the only significant predictors of the nurses' clinical competence.

CONCLUSIONS

Nurses perceived all three factors of professional values with high importance in influencing their clinical competence. These findings can contribute to the development of educational interventions to improve and sustain professional values and clinical competence among acute care nurses.

Knowledge and Awareness of Rare Diseases Among Healthcare Professionals in the Kingdom of Bahrain

Aim  Recent studies highlighted that lack of knowledge on rare diseases is a problem that requires attention. This study aims to assess healthcare professionals' general awareness and knowledge of rare diseases in a tertiary hospital in the Kingdom of Bahrain. Method  The study employed a cross-sectional design, utilizing a survey questionnaire derived from the most recent literature. The survey encompassed socio-demographic factors and quiz-based questions that were previously created by Domaradzi and Walkowiak to assess knowledge and awareness of rare diseases. To ensure convenience and accessibility, the survey was made available in both Arabic and English languages. Results  Of a total of 333 responses, 25.2% were physicians, 53.8% were nurses, and 21.0% were allied health personnel. The majority of participants (87.4%) were aware of and had heard the term "rare diseases" prior to this survey. Participants were able to recognize what age group is frequently affected by rare diseases (p=0.023) and what the common cause of rare diseases worldwide is (p<0.001). Overall scores showed that only four participants answered all questions correctly, testing their knowledge of rare diseases. There was a weak correlation between self-declared knowledge and the overall score achieved (r=0.190; p<0.001), which indicates that the population's self-declared knowledge did not portray their actual knowledge of rare diseases.  Conclusion  This study highlights the need for improved knowledge of rare diseases among healthcare professionals, which aligns with the global knowledge landscape. To bridge the knowledge gap, we recommend action plans to ensure that healthcare professionals have rich knowledge of rare diseases and further improve patient care. Additionally, enhancing advocacy efforts is crucial to ensure optimal local and global patient care services.

Instruments measuring evidence-based practice behavior, attitudes, and self-efficacy among healthcare professionals: a systematic review of measurement properties

BACKGROUND

Evidence-based practice (EBP) is well known to most healthcare professionals. Implementing EBP in clinical practice is a complex process that can be challenging and slow. Lack of EBP knowledge, skills, attitudes, self-efficacy, and behavior can be essential barriers that should be measured using valid and reliable instruments for the population in question. Results from previous systematic reviews show that information regarding high-quality instruments that measure EBP attitudes, behavior, and self-efficacy in various healthcare disciplines need to be improved. This systematic review aimed to summarize the measurement properties of existing instruments that measure healthcare professionals' EBP attitudes, behaviors, and self-efficacy.

METHODS

We included studies that reported measurement properties of instruments that measure healthcare professionals' EBP attitudes, behaviors, and self-efficacy. Medline, Embase, PsycINFO, HaPI, AMED via Ovid, and Cinahl via Ebscohost were searched in October 2020. The search was updated in December 2022. The measurement properties extracted included data on the item development process, content validity, structural validity, internal consistency, reliability, and measurement error. The quality assessment, rating of measurement properties, synthesis, and modified grading of the evidence were conducted in accordance with the COSMIN methodology for systematic reviews.

RESULTS

Thirty-four instruments that measure healthcare professionals' EBP attitudes, behaviors or self-efficacy were identified. Seventeen of the 34 were validated in two or more healthcare disciplines. Nurses were most frequently represented (n = 53). Despite the varying quality of instrument development and content validity studies, most instruments received sufficient ( +) ratings on content validity, with the quality of evidence graded as "very low" in most cases. Structural validity and internal consistency were the measurement properties most often assessed, and reliability and measurement error were most rarely assessed. The quality assessment results and overall rating of these measurement properties varied, but the quality of evidence was generally graded higher for these properties than for content validity.

CONCLUSIONS

Based on the summarized results, the constructs, and the population of interest, several instruments can be recommended for use in various healthcare disciplines. However, future studies should strive to use qualitative methods to further develop existing EBP instruments and involve the target population.

TRIAL REGISTRATION

This review is registered in PROSPERO. CRD42020196009. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020196009.

Nurses' evidence-based practice competence and hospital practice environment after specific training under the Best Practice Spotlight Organization® Programme. A cross sectional study

BACKGROUND

Barriers to implementing training strategies for the improvement of evidence-based practice competence of nurses in hospital practice environments still persist.

OBJECTIVE

The aim of the study was to evaluate the impact of a specific training within the framework of the Best Practice Spotlight Organization® programme, on nurses' evidence-based practice competence and the practice environment in two hospitals.

DESIGN

This is a observational cross-sectional study assessing evidence-based practice competence and perceptions of Practice Environments.

PARTICIPANTS

The study sample were 204 nurses working at medical and surgical inpatient units at two hospitals involved in the Best Practice Spotlight Organization® programme.

METHODS

The study was conducted from February 2020 to May 2020. Three questionnaires were used to collect data: a sociodemographic/occupational questionnaire, a questionnaire exploring evidence-based practice skills, and a questionnaire exploring nurses' perceptions of their hospital practice environments.

RESULTS

A total of 204 nurses participated. They were classified into two groups: those who had received specific training within the framework of the programme, called trained-champions (n = 66), and those who had not yet received training, control group (n = 138). The trained-champions exhibited better evidence-based practice competence values than the control group in all dimensions (p < 0.001), with a higher difference in means in the "Utilisation" dimension (-0.80; CI:-0.99,-0.60) and the "Knowledge" dimension (-0.63; CI:-0.88,-0.38). Trained-champions also had a more positive perception of the practice environments than the controls in all dimensions (p ≤ 0.001). The largest differences in means were in the "Participation" dimension (-0.48; CI:-0.66,-0.31) and in the "Leadership" dimension (-0.41; CI:-0.59,-0.23).

CONCLUSIONS

Specific EBP training within the framework of the Best Practice Spotlight Organization® programme has succeeded in nurses (trained-champions) obtaining better EBP competence than others without this training. This could have contributed to increase nurses' abilities to integrate evidence into decision making in their clinical practice, while positively influencing them to perceive their PEs more favorably.

Challenges and future directions in the measurement of evidence-based practice: Qualitative analysis of umbrella review findings

RATIONALE, AIMS AND OBJECTIVES: An important aspect of scholarly discussions about evidence-based practice (EBP) is how EBP is measured. Given the conceptual and empirical developments in the study of EBP over the last 3 decades, there is a need to better understand how to best measure EBP in educational and clinical contexts. The aim of this study was to identify and describe the main challenges, recommendations for practice, and areas of future research in the measurement of EBP across the health professions as reported by systematic reviews (SRs).

METHODS

We conducted a secondary analysis of qualitative data obtained in the context of a previously published umbrella review that aimed to compare SRs on EBP measures. Two reviewers independently extracted excerpts from the results and discussion/conclusion sections of the 10 included SRs that aligned with the three research aims. An iterative six-phase reflexive thematic analysis according to Braun and Clarke was conducted.

RESULTS

Our thematic analysis produced five themes describing the main challenges associated with measuring EBP, four themes outlining main recommendations for practice, and four themes representing areas of future research. Challenges include limited psychometric testing and validity evidence for existing EBP measures; limitations with the self-report format; lack of construct clarity of EBP measures; inability to capture the complexity of the EBP process and outcomes; and the context-specific nature of EBP measures. Reported recommendations for practice include acknowledging the multidimensionality of EBP; adapting EBP measures to the context and re-examining the validity argument; and considering the feasibility and acceptability of measures. Areas of future research included the development of comprehensive, multidimensional EBP measures and the need for expert consensus on the operationalization of EBP.

CONCLUSIONS

This study suggests that existing measures may be insufficient in capturing the multidimensional, contextual and dynamic nature of EBP. There is a need for a clear operationalization of EBP and an improved understanding and application of validity theory.

Analysis of Healthcare Professionals' and Institutions' Roles in Twitter Colostomy Information

Social media represents a powerful tool for disseminating verified health information on topics such as colostomy, and the roles of healthcare professionals and institutions to ensure the veracity of the information conveyed is increasingly relevant. The main objectives of this study were to analyze the roles of these healthcare professionals and institutions in the conversation about colostomy, without being framed in a specific health communication campaign, and to know the use of reliable information in the conversation. The study was carried out by analyzing Twitter messages containing the hashtag "colostomy" and "Chron" between the 1 January and the 30 April 2022. It was conducted using the NodeXL software, focusing on content analysis of tweets and users' accounts. The results show that accounts with healthcare activity influence the impressions generated on the network (p = 0.018), finding that nurses are the most active healthcare professionals (22.24%) also having a significant effect on the overall network interactions (p = 0.022). In contrast, we found that institutions do not actively participate on the network. We emphasize the responsibility of institutions for health education and the need for professionals to improve communication skills on social networks, but also the need to improve communication skills on social media to support public health campaigns through these increasingly important channels.

Development and Validation of the Soft Skills Questionnaire for Nurses

Introduction

Skills challenge has been given great attention for its impact on employees' performance. Various approaches have been put forward to design professional development programs that help in preparing nurses to work in the field and ongoing training programs to keep them up to each new method and technique at the interpersonal improvement level.

Objective

To develop and validate a questionnaire that tests the communication and management skills, emotional intelligence, and confidentiality of nurses in Lebanon.

Methods

The questionnaire, consisting of 25 statements, was generated and developed by experts in the field of nursing, soft skills, and questionnaire development. The items of the questionnaire were assessed using face, content, and construct validity and data validation was examined through psychometric properties at the final stage of the validation. Internal consistency and reliability were assessed through Cronbach alpha ( α ). Further analyses were carried out to decide on the number of factors to be extracted using Oblimin Rotation method. All statistical tests were performed using Statistical Package for the Social Sciences (SPSS 20.0).

Results

Nineteen items of the 25-item scale had an I-CVI of 1.00 and the remaining six items had an I-CVI of 0.87. The S-CVI/UA was 0.76 and the S-CVI/Ave was 0.97, which meant that the items were good for the underlying construct. For the psychometric measures, the results were quite accepted and satisfactory. The Kaiser-Meyer-Oklin measure of sampling adequacy and the significance for the Bartlett's test for the whole questionnaire were quite acceptable with 0.680 and 0.000, respectively. Furthermore, the Cronbach alpha (α) value was 0.824 indicating a high internal consistency between the items of the questionnaire. While obtaining exploratory factor analysis for each section, results showed that Oblimin Rotation method should be applied to the last section in which three items were eliminated to maintain a simple factor structure.

Conclusion

This study shows that the 25-item Soft Skills Questionnaire is a valid and reliable tool for evaluating the level of communication of nurses, their emotional intelligence, confidentiality, and management.

Health Literacy and Critical Lecture as Key Elements to Detect and Reply to Nutrition Misinformation on Social Media: Analysis between Spanish Healthcare Professionals

Health misinformation about nutrition and other health aspects on social media is a current public health concern. Healthcare professionals play an essential role in efforts to detect and correct it. The present study focuses on analyzing the use of competencies associated with training in methodology, health literacy, and critical lecture in order to detect sources of health misinformation that use scientific articles to support their false information. A qualitative study was conducted between 15 and 30 January 2022, wherein the participants were recruited from active users from a nutrition conversation on Twitter, diets, and cancer and defined themselves as healthcare professionals. This study demonstrates that health literacy and critical lecture competencies allow for the detection of more misinformation messages and are associated with a high rate of responses to users that spread the misinformation messages. Finally, this study proposes the necessity of developing actions to improve health literacy and critical lecture competencies between healthcare professionals. However, in order to achieve this, health authorities must develop strategies to psychologically support those healthcare professionals faced with bullying as a result of their activity on social media debunking health hoaxes.

Self-perceived competences in evidence-based practice of clinical-teaching nurses versus clinical nurses

AIM

To compare the evidence-based practice (EBP) self-perceived competences of clinical teacher nurses (CTN) versus clinical nurses (CN) to detect areas for improvement in practical training.

METHOD

A cross-sectional study by means of a self-assessment questionnaire sent to nurses of two public hospitals of Castilla y León was performed, between February to May 2020. Variables included competences in evidence based practice (EBP) - attitude, knowledge, skills and use-, sociodemographic, job, academic, teaching relations and training in investigation methodology and/or EBP. A validated questionnaire EBP-COQ prof© of 35 questions with answers type Likert (1, very disagree-5, very agree) was used. Data analysis (descriptive and bivariate) was performed by means SPSS v.24 program.

RESULTS

171 questionnaires were answered by nurses. CN 52%, CTN 48%. There were no significant differences between both groups regarding sociodemographic variables. Mean age was 43.6 ± 9.9 and 42.9 ± 8.5 for CN and CTN, respectively. Total sample showed a mean EBP competency score of 3.54 ± 1.00 (attitudes: 4.40 ± 0.60; knowledge: 3.08 ± 0.94; skills: 3.57 ± 0.66; utilization: 3.36 ± 0.75). The CTN group obtained higher mean scores in knowledge dimension, compared with CN (P = .02) and with total sample (P = .02). There were no significant differences in other dimensions.

CONCLUSION

CTN showed better self-perceived competences scores only in the knowledge dimension compared with CN. Taking in account the level of responsibility they support in their daily practice, it would be advisable to design management strategies in order to improve attitudes, skills and utilize EBP, acting as professional role models for students and peer mentors.

Validity, reliability, and acceptability of the Evidence-Informed Decision-Making (EIDM) competence measure

Valid, reliable, and acceptable tools for assessing self-reported competence in evidence-informed decision-making (EIDM) are required to provide insight into the current status of EIDM knowledge, skills, attitudes/beliefs, and behaviours for registered nurses working in public health. The purpose of this study was to assess the validity, reliability, and acceptability of the EIDM Competence Measure. A psychometric study design was employed guided by the Standards for Educational and Psychological Testing and general measurement development principles. All registered nurses working across 16 public health units in Ontario, Canada were invited to complete the newly developed EIDM Competence Measure via an online survey. The EIDM Competence Measure is a self-reported tool consisting of four EIDM subscales: 1) knowledge; 2) skills; 3) attitudes/beliefs; and 4) behaviours. Acceptability was measured by completion time and percentage of missing data of the original 40-item tool. The internal structure of the tool was first assessed through item-subscale total and item-item correlations within subscales for potential item reduction of the original 40-item tool. Following item reduction which resulted in a revised 27-item EIDM Competence Measure, a principal component analysis using an oblique rotation was performed to confirm the four subscale structure. Validity based on relationships to other variables was assessed by exploring associations between EIDM competence attributes and individual factors (e.g., years of nursing experience, education) and organizational factors (e.g., resource allocation). Internal reliability within each subscale was analyzed using Cronbach’s alphas. Across 16 participating public health units, 201 nurses (mean years as a registered nurse = 18.1, predominantly female n = 197; 98%) completed the EIDM Competence Measure. Overall missing data were minimal as 93% of participants completed the entire original 40-item tool (i.e., no missing data), with 7% of participants having one or more items with missing data. Only one participant (0.5%) had >10% of missing data (i.e., more than 4 out of 40 items with data missing). Mean completion time was 7 minutes and 20 seconds for the 40-item tool. Extraction of a four-factor model based on the 27-item version of the scale showed substantial factor loadings (>0.4) that aligned with the four EIDM subscales of knowledge, skills, attitudes/beliefs, and behaviours. Significant relationships between EIDM competence subscale scores and education, EIDM training, EIDM project involvement, and supportive organizational culture were observed. Cronbach’s alphas exceeded minimum standards for all subscales: knowledge (α = 0.96); skills (α = 0.93); attitudes/beliefs (α = 0.80); and behaviours (α = 0.94).

Design and validity of an instrument to assess healthcare professionals' perceptions, behaviour, self-efficacy and attitudes towards evidence-based health practice: I-SABE

OBJECTIVES

To develop and validate an instrument to measure Brazilian healthcare professionals' perceptions, behaviour, self-efficacy and attitudes towards evidence-based health practice.

DESIGN

Validation of an instrument using the Delphi method to ensure content validity and data from a cross-sectional survey to evaluate psychometric characteristics (psychometric sensitivity, factorial validity and reliability).

SETTING

National Register of Health Establishments database.

PARTICIPANTS

We included clinical health professionals who were working in the Brazilian public health system.

RESULTS

The Instrument to assess Evidence-Based Health (I-SABE) was constructed with five domains: self-efficacy; behaviour; attitude; results/benefits and knowledge/skills. Content validity was done by 10-12 experts (three rounds). We applied I-SABE to 217 health professionals. Bartlett's sphericity test and the Kaiser-Meyer-Olkin (KMO) index were adequate (χ²=1455.810, p<0.001; KMO=0.847). Considering the factorial loads of the items and the convergence between the Scree Plot and the Kaiser criterion the four domains tested in this analysis, explaining 59.2% of the total variance. The internal consistency varied between the domains: self-efficacy (α=0.76), behaviour (α=0.30), attitudes (α=0.644), results/benefits to the patient (α=0.835).

CONCLUSIONS

The results of the psychometric analysis of the I-SABE confirm the good quality of this tool. The I-SABE can be used both in educational activities as well as an assessment tool among healthcare professionals in the Brazilian public health settings.

Quality, methods, and recommendations of systematic reviews on measures of evidence-based practice: an umbrella review

OBJECTIVES

The objective of the review was to estimate the quality of systematic reviews on evidence-based practice measures across health care professions and identify differences between systematic reviews regarding approaches used to assess the adequacy of evidence-based practice measures and recommended measures.

INTRODUCTION

Systematic reviews on the psychometric properties of evidence-based practice measures guide researchers, clinical managers, and educators in selecting an appropriate measure for use. The lack of psychometric standards specific to evidence-based practice measures, in addition to recent findings suggesting the low methodological quality of psychometric systematic reviews, calls into question the quality and methods of systematic reviews examining evidence-based practice measures.

INCLUSION CRITERIA

We included systematic reviews that identified measures that assessed evidence-based practice as a whole or of constituent parts (eg, knowledge, attitudes, skills, behaviors), and described the psychometric evidence for any health care professional group irrespective of assessment context (education or clinical practice).

METHODS

We searched five databases (MEDLINE, Embase, CINAHL, PsycINFO, and ERIC) on January 18, 2021. Two independent reviewers conducted screening, data extraction, and quality appraisal following the JBI approach. A narrative synthesis was performed.

RESULTS

Ten systematic reviews, published between 2006 and 2020, were included and focused on the following groups: all health care professionals (n = 3), nurses (n = 2), occupational therapists (n = 2), physical therapists (n = 1), medical students (n = 1), and family medical residents (n = 1). The overall quality of the systematic reviews was low: none of the reviews assessed the quality of primary studies or adhered to methodological guidelines, and only one registered a protocol. Reporting of psychometric evidence and measurement characteristics differed. While all the systematic reviews discussed internal consistency, feasibility was only addressed by three. Many approaches were used to assess the adequacy of measures, and five systematic reviews referenced tools. Criteria for the adequacy of individual properties and measures varied, but mainly followed standards for patient-reported outcome measures or The Standards of Educational and Psychological Testing. Two hundred and four unique measures were identified across 10 reviews. One review explicitly recommended measures for occupational therapists, and four reviews identified adequate measures for all health care professionals (n = 3) and medical students (n = 1). The 27 measures deemed adequate by these five systematic reviews are described.

CONCLUSIONS

Our results suggest a need to improve the overall methodological quality and reporting of systematic reviews on evidence-based practice measures to increase the trustworthiness of recommendations and allow comprehensive interpretation by end-users. Risk of bias is common to all the included systematic reviews as the quality of primary studies was not assessed. The diversity of tools and approaches used to evaluate the adequacy of evidence-based practice measures reflects tensions regarding the conceptualization of validity, suggesting a need to reflect on the most appropriate application of validity theory to evidence-based practice measures.

SYSTEMATIC REVIEW REGISTRATION NUMBER

PROSPERO CRD42020160874.

Development and content validation of a measure to assess evidence-informed decision-making competence in public health nursing

There are professional expectations for public health nurses to develop competencies in evidence-informed decision-making (EIDM) due to its potential for improved client outcomes. Robust tools to assess EIDM competence can encourage increased EIDM engagement and uptake. This study aimed to develop and validate the content of a measure to assess EIDM competence among public health nurses. A four-stage process, based on measure development principles and the Standards for Educational and Psychological Testing, was used to develop and refine items for a new EIDM competence measure: a) content coverage assessment of existing measures; b) identification of existing measures for use and development of items; c) validity assessment based on content; d) validity assessment based on response process. An EIDM competence measurement tool consisting of EIDM knowledge, skills, attitudes/beliefs, and behaviour items was developed using conceptual literature and existing measures (Evidence-Based Practice Competency Tool and Evidence-Based Practice Beliefs Scale) to address limitations of existing EIDM tools identified from the content coverage assessment. Item content validity index ratings ranged from 0.64–1.00. Qualitative themes from validity assessment based on content and response process included word changes to improve clarity, reducing item redundancy, separating multi-component items, and ensuring items reflect nursing role expectations. Upon determining its reliability and validity, there is potential for the EIDM competence measure to be used in: public health nursing practice to identify competence gaps and strengths to facilitate professional development activities; in research to support development of strategies to build EIDM capacity; and for curriculum planning and development across nursing education programs.