Validity, reliability, and acceptability of the Evidence-Informed Decision-Making (EIDM) competence measure

Valid, reliable, and acceptable tools for assessing self-reported competence in evidence-informed decision-making (EIDM) are required to provide insight into the current status of EIDM knowledge, skills, attitudes/beliefs, and behaviours for registered nurses working in public health. The purpose of this study was to assess the validity, reliability, and acceptability of the EIDM Competence Measure. A psychometric study design was employed guided by the Standards for Educational and Psychological Testing and general measurement development principles. All registered nurses working across 16 public health units in Ontario, Canada were invited to complete the newly developed EIDM Competence Measure via an online survey. The EIDM Competence Measure is a self-reported tool consisting of four EIDM subscales: 1) knowledge; 2) skills; 3) attitudes/beliefs; and 4) behaviours. Acceptability was measured by completion time and percentage of missing data of the original 40-item tool. The internal structure of the tool was first assessed through item-subscale total and item-item correlations within subscales for potential item reduction of the original 40-item tool. Following item reduction which resulted in a revised 27-item EIDM Competence Measure, a principal component analysis using an oblique rotation was performed to confirm the four subscale structure. Validity based on relationships to other variables was assessed by exploring associations between EIDM competence attributes and individual factors (e.g., years of nursing experience, education) and organizational factors (e.g., resource allocation). Internal reliability within each subscale was analyzed using Cronbach’s alphas. Across 16 participating public health units, 201 nurses (mean years as a registered nurse = 18.1, predominantly female n = 197; 98%) completed the EIDM Competence Measure. Overall missing data were minimal as 93% of participants completed the entire original 40-item tool (i.e., no missing data), with 7% of participants having one or more items with missing data. Only one participant (0.5%) had >10% of missing data (i.e., more than 4 out of 40 items with data missing). Mean completion time was 7 minutes and 20 seconds for the 40-item tool. Extraction of a four-factor model based on the 27-item version of the scale showed substantial factor loadings (>0.4) that aligned with the four EIDM subscales of knowledge, skills, attitudes/beliefs, and behaviours. Significant relationships between EIDM competence subscale scores and education, EIDM training, EIDM project involvement, and supportive organizational culture were observed. Cronbach’s alphas exceeded minimum standards for all subscales: knowledge (α = 0.96); skills (α = 0.93); attitudes/beliefs (α = 0.80); and behaviours (α = 0.94).

Effectiveness of Digital Flipped Learning Evidence-Based Practice on Nurses' Knowledge, Attitude, and Practice: A Quasi-Experimental Trial

Background: Evidence-based care has become critical in raising the quality of medical facilities. The implementation of evidence-based practice helps medical practitioners make better clinical decisions. Objective: The objective of this study was to investigate whether the innovative flipped teaching model could be as effective as the conventional teaching model in terms of knowledge, attitude, and practice and to confirm the continuous effect. Design: A quasi-experimental design using the flipped and conventional learning groups concurrently with repeat measurements was used. Setting: The setting was a 475-bed regional teaching hospital in Taiwan, from March to July 2020. Participants: The study included 114 licensed nurses who had worked longer than three months, with 57 participants each in two groups. Methods: The participants were assigned to two groups using a block randomization method. All participants completed questionnaires related to knowledge, attitude, and practice of EBP at four-time points: pre-test (T0) and immediately after intervention (T1), at month 1 (T2), and at month 3 (T3). Analysis of repeated generalized estimating equations was used. Results: The flipped and conventional learning groups had significant differences in knowledge, attitude, and practice at the T0 and T1 (p < 0.05). The flipped group was higher than the conventional group at T3 in the knowledge score (p = 0.001) and lower than the conventional group at T2 in the attitude score (p = 0.010). There were no significant differences between the two groups’ practice scores at different time points. There were no significantly different score changes for knowledge, attitude, and practice (p > 0.05). The interaction term only at T3 vs. T0 in the knowledge score was slightly different (p = 0.049) in primary outcome. Conclusion: The intervention methods of both groups were effective. Flipped learning is more flexible and has more time for discussion, which nurses favor. Under the policy promoted in the hospital, EBP combined with the nursing advancement system was standardized, and conventional learning also improved the learning effect.

Long-Term Outcomes of a Collaborative Regional Evidence-Based Practice Fellowship

Academic-practice partnerships provide a model for sharing resources, increasing professional knowledge and skills, improving patient outcomes, and strengthening organizational cultures of quality and safety. This article describes the long-term outcomes of a regional collaborative evidence-based practice fellowship. Results reveal the fellowship had a measurable positive impact on fellows' evidence-based practice knowledge and practice, project outcomes, professional growth, and the culture of excellence within partner organizations.

Evidence-based medicine: a brief historical analysis of conceptual landmarks and practical goals for care

Evidence-based medicine (EBM) is intended to improve the efficiency and quality of health services provided to the population and reduce the operational costs of prevention, treatment, and rehabilitation; the objective of EBM is to identify relevant issues and promote the social applicability of conclusions. This article underscores the importance of EBM in modern clinical teaching and social practices from the contributions of Archibald Cochrane and David Sackett to the development and dissemination of this paradigm in care and education during the twentieth century. EBM has helped broaden discussions on the relationships between teaching and medical practice, and has taken on an important role in curriculum reforms and training models and practices in health care.

Aligning Organizational Culture and Infrastructure to Support Evidence-Based Practice

Standardized nursing practice based on the foundations of evidence-based practice leads to high-quality patient care and optimal outcomes. Despite knowing the benefits of evidence-based practice, health care organizations do not consistently make it the standard of care; thus, implementation of evidence-based practice at the system level continues to be challenging. This article describes the process adopted by a facility in the Southwest that took on the challenge of changing the organizational culture to incorporate evidence-based practice. The organization met the challenges by identifying perceived and actual barriers to successful implementation of evidence-based practice. The lack of standardized practice was addressed by developing a group of stakeholders including organizational leaders, clinical experts, and bedside providers. Changing the culture required a comprehensive process of document selection and development, education, and outcome evaluation. The ultimate aim was to implement an integrated system to develop practices and documents based on the best evidence to support patient outcomes.

Impact of an extracurricular, student-led journal club on evidence-based practice among baccalaureate nursing students

Objective Journal clubs are accepted as an effective strategy for promoting evidence-based practice (EBP). However, journal clubs are underutilized in nursing education, and little is known about the impact of extracurricular, student-led journal clubs on EBP implementation among baccalaureate nursing students. The purpose of this study was to estimate the impact of journal club attendance on EBP implementation. Methods A web-based survey was conducted in April 2019 following eight sessions of monthly journal club among senior nursing students (n=78). Results Fifteen students attended four or more extracurricular, student-led journal club sessions (19.2%). EBP practice score was significantly higher among frequent journal club attendees. In multivariate analysis, journal club attendance was the significant predictor of EBP practice (β=0.34; p=0.006). Conclusion Graduating senior nursing students who attend extracurricular, student-led journal club sessions are more likely to carry out EBP practice. Participation in journal clubs may help increase their EBP competencies.

Measures of evidence-informed decision-making competence attributes: a psychometric systematic review

Background

The current state of evidence regarding measures that assess evidence-informed decision-making (EIDM) competence attributes (i.e., knowledge, skills, attitudes/beliefs, behaviours) among nurses is unknown. This systematic review provides a narrative synthesis of the psychometric properties and general characteristics of EIDM competence attribute measures in nursing.

Methods

The search strategy included online databases, hand searches, grey literature, and content experts. To align with the Cochrane Handbook of Systematic Reviews, psychometric outcome data (i.e., acceptability, reliability, validity) were extracted in duplicate, while all remaining data (i.e., study and measure characteristics) were extracted by one team member and checked by a second member for accuracy. Acceptability data was defined as measure completion time and overall rate of missing data. The Standards for Educational and Psychological Testing was used as the guiding framework to define reliability, and validity evidence, identified as a unified concept comprised of four validity sources: content, response process, internal structure and relationships to other variables. A narrative synthesis of measure and study characteristics, and psychometric outcomes is presented across measures and settings.

Results

A total of 5883 citations were screened with 103 studies and 35 unique measures included in the review. Measures were used or tested in acute care (n = 31 measures), public health (n = 4 measures), home health (n = 4 measures), and long-term care (n = 1 measure). Half of the measures assessed a single competence attribute (n = 19; 54.3%). Three measures (9%) assessed four competence attributes of knowledge, skills, attitudes/beliefs and behaviours. Regarding acceptability, overall missing data ranged from 1.6–25.6% across 11 measures and completion times ranged from 5 to 25 min (n = 4 measures). Internal consistency reliability was commonly reported (21 measures), with Cronbach’s alphas ranging from 0.45–0.98. Two measures reported four sources of validity evidence, and over half (n = 19; 54%) reported one source of validity evidence.

Conclusions

This review highlights a gap in the testing and use of competence attribute measures related to evidence-informed decision making in community-based and long-term care settings. Further development of measures is needed conceptually and psychometrically, as most measures assess only a single competence attribute, and lack assessment and evidence of reliability and sources of established validity evidence.

Registration

PROSPERO #CRD42018088754.

Evaluation of a Hospital-Based Nursing Research and Evidence-Based Practice Mentorship Program on Improving Nurses' Knowledge, Attitudes, and Evidence-Based Practice

BACKGROUND

Evidence-based practice (EBP) is a core requirement for nurses, contributing toward better clinical outcomes. Mentorship could prepare early adopters of EBP to create an EBP culture.

METHOD

Nine nurses in an acute hospital in Singapore participated in a mentorship program throughout 2015. Mentees conducted ward-based EBP education sessions for nursing colleagues. The Evidence-Based Practice Questionnaire (EBPQ) was used to measure the program's effect on mentees' and their ward colleagues' knowledge, attitude, and practice of EBP. Both groups completed the EBPQ before and 3 months after completion of the program. Wilcoxon rank-sum tests were performed to compare changes in EBPQ scores.

RESULTS

Both mentees and ward colleagues reported improved posttest median scores for all EBPQ subscales and the overall score. However, mentees reported a larger magnitude of improvement.

CONCLUSION

A hospital-based research and EBP mentorship program increases nurses' knowledge, attitude, and practice of EBP, creating an EBP culture change. [J Contin Educ Nurs. 2020;51(1):46-52.].

Psychometric Properties of the Chinese Version of the Evidence-Based Practice Questionnaire for Nurses

BACKGROUND AND PURPOSE

The Evidence-Based Practice Questionnaire (EBPQ-English) has been used in various populations. However, it has not been validated in the Chinese nursing population. This study aimed to translate EBPQ-English into Chinese and evaluate its psychometric properties.

METHODS

The Brislin translation procedure was used to maintain the conceptual equivalence. The validity and reliability of EBPQ-Chinese were investigated using exploratory factor analysis and Cronbach's α with 810 nurses from nine tertiary hospitals in Southern China.

RESULTS

Principle axis factoring and oblimin rotation yielded three factors with 22 items, including Knowledge and Skills (k = 14; α = 0.94), Attitudes (k = 3; α = 0.83), and Practice (k = 5; α = 0.86), which explained 57.03% of the total variance.

CONCLUSIONS

Evidence supports the validity and reliability of a three-factor 22-item EBPQ-Chinese.

Competences and Barriers for the Evidence-Based Practice in Nursing: an integrative review

ABSTRACT Objective: To analyze knowledge, attitudes, practices, and frequent barriers to the implementation of the Evidence-Based Practice among nursing assistants in the hospital. Method: This is an integrative review, whose search for primary studies occurred in the PubMed, CINAHL and LILACS databases. For the analysis, cross-sectional observational studies were included in English, Portuguese and Spanish, published in nursing journals, from January 2007 to July 2016. Results: The search resulted in 363 articles, including nine primary studies. The sources of recurrent evidence among care nurses were: personal experience and local care protocols. These professionals presented weaknesses in the implementation of the Evidence-Based Practice related to the lack of knowledge for evidence evaluation, work overload and resistance to change of practice. Final considerations Nurses presented favorable attitudes, however, with little knowledge to perform the Evidence-Based Practice. Results can support interventions for its implementation in the hospital.

Development and validation of the Evidence Based Medicine Questionnaire (EBMQ) to assess doctors' knowledge, practice and barriers regarding the implementation of evidence-based medicine in primary care

Background

Evidence-Based Medicine (EBM) integrates best available evidence from literature and patients’ values, which then informs clinical decision making. However, there is a lack of validated instruments to assess the knowledge, practice and barriers of primary care physicians in the implementation of EBM. This study aimed to develop and validate an Evidence-Based Medicine Questionnaire (EBMQ) in Malaysia.

Methods

The EBMQ was developed based on a qualitative study, literature review and an expert panel. Face and content validity was verified by the expert panel and piloted among 10 participants. Primary care physicians with or without EBM training who could understand English were recruited from December 2015 to January 2016. The EBMQ was administered at baseline and two weeks later. A higher score indicates better knowledge, better practice of EBM and less barriers towards the implementation of EBM. We hypothesized that the EBMQ would have three domains: knowledge, practice and barriers.

Results

The final version of the EBMQ consists of 80 items: 62 items were measured on a nominal scale, 22 items were measured on a 5 point Likert-scale. Flesch reading ease was 61.2. A total of 343 participants were approached; of whom 320 agreed to participate (response rate = 93.2%). Factor analysis revealed that the EBMQ had eight domains after 13 items were removed: “EBM websites”, “evidence-based journals”, “types of studies”, “terms related to EBM”, “practice”, “access”, “patient preferences” and “support”. Cronbach alpha for the overall EBMQ was 0.909, whilst the Cronbach alpha for the individual domain ranged from 0.657–0.940. The EBMQ was able to discriminate between doctors with and without EBM training for 24 out of 42 items. At test-retest, kappa values ranged from 0.155 to 0.620.

Conclusions

The EBMQ was found to be a valid and reliable instrument to assess the knowledge, practice and barriers towards the implementation of EBM among primary care physicians in Malaysia.

Electronic supplementary material

The online version of this article (10.1186/s12875-018-0779-5) contains supplementary material, which is available to authorized users.

Effect of Evidence-Based Practice Programs on Individual Barriers of Workforce Nurses: An Integrative Review

HOW TO OBTAIN CONTACT HOURS BY READING THIS ISSUE Instructions: 1.2 contact hours will be awarded by Villanova University College of Nursing upon successful completion of this activity. A contact hour is a unit of measurement that denotes 60 minutes of an organized learning activity. This is a learner-based activity. Villanova University College of Nursing does not require submission of your answers to the quiz. A contact hour certificate will be awarded after you register, pay the registration fee, and complete the evaluation form online at http://goo.gl/gMfXaf. In order to obtain contact hours you must: 1. Read the article, "Effect of Evidence-Based Practice on Individual Barriers of Workforce Nurses: An Integrative Review" found on pages 398-406, carefully noting any tables and other illustrative materials that are included to enhance your knowledge and understanding of the content. Be sure to keep track of the amount of time (number of minutes) you spend reading the article and completing the quiz. 2. Read and answer each question on the quiz. After completing all of the questions, compare your answers to those provided within this issue. If you have incorrect answers, return to the article for further study. 3. Go to the Villanova website to register for contact hour credit. You will be asked to provide your name, contact information, and a VISA, MasterCard, or Discover card number for payment of the $20.00 fee. Once you complete the online evaluation, a certificate will be automatically generated. This activity is valid for continuing education credit until August 31, 2019. CONTACT HOURS This activity is co-provided by Villanova University College of Nursing and SLACK Incorporated. Villanova University College of Nursing is accredited as a provider of continuing nursing education by the American Nurses Credentialing Center's Commission on Accreditation. OBJECTIVES Identify individual barriers in the implementation of evidence-based practice (EBP) by nurses. Describe interventions of the programs reviewed in the article that directly affect barriers to clinical nurses' adoption of EBP or the use of research. DISCLOSURE STATEMENT Neither the planners nor the author have any conflicts of interest to disclose.

BACKGROUND

Individual barriers such as a lack of research awareness, electronic database navigation skills, and research comprehension prevent nurses from implementing evidence-based practice (EBP). The aim of this review article is to examine EBP programs and their influence on individual barriers among workforce nurses.

METHOD

A keyword search of online databases was conducted for original research published from 2004- 2015. A review of cited references and footnote searching of significant articles was conducted to identify additional relevant articles.

RESULTS

Twenty articles met the inclusion criteria. Although there was great variation among EBP programs, the majority of participants reported increased awareness, value, belief, knowledge, and skill as it relates to research utilization and EBP.

CONCLUSION

This review suggests that individual barriers to EBP may be influenced by clinically based EBP programs. However, a lack of randomized controlled studies and inconsistencies in measurement make it difficult to recommend best practices for developing EBP programs for nurses in the clinical setting. J Contin Educ Nurs. 2016;47(9):398-406.

Assessment of an intervention for the diffusion of evidence-based nursing in a teaching hospital

Objective

To evaluate an intervention for the diffusion of evidence-based practice among the nurse leaders of a public teaching hospital.

Methods

This is a descriptive-quantitative study based on the evaluation of workshops at a teaching hospital in the Triângulo Mineiro region of the state of Minas Gerais, Brazil, in 2016, conducted from the conceptual perspective of "Diffusion of Innovation and Skills for the Use of Evidence-Based Nursing in Care Settings". We applied an Evidence-Based Practice Questionnaire and analysed the individual evaluations of each participant according to the frequency of cores of meaning and the calculation of content validity index.

Results

Ninety percent of the nurse leaders agreed to participate in the evaluation. The leaders had a positive attitude toward incorporating evidence into practice (average = 5.4; SD = ±1.3). Their main difficulty was the ability to understand research (average = 3.5; SD = ±1.3). Motivational aspects related to intervention had the highest content validity index (CVI = 0.9).

Conclusion

The workshops encouraged the diffusion of information regarding the need to incorporate scientific evidences to better qualify the care provided by nurse leaders in the public teaching hospital.

Six-Month Follow-up of a Regional Evidence-based Practice Fellowship Program

OBJECTIVE

This study examined a 6-month follow-up of a regional evidence-based practice (EBP) fellowship program and the predictors of EBP adoption at hospital units.

BACKGROUND

The immediate beneficial effects of a regional EBP program are known, but the medium-term effects are not certain.

METHODS

A matched pretest/posttest study was conducted using a mailed questionnaire 6 months after the completion of a 9-month regional EBP fellowship program among 3 annual cohorts of participants.

RESULTS

Statistically significant improvements in the mean scores of EBP beliefs, EBP implementation, and group cohesion were found (P < .05). Of the 47 participants who completed their EBP projects, more than three-quarters reported EBP adoption at their own hospital units, and EBP beliefs were a positive predictor of EBP adoption (odds ratio, 1.12; 95% confidence interval, 1.02-1.22; P = .017).

CONCLUSIONS

The outcome improvements continued 6 months after the fellowship program, and strong EBP beliefs predicted EBP adoption in the participants' units.

Immersion in Evidence-Based Practice Fellowship Program: A Transforming Experience for Staff Nurses

The aim of this study was to explore professional and personal changes staff nurses experience during and after a 1-year evidence-based practice program. Focus groups were conducted with staff who completed an evidence-based practice fellowship program. Five themes emerged from the focus groups: support, resources, knowledge, opportunity, and empowerment. A 1-year fellowship program provides essential elements needed for organizational structural empowerment. Sense of empowerment helps to explain outcomes of fellowship programs and successes of graduates.

Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review

BACKGROUND

Basic skills in evidence-based medicine (EbM) are indispensable for healthcare professionals to promote consumer-centred, evidence-based treatment. EbM training courses are complex interventions - a fact that has not been methodologically reflected by previous systematic reviews. This review evaluates the effects of EbM training for healthcare professionals as well as the quality of reporting of such training interventions.

METHODS

We searched PubMed, EMBASE, CINAHL, Cochrane Library, ERIC, Campbell Library and PsycINFO up to 9/2014. Randomised controlled trials, controlled clinical trials as well as before-after trials were included. Authors were contacted in order to obtain missing data. Two independent reviewers extracted data and assessed risk of bias.

RESULTS

We reviewed 14.507 articles; n = 61 appeared potentially eligible; n = 13 involving 1,120 participants were included. EbM training shows some impact on knowledge and skills, whereas the impact on practical EbM application remains unclear. Risk of bias of included trials raises uncertainty about the effects. Description of complex interventions was poor.

CONCLUSIONS

EbM training has some positive effects on knowledge and skills of healthcare professionals. Appropriate methods for development, piloting, evaluation, reporting and implementation of the training should be applied.

[Approaches, knowledge and capabilities of nurses and physicians regarding evidence-based clinical practice in the Imbadura province (Ecuador)]

OBJECTIVE

The research raises the need to increase understanding of organizational and personal factors that influence the attitude and aptitude of each professional, with respect to evidence-based clinical practice. The aim of this study is to describe the transfer of knowledge into clinical practice in hospital units in Imbabura (Ecuador) identifying the obstacles to implementing evidence-based clinical practice validated questionnaire EBPQ-19.

METHOD

A cross-sectional observational study was conducted in hospitals of the Ministry of Public Health of Imbabura of Ecuador took place, including a total of 281 nurses and physicians.

RESULTS

Nurses and physicians showed positive attitudes toward evidence-based clinical practice (EBCP) and their use to support clinical decision-making. This research evidences perceptions of professionals on strategies for knowledge transfer and obstacles to carry it out. Significant differences between the perception of the use of EBCP strategies between nurses and physicians are observed. Physicians consider they use them frequently, while nurses acknowledge using them less (chi-square: 105.254, P=.018).

CONCLUSION

In conclusion, we can say that these factors should be considered as necessary to improve the quality of care that is provided to users based on the best available evidence. It is necessary to start developing change interventions in this regard to remedy the current situation of clinical practice based not on evidence, but rather on experience only. Experimental studies demonstrating the effectiveness of strategies to eliminate barriers to scientific evidence-based clinical practice should be conducted.

Medical students' attitudes on and experiences with evidence-based medicine: a qualitative study

RATIONALE, AIMS AND OBJECTIVES

This qualitative study was designed to determine the attitudes towards and experiences of medical students on evidence-based medicine (EBM).

METHODS

The study was conducted using the phenomenological method. Medical students' attitudes about and experiences with evidence-based medicine were determined through semi-structured interviews. Forty senior medical students were chosen by purposive sampling from medical sciences students of Tabriz University and Shahid Beheshti University. The context of interviews was analysed using the content analysis method.

RESULTS

Medical students' attitudes and experiences were ascertained through four main questions, and their answers were divided in to 12 categories and 31 subcategories. According to the subjects of the study, two basic concepts that they understood about EBM were its being up to date and requiring research skills. To the question what is necessary for EBM, the students' answers were summarized as follows: access to information, teamwork and faculty members who could provide modeling and organizational support. Students reported having used EBM for problem solving, thinking and self-confidence. On the other hand, lack of equipment and facilities, human factors and organizational factors were considered the main barriers to EBM use.

CONCLUSION

According to the results of this study, providing suitable conditions and appropriate planning to address identified barriers and encouraging students can promote EBM practice. Also, more extensive EBM integration in medical curricula and clinical settings by leading faculty members would prompt medical students to use EBM in their daily practice.

Hawaii's statewide evidence-based practice program

Hawaii's innovative statewide evidence-based practice program facilitates practice change across multiple health care systems. The innovation eliminated duplicative efforts and provided resources, was compatible with the values of health care organizations, and had experience with a pilot program. Interpersonal and mass media communication promoted and embedded the practice change. Users included nurse champions with multidisciplinary team members. The rate of adoption varied across projects and, although resources seemed to be a major determinant of successful institutionalization, there does not seem to be a predictable pattern of successful project implementation.