An Adaptation of the Original Fresno Test to Measure Evidence-Based Practice Competence in Pediatric Bedside Nurses

Instruments to Assess Evidence-Based Practice Among Health Care Professionals: A Systematic Review

BACKGROUND

The use of measurement instruments to assess the use of Evidence-Based Practice by health professionals has been frequently reported in studies.

AIMS

This systematic review aimed to summarize, describe, and evaluate the measurement properties of the instruments that evaluate the use of Evidence-Based Practice in health professionals.

METHODS

The search was carried out in four databases considering three groups of search terms: evidence-based practice, evaluation, and measurement proprieties. Studies were included that described the use of instruments to assess Evidence-Based Practice in health professionals, with the full-text publication, which analyzed the measurement properties, in English. The methodological quality of the studies was evaluated using COnsensus-based Standards for the selection of health Measurement INstruments.

RESULTS

In total, 6,429 were found and only 92 were eligible for data analysis. Forty new instruments were identified most were developed for nursing and physical therapist. The investigators performed at least 1 type of validity test on 73% of the instruments. Reliability was tested at 90%, through internal consistency. Responsiveness was tested on less than half of the instruments (30%). Most of the instruments identified are reliable and valid to measure evidence-based practice in health professionals.

CONCLUSION

Although the Fresno Test remains the most complete instrument, and adequate for use. The COnsensus-based Standards for the selection of health Measurement INstruments checklist classified 7 (seven) instruments as suitable for the target audience.

Translating and Validating the Vietnamese Version of the Health Sciences Evidence-Based Practice Questionnaire

No validated instrument is available for assessing the evidence-based practice capacity of Vietnamese health professionals. This study aimed to translate and validate the Health Sciences Evidence-Based Practice questionnaire (HS-EBP) from English to Vietnamese and ascertain its psychometric properties. Data were collected from two obstetric hospitals in Vietnam. Participants: A total of 343 midwives were randomly selected. The HS-EBP questionnaire was translated by a group of bilingual experts into Vietnamese (HS-EBP-V). Content validity was assessed by two experts. Internal consistency and test-retest reliabilities were assessed using Cronbach's α and intraclass correlation (ICC), respectively. Construct validity was assessed using the contrasted groups approach. As a result, the content validity index of the HS-EBP-V reached 1.0. For the individual subscales, Cronbach's α was 0.92-0.97 and ICC was between 0.45 and 0.66. The validity of the contrasted-groups approach showed discrimination by a significant difference in the subscale scores among diploma holders compared with bachelor's degree holders (p < 0.001). The validation of the HS-EBP questionnaire indicated satisfactory psychometric properties. The results indicate that the HS-EBP is a reliable and valid instrument which assesses the competencies of as well as facilitators of and barriers to the five steps of EBP among midwives. The HS-EBP-V was deemed a reliable and validated tool for assessing the competency and application of EBP among Vietnamese healthcare professionals.

An objective test to measure evidence-based practice knowledge and skill competency of acute care nurses: A psychometric validation study

BACKGROUND

Few objective measures of evidence-based practice (EBP) knowledge/skill exist. The Fresno Test, one objective method, was validated first with medicine, followed by versions for physical therapists, occupational therapists, speech therapists, social workers, dietitians, pediatric nurses, and health care students. The Fresno Test was adapted and tested with cohorts of acute care nurses. Six of the 14 items required revision to achieve acceptable psychometrics.

AIM

The aim of this second validation study was to revise and validate a new version of the test, The Modified Fresno Test-Acute Care Nursing (MFT-ACN), to determine if it could distinguish EBP knowledge/skills among acute care nurses.

METHODS

A panel of eight EBP experts were engaged in multiple Delphi rounds to revise items. Individual-content validity indices (CVI) ranged from 0.83 to 1.0, with scale-CVI 0.92. Using a cohort design, a cross-sectional sample of 90 novice, master, and expert nurses were recruited via national listservs or snowball sampling to complete the revised test. Two doctorally prepared EBP experts independently scored tests using the standardized rubric.

RESULTS

The MFT-ACN yielded strong psychometric properties (intra-class correlation coefficients > 0.80; item discrimination indices > 0.20; item-total correlations > 0.30). One poorly performing item was dropped per a priori cut-off values. The final test included 13 items, with a Cronbach's alpha = 0.77. Item difficulty was moderate to high. Most items discriminated well between cohorts. Mean total scores were positively correlated with age, years since graduation, years of acute care experience, and formal EBP or research workshops or conferences or courses or immersions. Perceived level of EBP expertise was not associated with mean scores. Further research is recommended with a larger sample to assess the tests' responsiveness to change in EBP knowledge/skills over time and enhance its acceptability and feasibility. Additional research should further evaluate construct and concurrent validity against other objective assessments of EBP knowledge/skills.

LINKING EVIDENCE TO ACTION

The validated 13-item MFT-ACN can be used to evaluate EBP competencies of acute care nurses in academic and practice settings. It can also be used by nurse scientists to build a stronger evidence base on types of educational programs that excel in advancing the critical competency of EBP among our nursing workforce.

Using mixed-methods in evidence-based nursing: a scoping review guided by a socio-ecological perspective

Background

Increased pressure for evidence-based practice in nursing necessitates that researchers use effective approaches. Mixed-methods research (MMR) has potential to improve the knowledge and implementation of evidence-based nursing (EBN) by generating outcome-based and contextually-focused evidence.

Aims

To identify methodological trends in how MMR is used in EBN research.

Methods

Searches were completed in PubMed, CINAHL, and Google Scholar using the terms "nursing", "mixed-methods", and "evidence-based". Seventy-two articles using MMR to address EBN and published 2000-2021 were reviewed across content themes and methodological domains of the Socio-Ecological Framework for MMR.

Results

Mixed-methods research has been used to study how EBN strategies are perceived, developed and assessed, and implemented or evaluated. A few studies provided an MMR definition reflecting the methods perspective, and the dominant MMR rationale was gaining a comprehensive understanding of the issue. The leading design was concurrent, and half of studies intersected MMR with evaluation, action/participatory, and/or case-study approaches. Research quality was primarily assessed using criteria specific to quantitative and qualitative approaches.

Conclusions

Mixed-methods research has great potential to enhance EBN research by generating more clinically useful findings and helping nurses understand how to identify and implement the best available research evidence in practice.

Factor structure and short version of the modified Fresno test to assess the use of the evidence-based practice in physiotherapists

BACKGROUND

The Modified Fresno Test has been used to evaluate the use of the Evidence-Based Physiotherapy (EBP). So far, none of the versions of the Fresno Test were subjected to analysis of the factorial structure. The objective of the study was to describe the exploratory and confirmatory factor structure of the Modified Fresno Test adapted to the Portuguese-Brazilian and analyze the statistical feasibility for the elaboration of a short version.

METHODS

The questionnaire was applied with a convenience sample of 57 physiotherapists, being 36 professionals (13 of these also professors) and 21 students from the last semester of the physiotherapy course. Exploratory Factor Analysis (EFA) was performed by the method of principal components. Confirmatory Factor Analysis (CFA) was performed by the method of maximum likelihood. The total score of the answers in the test and retest was evaluated, totalling 228 observations. Reliability was assessed by means of internal consistency, using Cronbach's alpha coefficient.

RESULTS

Reliability was satisfactory (α 0.81) for all questions of the instrument. The coefficient α calculated for the corrected item-total showed values higher than 0.20 except for item 9. Preliminary tests for Exploratory Factor Analysis showed acceptable values with Kaiser-Meyer-Olkin (KMO = 0.80) and Bartlett's test of sphericity [chi-square (78) = 1149.615, p < 0.001], indicating that the correlations were sufficient for analysis. The analysis revealed the presence of 3 factors (eigenvalues> 1), which explains 60.9% of the instrument's total variance. In Confirmatory Factor Analysis, none of the indices came close to an acceptable level (≥ 0.90), however, the second model which tested a three-factor structure provided a better fit to the data. From the results of this study the Modified Fresno Test short version was drawn.

CONCLUSION

The analysis showed good factor validity and adequate internal consistency for the use of the instrument consisting of 13 questions and 3 factors. This model proved to be better than the original model. The short version consisting of 9 questions may be an appropriate alternative for use in the population of interest.

Fresno test to measure evidence-based practice knowledge and skills for Portuguese undergraduate nursing students: A translation and adaptation study

BACKGROUND

The Fresno Test was originally identified as an instrument to assess evidence-based practice knowledge and skills through cognitive testing and performance assessment in medical students. Further studies have been recommended to establish the measurement properties of the Fresno Test in different learner populations.

OBJECTIVES

To perform a cross-cultural adaptation of the Fresno Test for Portuguese undergraduate nursing students and to analyze the interrater reliability.

DESIGN

Cross-cultural adaptation study with interrater reliability assessment carried out in two phases during 2017-2018.

SETTINGS

One of the main nursing schools, Portugal.

PARTICIPANTS

Fourth year undergraduate nursing students.

METHODS

The study was performed in two phases, firstly the cross-cultural adaptation (performed in five stages) and secondly the analysis of interrater reliability.

RESULTS

Stages I, II, III and IV of the cross-cultural adaptation proceeded smoothly and the expert panel produced and agreed upon the pre-final version of Adapted Fresno Test. In stage V (the pre-test stage), students reported a general understanding of the items, but they reported a lack of knowledge to answer the test. An expert panel subsequently agreed that modifications were needed to ensure the test was within the student's competency level and to decrease risk of assessment bias. For phase II, 50 complete questionnaires were randomly selected to be rated by three independent nurses using the modified rubric to score the test. The overall interrater reliability was 0.826 with a range from 0.271 to 1.000 for each item.

CONCLUSIONS

The Adapted Fresno Test presented in this paper is the first instrument translated for European Portuguese and adapted specially for undergraduate nursing students. Despite good interrater reliability, further validation studies with more robust samples are suggested to definitively establish psychometric properties beyond the interrater reliability.