Online training course on critical appraisal for nurses: adaptation and assessment

Impact of implementing virtual journal club on developing competencies for critical appraisal among post-graduate nursing students

BACKGROUND

Virtual journal clubs (VJCs) are innovative technologies with the potential to foster collaboration, facilitate multilingual communication, improve cultural competencies, and expand global professional networks. This allowed participants to be exposed to critical appraisal of the articles. However, its long-term impact on competency development has been debated. This study aimed to investigate the impact of implementing VJCs on developing competencies for critical appraisal among postgraduate nursing students.

METHODS

A quasi-experimental (pretest/posttest one-group) research design was used with a convenience sample of 40 participants from the community health nursing department, Faculty of Nursing, Mansoura University, Egypt who agreed to participate. The participants received an online self-administered knowledge and attitude data collection tool through Google Forms. However, critical appraisal skills were evaluated by an observational checklist with a rubric through synchronized mode. Eleven VJC sessions were conducted for each participant. Descriptive analysis served as the primary method for analyzing participants' responses. Students' t-test and one-way analysis of variance (ANOVA) were used to measure differences between the pretest and post-test. The study also used a correlation test to assess the relationship of variables.

RESULTS

The findings indicated a highly statistically significant difference among the participants regarding knowledge, critical appraisal skills, and attitudes toward VJC before, immediately, and six months after VJC session implementation. In addition, a positive significant correlation with a highly statistically significant difference between the participants' total knowledge score levels, total practice score levels, and total attitude score levels in the immediate post and after six months of VJC session implementation (p < 0.001).

CONCLUSION

The findings indicate this intervention has the potential to enhance critical appraisal competencies among postgraduate students. Therefore, VJCs should be included regularly to enhance critical appraisal competencies in academic settings for continued professional development.

Exploring the potential impact of applying web-based training program on nurses' knowledge, skills, and attitudes regarding evidence-based practice: A quasi-experimental study

Evidence-based practice (EBP) has gained significant importance in clinical practice worldwide, including in nursing. This study aimed to explore the potential impact of applying a web-based training program on nurses' knowledge, skills, and attitudes regarding EBP. A quasi-experimental pretest-posttest research design was utilized with a purposive sample of 64 professional nurses who agreed to participate. The study took place in different hospitals and primary healthcare centers in the Bisha Governorate, Aseer region, Saudi Arabia. A four-week standardized web-based training program was implemented using an online learning approach. Nurses were provided with an online self-rated data collection tool through the Google Forms platform. The findings indicated a highly significant difference in the total knowledge and EBP skills mean scores of the post-intervention (53.08±15.9) and (66.03±8.95), respectively compared to pre-intervention (P<0.05). Additionally, there was marked improvement in the mean scores of the positive attitude of the training sessions post-intervention compared to pre-intervention. The program was also well-received by the nurses in terms of quality and usability. The program has the potential to enhance nurses' knowledge, skills, and attitudes toward EBP. Therefore, healthcare organizations may consider adopting web-based training as a means of continuing professional education to promote EBP competencies among nurses.

Implementing a novel programme for nurses and allied health professionals to develop capacity for evidence-informed clinical practice

Background

Nurses and allied health professionals (AHPs) require skills and support to access, appraise, interpret and use research evidence in clinical practice. We describe the process of designing and implementing the Evidence in Practice (EiP) programme at a UK hospital.

Methods

Key stakeholders were engaged to identify learning needs and priorities in appraising and implementing research evidence. To address these, we designed a multi-strategy bespoke programme of activities.

Results

The programme comprised the development of (a) a visual summary of a research paper, (b) five skills development masterclasses and (c) a six-month mentoring scheme to develop and implement plans for translating evidence into practice.

Discussion

The programme overcame many of the traditional barriers (lack of access, skills and time) to increase engagement of nurses and AHP staff in accessing, reviewing and using evidence in clinical practice.

Conclusion

With clinical leadership support, it is feasible to use a multi-strategy approach to promote and enable nurses and AHPs to use evidence in clinical practice.

A Quasi-Experimental Study of a Basics of Evidence-Based Practice Educational Intervention for Health and Social Care Professionals

Education is one of the central interventions to promote evidence-based practice (EBP) in service organizations. An educational intervention to promote EBP among health and social care professionals was implemented in a Finnish hospital. The aim of this study was to explore the outcomes of an educational intervention, focusing on the basics of EBP for health and social care professionals, using a quasi-experimental study design. The data were collected with a questionnaire before, immediately after, and 6 months after the education (n = 48). The data were analyzed with descriptive statistics and nonparametric tests. Immediately after the education, an increase was found in the EBP knowledge of participants, in participants’ confidence in their own ability to conduct database searches and read scientific articles, and in the number of participants using databases at work. Six months after the education, improvements were still found between the first and the third measurement in the participants’ knowledge and confidence in their own ability to conduct database searches and read scientific articles. The number of those who had made an initiative about a research topic regarding the development of their own work had increased from the first to the third measurement. The educational intervention produced a statistically significant improvement on most of the areas evaluated. Significant improvements were often found even 6 months after the education was finished. However, the low completion rate and a quasi-experimental before and after design limit the conclusions that can be derived from this study.

Translating facilitated multimodal online learning into effective person-centred practice for the person living with dementia among health care staff in Australia: an observational study

BACKGROUND

This paper aims to identify whether health care staff perceive a 12-week online facilitated, multimodal, person-centred care, dementia education program influences their knowledge, skills, behaviour and practice improvement activities in dementia care. In particular it will examine a dementia education program 'Positive Approach to Care of the Older Person with Dementia' (The Program).

METHODS

Three clusters of online questions were developed. Participants completed the first cluster at course completion (N = 1455;2013-2016). The second cluster was added into the 2015-2016 exit-surveys to measure clinical practice improvement (CPI) activities implementation (N = 520). Thirdly, all participants were invited to a 2018 follow-up survey (N = 343). The Program was also matched with key factors that are likely to result in effective online dementia education programs.

RESULTS

The Program had a 78% completion rate. At course completion (2013-2016, N = 1455), 62% felt that the online forums generated useful discussion and 92% thought their work would support implementing their new knowledge and skills. In 2015-16, participants (N = 520) reported that The Program had influenced their practice in terms of new knowledge (87%), understanding (87%), awareness (88%), and new ideas about delivering dementia care (80%). Almost all (95%) participants indicated they had changed 'an aspect of their own professional practice'. Sixty-three percent had planned to develop a CPI activity. Of those (N = 310), 40% developed a new or improved tool and 21% planned to deliver education or create new resources. The most common CPI activities reported in the 2018 follow-up survey (N = 343) included education (49%) and role modelling of new behaviour (47%). Additionally, 75% indicated their CPI influenced their practice and had influenced patients (53%) and colleagues (53%). Fifty-seven percent reported their projects were sustained for 12 months or more.

CONCLUSION

The Positive Approach to Care of the Older Person with Dementia education program can potentially improve training the dementia workforce. Participants perceived that a multimodal online platform facilitated by clinical champions influences knowledge transfer, skills and behaviour, encourages workplace CPI activities. Further effort could be directed towards empowering and supporting care staff on system, procedure and practice change and engaging management to translate training activities into practice.

A Web-Based Dementia Education Program and its Application to an Australian Web-Based Dementia Care Competency and Training Network: Integrative Systematic Review

Background

Dementia education that meets quality and safety standards is paramount to ensure a highly skilled dementia care workforce. Web-based education provides a flexible and cost-effective medium. To be successful, Web-based education must contain features that promote learning and support knowledge translation into practice. The Dementia Care Competency and Training Network (DCC&TN) has developed an innovative Web-based program that promotes improvement of the attitudes, knowledge, skills, behavior, and practice of clinicians, regardless of their work setting, in order to improve the quality of life for people living with dementia.

Objective

This review aims to (1) determine the key features that are associated with an effective and functional Web-based education program—an effective and functional Web-based program is defined as one that measures results, is accessible, is user friendly, and translates into clinical practice—and (2) determine how these features correlate with the DCC&TN.

Methods

Six electronic databases—Medline, Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), AusHealth, Nursing@Ovid, and Google Scholar—were searched for articles published between 2009 and 2018 using the following keywords: Education, Distance, Continuing, Learning, Online, Web-Based, Internet, Dementia, Program Evaluation, Validation Studies, Outcome and Process Assessment Healthcare, Nursing, Assisted Instruction, and Facilitated. The Critical Appraisal Skills Programme (CASP) and Kirkpatrick’s model for the evaluation of training were used to ensure quality and rigor of the analysis.

Results

A total of 46 studies met the inclusion criteria. In total, 14 key features were associated with an effective Web-based learning environment, which enabled the environment to be as follows: self-directed, individualized, interactive, multimodal, flexible, accessible, consistent, cost-effective, measurable with respect to participant satisfaction, equitable, facilitated, nurturing of critical thinking and reflection, supportive of creating a learning community, and translated into practice. These features were further categorized into five subgroups: applicability, attractiveness, functionality, learner interaction, and implementation into practice. Literature frequently cites Kirkpatrick’s four-level model of evaluation and application in the review of education and training; however, few studies appeared to integrate all four levels of Kirkpatrick’s model. Features were then correlated against the DCC&TN, with an encouraging connection found between these features and their inclusion within the content and structure of the DCC&TN.

Conclusions

A total of 14 key features were identified that support an effective and functional Web-based learning environment. Few studies incorporated Kirkpatrick’s salient elements of the model—reaction, learning, behavior, and results—in their evaluation and clinical application. It could, therefore, be considered prudent to include Kirkpatrick’s levels of training evaluation within studies of dementia training. There were few studies that evaluated Web-based dementia education programs, with even fewer reporting evidence that Web-based training could increase staff confidence, knowledge, skills, and attitudes toward people with dementia and be sustainable over time. The DCC&TN appeared to contain the majority of key features and is one of the few programs inclusive of hospital, community, and residential care settings. The 14 key features can potentially enhance and complement future development of online training programs for health sciences education and beyond. The DCC&TN model could potentially be used as a template for future developers and evaluators of Web-based dementia training.

A Web-Based Training Resource for Therapists to Deliver an Evidence-Based Exercise Program for Rheumatoid Arthritis of the Hand (iSARAH): Design, Development, and Usability Testing

Background

The Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) is a tailored, progressive exercise program for people having difficulties with wrist and hand function due to rheumatoid arthritis (RA). The program was evaluated in a large-scale clinical trial and was found to improve hand function, was safe to deliver, and was cost-effective. These findings led to the SARAH program being recommended in the UK National Institute for Health and Care Excellence guidelines for the management of adults with RA. To facilitate the uptake of this evidence-based program by clinicians, we proposed a Web-based training program for SARAH (iSARAH) to educate and train physiotherapists and occupational therapists on delivering the SARAH program in their practice. The overall iSARAH implementation project was guided by the 5 phases of the analysis, design, development, implementation, and evaluation (ADDIE) system design model.

Objective

The objective of our study was to conduct the first 3 phases of the model in the development of the iSARAH project.

Methods

Following publication of the trial, the SARAH program materials were made available to therapists to download from the trial website for use in clinical practice. A total of 35 therapists who downloaded these materials completed an online survey to provide feedback on practice trends in prescribing hand exercises for people with RA, perceived barriers and facilitators to using the SARAH program in clinical practice, and their preferences for the content and Web features of iSARAH. The development and design of iSARAH were further guided by a team of multidisciplinary health professionals (n=17) who took part in a half-day development meeting. We developed the preliminary version of iSARAH and tested it among therapists (n=10) to identify and rectify usability issues and to produce the final version.

Results

The major recommendations made by therapists and the multidisciplinary team were having a simple Web design and layout, clear exercise pictures and videos, and compatibility of iSARAH on various browsers and devices. We rectified all usability issues in the preliminary version to develop the final version of iSARAH, which included 4 short modules and additional sections on self-assessment, frequently asked questions, and a resource library.

Conclusions

The use of the ADDIE design model and engagement of end users in the development and evaluation phases have rendered iSARAH a convenient, easy-to-use, and effective Web-based learning resource for therapists on how to deliver the SARAH program. There is also huge potential for adapting iSARAH across different cultures and languages, thus opening more opportunities for wider uptake and application of the SARAH program into practice.

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties

BACKGROUND

Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL) abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1) identify the instruments for assessment of SDL abilities among nursing students and nurses; 2) critically evaluate the methodological studies quality; and 3) compare the psychometric properties of the available instruments.

METHODS

A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN) panel. Study inclusion, data extraction and quality assessment were performed by researchers independently.

RESULTS

Eleven studies were included and four tools based on Knowles's theory have emerged: 1) the Self-Directed Learning Readiness Scale; 2) the Self-Directed Learning Readiness Scale for Nursing Education; 3) the Self-Rating Scale of Self-Directed Learning, and 4) the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument). The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative factor analyses.

CONCLUSIONS

On the basis of the findings, the Self-Directed-Learning-Instrument can be recommended for the assessment of SDL abilities among nursing students and nurses, given the excellent methodology quality adopted in estimating the psychometric properties. However, rigorous study designs aimed at estimating psychometric properties of tools in wide samples of nursing students and nurses across different stages of professional life, from undergraduate education to professional maturity, in different cultural, educational, and work settings, are strongly recommended.

E-learning for grass-roots emergency public health personnel: Preliminary lessons from a national program in China

In China, grass-roots emergency public health personnel have relatively limited emergency response capabilities and they are constantly required to update their professional knowledge and skills due to recurring and new public health emergencies. However, professional training, a principal solution to this problem, is inadequate because of limitations in manpower and financial resources at grass-roots public health agencies. In order to provide a cost-effective and easily expandable way for grass-roots personnel to acquire knowledge and skills, the National Health Planning Commission of China developed an emergency response information platform and provided trial access to this platform in Anhui and Heilongjiang provinces in China. E-learning was one of the modules of the platform and this paper has focused on an e-learning pilot program. Results indicated that e-learning had satisfactorily improved the knowledge and ability of grass-roots emergency public health personnel, and the program provided an opportunity to gain experience in e-course design and implementing e-learning. Issues such as the lack of personalized e-courses and the difficulty of evaluating the effectiveness of e-learning are topics for further study.

Adaptation and Evaluation of Online Self-learning Modules to Teach Critical Appraisal and Evidence-Based Practice in Nursing: An International Collaboration

Healthcare professionals need to update their knowledge and acquire skills to continually inform their practice based on scientific evidence. This study was designed to evaluate online self-learning modules on critical appraisal skills to promote the use of research in clinical practice among nurses from Quebec (Canada) and the Basque Country (Spain). The teaching material was developed in Quebec and adapted to the Basque Country as part of an international collaboration project. A prospective pre-post study was conducted with 36 nurses from Quebec and 47 from the Basque Country. Assessment comprised the administration of questionnaires before and after the course in order to explore the main intervention outcomes: knowledge acquisition and self-learning readiness. Satisfaction was also measured at the end of the course. Two of the three research hypotheses were confirmed: (1) participants significantly improved their overall knowledge score after the educational intervention; and (2) they were, in general, satisfied with the course, giving it a rating of seven out of 10. Participants also reported a greater readiness for self-directed learning after the course, but this result was not significant in Quebec. The study provides unique knowledge on the cultural adaptation of online self-learning modules for teaching nurses about critical appraisal skills and evidence-based practice.

The Effectiveness of Interventions for Improving the Research Literacy of Nurses: A Systematic Review

BACKGROUND

Internationally, a considerable body of research exists examining why nurses do not use evidence in practice. Consistently, the research finds that lack of knowledge about research or discomfort with understanding research terminology are among the chief reasons given. Research education is commonly included in undergraduate nursing degree programs, but this does not seem to translate into a strong understanding of research following graduation, or an ability to use it in practice.

AIM

The objective of this review was to identify the effectiveness of workplace, tertiary-level educational, or other interventions designed to improve or increase postregistration nurses' understanding of research literature and ability to critically interact with research literature with the aim of promoting the use of research evidence in practice in comparison to no intervention, other intervention, or usual practice.

METHODS

A wide range of databases were searched for quantitative studies of registered nurses receiving educational interventions designed to increase or improve their understanding of research literature in tertiary or workplace settings. Two reviewers working independently critically appraised the relevant papers and extracted the data using Joanna Briggs Institute instruments. Data are presented as a narrative summary as no meta-analysis was possible.

RESULTS

Searching identified 4,545 potentially relevant papers, and after the sifting of titles and abstracts, 96 papers were selected for retrieval. On examination of full-text versions, 10 of the 96 retrieved papers were found to meet the inclusion criteria. Included studies were low to moderate quality. Interactive or activity-based learning seems to be effective in terms of improving research knowledge, critical appraisal ability, and research self-efficacy. Utilizing a program with a strong base in an appropriate theory also seems to be associated with greater effectiveness, particularly for workplace interventions.

LINKING EVIDENCE TO ACTION

The included studies strongly favored interactive interventions, and those utilizing theory in their construction. Therefore, these types of interventions should be implemented to improve the effectiveness of research education for nurses as well as their research literacy.

Developing blended online and classroom strategies to deliver an occupational health nursing overview course in a multi-state region in the United States

This article describes how hybrid online and classroom learning approaches were used to design and offer an occupational health nursing review course throughout a multi-state region of the northwest United States. In response to demand from practicing occupational health nurses for board certification preparation, a series of asynchronous and synchronous continuing education modules was created covering a range of occupational health nursing topics. This review course illustrates how innovative educational delivery models can serve the needs of occupational health nurses challenged by geographic and time constraints.