Development of a web-based tool to evaluate competences of nursing students through the assessment of their clinical skills

Developing student nurses' evaluative judgement in clinical practice tertiary education: A systematic scoping review of teaching and assessment methods

OBJECTIVES

This review aimed to systematically scope undergraduate or postgraduate tertiary higher education nursing students' clinical practice teaching and assessment methods to identify features that align with promoting students' evaluative judgement.

INTRODUCTION

Evaluative judgement is a new concept to nursing tertiary education. Currently, there are no published reviews of evaluative judgement in nursing clinical practice education. This review aims to assist nursing educators to operationalise the concept of evaluative judgement in clinical practice education. As such the starting point was to determine features of evaluative judgement in current clinical teaching and assessment designs.

INCLUSION CRITERIA

Peer reviewed qualitative or quantitative studies that have evaluated teaching and/or assessment of tertiary (university/higher education) pre-registration (undergraduate) or post-registration (postgraduate) nursing students' clinical practice.

METHODS

The systematic scoping review was prospectively registered systematic review (OSF DOI 10.17605/OSF.IO/PYWZ6) reported using PRISMA guidelines. A systematic search of five databases (Medline, Scopus, Web of Science, ProQuest, CINAHL) was conducted, limited from 1989 onwards and in English. Two reviewers independently screened titles and abstracts, then full text, with disagreements resolved with a third independent author. Data were extracted, including the frequency and methods of developing students' evaluative judgement across the categories of discerning quality, judgement process, calibration and feedback. A narrative synthesis was performed.

RESULTS

Seventy-one studies were included (n=53 teaching, n=18 assessment). Most of the included studies, included some, but not all, of the features to develop nursing students' evaluative judgment. For teaching methods, the most identified evaluative judgement features in the included studies were discerning quality (n=47), feedback (n=41) and judgement process (n=21). Only three studies included a method of calibration. For the assessment methods, feedback (n=16), discerning quality (n=15), judgement process (n=9) and calibration (n=4) were included. Many clinical practice teaching and assessment methods in nursing included features that develop students' evaluative judgement, with methods relating to discerning quality and feedback well embedded. Further adjustments are required to include methods to assist students to judge and calibrate their own performance.

CONCLUSION

This systematic scoping review identified that evaluative judgement in current nursing clinical teaching and assessment is not an overt aim. With minor adjustment to teaching and assessment design, nursing students could be better supported to develop their ability to judge the value of their own work.

Effectiveness of structured self-evaluation of video recorded performance on peripheral intravenous catheter insertion: a randomised control trial study protocol

BACKGROUND

Clinical psychomotor skills training is a core component of undergraduate nursing education. Performing technical skills competently involves the use of cognitive and motor function. The training of these technical skills is typically carried out in clinical simulation laboratories. Peripheral intravenous catheter/cannula insertion is an example of a technical skill. It is the most common invasive procedure performed in the healthcare environment. Owing to unacceptable clinical risk and complications to patients, it is imperative that practitioners performing these skills are trained effectively to provide patients with best practice and high-quality care. Technologies identified as innovative teaching methods to help train students in this skill and in the skill of venepuncture include virtual reality, hypermedia and simulators. However, little high-quality evidence exists to confirm such educational approaches are effective.

METHODS/DESIGN

This study is a single-centre, non-blinded, two-group, pre-test and post-test randomised control trial. The randomised control trial will investigate whether a formal structured self-evaluation of videoed performance (experimental group) has an impact on nursing students' peripheral intravenous cannulation knowledge, performance and confidence. The control group will also be videoed performing the skill but they will not view or self-evaluate their videoed performance. The peripheral intravenous cannulation procedures will be carried out in a clinical simulation laboratory using a task trainer. The data collection tools will be completed online using survey forms. Students will be randomised into the experimental group or into the control group using simple random sampling. The primary outcome measures the nursing students' knowledge level of the skill of peripheral intravenous cannulation insertion. Secondary outcomes evaluate procedural competence and self-reported confidence and practices in the clinical environment.

DISCUSSION

This randomised control trial will investigate whether this pedagogical approach, using video modelling and self-evaluation, will positively influence students' knowledge, confidence and performance in the skill of peripheral intravenous cannulation. Evaluating such teaching strategies using stringent methodologies may be impactful in influencing the training provided to healthcare practitioners.

TRIAL REGISTRATION

The randomised control trial detailed in this article is an educational research study and so does not fall under the ICMJE definition of a clinical trial as "any research project that prospectively assigns people or a group of people to an intervention, with or without concurrent comparison or control groups, to study the relationship between a health-related intervention and a health outcome".

Clinical nursing competency assessment: a scoping review

Objective

To ensure that only competent graduates are licensed to practice nursing, councils conduct licensing examinations, which may include among others clinical competency assessment. This review explored current practices in clinical competency assessment of nursing students as part of a larger study aimed at developing an evidence-based, context-specific framework for clinical competency assessment in a sub-Saharan African (SSA) country.

Methods

A scoping guided by the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) was conducted.

Results

Findings from 28 out of 1151 studies identified from Scopus, PubMed, CINAHL, Wiley Online Library, and ProQuest were included and synthesized. Results show that a good assessment system must be valid, reliable, transparent, feasible, fair, objective, and must provide feedback and continually improve to have an educational impact. Clinical competency assessment systems must be developed on sound empirical evidence, pilot tested, and involve thorough training and evaluation of the examiners. Continuous evaluation of the assessment system is also essential to ensure the quality and relevance of the assessment system. Only one of the included studies was conducted in Africa.

Conclusions

The paucity of clinical competency assessment research in sub-Saharan Africa may lead to benchmarking assessment systems on research conducted outside the context. Sub-Saharan Africa has a set of circumstances that demand a context-specific clinical competency assessment framework to guide clinical competency assessment.

The effects of web based education and Kahoot usage in evaluation of the knowledge and skills regarding intramuscular injection among nursing students

BACKGROUND

Nursing is a discipline based on practice, which requires the integration of theory and implementation. Nurse educators should continuously review their curriculum and include "information technology" to help students obtain the required knowledge and skills.

OBJECTIVES

The present study aims to review the effects of Kahoot usage within the framework of web-based education evaluation regarding the intramuscular injection knowledge and skills of nursing students.

DESIGN

In this semi-experimental study, 110 first-year nursing students who registered in a university in Çankırı in the academic year of 2019-2020 and selected with simple random sampling participated.

METHOD

While the experimental group (n = 51) was experiencing Kahoot concerning web-based education and test evaluation, the control group (n = 59) experienced face-to-face education. To evaluate the knowledge of the students, the "Intramuscular Injection Knowledge test" and the "Checklist of Intramuscular Injection" were used in this study.

RESULTS

The findings showed that the experimental group had significantly higher mean scores in knowledge scores and skill performance for intramuscular injection.

CONCLUSION

Web-based education and Kahoot usages in the evaluation showed positive effects on nursing students' intramuscular injection knowledge and skills. Therefore, Kahoot has shown itself as a promising, effective and beneficial tool as a formative evaluator in terms of motivating and supporting learning activities/processes. In light of the findings obtained in this study, we propose that Kahoot should be integrated into the curriculum in the web-based education of nursing as an alternative tool for formative evaluation.

Guess it (SVUAL): An app designed to help nursing students acquire and retain knowledge about basic and advanced life support techniques

To design an app that helps nursing students to acquire and retain knowledge of Basic and Advanced Life Support techniques, as well as analyze the students' gamification experience. The study had two phases: 1) App design and development and 2) experimental study. A total of 184 students participated, with 92 in the experimental group and 92 in the control group. The instruments used were the Guess it (SVUAL) app, a test on knowledge and the Gameful Experience Scale. The app was deemed to have a suitable level of content and user-friendliness of 97%. The experimental group obtained a higher average score on the knowledge test than the control group (U = 2835.500; Z = -3.968; p < 0.05). On the re-test, the experimental group also obtained a higher average score than the control group. As for the experience within the game, all the dimensions scored higher than average, except the absence of negative effects dimension, which indicates that the app had very few negative consequences on the participants. The developed app has proven to have a good level of content and to be user-friendly, improving knowledge levels and retention of information in nursing students.