Application of an objective structured clinical examination to evaluate and monitor intern's proficiency of hand hygiene and personal protective equipment use in the United States

Staying proper with your personal protective equipment: How to don and doff

INTRODUCTION

The global COVID-19 pandemic highlighted the importance of protecting frontline healthcare workers from novel respiratory infections while also exposing the limited instruction that medical students receive on proper donning of personal protective equipment (PPE) and more importantly the safe doffing of contaminated PPE to minimize their risk of nosocomial infection. The best methods of providing this kind of instruction have not yet been determined.

METHODS

Anesthesiology interns and CA-1 residents were trained on proper PPE donning and doffing for AGPs using a methodology based on Miller's pyramid and following a "knows-knows how-shows-does" progression. Participants donned PPE without instruction and were sprayed with Glo Germ® to identify areas of contamination, after which they received both video and in-person instruction on best practices for donning and doffing PPE for AGPs. Following instruction, they again donned PPE and were sprayed with Glo Germ® to identify areas of contamination.

RESULTS

54 participants completed the study. Before training, overall donning compliance was 60% and overall doffing compliance was 48%. Overall, 70% were contaminated after PPE doffing, with 46% having multiple sites of contamination. After training, donning compliance increased by nearly 30% (P < 0.001), doffing compliance increased by over 20% (P < 0.001), and overall contamination decreased by nearly 30% (P = 0.029), with multiple-site contamination decreasing to only 6% (P = 0.013).

DISCUSSION

While best methods for providing instruction regarding topics such as PPE donning and doffing have not yet been determined, we have demonstrated that the underlying knowledge base from medical school regarding proper donning and doffing for respiratory isolation is insufficient for preventing self-contamination, and that Miller's pyramid-based training using both video and in-person instruction combined with task execution by learners can improve compliance with PPE donning and doffing protocols and more importantly decrease skin contamination among a group of early training anesthesiology residents.

Effectiveness and Utility of Virtual Reality Simulation as an Educational Tool for Safe Performance of COVID-19 Diagnostics: Prospective, Randomized Pilot Trial

Background

Although the proper use of hygiene and personal protective equipment (PPE) is paramount for preventing the spread of diseases such as COVID-19, health care personnel have been shown to use incorrect techniques for donning/doffing of PPE and hand hygiene, leading to a large number of infections among health professionals. Education and training are difficult owing to the social distancing restrictions in place, shortages of PPE and testing material, and lack of evidence on optimal training. Virtual reality (VR) simulation can offer a multisensory, 3-D, fully immersive, and safe training opportunity that addresses these obstacles.

Objective

The aim of this study is to explore the short- and long-term effectiveness of a fully immersive VR simulation versus a traditional learning method regarding a COVID-19–related skill set and media-specific variables influencing training outcomes.

Methods

This was a prospective, randomized controlled pilot study on medical students (N=29; intervention VR training, n=15, vs control video-based instruction, n=14) to compare the performance of hand disinfection, nasopharyngeal swab taking, and donning/doffing of PPE before and after training and 1 month later as well as variables of media use.

Results

Both groups performed significantly better after training, with the effect sustained over one month. After training, the VR group performed significantly better in taking a nasopharyngeal swab, scoring a median of 14 out of 17 points (IQR 13-15) versus 12 out of 17 points (IQR 11-14) in the control group, P=.03. With good immersion and tolerability of the VR simulation, satisfaction was significantly higher in the VR group compared to the control group (median score of User Satisfaction Evaluation Questionnaire 27/30, IQR 23-28, vs 22/30, IQR 20-24, in the control group; P=.01).

Conclusions

VR simulation was at least as effective as traditional learning methods in training medical students while providing benefits regarding user satisfaction. These results add to the growing body of evidence that VR is a useful tool for acquiring simple and complex clinical skills.

Rapid Dissemination of a COVID-19 Airway Management Simulation Using a Train-the-Trainers Curriculum

PROBLEM

The most effective way to train clinicians to safely don and doff personal protective equipment (PPE) and perform aerosol-generating procedures (AGPs), such as intubations, is unknown when clinician educators are unavailable, as they have been during the COVID-19 pandemic. Proper PPE and airway management techniques are critical to prevent the transmission of respiratory illnesses such as COVID-19.

APPROACH

In March 2020, the authors implemented a structured train-the-trainers curriculum to teach PPE techniques and a modified airway management algorithm for suspected COVID-19 patients. A single emergency medicine physician trainer taught 17 subsequent emergency medicine and critical care physician trainers the proper PPE and airway management techniques. The initial trainer and 7 of the subsequent trainers then instructed 99 other emergency medicine resident and attending physicians using in situ simulation. Trainers and learners completed retrospective pre-post surveys to assess their comfort teaching the material and performing the techniques, respectively.

OUTCOMES

The surveys demonstrated a significant increase in the trainers' comfort in teaching simulation-based education, from 4.00 to 4.53 on a 5-point Likert scale (P < .005), and in teaching the airway management techniques through simulation, from 2.47 to 4.47 (P < .001). There was no difference in the change in comfort level between those learners who were taught by the initial trainer and those who were taught by the subsequent trainers. These results suggest that the subsequent trainers were as effective in teaching the simulation material as the initial trainer.

NEXT STEPS

Work is ongoing to investigate clinician- and patient-specific outcomes, including PPE adherence, appropriate AGP performance, complication rate, and learners' skill retention. Future work will focus on implementing similar train-the-trainers strategies for other health professions, specialties, and high-risk or rare procedures.

Empirical analysis comparing the tele-objective structured clinical examination (teleOSCE) and the in-person assessment in Australia

PURPOSE

It aimed to compare the use of the tele objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE.

METHODS

This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia.

RESULTS

In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference -0.277, P<0.001, effect size 0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020.

CONCLUSION

The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.

Comparison of students' performance of objective structured clinical examination during clinical practice

PURPOSE

Clinical practice for medical students aims to improve their clinical competency. Since students gain experience in clinical practice, it is assumed that their capacity for care is strengthened. This study aimed to verify whether there is a change in the competency of medical students after clinical practice.

METHODS

We assessed the clinical performance of 120 medical students who were enrolled in the fifth year over the academic years 2016-2018. Objective structured clinical examination (OSCE) was used to measure the clinical competency.

RESULTS

The OSCE scores for November fifth grade improved significantly compared to May fifth grade. The scores in September of sixth grade were slightly lower than those of November of fifth grade, but there was no statistically significant difference.

CONCLUSION

It was confirmed that the clinical practice of fifth-year students improved their clinical competency, but it did not show any significant shift in the clinical competency of sixth-year students. The results of this study suggest that it is very important to organize the curriculum so that students can continue to experience patient-facing care throughout the entire clinical practice course to produce highly qualified physicians.