Using Virtual Reality Head-Mounted Displays to Assess Skills in Emergency Medicine: Validity Study

BACKGROUND

Many junior doctors must prepare to manage acutely ill patients in the emergency department. The setting is often stressful, and urgent treatment decisions are needed. Overlooking symptoms and making wrong choices may lead to substantial patient morbidity or death, and it is essential to ensure that junior doctors are competent. Virtual reality (VR) software can provide standardized and unbiased assessment, but solid validity evidence is necessary before implementation.

OBJECTIVE

This study aimed to gather validity evidence for using 360-degree VR videos with integrated multiple-choice questions (MCQs) to assess emergency medicine skills.

METHODS

Five full-scale emergency medicine scenarios were recorded with a 360-degree video camera, and MCQs were integrated into the scenarios to be played in a head-mounted display. We invited 3 groups of medical students with different experience levels to participate: first- to third-year medical students (novice group), last-year medical students without emergency medicine training (intermediate group), and last-year medical students with completed emergency medicine training (experienced group). Each participant's total test score was calculated based on the number of correct MCQ answers (maximum score of 28), and the groups' mean scores were compared. The participants rated their experienced presence in emergency scenarios using the Igroup Presence Questionnaire (IPQ) and their cognitive workload with the National Aeronautics and Space Administration Task Load Index (NASA-TLX).

RESULTS

We included 61 medical students from December 2020 to December 2021. The experienced group had significantly higher mean scores than the intermediate group (23 vs 20; P=.04), and the intermediate group had significantly higher scores than the novice group (20 vs 14; P<.001). The contrasting groups' standard-setting method established a pass-or-fail score of 19 points (68% of the maximum possible score of 28). Interscenario reliability was high, with a Cronbach α of 0.82. The participants experienced the VR scenarios with a high degree of presence with an IPQ score of 5.83 (on a scale from 1-7), and the task was shown to be mentally demanding with a NASA-TLX score of 13.30 (on a scale from 1-21).

CONCLUSIONS

This study provides validity evidence to support using 360-degree VR scenarios to assess emergency medicine skills. The students evaluated the VR experience as mentally demanding with a high degree of presence, suggesting that VR is a promising new technology for emergency medicine skills assessment.

Team performance training for medical students: Low vs high fidelity simulation

Objectives

The aim of this study is to evaluate a simulation-based team performance course for medical students and compare its low- and high-fidelity components.

Study design

This is a prospective crossover observational study. Groups participated in one low- and one high-fidelity session twice. Low-fidelity scenarios included management of an emergency case on a simulated-patient, whereas high-fidelity scenarios constituted of multiple-trauma cases where simulated-patients wore a hyper-realistic suit. Team performance was assessed objectively, using the TEAM™ tool, and subjectively using questionnaires. Questionnaires were also used to assess presence levels, stress levels and evaluate the course.

Results

Participants’ team performance was higher in the low-fidelity intervention as assessed by the TEAM™ tool. An overall mean increase in self-assessed confidence towards non-technical skills attitudes was noted after the course, however there was no difference in self-assessed performance between the two interventions. Both reported mean stress and presence levels were higher for the high-fidelity module. Evaluation scores for all individual items of the questionnaire were ≥4.60 in both NTS modules. Students have assessed the high-fidelity module higher (4.88 out of 5, SD = 0.29) compared to low-fidelity module (4.74 out of 5, SD = 0.67).

Conclusions

Both the low- and high-fidelity interventions demonstrated an improvement in team performance of the attending medical students. The high-fidelity intervention was more realistic, yet more stressful. Furthermore, it proved to be superior in harvesting leadership, teamwork and task management skills. Both modules were evaluated highly by the students, however, future research should address retention of the taught skills and adaptability of such interventions.

•

The high-fidelity intervention was superior in harvesting leadership, teamwork and task management skills, yet more stressful.

•

We set the group to develop a novel group of team-based OSCE performance.

•

The next step is to adapt such taught skills to different specialties and implement initiatives in the medical school curricula.

High-Fidelity Simulation of Pediatric Emergency Care: An Eye-Opening Experience for Baccalaureate Nursing Students

Background Little attention has been given to in-depth examination of what high-fidelity simulation is like for nursing students within the context of a pediatric emergency, such as a cardiopulmonary arrest. It is possible that such high-fidelity simulation could provoke in nursing students intense psychological reactions. Purpose The purpose of this study was to learn about baccalaureate nursing students' lived experience of high-fidelity simulation of pediatric cardiopulmonary arrest. Method Phenomenological methods were used. Twenty-four interviews were conducted with 12 students and were analyzed for themes. Results The essence of the experience is that it was eye-opening. The students found the simulation to be a surprisingly realistic nursing experience as reflected in their perceiving the manikin as a real patient, thinking that they were saving their patient's life, feeling like a real nurse, and feeling relief after mounting stress. It was a surprisingly valuable learning experience in that the students had an increased awareness of the art and science of nursing and increased understanding of the importance of teamwork and were feeling more prepared for clinical practice and wanting more simulation experiences. Conclusion Educators should capitalize on the benefits of high-fidelity simulation as a pedagogy, while endeavoring to provide psychologically safe learning.

The Centricity of Presence in Scenario-Based High Fidelity Human Patient Simulation

Enhancing immersive presence has been shown to have influence on learning outcomes in virtual types of simulation. Scenario-based human patient simulation, a mixed reality form, may pose unique challenges for inducing the centricity of presence among participants in simulation. A model for enhancing the centricity of presence in scenario-based human patient simulation is presented here. The model represents a theoretical linkage among the interaction of pedagogical, individual, and group factors that influence the centricity of presence among participants in simulation. Presence may have an important influence on the learning experiences and learning outcomes in scenario-based high fidelity human patient simulation. This report is a follow-up to an article published in 2014 by the author where connections were made to the theoretical basis of presence as articulated by nurse scholars.