Medical Student Perspectives on the Use of Immersive Virtual Reality for Clinical Assessment Training

Tolerability and Acceptability of Autonomous Immersive Virtual Reality Incorporating Digital Twin Technology for Mass Training in Healthcare

INTRODUCTION

As part of onboarding and systems testing for a clinical expansion, immersive virtual reality (VR) incorporating digital twin technology was used. While digital twin technology has been leveraged by industry, its use in health care has been limited with no prior application for onboarding or training. The tolerability and acceptability of immersive VR for use by a large population of healthcare staff were unknown.

METHODS

A prospective, observational study of an autonomous immersive VR onboarding experience to a new clinical space was conducted from May to September 2021. Participants were healthcare staff from several critical care and acute care units. Primary outcomes were tolerance and acceptability measured by reported adverse effects and degree of immersion. Secondary outcomes were attitudes toward the efficacy of VR compared with standard onboarding experiences.

RESULTS

A total of 1522 healthcare staff participated. Rates of adverse effects were low and those with prior VR experience were more likely to report no adverse effects. Odds of reporting immersion were high across all demographic groups, though decreased with increasing age. The preference for VR over low-fidelity methods was high across all demographics; however, preferences were mixed when compared with traditional simulation and real-time clinical care.

CONCLUSIONS

Large-scale VR onboarding is feasible, tolerable, and acceptable to a diverse population of healthcare staff when using digital twin technology. This study also represents the largest VR onboarding experience to date and may address preconceived notions that VR-based training in health care is not ready for widespread adoption.

Impact of Virtual Reality Simulation on New Nurses' Assessment of Pediatric Respiratory Distress

BACKGROUND

Children often experience respiratory illnesses requiring bedside nurses skilled in recognizing respiratory decompensation. Historically, recognizing respiratory distress has relied on teaching during direct patient care. Virtual reality simulation may accelerate such recognition among novice nurses.

OBJECTIVE

To determine whether a virtual reality curriculum improved new nurses' recognition of respiratory distress and impending respiratory failure in pediatric patients based on assessment of physical examination findings and appropriate escalation of care.

METHODS

New nurses (n = 168) were randomly assigned to complete either an immersive virtual reality curriculum on recognition of respiratory distress (intervention) or the usual orientation curriculum (control). Group differences and changes from 3 months to 6 months after the intervention were examined.

RESULTS

Nurses in the intervention group were significantly more likely to correctly recognize impending respiratory failure at both 3 months (23.4% vs 3.0%, P < .001) and 6 months (31.9% vs 2.6%, P < .001), identify respiratory distress without impending respiratory failure at 3 months (57.8% vs 29.6%, P = .002) and 6 months (57.9% vs 17.8%, P < .001), and recognize patients' altered mental status at 3 months (51.4% vs 18.2%, P < .001) and 6 months (46.8% vs 18.4%, P = .006).

CONCLUSIONS

Implementation of a virtual reality-based training curriculum was associated with improved recognition of pediatric respiratory distress, impending respiratory failure, and altered mental status at 3 and 6 months compared with standard training approaches. Virtual reality may offer a new approach to nurse orientation to enhance training in pediatrics-specific assessment skills.

Multiuser immersive virtual reality simulation for interprofessional sepsis recognition and management

INTRODUCTION

Sepsis is a leading cause of pediatric mortality. While there has been significant effort toward improving adherence to evidence-based care, gaps remain. Immersive multiuser virtual reality (MUVR) simulation may be an approach to enhance provider clinical competency and situation awareness for sepsis.

METHODS

A prospective, observational pilot of an interprofessional MUVR simulation assessing a decompensating patient from sepsis was conducted from January to June 2021. The study objective was to establish validity and acceptability evidence for the platform by assessing differences in sepsis recognition between experienced and novice participants. Interprofessional teams assessed and managed a patient together in the same VR experience with the primary outcome of time to recognition of sepsis utilizing the Situation Awareness Global Assessment Technique analyzed using a logistic regression model. Secondary outcomes were perceived clinical accuracy, relevancy to practice, and side effects experienced.

RESULTS

Seventy-two simulations included 144 participants. The cumulative odds ratio of recognizing sepsis at 2 min into the simulation in comparison to later time points by experienced versus novice providers were significantly higher with a cumulative odds ratio of 3.70 (95% confidence interval: 1.15-9.07, p = .004). Participants agreed that the simulation was clinically accurate (98.6%) and will impact their practice (81.1%), with a high degree of immersion (95.7%-99.3%), and the majority of side effects were perceived as mild (70.4%-81.4%).

CONCLUSIONS

Our novel MUVR simulation demonstrated significant differences in sepsis recognition between experienced and novice participants. This validity evidence along with the data on the simulation's acceptability supports expanded use in training and assessment.

Virtual Reality for Developing Patient-Facing Communication Skills in Medical and Graduate Education: Protocol for a Scoping Review

BACKGROUND

Clinician-patient communication is an integral component in providing quality medical care. However, research on clinician-patient communication has shown overall patient discontent with provider communication skills. While virtual reality (VR) is readily used for procedural-based learning in medical education, its potential for teaching patient-facing communication skills remains unexplored. This scoping review aims to evaluate the effectiveness and feasibility of VR applications used for patient-facing communication skills development in medical education.

OBJECTIVE

The primary objective is to synthesize and evaluate the effectiveness of available VR tools and applications used for patient-facing communication skills development in medical education. The secondary objectives are to (1) assess the feasibility of adapting VR applications to develop patient-facing communication skills in medical education and (2) provide an overview of the challenges associated with adapting VR applications to develop patient-facing communication skills in medical education.

METHODS

A total of 4 electronic databases (ERIC, Embase, PubMed, and MEDLINE) were searched for primary peer-reviewed articles published through April 11, 2023. Articles evaluating the implementation of non-, semi-, and fully immersive VR training for patient- or caregiver-facing communication skills training provided to graduate, medical, or other allied health care professions students were included. Studies that assessed augmented reality, mixed reality, artificial intelligence, or VR for non-communication-based training were excluded. Study selection will include a title, abstract, and full-text screening by 4 authors. Data from eligible studies will be extracted and entered into a database and presented in tabular format. Findings will be reported according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines for scoping reviews.

RESULTS

As of April 11, 2023, the search strategy has been confirmed and the search has been completed. We are currently at the title and abstract screening stage. Once complete, the articles will undergo full-text screening according to eligibility criteria as described in the methods.

CONCLUSIONS

The findings of this review will inform the development of a graduate-level clinical skills research course within the Institute of Medical Science graduate department at the University of Toronto. It is also expected that these findings will be of interest to other health care-specific faculties inside and beyond our institution. Further, our scoping review will summarize the limited field of literature on VR use in medical communications training and identify areas for future inquiry.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/53901.

Virtual Reality to Assess Resident Recognition of Impending Respiratory Failure During COVID-19

OBJECTIVES

To assess the performance of pediatric residents in recognizing a decompensating patient with impending respiratory failure and appropriately escalating care using a virtual reality (VR) simulated case of an infant with bronchiolitis after an extended period of decreased clinical volumes during the coronavirus disease 2019 (COVID-19) pandemic.

METHODS

Sixty-two pediatric residents at a single academic pediatric referral center engaged in a 30-minute VR simulation on respiratory failure in a 3-month-old admitted to the pediatric hospital medicine service with bronchiolitis. This occurred in a socially distant manner across the Zoom platform during the COVID-19 pandemic (January-April 2021). Residents were assessed on their ability to (1) recognize altered mental status (AMS), (2) designate clinical status as "(impending) respiratory failure," and (3) escalate care. Statistical differences between and across postgraduate year (PGY) levels were examined using χ2 or Fisher's exact test, followed by pairwise comparison and posthoc multiple testing using the Hochberg test.

RESULTS

Among all residents, 53% successfully recognized AMS, 16% identified respiratory failure, and 23% escalated care. No significant differences were seen across PGY levels for recognizing AMS or identifying respiratory failure. PGY3+ residents were more likely to escalate care than PGY2 residents (P = .05).

CONCLUSIONS

In the setting of an extended period with decreased clinical volumes during the COVID-19 pandemic, pediatric residents across all PGY levels demonstrated challenges with identifying (impending) respiratory failure and appropriately escalating care during VR simulations. Though limited, VR simulation may serve as a safe adjunct for clinical training and assessment during times of decreased clinical exposure.

Using Technology to Overcome Vaccine Hesitancy

Technology holds great potential to address many vaccine hesitancy determinants and support vaccine uptake given its ability to amplify positive messages, support knowledge, and enhance providers' recommendations. Modalities previously implemented with variable success have included automated reminder systems, decision support for clinicians, online education programs, social media campaigns, and virtual reality curricula. Further research is needed to identify the optimal uses of technology at the patient/parent and provider levels to overcome vaccine hesitancy. The most effective interventions will likely be multipronged providing patients, parents, and providers with information related to vaccine status.

Use of Extended Reality in Medical Education: An Integrative Review

Extended reality (XR) has emerged as an innovative simulation-based learning modality. An integrative review was undertaken to explore the nature of evidence, usage, and effectiveness of XR modalities in medical education. One hundred and thirty-three (N = 133) studies and articles were reviewed. XR technologies are commonly reported in surgical and anatomical education, and the evidence suggests XR may be as effective as traditional medical education teaching methods and, potentially, a more cost-effective means of curriculum delivery. Further research to compare different variations of XR technologies and best applications in medical education and training are required to advance the field.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-022-01698-4.

Assessment of Virtual Reality among University Professors: Influence of the Digital Generation

This paper conducts quantitative research on the assessment made by a group of 623 Spanish and Latin American university professors about the use of virtual reality technologies in the classroom and their own digital skills in this respect. The main objective is to analyze the differences that exist in this regard due to the digital generation of the professors (immigrants or digital natives). As an instrument, a survey designed for this purpose was used, the validity of which has been tested in the study. It was found that digital natives say they are more competent in the use of virtual reality and value its technical and didactic aspects more highly, although they also identify more disadvantages in its use than digital immigrants. Differences in responses were found by gender and areas of knowledge of the professors with respect to the opinions expressed. It is suggested that universities design training plans on teaching digital competence and include in them the didactic use of virtual reality technologies in higher education.

An Immersive Virtual Reality Curriculum for Pediatric Hematology Clinicians on Shared Decision-making for Hydroxyurea in Sickle Cell Anemia

Although hydroxyurea (HU) is an effective treatment for sickle cell anemia, uptake remains low. Shared decision-making (SDM) is a recommended strategy for HU initiation to elicit family preferences; however, clinicians lack SDM training. We implemented an immersive virtual reality (VR) curriculum at 8 pediatric institutions to train clinicians on SDM that included counseling virtual patients. Clinicians' self-reported confidence significantly improved following the VR simulations on all communication skills assessed, including asking open-ended questions, eliciting specific concerns, and confirming understanding (Ps≤0.01 for all). VR may be an effective method for educating clinicians to engage in SDM for HU.

Immersive Anatomy Atlas: Learning Factual Medical Knowledge in a Virtual Reality Environment

In order to improve learning efficiency and memory retention in medical teaching, furthering active learning seems to be an effective alternative to classical teaching. One option to make active exploration of the subject matter possible is the use of virtual reality (VR) technology. The authors developed an immersive anatomy atlas which allows users to explore human anatomical structures interactively through virtual dissection. Thirty-two senior-class students from two German high schools with no prior formal medical training were separated into two groups and tasked with answering an anatomical questionnaire. One group used traditional anatomical textbooks and the other used the immersive virtual reality atlas. The time needed to answer the questions was measured. Several weeks later, the participants answered a similar questionnaire with different anatomical questions in order to test memory retention. The VR group took significantly less time to answer the questionnaire, and participants from the VR group had significantly better results over both tests. Based on the results of this study, VR learning seems to be more efficient and to have better long-term effects for the study of anatomy. The reason for that could lie in the VR environment's high immersion, and the possibility to freely and interactively explore a realistic representation of human anatomy. Immersive VR technology offers many possibilities for medical teaching and training, especially as a support for cadaver dissection courses.

Virtual Reality in Medical Students' Education: Scoping Review

BACKGROUND

Virtual reality (VR) produces a virtual manifestation of the real world and has been shown to be useful as a digital education modality. As VR encompasses different modalities, tools, and applications, there is a need to explore how VR has been used in medical education.

OBJECTIVE

The objective of this scoping review is to map existing research on the use of VR in undergraduate medical education and to identify areas of future research.

METHODS

We performed a search of 4 bibliographic databases in December 2020. Data were extracted using a standardized data extraction form. The study was conducted according to the Joanna Briggs Institute methodology for scoping reviews and reported in line with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines.

RESULTS

Of the 114 included studies, 69 (60.5%) reported the use of commercially available surgical VR simulators. Other VR modalities included 3D models (15/114, 13.2%) and virtual worlds (20/114, 17.5%), which were mainly used for anatomy education. Most of the VR modalities included were semi-immersive (68/114, 59.6%) and were of high interactivity (79/114, 69.3%). There is limited evidence on the use of more novel VR modalities, such as mobile VR and virtual dissection tables (8/114, 7%), as well as the use of VR for nonsurgical and nonpsychomotor skills training (20/114, 17.5%) or in a group setting (16/114, 14%). Only 2.6% (3/114) of the studies reported the use of conceptual frameworks or theories in the design of VR.

CONCLUSIONS

Despite the extensive research available on VR in medical education, there continue to be important gaps in the evidence. Future studies should explore the use of VR for the development of nonpsychomotor skills and in areas other than surgery and anatomy.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2020-046986.

Remote Virtual Reality Teaching: Closing an Educational Gap During a Global Pandemic

OBJECTIVE

Resident physicians are expected to recognize patients requiring escalation of care on day 1 of residency, as outlined by the Association of American Medical Colleges. Opportunities for medical students to assess patients at the bedside or through traditional simulation-based medical education have decreased because of coronavirus disease 2019 restrictions. Virtual reality (VR) delivered remotely via video teleconferencing may address this educational gap.

METHODS

A prospective pilot study targeting third-year pediatric clerkship students at a large academic children's hospital was conducted from April to December 2020. Groups of 6 to 15 students participated in a 1.5-hour video teleconferencing session with a physician facilitator donning a VR headset and screen sharing interactive VR cases of a hospitalized infant with respiratory distress. Students completed surveys assessing the immersion and tolerability of the virtual experience and reported its perceived effectiveness to traditional educational modalities. Comparisons were analyzed with binomial testing.

RESULTS

Participants included third-year medical students on their pediatric clerkship. A total of 140 students participated in the sessions, with 63% completing the survey. A majority of students reported VR captured their attention (78%) with minimal side effects. Students reported remote VR training as more effective (P < .001) than reading and online learning and equally or more effective (P < .001) than didactic teaching. Most students (80%) rated remote VR as less effective than bedside teaching.

CONCLUSIONS

This pilot reveals the feasibility of remote group clinical training with VR via a video conferencing platform, addressing a key experience gap while navigating coronavirus disease 2019 limitations on training.

A Virtual Reality Resident Training Curriculum on Behavioral Health Anticipatory Guidance: Development and Usability Study

BACKGROUND

Behavioral health disorders have steadily increased and been exacerbated by the COVID-19 pandemic. Though behavioral health disorders can be successfully mitigated with early implementation of evidence-based parent management strategies, education for pediatric residents on behavioral health anticipatory guidance has been limited to date, with training challenges compounded by the physical distancing requirements of the COVID-19 pandemic. Virtual reality (VR) simulations provide an opportunity to train residents on this complex competency by allowing deliberate practice of necessary skills while adhering to current social distancing guidelines.

OBJECTIVE

This study explored the usability of a VR-based behavioral health anticipatory guidance curriculum for pediatric residents.

METHODS

This mixed methods study included 14 postgraduate third-year pediatric residents who completed the behavioral health anticipatory guidance VR curriculum. Residents completed the MEC Spatial Presence Questionnaire to assess immersion in the virtual environment. Semistructured interviews were used to elucidate residents' perspectives on the curriculum's content and format. The interviews were analyzed using conventional content analysis.

RESULTS

Quantitatively, residents reported a high degree of immersion, spatial presence, and cognitive involvement. Most residents (11/14, 79%) agreed or strongly agreed that it seemed as though they took part in the action of the simulation. Qualitatively, two themes emerged from the data: (1) the curriculum expands behavioral health anticipatory guidance and motivational interviewing knowledge and skills and (2) VR technology is uniquely positioned to develop competence. These themes revealed that the curriculum expanded their current level of knowledge and skill, addressed training gaps, and was applicable to all residents. Additionally, residents experienced VR as immersive, feasible, realistic to the clinic setting, and a safe space to practice and learn new skills.

CONCLUSIONS

Pilot data indicates that VR may be an effective tool to teach pediatric residents behavioral health anticipatory guidance, meeting a current gap in medical education training. This VR curriculum is particularly relevant in the context of the COVID-19 pandemic given the increased behavioral health concerns of families.

Development and Implementation of Augmented Reality Enhanced High-Fidelity Simulation for Recognition of Patient Decompensation

INTRODUCTION

Simulation is a core aspect of training and assessment; however, simulation laboratories are limited in their ability to visually represent mental, respiratory, and perfusion status. Augmented reality (AR) represents a potential adjunct to address this gap.

METHODS

A prospective, observational pilot of interprofessional simulation assessing a decompensating patient was conducted from April to June 2019. Teams completed 2 simulations: (1) traditional training (TT) using a manikin (Laerdal SimJunior) and (2) AR-enhanced training (ART) using a manikin plus an AR patient. The primary outcome was self-assessed effectiveness at the assessment of patient decompensation. Secondary outcomes were attitudes toward and adverse effects during the AR training.

RESULTS

Twenty-one simulation sessions included 84 participants in headsets. Participants reported improved ability to assess the patient's mental status, respiratory status, and perfusion status (all P < 0.0001) during ART in comparison to TT. Similar findings were noted for recognition of hypoxemia, shock, apnea, and decompensation (all P ≤ 0.0003) but not for recognition of cardiac arrest (P = 0.06). Most participants agreed or strongly agreed that ART accurately depicted a decompensating patient (89%), reinforced key components of the patient assessment (88%), and will impact how they care for patients (68%). Augmented reality-enhanced training was rated more effective than manikin training and standardized patients and equally as effective as bedside teaching.

CONCLUSIONS

This novel application of AR to enhance the realism of manikin simulation demonstrated improvement in self-assessed recognition of patient decompensation. Augmented reality may represent a viable modality for increasing the clinical impact of training.

Development of a Virtual Three-Dimensional Assessment Scenario for Anatomical Education

In anatomical education three-dimensional (3D) visualization technology allows for active and stereoscopic exploration of anatomy and can easily be adopted into medical curricula along with traditional 3D teaching methods. However, most often knowledge is still assessed with two-dimensional (2D) paper-and-pencil tests. To address the growing misalignment between learning and assessment, this viewpoint commentary highlights the development of a virtual 3D assessment scenario and perspectives from students and teachers on the use of this assessment tool: a 10-minute session of anatomical knowledge assessment with real-time interaction between assessor and examinee, both wearing a HoloLens and sharing the same stereoscopic 3D augmented reality model. Additionally, recommendations for future directions, including implementation, validation, logistic challenges, and cost-effectiveness, are provided. Continued collaboration between developers, researchers, teachers, and students is critical to advancing these processes.

The Future of Onboarding: Implementation of Immersive Virtual Reality for Nursing Clinical Assessment Training

An immersive virtual reality curriculum was piloted with new nurse graduates that focused on improving clinical reasoning and situational awareness for pediatric respiratory distress and impending respiratory failure. Learnings from this pilot could inform strategies for development of standardized, efficient, and safe onboarding curricula to increase the likelihood of successful transition to practice.

Establishing Objective Measures of Clinical Competence in Undergraduate Medical Education Through Immersive Virtual Reality

OBJECTIVE

The Association of American Medical Colleges defines recognition of the need for urgent or emergent escalation of care as a key Entrustable Professional Activity (EPA) for entering residency (EPA#10). This study pilots the use of an immersive virtual reality (VR) platform for defining objective observable behaviors as standards for evaluation of medical student recognition of impending respiratory failure.

METHODS

A cross-sectional observational study was conducted from July 2018 to December 2019, evaluating student performance during a VR scenario of an infant in impending respiratory failure using the OculusRift VR platform. Video recordings were rated by 2 pair of physician reviewers blinded to student identity. One pair provided a consensus global assessment of performance (not competent, borderline, or competent) while the other used a checklist of observable behaviors to rate performance. Binary discriminant analysis was used to identify the observable behaviors that predicted the global assessment rating.

RESULTS

Twenty-six fourth year medical students participated. Student performance of 8 observable behaviors was found to be most predictive of a rating of competent, with a 91% probability. Correctly stating that the patient required an escalation of care had the largest contribution toward predicting a rating of competent, followed by commenting on the patient's increased heart rate, low oxygen saturation, increased respiratory rate, and stating that the patient was in respiratory distress.

CONCLUSIONS

This study demonstrates that VR can be used to establish objective and observable performance standards for assessment of EPA attainment - a key step in moving towards competency based medical education.