1
|
Keicher F, Backhaus J, König S, Mühling T. Virtual reality for assessing emergency medical competencies in junior doctors - a pilot study. Int J Emerg Med 2024; 17:125. [PMID: 39333858 DOI: 10.1186/s12245-024-00721-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Accepted: 09/15/2024] [Indexed: 09/30/2024] Open
Abstract
BACKGROUND The teaching and assessment of clinical-practical skills in medical education face challenges in adequately preparing students for professional practice, especially in handling emergency situations. This study aimed to evaluate the emergency medical competencies of junior doctors using Virtual Reality (VR)-based scenarios to determine their preparedness for real-world clinical situations. METHODS Junior doctors with 0-6 months of professional experience participated in one of three VR-based emergency scenarios. These scenarios were designed to test competencies in emergency medical care. Performance was automatically assessed through a scenario-specific checklist, and participants also completed self-assessments and a clinical reasoning ability test using the Post-Encounter Form. RESULTS Twenty-one junior doctors participated in the study. Results showed that while general stabilization tasks were performed well, there were notable deficiencies in disease-specific diagnostic and therapeutic actions. On average, 65.6% of the required actions were performed correctly, with no significant variance between different scenarios. Participants achieved an average score of 80.5% in the Post-Encounter-Form, indicating a robust ability to handle diagnostic decisions. Self-assessments did not correlate significantly with objective measures of competency, highlighting the subjective nature of self-evaluation. CONCLUSION VR-based simulations can provide a detailed picture of EMC, covering both diagnostic and therapeutic aspects. The findings of this pilot study suggest that while participants are generally well-prepared for routine tasks, more focus is needed on complex case management. VR assessments could be a promising tool for evaluating the readiness of new medical professionals for clinical practice.
Collapse
Affiliation(s)
- Franca Keicher
- Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Bavaria, Germany
- University Hospital Würzburg, Children's Hospital, Würzburg, Bavaria, Germany
| | - Joy Backhaus
- Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Bavaria, Germany
| | - Sarah König
- Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Bavaria, Germany
| | - Tobias Mühling
- Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Bavaria, Germany.
| |
Collapse
|
2
|
Guruswamy J, Chhina A, Mitchell JD, Shah S, Uribe-Marquez S. Virtual Reality and Augmented Reality in Anesthesiology Education. Int Anesthesiol Clin 2024; 62:64-70. [PMID: 38798152 DOI: 10.1097/aia.0000000000000445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Affiliation(s)
- Jayakar Guruswamy
- Department of Anesthesiology, Pain Management, and Perioperative Medicine, Henry Ford Health, Michigan State University, Detroit, Michigan
| | | | | | | | | |
Collapse
|
3
|
Tang Y, Liang H, Zhan J. The application of metaverse in occupational health. Front Public Health 2024; 12:1396878. [PMID: 38665240 PMCID: PMC11043589 DOI: 10.3389/fpubh.2024.1396878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Accepted: 04/02/2024] [Indexed: 04/28/2024] Open
Abstract
Background The metaverse, as a new digital interactive platform, is garnering significant attention and exploration across industries due to technological advancements and societal digital transformation. In occupational health, there is immense potential for leveraging the metaverse to enhance work environments and occupational health management. It offers companies more efficient and intelligent solutions for occupational health management while providing employees with safer and more comfortable work environments. Methods A comprehensive literature search was conducted using PubMed, Web of Science, IEEE Xplore, and Google Scholar databases to identify relevant studies published between January 2015 and March 2024. The search terms included "metaverse," "virtual reality," "occupational health," "workplace safety," "job training," and "telemedicine." The selected articles were analyzed, and key findings were summarized narratively. Results The review summarizes the broad application prospects of metaverse technology in immersive training, occupational risk identification and assessment, and occupational disease monitoring and diagnosis. However, applying the metaverse in occupational health also faces challenges such as inadequate technical standards, data privacy issues, human health hazards, high costs, personnel training, and lagging regulations. Conclusion Metaverse offers new possibilities for addressing the numerous challenges faced in occupational health and has broad application prospects. In the future, collaborative efforts from multiple stakeholders will be necessary to promote the sustainable development of metaverse technology in occupational health and better protect workers' occupational health.
Collapse
Affiliation(s)
| | | | - Jingming Zhan
- Division of Radiology and Environmental Medicine, China Institute for Radiation Protection, Taiyuan, China
| |
Collapse
|
4
|
Ryason A, Xia Z, Jackson C, Wong VT, Li H, De S, Jones SB. Validation of a Virtual Simulator With Haptic Feedback for Endotracheal Intubation Training. Simul Healthc 2024; 19:122-130. [PMID: 36598824 PMCID: PMC10314962 DOI: 10.1097/sih.0000000000000708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
INTRODUCTION Endotracheal intubation (ETI) is a procedure that varies in difficulty because of patient characteristics and clinical conditions. Existing physical simulators do not encompass these variations. The Virtual Airway Skills Trainer for Endotracheal Intubation (VAST-ETI) was developed to provide different patient characteristics and high-fidelity haptic feedback to improve training. METHODS We demonstrate the effectiveness of VAST-ETI as a training and evaluation tool for ETI. Construct validation was evaluated by scoring the performance of experts ( N = 15) and novices ( N = 15) on the simulator to ensure its ability to distinguish technical proficiency. Convergent and predictive validity were evaluated by performing a learning curve study, in which a group of novices ( N = 7) were trained for 2 weeks using VAST-ETI and then compared with a control group ( N = 9). RESULTS The VAST-ETI was able to distinguish between expert and novice based on mean simulator scores ( t [88] = -6.61, P < 0.0005). When used during repeated practice, individuals demonstrated a significant increase in their score on VAST-ETI over the learning period ( F [11,220] = 7206, P < 0.001); however when compared with a control group, there was not a significant interaction effect on the simulator score. There was a significant difference between the simulator-trained and control groups ( t [12.85] = -2.258, P = 0.042) when tested in the operating room. CONCLUSIONS Our results demonstrate the effectiveness of virtual simulation with haptic feedback for assessing performance and training of ETI. The simulator was not able to differentiate performance between more experienced trainees and experts because of limits in simulator difficulty.
Collapse
Affiliation(s)
- Adam Ryason
- From the Rensselaer Polytechnic Institute (A.R., H.L., S.D.), Troy, NY; Huazhong University of Science and Technology (Z.X.), Wuhan, People's Republic of China; Beth Israel Deaconess Medical Center (C.J., V.T.W.), Boston, MA; and Albany Medical College (S.B.J.), Albany, NY
| | | | | | | | | | | | | |
Collapse
|
5
|
Bekbolatova M, Mayer J, Ong CW, Toma M. Transformative Potential of AI in Healthcare: Definitions, Applications, and Navigating the Ethical Landscape and Public Perspectives. Healthcare (Basel) 2024; 12:125. [PMID: 38255014 PMCID: PMC10815906 DOI: 10.3390/healthcare12020125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 12/27/2023] [Accepted: 01/02/2024] [Indexed: 01/24/2024] Open
Abstract
Artificial intelligence (AI) has emerged as a crucial tool in healthcare with the primary aim of improving patient outcomes and optimizing healthcare delivery. By harnessing machine learning algorithms, natural language processing, and computer vision, AI enables the analysis of complex medical data. The integration of AI into healthcare systems aims to support clinicians, personalize patient care, and enhance population health, all while addressing the challenges posed by rising costs and limited resources. As a subdivision of computer science, AI focuses on the development of advanced algorithms capable of performing complex tasks that were once reliant on human intelligence. The ultimate goal is to achieve human-level performance with improved efficiency and accuracy in problem-solving and task execution, thereby reducing the need for human intervention. Various industries, including engineering, media/entertainment, finance, and education, have already reaped significant benefits by incorporating AI systems into their operations. Notably, the healthcare sector has witnessed rapid growth in the utilization of AI technology. Nevertheless, there remains untapped potential for AI to truly revolutionize the industry. It is important to note that despite concerns about job displacement, AI in healthcare should not be viewed as a threat to human workers. Instead, AI systems are designed to augment and support healthcare professionals, freeing up their time to focus on more complex and critical tasks. By automating routine and repetitive tasks, AI can alleviate the burden on healthcare professionals, allowing them to dedicate more attention to patient care and meaningful interactions. However, legal and ethical challenges must be addressed when embracing AI technology in medicine, alongside comprehensive public education to ensure widespread acceptance.
Collapse
Affiliation(s)
- Molly Bekbolatova
- Department of Osteopathic Manipulative Medicine, College of Osteopathic Medicine, New York Institute of Technology, Old Westbury, NY 11568, USA; (M.B.); (J.M.)
| | - Jonathan Mayer
- Department of Osteopathic Manipulative Medicine, College of Osteopathic Medicine, New York Institute of Technology, Old Westbury, NY 11568, USA; (M.B.); (J.M.)
| | - Chi Wei Ong
- School of Chemistry, Chemical Engineering, and Biotechnology, Nanyang Technological University, 62 Nanyang Drive, Singapore 637459, Singapore
| | - Milan Toma
- Department of Osteopathic Manipulative Medicine, College of Osteopathic Medicine, New York Institute of Technology, Old Westbury, NY 11568, USA; (M.B.); (J.M.)
| |
Collapse
|
6
|
Yi WS, Rouhi AD, Duffy CC, Ghanem YK, Williams NN, Dumon KR. A Systematic Review of Immersive Virtual Reality for Nontechnical Skills Training in Surgery. JOURNAL OF SURGICAL EDUCATION 2024; 81:25-36. [PMID: 38036388 DOI: 10.1016/j.jsurg.2023.11.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 11/01/2023] [Accepted: 11/05/2023] [Indexed: 12/02/2023]
Abstract
OBJECTIVE Immersive virtual reality (IVR) can be utilized to provide low cost and easily accessible simulation on all aspects of surgical education. In addition to technical skills training in surgery, IVR simulation has been utilized for nontechnical skills training in domains such as clinical decision-making and pre-operative planning. This systematic review examines the current literature on the effectiveness of IVR for nontechnical skill acquisition in surgical education. DESIGN A literature search was performed using MEDLINE, EMBASE, and Web of Science for primary studies published between January 1, 1995 and February 9, 2022. Four reviewers screened titles, abstracts, full texts, extracted data, and analyzed included studies to answer 5 key questions: How is IVR being utilized in nontechnical skills surgical education? What is the methodological quality of studies? What technologies are being utilized? What metrics are reported? What are the findings of these studies? RESULTS The literature search yielded 2340 citations, with 12 articles included for qualitative synthesis. Of included articles, 33% focused on clinical decision-making and 67% on anatomy/pre-operative planning. Motion sickness was a recorded metric in 25% of studies, with an aggregate incidence of 13% (11/87). An application score was reported in 33% and time to completion in 16.7%. A commercially developed application was utilized in 25%, while 75% employed a noncommercial application. The Oculus Rift was used in 41.7% of studies, HTC Vive in 25%, Samsung Gear in 16.7% of studies, Google Daydream in 8%, and 1 study did not report. The mean Medical Education Research Quality Instrument (MERSQI) score was 10.3 ± 2.3 (out of 18). In all studies researching clinical decision-making, participants preferred IVR to conventional teaching methods and in a nonrandomized control study it was found to be more effective. Averaged across all studies, mean scores were 4.33 for enjoyment, 4.16 for utility, 4.11 for usability, and 3.73 for immersion on a 5-point Likert scale. CONCLUSIONS The IVR nontechnical skills applications for surgical education are designed for clinical decision-making or anatomy/pre-operative planning. These applications are primarily noncommercially produced and rely upon a diverse array of HMDs for content delivery, suggesting that development is primarily coming from within academia and still without clarity on optimal utilization of the technology. Excitingly, users find these applications to be immersive, enjoyable, usable, and of utility in learning. Although a few studies suggest that IVR is additive or superior to conventional teaching or imaging methods, the data is mixed and derived from studies with weak design. Motion sickness with IVR remains a complication of IVR use needing further study to determine the cause and means of mitigation.
Collapse
Affiliation(s)
- William S Yi
- Department of Surgery, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Department of Surgical Education, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Penn Medicine Clinical Simulation Center, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Armaun D Rouhi
- Department of Surgery, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Caoimhe C Duffy
- Department of Anesthesiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Yazid K Ghanem
- Department of Surgery, Cooper University Hospital, Camden, New Jersey
| | - Noel N Williams
- Department of Surgery, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Department of Surgical Education, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Penn Medicine Clinical Simulation Center, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Kristoffel R Dumon
- Department of Surgery, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Department of Surgical Education, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Penn Medicine Clinical Simulation Center, University of Pennsylvania, Philadelphia, Pennsylvania.
| |
Collapse
|
7
|
Abbas JR, Chu MMH, Jeyarajah C, Isba R, Payton A, McGrath B, Tolley N, Bruce I. Virtual reality in simulation-based emergency skills training: A systematic review with a narrative synthesis. Resusc Plus 2023; 16:100484. [PMID: 37920857 PMCID: PMC10618508 DOI: 10.1016/j.resplu.2023.100484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 09/22/2023] [Accepted: 09/25/2023] [Indexed: 11/04/2023] Open
Abstract
Objective An important role is predicted for virtual reality (VR) in the future of medical education. We performed a systematic review of the literature with a narrative synthesis, to examine the current evidence for VR in simulation-based emergency skills training. We broadly define emergency skills as any clinical skill used in the emergency care of patients across all clinical settings. Methods This systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines. The data sources accessed during this study included: PubMed, CINAHL, EMBASE, AMED, EMCARE, HMIC, BNI, PsychINFO, Medline, CENTRAL, SCOPUS, Web of Science, BIOSIS Citation Index, ERIC, ACM Digital Library, IEEE Xplore, and ProQuest Dissertations and Thesis Global. Cochrane's Rob 2 and ROBVIS tools were used during study quality assessment. No ethical review was required for this work. Results Thirty-four articles published between 14th March 1998 and 1st March 2022 were included in this review. Studies were predominantly conducted in the USA and Europe and focussed on a variety of healthcare disciplines including medical, nursing, and allied health. VR education was delivered using head-mounted displays, Cave Automatic Virtual Environment systems, and bespoke setups. These systems delivered education in a variety of areas (emergency medicine, equipment training, obstetrics, and basic/advanced life support). Subjective potential advantages of this technology included realism, replayability, and time-effectiveness. Reports of adverse events were low in frequency across the included studies. Whilst clear educational benefit was generally noted, this was not reflected in changes to patient-based outcomes. Conclusion There may be educational benefit to using VR in the context of simulation-based emergency skills training including knowledge gain and retention, skill performance, acceptability, usability, and validity. Currently, there is insufficient evidence to demonstrate clear cost-effectiveness, or direct improvement of patient or institutional outcomes, at this stage.
Collapse
Affiliation(s)
- Jonathan R Abbas
- The University of Manchester, Oxford Road, Manchester M13 9PL, United Kingdom
- Manchester University NHS Foundation Trust, Oxford Road, Manchester M13 9WL, United Kingdom
| | - Michael M H Chu
- Manchester University NHS Foundation Trust, Oxford Road, Manchester M13 9WL, United Kingdom
| | - Ceyon Jeyarajah
- Manchester University NHS Foundation Trust, Oxford Road, Manchester M13 9WL, United Kingdom
| | - Rachel Isba
- Manchester University NHS Foundation Trust, Oxford Road, Manchester M13 9WL, United Kingdom
- Lancaster Medical School, Lancaster University, Lancaster LA1 4YW, United Kingdom
- Alder Hey Children's NHS Foundation Trust, Eaton Road Liverpool, L12 2AP, United Kingdom
| | - Antony Payton
- The University of Manchester, Oxford Road, Manchester M13 9PL, United Kingdom
- VREvo Ltd, The University of Manchester Core Technology Facility, 46 Grafton Street, Manchester, M13 9NT
| | - Brendan McGrath
- Manchester University NHS Foundation Trust, Oxford Road, Manchester M13 9WL, United Kingdom
- Manchester Academic Critical Care, Division of Infection, Immunity and Respiratory Medicine, School of Biological Sciences, Faculty of Biology Medicine and Health, University of Manchester, Manchester Academic Health Sciences Centre, Manchester, United Kingdom
| | - Neil Tolley
- Imperial College Healthcare NHS Trust, The Bays, South Wharf Road, St Mary's Hospital, London W2 1NY, United Kingdom
| | - Iain Bruce
- The University of Manchester, Oxford Road, Manchester M13 9PL, United Kingdom
- Manchester University NHS Foundation Trust, Oxford Road, Manchester M13 9WL, United Kingdom
| |
Collapse
|
8
|
Pasick LJ, Tong JY, Benito DA, Sargi Z, Anis MM. Airway fires in otolaryngologic surgery: A database review. Am J Otolaryngol 2023; 44:104003. [PMID: 37478536 DOI: 10.1016/j.amjoto.2023.104003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 07/10/2023] [Indexed: 07/23/2023]
Abstract
PURPOSE An estimated 34 % of reported operating room fires involve the airway. Despite the inherent risks in otolaryngologic surgery, education regarding prevention and management of airway fires is limited in graduate medical training. One contributing factor is a lack of reporting of such rare events in our literature. METHODS The U.S. Food and Drug Administration's Manufacturer and User Facility Device Experience database was queried for reports of adverse events related to fires occurring during surgical procedures of the airway from January 1, 2010, to March 31, 2020. RESULTS 3687 reports were identified and 49 unique reports of airway fire were included. Sustained fires were described in 16 (32.7 %) reports and 33 (67.3 %) described transient flares. 2 fires extended beyond the airway and 9 (18.4 %) were noted to have occurred at the start of the case. Fires were reported most commonly during tonsillectomy (n = 22 [44.9 %]), vocal fold excision (n = 5 [10.2 %]), and adenoidectomy (n = 4 [8.2 %]). 46 reports attributed flare initiation to a specific element of the fire triangle. 16 patient and 2 operator injuries were reported. Saline washing was utilized in 7 (14.3 %) cases overall. Patients were extubated immediately in 2 (12.5 %) of the 16 reports of sustained fires. 0 mortalities were reported. CONCLUSION Airway fires were reported in a variety of upper airway procedures performed regularly by otolaryngologists. The triggering factor that led to fire was identified as a spark or char in about half of the reported cases, and only 2 reports described immediate removal of the endotracheal tube.
Collapse
Affiliation(s)
- Luke J Pasick
- Department of Otolaryngology-Head and Neck Surgery, University of Miami Miller School of Medicine, Miami, FL, USA.
| | - Jane Y Tong
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Maryland School of Medicine. Baltimore, MD, USA
| | - Daniel A Benito
- Department of Otolaryngology-Head and Neck Surgery, Cleveland Clinic Florida, Stuart, FL, USA
| | - Zoukaa Sargi
- Department of Otolaryngology-Head and Neck Surgery, University of Miami Miller School of Medicine, Miami, FL, USA
| | - Mursalin M Anis
- Department of Otolaryngology-Head and Neck Surgery, University of Miami Miller School of Medicine, Miami, FL, USA
| |
Collapse
|
9
|
De S, Jackson CD, Jones DB. Intelligent Virtual Operating Room for Enhancing Nontechnical Skills. JAMA Surg 2023; 158:662-663. [PMID: 36920404 PMCID: PMC10753974 DOI: 10.1001/jamasurg.2022.6721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/16/2023]
Abstract
This article discusses an intelligent immersive virtual operating room to enable teams to train in a distributed fashion wearing head-mounted displays.
Collapse
Affiliation(s)
- Suvranu De
- FAMU-FSU College of Engineering, Tallahassee, Florida
| | - Cullen D Jackson
- Department of Anesthesia, Critical Care and Pain Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | - Daniel B Jones
- Department of Surgery, Rutgers New Jersey Medical School, Newark
| |
Collapse
|
10
|
Abstract
SUMMARY STATEMENT Simulation-based training using virtual reality head-mounted displays (VR-HMD) is increasingly being used within the field of medical education. This article systematically reviews and appraises the quality of the literature on the use of VR-HMDs in medical education. A search in the databases PubMed/MEDLINE, Embase, ERIC, Scopus, Web of Science, Cochrane Library, and PsychINFO was carried out. Studies were screened according to predefined exclusion criteria, and quality was assessed using the Medical Education Research Study Quality Instrument. In total, 41 articles were included and thematically divided into 5 groups: anatomy, procedural skills, surgical procedures, communication skills, and clinical decision making. Participants highly appreciated using VR-HMD and rated it better than most other training methods. Virtual reality head-mounted display outperformed traditional methods of learning surgical procedures. Although VR-HMD showed promising results when learning anatomy, it was not considered better than other available study materials. No conclusive findings could be synthesized regarding the remaining 3 groups.
Collapse
|
11
|
Truong H, Qi D, Ryason A, Sullivan AM, Cudmore J, Alfred S, Jones SB, Parra JM, De S, Jones DB. Does your team know how to respond safely to an operating room fire? Outcomes of a virtual reality, AI-enhanced simulation training. Surg Endosc 2022; 36:3059-3067. [PMID: 34264400 PMCID: PMC10771129 DOI: 10.1007/s00464-021-08602-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2021] [Accepted: 06/06/2021] [Indexed: 01/22/2023]
Abstract
BACKGROUND Operating room (OR) fires are rare but devastating events requiring immediate and effective response. Virtual Reality (VR) simulation training can provide a safe environment for practice of skills in such highly stressful situation. This study assessed interprofessional participants' ability to respond to VR-simulated OR fire scenarios, attitudes, numbers of attempt of the VR simulation do participants need to successfully respond to OR fires and does prior experience, confidence level, or professional role predict the number of attempts needed to demonstrate safety and pass the simulation. METHODS 180 surgical team members volunteered to participate in this study at Beth Israel Deaconess Medical Center, Boston, MA. Each participant completed five VR OR simulation trials; the final two trials incorporated AI assistance. Primary outcomes were performance scores, number of attempts needed to pass, and pre- and post-survey results describing participant confidence and experiences. Differences across professional or training role were assessed using chi-square tests and analyses of variance. Differences in pass rates over time were assessed using repeated measures logistic regression. RESULTS One hundred eighty participants completed simulation testing; 170 (94.4%) completed surveys. Participants included surgeons (17.2%), anesthesiologists (10.0%), allied health professionals (41.7%), and medical trainees (31.1%). Prior to training, 45.4% of participants reported feeling moderately or very confident in their ability to respond to an OR fire. Eight participants (4.4%) responded safely on the first simulation attempt. Forty-three participants (23.9%) passed by the third attempt (VR only); an additional 97 participants (53.9%) passed within the 4-5th attempt (VR with AI assistance). CONCLUSIONS Providers are unprepared to respond to OR fires. VR-based simulation training provides a practical platform for individuals to improve their knowledge and performance in the management of OR fires with a 79% pass rate in our study. A VR AI approach to teaching this essential skill is innovative, feasible, and effective.
Collapse
Affiliation(s)
- Hung Truong
- Department of Surgery, Beth Israel Deaconess Medical Center, Harvard School of Medicine, 330 Brookline Ave, Shapiro Clinical Center 3rd Floor, Boston, MA, 02215, USA
| | - Di Qi
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Adam Ryason
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Amy M Sullivan
- Beth Israel Deaconess Medical Center, Carl J. Shapiro Institute for Research and Education, Harvard Medical School, Boston, MA, USA
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Jaime Cudmore
- Department of Surgery, Beth Israel Deaconess Medical Center, Harvard School of Medicine, 330 Brookline Ave, Shapiro Clinical Center 3rd Floor, Boston, MA, 02215, USA
| | - Samuel Alfred
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Stephanie B Jones
- Department of Anesthesia and Critical Care, Albany Medical Center, Albany, NY, USA
| | - Jose M Parra
- Beth Israel Deaconess Medical Center, Carl J. Shapiro Institute for Research and Education, Harvard Medical School, Boston, MA, USA
| | - Suvranu De
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Daniel B Jones
- Department of Surgery, Beth Israel Deaconess Medical Center, Harvard School of Medicine, 330 Brookline Ave, Shapiro Clinical Center 3rd Floor, Boston, MA, 02215, USA.
| |
Collapse
|
12
|
Disruptions to shared mental models from poor quality of service in collaborative virtual environments. Sci Rep 2021; 11:23556. [PMID: 34876607 PMCID: PMC8651719 DOI: 10.1038/s41598-021-02567-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Accepted: 11/16/2021] [Indexed: 11/22/2022] Open
Abstract
Collaborative virtual environments are being used in various applications ranging from online games to complex team training scenarios. The key to the success of such environments is the ability of the participants to form a shared mental model of the collaborative task being performed. Poor quality of service can deteriorate user performance and quality of experience, leading to a disruption of this mental model. While the effects of quality of service have been analyzed for traditional desktop environments, these effects remain unclear in collaborative virtual environments during user-to-user interactions. Here, we analyze the role of latency and packet bursts, two common problems in collaborative applications, on both simulator perception and actual task performance in a collaborative fire-fighting simulator. This exploratory study indicates that large latencies have a significant (p < 0.05) impact on the quality of experience, but not task performance. In contrast, packet bursts have a much larger impact on both the quality of experience and performance. Additionally, the network role, such as whether a user is a client or server, showed a significant (p < 0.05) impact on task performance in conditions impaired by packet bursts.
Collapse
|
13
|
Truong H, Sullivan AM, Abu-Nuwar MR, Therrien S, Jones SB, Pawlowski J, Parra JM, Jones DB. Operating room team training using simulation: Hope or hype? Am J Surg 2021; 222:1146-1153. [PMID: 33933207 DOI: 10.1016/j.amjsurg.2021.01.044] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 01/20/2021] [Accepted: 01/31/2021] [Indexed: 10/22/2022]
Abstract
BACKGROUND This study sought to determine the long-term impact of multidisciplinary simulated operating room (OR) team training. METHOD Two-wave survey study (immediate post-training survey 2010-2017, follow-up 2018). Differences across time, specialty, and experience with adverse events were assessed using chi-square and t -tests. RESULTS Immediately after training, more than 90% of respondents found simulation scenarios realistic and reported team training would provide safer patient care. However, follow-up participants reported less enthusiasm toward training, with 58% stating they would like to take similar training again. A majority of participants (77%) experienced adverse events after training; those reporting adverse events reported more positive long-term evaluations. CONCLUSIONS Simulated OR team training is initially highly valued by participants and is perceived as contributing to patient safety. Diminution of participant enthusiasm over time suggests that repeat training requirements be reconsidered, and less costly, alternative methods (such as asynchronous learning or virtual reality) should be explored.
Collapse
Affiliation(s)
- Hung Truong
- Beth Israel Deaconess Medical Center Division of Bariatric and Minimally Invasive Surgery, United States.
| | - Amy M Sullivan
- Carl J. Shapiro Institute for Research and Education, Beth Israel Deaconess Medical Center, United States; Beth Israel Deaconess Medical Center Department of Medicine, United States.
| | - Mohamad Rassoul Abu-Nuwar
- Beth Israel Deaconess Medical Center Division of Bariatric and Minimally Invasive Surgery, United States.
| | - Stephanie Therrien
- Beth Israel Deaconess Medical Center Division of Bariatric and Minimally Invasive Surgery, United States.
| | | | - John Pawlowski
- Beth Israel Deaconess Medical Center Department of Anesthesia, Critical Care and Pain Medicine, United States.
| | - Jose M Parra
- Carl J. Shapiro Institute for Research and Education, Beth Israel Deaconess Medical Center, United States.
| | - Daniel B Jones
- Beth Israel Deaconess Medical Center Division of Bariatric and Minimally Invasive Surgery, United States.
| |
Collapse
|