1
|
Munawar A, Li Z, Nagururu N, Trakimas D, Kazanzides P, Taylor RH, Creighton FX. Fully immersive virtual reality for skull-base surgery: surgical training and beyond. Int J Comput Assist Radiol Surg 2024; 19:51-59. [PMID: 37347346 PMCID: PMC11163985 DOI: 10.1007/s11548-023-02956-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 05/08/2023] [Indexed: 06/23/2023]
Abstract
PURPOSE A virtual reality (VR) system, where surgeons can practice procedures on virtual anatomies, is a scalable and cost-effective alternative to cadaveric training. The fully digitized virtual surgeries can also be used to assess the surgeon's skills using measurements that are otherwise hard to collect in reality. Thus, we present the Fully Immersive Virtual Reality System (FIVRS) for skull-base surgery, which combines surgical simulation software with a high-fidelity hardware setup. METHODS FIVRS allows surgeons to follow normal clinical workflows inside the VR environment. FIVRS uses advanced rendering designs and drilling algorithms for realistic bone ablation. A head-mounted display with ergonomics similar to that of surgical microscopes is used to improve immersiveness. Extensive multi-modal data are recorded for post-analysis, including eye gaze, motion, force, and video of the surgery. A user-friendly interface is also designed to ease the learning curve of using FIVRS. RESULTS We present results from a user study involving surgeons with various levels of expertise. The preliminary data recorded by FIVRS differentiate between participants with different levels of expertise, promising future research on automatic skill assessment. Furthermore, informal feedback from the study participants about the system's intuitiveness and immersiveness was positive. CONCLUSION We present FIVRS, a fully immersive VR system for skull-base surgery. FIVRS features a realistic software simulation coupled with modern hardware for improved realism. The system is completely open source and provides feature-rich data in an industry-standard format.
Collapse
Affiliation(s)
- Adnan Munawar
- Johns Hopkins University, Baltimore, MD, 21218, USA.
| | - Zhaoshuo Li
- Johns Hopkins University, Baltimore, MD, 21218, USA
| | | | | | | | | | | |
Collapse
|
2
|
Zagury-Orly I, Solinski MA, Nguyen LH, Young M, Drozdowski V, Bain PA, Gantwerker EA. What is the Current State of Extended Reality Use in Otolaryngology Training? A Scoping Review. Laryngoscope 2023; 133:227-234. [PMID: 35548939 DOI: 10.1002/lary.30174] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 04/26/2022] [Accepted: 04/29/2022] [Indexed: 01/19/2023]
Abstract
OBJECTIVE To map current literature on the educational use of extended reality (XR) in Otolaryngology-Head and Neck Surgery (OHNS) to inform teaching and research. STUDY DESIGN Scoping Review. METHODS A scoping review was conducted, identifying literature through MEDLINE, Ovid Embase, and Web of Science databases. Findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping review checklist. Studies were included if they involved OHNS trainees or medical students who used XR for an educational purpose in OHNS. XR was defined as: fully-immersive virtual reality (VR) using head-mounted displays (HMDs), non-immersive and semi-immersive VR, augmented reality (AR), or mixed reality (MR). Data on device use were extracted, and educational outcomes were analyzed according to Kirkpatrick's evaluation framework. RESULTS Of the 1,434 unique abstracts identified, 40 articles were included. All articles reported on VR; none discussed AR or MR. Twenty-nine articles were categorized as semi-immersive, none used occlusive HMDs therefore, none met modern definitions of immersive VR. Most studies (29 of 40) targeted temporal bone surgery. Using the Kirkpatrick four-level evaluation model, all studies were limited to level-1 (learner reaction) or level-2 (knowledge or skill performance). CONCLUSIONS Current educational applications of XR in OHNS are limited to VR, do not fully immerse participants and do not assess higher-level learning outcomes. The educational OHNS community would benefit from a shared definition for VR technology, assessment of skills transfer (level-3 and higher), and deliberate testing of AR, MR, and procedures beyond temporal bone surgery. Laryngoscope, 133:227-234, 2023.
Collapse
Affiliation(s)
- Ivry Zagury-Orly
- Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada
| | - Mark A Solinski
- Loyola University Chicago Stritch School of Medicine, Maywood, Illinois, USA
| | - Lily Hp Nguyen
- Department of Otolaryngology-Head and Neck Surgery, McGill University, Montreal, Quebec, Canada.,Institute of Health Sciences Education, Faculty of Medicine, McGill University, Montreal, Quebec, Canada
| | - Meredith Young
- Institute of Health Sciences Education, Faculty of Medicine, McGill University, Montreal, Quebec, Canada.,Department of Medicine, Faculty of Medicine, McGill University, Montreal, Quebec, Canada
| | - Veronica Drozdowski
- Loyola University Chicago Stritch School of Medicine, Maywood, Illinois, USA
| | - Paul A Bain
- Countway Library of Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Eric A Gantwerker
- Department of Otolaryngology-Head and Neck Surgery, Zucker School of Medicine at Hofstra/Northwell, Hempstead, New York, USA
| |
Collapse
|
3
|
Nigam A, Mohanty RR, Kellam JF, Ambrose CG, Krishnamurthy VR, Tai BL. An objective assessment for bone drilling: A pilot study on vertical drilling. J Orthop Res 2023; 41:378-385. [PMID: 35578977 DOI: 10.1002/jor.25377] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 04/13/2022] [Accepted: 05/14/2022] [Indexed: 02/04/2023]
Abstract
The purpose of this study is to propose a quantitative assessment scheme to help with surgical bone drilling training. This pilot study gathered and compared motion and force data from expert surgeons (n = 3) and novice residents (n = 6). The experiment used three-dimensional printed bone simulants of young bone (YB) and osteoporotic bone (OB), and drilling overshoot, time, and force were measured. There was no statistically significant difference in overshoot between the two groups (p = 0.217 for YB and 0.215 for OB). The results, however, show that the experts took less time (mean = 4.01 s) than the novices (mean = 9.98 s), with a statistical difference (p = 0.003 for YB and 0.0001 for OB). In addition, the expert group performed more consistently than the novices. The force analysis further revealed that experts used a higher force to drill the first cortical section and a noticeably lower force in the second cortex to control the overshoot (approximate reduction of 5.5 N). Finally, when drilling time and overshoot distance were combined, the motion data distinguished the skill gap between expert and novice drilling; the force data provided insight into the drilling mechanism and performance outcomes. This study lays the groundwork for a data-driven training scheme to prepare novice residents for clinical practice.
Collapse
Affiliation(s)
- Aman Nigam
- Department of Mechanical Engineering, Texas A&M University, College Station, Texas, USA
| | - Ronak R Mohanty
- Department of Mechanical Engineering, Texas A&M University, College Station, Texas, USA
| | - James F Kellam
- Department of Orthopaedic Surgery, University of Texas Health Science Center at Houston (UTHealth), Houston, Texas, USA
| | - Catherine G Ambrose
- Department of Orthopaedic Surgery, University of Texas Health Science Center at Houston (UTHealth), Houston, Texas, USA
| | | | - Bruce L Tai
- Department of Mechanical Engineering, Texas A&M University, College Station, Texas, USA
| |
Collapse
|
4
|
James Talks B, Lamtara J, Wijewickrema S, Collins A, Gerard JM, Macleold Mitchell-Innes A, O’Leary S, O’Leary S. Developing an Evidence-Based Surgical Curriculum: Learning from a Randomized Controlled Trial of Surgical Rehearsal in Virtual Reality. J Int Adv Otol 2023; 19:16-21. [PMID: 36718031 PMCID: PMC9984964 DOI: 10.5152/iao.2023.22851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Surgical rehearsal - patient-specific preoperative surgical practice - can be provided by virtual reality simulation. This study investigated the effect of surgical rehearsal on cortical mastoidectomy performance and procedure duration. METHODS University students (n=40) were randomized evenly into a rehearsal and control group. After watching a video tutorial on cortical mastoidectomy, participants completed the procedure on a virtual reality simulator as a pre-test. Participants completed a further 8 cortical mastoidectomies on the virtual reality simulator as training before drilling two 3-dimensional (3D) printed temporal bones. The rehearsal group received 3D printed bones they had previously operated on in virtual reality, while the control group received 2 new bones. Cortical mastoidectomy was assessed by 3 blinded graders using the Melbourne Mastoidectomy Scale. RESULTS There was high interrater reliability between the 3 graders (intraclass correlation coefficient, r=0.8533, P < .0001). There was no difference in the mean surgical performance on the two 3D printed bones between the control and rehearsal groups (P=.2791). There was no significant difference in the mean procedure duration between the control and rehearsal groups for both 3D printed bones (P=.8709). However, there was a significant decrease in procedure duration between the first and second 3D printed bones (P < .0001). CONCLUSION In this study, patient-specific virtual reality rehearsal provided no additional advantage to cortical mastoidectomy performance by novice operators compared to generic practice on a virtual reality simulator. Further, virtual reality training did not improve cortical mastoidectomy performance on 3D printed bones, highlighting the impact of anatomical diversity and changing operating modalities on the acquisition of new surgical skills.
Collapse
Affiliation(s)
- Benjamin James Talks
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia,Corresponding author: Benjamin James Talks, e-mail:
| | - Jesslyn Lamtara
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia
| | - Sudanthi Wijewickrema
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia
| | - Aaron Collins
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia
| | - Jean-Marc Gerard
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia
| | - Alistair Macleold Mitchell-Innes
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia,Department of Otolaryngology, Taunton and Somerset NHS Foundation Trust, Somerset, United Kingdom
| | - Stephen O’Leary
- Department of Surgery (Otolaryngology), University of Melbourne, Royal Victorian Eye and Ear Hospital, Victoria Australia
| | | | | | | | | | | | | | | | | |
Collapse
|
5
|
Kaliaperumal C. Predicting the Position of the Internal Landmarks of Middle Cranial Fossa Using the Zygomatic Root: An Attempt to Simplify Its Complexity. INDIAN JOURNAL OF NEUROSURGERY 2022. [DOI: 10.1055/s-0042-1750297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022] Open
|
6
|
Hochman JB, Pisa J, Singh S, Gousseau M, Unger B. Comparison of Summative Temporal Bone Dissection Scales Demonstrate Equivalence. Int Arch Otorhinolaryngol 2022; 26:e556-e560. [PMID: 36405459 PMCID: PMC9668416 DOI: 10.1055/s-0041-1740162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 09/11/2021] [Indexed: 11/24/2022] Open
Abstract
Introduction
Temporal bone surgery is a unique and complicated surgical skill that requires extensive training. There is an educational requirement to maximize trainee experience and provide effective feedback.
Objective
We evaluate three temporal bone dissection scales for efficacy, reliability, and accuracy in identifying resident skill during temporal bone surgery.
Methods
Residents of various skill levels performed a mastoidectomy with posterior tympanotomy on identic 3D-printed temporal bone models. Four blinded otologic surgeons evaluated each specimen at two separate intervals using three separate dissection scales: the Welling Scale (WS), the Iowa Temporal Bone Assessment Tool (ITBAT), and the CanadaWest Scale (CWS). Scores from each scale were compared in their ability to accurately separate residents by skill level, inter- and intrarater reliability, and efficiency in application.
Results
Nineteen residents from 9 postgraduate programs participated. Assessment was clustered into junior (postgraduate year or PGY 1, 2), intermediate (PGY 3) and senior resident (PGY 4, 5) cohorts. Analysis of variance (ANOVA) found significant differences between cohort performance (
p
< 0.05) for all 3 scales considering the PGY level and the subjective account of temporal bone surgical experience. The inter-rater reliability was consistent across each scale. The intrarater reliability was comparable between the CWS (0.711) and the WS (0.713), but not the ITBAT (0.289). Time (in seconds) to complete scoring for each scale was also comparable between the CWS (42.7 ± 16.8), the WS (76.6 ± 14.5), and the ITBAT (105.6 ± 38.9).
Conclusion
All three scales demonstrated construct validity and consistency in performance, and consideration should be given to judicious use in training.
Collapse
Affiliation(s)
- Jordan B. Hochman
- Division of Neurotologic Surgery, Department of Otolaryngology Head and Neck Surgery, Faculty of Health Sciences, University of Manitoba, Manitoba, Canada
| | - Justyn Pisa
- Department of Otolaryngology Head and Neck Surgery, Health Sciences Centre, Winnipeg, Manitoba, Canada
| | - Shubhi Singh
- Department of Otolaryngology Head and Neck Surgery, Health Sciences Centre, Winnipeg, Manitoba, Canada
| | - Michael Gousseau
- Department of General Otolaryngology, Dr. Michael Gousseau Medical Corporation, Portage La Prairie, Manitoba, Canada
| | - Bert Unger
- Division of Neurotologic Surgery, Department of Otolaryngology Head and Neck Surgery, Faculty of Health Sciences, University of Manitoba, Manitoba, Canada
- Laboratory for Surgical Modeling, Simulation and Robotics, University of Manitoba, Manitoba, Canada
| |
Collapse
|
7
|
Davids J, Manivannan S, Darzi A, Giannarou S, Ashrafian H, Marcus HJ. Simulation for skills training in neurosurgery: a systematic review, meta-analysis, and analysis of progressive scholarly acceptance. Neurosurg Rev 2021; 44:1853-1867. [PMID: 32944808 PMCID: PMC8338820 DOI: 10.1007/s10143-020-01378-0] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 07/17/2020] [Accepted: 08/21/2020] [Indexed: 02/07/2023]
Abstract
At a time of significant global unrest and uncertainty surrounding how the delivery of clinical training will unfold over the coming years, we offer a systematic review, meta-analysis, and bibliometric analysis of global studies showing the crucial role simulation will play in training. Our aim was to determine the types of simulators in use, their effectiveness in improving clinical skills, and whether we have reached a point of global acceptance. A PRISMA-guided global systematic review of the neurosurgical simulators available, a meta-analysis of their effectiveness, and an extended analysis of their progressive scholarly acceptance on studies meeting our inclusion criteria of simulation in neurosurgical education were performed. Improvement in procedural knowledge and technical skills was evaluated. Of the identified 7405 studies, 56 studies met the inclusion criteria, collectively reporting 50 simulator types ranging from cadaveric, low-fidelity, and part-task to virtual reality (VR) simulators. In all, 32 studies were included in the meta-analysis, including 7 randomised controlled trials. A random effects, ratio of means effects measure quantified statistically significant improvement in procedural knowledge by 50.2% (ES 0.502; CI 0.355; 0.649, p < 0.001), technical skill including accuracy by 32.5% (ES 0.325; CI - 0.482; - 0.167, p < 0.001), and speed by 25% (ES - 0.25, CI - 0.399; - 0.107, p < 0.001). The initial number of VR studies (n = 91) was approximately double the number of refining studies (n = 45) indicating it is yet to reach progressive scholarly acceptance. There is strong evidence for a beneficial impact of adopting simulation in the improvement of procedural knowledge and technical skill. We show a growing trend towards the adoption of neurosurgical simulators, although we have not fully gained progressive scholarly acceptance for VR-based simulation technologies in neurosurgical education.
Collapse
Affiliation(s)
- Joseph Davids
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, Holborn, London, WC1N 3BG, UK.
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK.
| | - Susruta Manivannan
- Department of Neurosurgery, Southampton University NHS Trust, Tremona Road, Southampton, SO16 6YD, UK
| | - Ara Darzi
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| | - Stamatia Giannarou
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| | - Hutan Ashrafian
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| | - Hani J Marcus
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, Holborn, London, WC1N 3BG, UK
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| |
Collapse
|
8
|
Andersen SAW, Varadarajan VV, Moberly AC, Hittle B, Powell KA, Wiet GJ. Patient-specific Virtual Temporal Bone Simulation Based on Clinical Cone-beam Computed Tomography. Laryngoscope 2021; 131:1855-1862. [PMID: 33780005 DOI: 10.1002/lary.29542] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 03/18/2021] [Accepted: 03/19/2021] [Indexed: 01/06/2023]
Abstract
OBJECTIVES Patient-specific surgical simulation allows presurgical planning through three-dimensional (3D) visualization and virtual rehearsal. Virtual reality simulation for otologic surgery can be based on high-resolution cone-beam computed tomography (CBCT). This study aimed to evaluate clinicians' experience with patient-specific simulation of mastoid surgery. METHODS Prospective, multi-institutional study. Preoperative temporal bone CBCT scans of patients undergoing cochlear implantation (CI) were retrospectively obtained. Automated processing and segmentation routines were used. Otologic surgeons performed a complete mastoidectomy with facial recess approach on the patient-specific virtual cases in the institution's temporal bone simulator. Participants completed surveys regarding the perceived accuracy and utility of the simulation. RESULTS Twenty-two clinical CBCTs were obtained. Four attending otologic surgeons and 5 otolaryngology trainees enrolled in the study. The mean number of simulations completed by each participant was 16.5 (range 3-22). "Overall experience" and "usefulness for presurgical planning" were rated as "good," "very good," or "excellent" in 84.6% and 71.6% of the simulations, respectively. In 10.7% of simulations, the surgeon reported to have gained a significantly greater understanding of the patient's anatomy compared to standard imaging. Participants were able to better appreciate subtle anatomic findings after using the simulator for 60.4% of cases. Variable CBCT acquisition quality was the most reported limitation. CONCLUSION Patient-specific simulation using preoperative CBCT is feasible and may provide valuable insights prior to otologic surgery. Establishing a CBCT acquisition protocol that allows for consistent segmentation will be essential for reliable surgical simulation. LEVEL OF EVIDENCE 3 Laryngoscope, 131:1855-1862, 2021.
Collapse
Affiliation(s)
- Steven Arild Wuyts Andersen
- Department of Otolaryngology, Nationwide Children's Hospital, Columbus, Ohio, U.S.A.,Department of Otolaryngology-Head and Neck Surgery, The Ohio State University, Columbus, Ohio, U.S.A.,Department of Otorhinolaryngology-Head and Neck Surgery, Rigshospitalet, Copenhagen, Denmark
| | - Varun V Varadarajan
- Department of Otolaryngology, Nationwide Children's Hospital, Columbus, Ohio, U.S.A.,Department of Otolaryngology-Head and Neck Surgery, The Ohio State University, Columbus, Ohio, U.S.A
| | - Aaron C Moberly
- Department of Otolaryngology-Head and Neck Surgery, The Ohio State University, Columbus, Ohio, U.S.A
| | - Bradley Hittle
- Department of Biomedical Informatics, The Ohio State University, Columbus, Ohio, U.S.A
| | - Kimerly A Powell
- Department of Biomedical Informatics, The Ohio State University, Columbus, Ohio, U.S.A
| | - Gregory J Wiet
- Department of Otolaryngology, Nationwide Children's Hospital, Columbus, Ohio, U.S.A.,Department of Otolaryngology-Head and Neck Surgery, The Ohio State University, Columbus, Ohio, U.S.A
| |
Collapse
|
9
|
Virtual Reality and Augmented Reality in Plastic Surgery: A Review. Arch Plast Surg 2017; 44:179-187. [PMID: 28573091 PMCID: PMC5447526 DOI: 10.5999/aps.2017.44.3.179] [Citation(s) in RCA: 109] [Impact Index Per Article: 15.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2017] [Revised: 04/18/2017] [Accepted: 04/21/2017] [Indexed: 11/08/2022] Open
Abstract
Recently, virtual reality (VR) and augmented reality (AR) have received increasing attention, with the development of VR/AR devices such as head-mounted displays, haptic devices, and AR glasses. Medicine is considered to be one of the most effective applications of VR/AR. In this article, we describe a systematic literature review conducted to investigate the state-of-the-art VR/AR technology relevant to plastic surgery. The 35 studies that were ultimately selected were categorized into 3 representative topics: VR/AR-based preoperative planning, navigation, and training. In addition, future trends of VR/AR technology associated with plastic surgery and related fields are discussed.
Collapse
|