1
|
Sharma N, Mallela AN, Khan T, Canton SP, Kass NM, Steuer F, Jardini J, Biehl J, Andrews EG. Evolution of the meta-neurosurgeon: A systematic review of the current technical capabilities, limitations, and applications of augmented reality in neurosurgery. Surg Neurol Int 2024; 15:146. [PMID: 38742013 PMCID: PMC11090549 DOI: 10.25259/sni_167_2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 04/05/2024] [Indexed: 05/16/2024] Open
Abstract
Background Augmented reality (AR) applications in neurosurgery have expanded over the past decade with the introduction of headset-based platforms. Many studies have focused on either preoperative planning to tailor the approach to the patient's anatomy and pathology or intraoperative surgical navigation, primarily realized as AR navigation through microscope oculars. Additional efforts have been made to validate AR in trainee and patient education and to investigate novel surgical approaches. Our objective was to provide a systematic overview of AR in neurosurgery, provide current limitations of this technology, as well as highlight several applications of AR in neurosurgery. Methods We performed a literature search in PubMed/Medline to identify papers that addressed the use of AR in neurosurgery. The authors screened three hundred and seventy-five papers, and 57 papers were selected, analyzed, and included in this systematic review. Results AR has made significant inroads in neurosurgery, particularly in neuronavigation. In spinal neurosurgery, this primarily has been used for pedicle screw placement. AR-based neuronavigation also has significant applications in cranial neurosurgery, including neurovascular, neurosurgical oncology, and skull base neurosurgery. Other potential applications include operating room streamlining, trainee and patient education, and telecommunications. Conclusion AR has already made a significant impact in neurosurgery in the above domains and has the potential to be a paradigm-altering technology. Future development in AR should focus on both validating these applications and extending the role of AR.
Collapse
Affiliation(s)
- Nikhil Sharma
- School of Medicine, University of Pittsburgh, Pittsburgh, United States
| | - Arka N. Mallela
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, United States
| | - Talha Khan
- Department of Computing and Information, University of Pittsburgh, Pittsburgh, United States
| | - Stephen Paul Canton
- Department of Orthopaedic Surgery, University of Pittsburgh Medical Center, Pittsburgh, United States
| | | | - Fritz Steuer
- School of Medicine, University of Pittsburgh, Pittsburgh, United States
| | - Jacquelyn Jardini
- Department of Biology, Haverford College, Haverford, Pennsylvania, United States
| | - Jacob Biehl
- Department of Computing and Information, University of Pittsburgh, Pittsburgh, United States
| | - Edward G. Andrews
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, United States
| |
Collapse
|
2
|
Kos TM, Colombo E, Bartels LW, Robe PA, van Doormaal TPC. Evaluation Metrics for Augmented Reality in Neurosurgical Preoperative Planning, Surgical Navigation, and Surgical Treatment Guidance: A Systematic Review. Oper Neurosurg (Hagerstown) 2023; 26:01787389-990000000-01007. [PMID: 38146941 PMCID: PMC11008635 DOI: 10.1227/ons.0000000000001009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 10/10/2023] [Indexed: 12/27/2023] Open
Abstract
BACKGROUND AND OBJECTIVE Recent years have shown an advancement in the development of augmented reality (AR) technologies for preoperative visualization, surgical navigation, and intraoperative guidance for neurosurgery. However, proving added value for AR in clinical practice is challenging, partly because of a lack of standardized evaluation metrics. We performed a systematic review to provide an overview of the reported evaluation metrics for AR technologies in neurosurgical practice and to establish a foundation for assessment and comparison of such technologies. METHODS PubMed, Embase, and Cochrane were searched systematically for publications on assessment of AR for cranial neurosurgery on September 22, 2022. The findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. RESULTS The systematic search yielded 830 publications; 114 were screened full text, and 80 were included for analysis. Among the included studies, 5% dealt with preoperative visualization using AR, with user perception as the most frequently reported metric. The majority (75%) researched AR technology for surgical navigation, with registration accuracy, clinical outcome, and time measurements as the most frequently reported metrics. In addition, 20% studied the use of AR for intraoperative guidance, with registration accuracy, task outcome, and user perception as the most frequently reported metrics. CONCLUSION For quality benchmarking of AR technologies in neurosurgery, evaluation metrics should be specific to the risk profile and clinical objectives of the technology. A key focus should be on using validated questionnaires to assess user perception; ensuring clear and unambiguous reporting of registration accuracy, precision, robustness, and system stability; and accurately measuring task performance in clinical studies. We provided an overview suggesting which evaluation metrics to use per AR application and innovation phase, aiming to improve the assessment of added value of AR for neurosurgical practice and to facilitate the integration in the clinical workflow.
Collapse
Affiliation(s)
- Tessa M. Kos
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Elisa Colombo
- Department of Neurosurgery, Clinical Neuroscience Center, Universitätsspital Zürich, Zurich, The Netherlands
| | - L. Wilbert Bartels
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Pierre A. Robe
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Tristan P. C. van Doormaal
- Department of Neurosurgery, Clinical Neuroscience Center, Universitätsspital Zürich, Zurich, The Netherlands
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
3
|
Colombo E, Lutters B, Kos T, van Doormaal T. Application of virtual and mixed reality for 3D visualization in intracranial aneurysm surgery planning: a systematic review. Front Surg 2023; 10:1227510. [PMID: 37829601 PMCID: PMC10564996 DOI: 10.3389/fsurg.2023.1227510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 09/18/2023] [Indexed: 10/14/2023] Open
Abstract
Background Precise preoperative anatomical visualization and understanding of an intracranial aneurysm (IA) are fundamental for surgical planning and increased intraoperative confidence. Application of virtual reality (VR) and mixed reality (MR), thus three-dimensional (3D) visualization of IAs could be significant in surgical planning. Authors provide an up-to-date overview of VR and MR applied to IA surgery, with specific focus on tailoring of the surgical treatment. Methods A systematic analysis of the literature was performed in accordance with the PRISMA guidelines. Pubmed, and Embase were searched to identify studies reporting use of MR and VR 3D visualization in IA surgery during the last 25 years. Type and number of IAs, category of input scan, visualization techniques (screen, glasses or head set), inclusion of haptic feedback, tested population (residents, fellows, attending neurosurgeons), and aim of the study (surgical planning/rehearsal, neurosurgical training, methodological validation) were noted. Results Twenty-eight studies were included. Eighteen studies (64.3%) applied VR, and 10 (35.7%) used MR. A positive impact on surgical planning was documented by 19 studies (67.9%): 17 studies (60.7%) chose the tailoring of the surgical approach as primary outcome of the analysis. A more precise anatomical visualization and understanding with VR and MR was endorsed by all included studies (100%). Conclusion Application of VR and MR to perioperative 3D visualization of IAs allowed an improved understanding of the patient-specific anatomy and surgical preparation. This review describes a tendency to utilize mostly VR-platforms, with the primary goals of a more accurate anatomical understanding, surgical planning and rehearsal.
Collapse
Affiliation(s)
- Elisa Colombo
- Department of Neurosurgery and Klinisches Neurozentrum Zurich ZH, Universität Zürich; Universitätsspital Zürich, Zurich, Switzerland
| | - Bart Lutters
- Julius Center for Health Sciences and Primary Care, Medical Humanities, University Medical Center Utrecht, Utrecht, Netherlands
| | - Tessa Kos
- Image Science Institute, University Medical Center Utrecht, Utrecht, Netherlands
| | - Tristan van Doormaal
- Department of Neurosurgery and Klinisches Neurozentrum Zurich ZH, Universität Zürich; Universitätsspital Zürich, Zurich, Switzerland
| |
Collapse
|
4
|
Mofatteh M, Mashayekhi MS, Arfaie S, Chen Y, Mirza AB, Fares J, Bandyopadhyay S, Henich E, Liao X, Bernstein M. Augmented and virtual reality usage in awake craniotomy: a systematic review. Neurosurg Rev 2022; 46:19. [PMID: 36529827 PMCID: PMC9760592 DOI: 10.1007/s10143-022-01929-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/21/2022] [Accepted: 12/12/2022] [Indexed: 12/23/2022]
Abstract
Augmented and virtual reality (AR, VR) are becoming promising tools in neurosurgery. AR and VR can reduce challenges associated with conventional approaches via the simulation and mimicry of specific environments of choice for surgeons. Awake craniotomy (AC) enables the resection of lesions from eloquent brain areas while monitoring higher cortical and subcortical functions. Evidence suggests that both surgeons and patients benefit from the various applications of AR and VR in AC. This paper investigates the application of AR and VR in AC and assesses its prospective utility in neurosurgery. A systematic review of the literature was performed using PubMed, Scopus, and Web of Science databases in accordance with the PRISMA guidelines. Our search results yielded 220 articles. A total of six articles consisting of 118 patients have been included in this review. VR was used in four papers, and the other two used AR. Tumour was the most common pathology in 108 patients, followed by vascular lesions in eight patients. VR was used for intraoperative mapping of language, vision, and social cognition, while AR was incorporated in preoperative training of white matter dissection and intraoperative visualisation and navigation. Overall, patients and surgeons were satisfied with the applications of AR and VR in their cases. AR and VR can be safely incorporated during AC to supplement, augment, or even replace conventional approaches in neurosurgery. Future investigations are required to assess the feasibility of AR and VR in various phases of AC.
Collapse
Affiliation(s)
- Mohammad Mofatteh
- School of Medicine, Dentistry and Biomedical Sciences, Queen's University Belfast, Belfast, UK.
| | | | - Saman Arfaie
- Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec, Canada
- Department of Molecular and Cell Biology, University of California Berkeley, Berkeley, CA, USA
| | - Yimin Chen
- Department of Neurology, Foshan Sanshui District People's Hospital, Foshan, China
| | | | - Jawad Fares
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Northwestern Medicine Malnati Brain Tumor Institute, Feinberg School of Medicine, Lurie Comprehensive Cancer Center, Northwestern University, Chicago, IL, USA
| | - Soham Bandyopadhyay
- Nuffield Department of Surgical Sciences, Oxford University Global Surgery Group, University of Oxford, Oxford, UK
- Clinical Neurosciences, Clinical & Experimental Sciences, Faculty of Medicine, University of Southampton, Southampton, Hampshire, UK
- Wessex Neurological Centre, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Edy Henich
- Department of Medicine, McGill University, Montreal, Quebec, Canada
| | - Xuxing Liao
- Department of Neurosurgery, Foshan Sanshui District People's Hospital, Foshan, China
| | - Mark Bernstein
- Division of Neurosurgery, Department of Surgery, University of Toronto, University Health Network, Toronto, Ontario, Canada
- Temmy Latner Center for Palliative Care, Mount Sinai Hospital, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
5
|
The intraoperative use of augmented and mixed reality technology to improve surgical outcomes: A systematic review. Int J Med Robot 2022; 18:e2450. [DOI: 10.1002/rcs.2450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 07/23/2022] [Accepted: 07/27/2022] [Indexed: 11/07/2022]
|
6
|
Schwandt E, Kockro R, Kramer A, Glaser M, Ringel F. Presurgical selection of the ideal aneurysm clip by the use of a three-dimensional planning system. Neurosurg Rev 2022; 45:2887-2894. [PMID: 35546216 PMCID: PMC9349090 DOI: 10.1007/s10143-022-01794-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 03/19/2022] [Accepted: 04/19/2022] [Indexed: 11/25/2022]
Abstract
Aneurysm occlusion rate after clipping is higher than after endovascular treatment. However, a certain percentage of incompletely clipped aneurysms remains. Presurgical selection of the proper aneurysm clips could potentially reduce the rate of incomplete clippings caused by inadequate clip geometry. The aim of the present study was to assess whether preoperative 3D image-based simulation allows for preoperative selection of a proper aneurysm clip for complete occlusion in individual cases. Patients harboring ruptured or unruptured cerebral aneurysms prior to surgical clipping were analyzed. CT angiography images were transferred to a 3D surgical-planning station (Dextroscope®) with imported models of 58 aneurysm clips. Intracranial vessels and aneurysms were segmented and the virtual aneurysm clips were placed at the aneurysm neck. Operating surgeons had information about the selected aneurysm clip, and patients underwent clipping. Intraoperative clip selection was documented and aneurysm occlusion rate was assessed by postoperative digital subtraction angiography. Nineteen patients were available for final analysis. In all patients, the most proximal clip at the aneurysm neck was the preselected clip. All aneurysms except one were fully occluded, as assessed by catheter angiography. One aneurysm had a small neck remnant that did not require secondary surgery and was occluded 15 months after surgery. 3D image-based preselection of a proper aneurysm clip can be translated to the operating room and avoids intraoperative clip selection. The associated occlusion rate of aneurysms is high.
Collapse
Affiliation(s)
- Eike Schwandt
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstr. 1, 55131, Mainz, Germany
| | - Ralf Kockro
- Department of Neurosurgery, Klinik Hirslanden, Zurich, Switzerland
| | - Andreas Kramer
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstr. 1, 55131, Mainz, Germany
| | - Martin Glaser
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstr. 1, 55131, Mainz, Germany
| | - Florian Ringel
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstr. 1, 55131, Mainz, Germany.
| |
Collapse
|
7
|
Aguilar-Salinas P, Gutierrez-Aguirre SF, Avila MJ, Nakaji P. Current status of augmented reality in cerebrovascular surgery: a systematic review. Neurosurg Rev 2022; 45:1951-1964. [PMID: 35149900 DOI: 10.1007/s10143-022-01733-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 12/01/2021] [Accepted: 01/05/2022] [Indexed: 12/29/2022]
Abstract
Augmented reality (AR) is an adjuvant tool in neuronavigation to improve spatial and anatomic understanding. The present review aims to describe the current status of intraoperative AR for the treatment of cerebrovascular pathology. A systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The following databases were searched: PubMed, Science Direct, Web of Science, and EMBASE up to December, 2020. The search strategy consisted of "augmented reality," "AR," "cerebrovascular," "navigation," "neurovascular," "neurosurgery," and "endovascular" in both AND and OR combinations. Studies included were original research articles with intraoperative application. The manuscripts were thoroughly examined for study design, outcomes, and results. Sixteen studies were identified describing the use of intraoperative AR in the treatment of cerebrovascular pathology. A total of 172 patients were treated for 190 cerebrovascular lesions using intraoperative AR. The most common treated pathology was intracranial aneurysms. Most studies were cases and there was only a case-control study. A head-up display system in the microscope was the most common AR display. AR was found to be useful for tailoring the craniotomy, dura opening, and proper identification of donor and recipient vessels in vascular bypass. Most AR systems were unable to account for tissue deformation. This systematic review suggests that intraoperative AR is becoming a promising and feasible adjunct in the treatment of cerebrovascular pathology. It has been found to be a useful tool in the preoperative planning and intraoperative guidance. However, its clinical benefits remain to be seen.
Collapse
Affiliation(s)
- Pedro Aguilar-Salinas
- Department of Neurosurgery, Banner University Medical Center, University of Arizona, Tucson, AZ, USA
| | | | - Mauricio J Avila
- Department of Neurosurgery, Banner University Medical Center, University of Arizona, Tucson, AZ, USA
| | - Peter Nakaji
- Department of Neurosurgery, Banner University Medical Center, University of Arizona, 755 E. McDowell Rd, Phoenix, AZ, 85006, USA.
| |
Collapse
|
8
|
Mori K, Watanabe S. Keyhole Approach in Cerebral Aneurysm Surgeries. Adv Tech Stand Neurosurg 2022; 44:265-275. [PMID: 35107685 DOI: 10.1007/978-3-030-87649-4_15] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Pterional approach via standard fronto-temporal craniotomy and interhemispheric approach via bifrontal craniotomy are the gold standards for clipping of cerebral aneurysms in the anterior circulation. Endovascular treatment is now widely used, but subsets of aneurysms are still indicated for surgical clipping. Modern technological advances allow less invasive clipping techniques such as the keyhole approach. This chapter discusses the surgical indications, preoperative simulation, surgical techniques, and pros and cons of keyhole (supraorbital) clipping. Selection of standard craniotomy or keyhole craniotomy should be uncontroversial, but keyhole clipping requires definite surgical indications based on the characteristics of the target aneurysm for safe clipping.
Collapse
Affiliation(s)
- Kentaro Mori
- Department of Neurosurgery, Tokyo General Hospital, Nakano, Tokyo, Japan.
| | - Sadayoshi Watanabe
- Department of Neurosurgery, Tokyo General Hospital, Nakano, Tokyo, Japan
| |
Collapse
|
9
|
Augmented reality visualization in brain lesions: a prospective randomized controlled evaluation of its potential and current limitations in navigated microneurosurgery. Acta Neurochir (Wien) 2022; 164:3-14. [PMID: 34904183 PMCID: PMC8761141 DOI: 10.1007/s00701-021-05045-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Accepted: 09/01/2021] [Indexed: 11/16/2022]
Abstract
Background Augmented reality (AR) has the potential to support complex neurosurgical interventions by including visual information seamlessly. This study examines intraoperative visualization parameters and clinical impact of AR in brain tumor surgery. Methods Fifty-five intracranial lesions, operated either with AR-navigated microscope (n = 39) or conventional neuronavigation (n = 16) after randomization, have been included prospectively. Surgical resection time, duration/type/mode of AR, displayed objects (n, type), pointer-based navigation checks (n), usability of control, quality indicators, and overall surgical usefulness of AR have been assessed. Results AR display has been used in 44.4% of resection time. Predominant AR type was navigation view (75.7%), followed by target volumes (20.1%). Predominant AR mode was picture-in-picture (PiP) (72.5%), followed by 23.3% overlay display. In 43.6% of cases, vision of important anatomical structures has been partially or entirely blocked by AR information. A total of 7.7% of cases used MRI navigation only, 30.8% used one, 23.1% used two, and 38.5% used three or more object segmentations in AR navigation. A total of 66.7% of surgeons found AR visualization helpful in the individual surgical case. AR depth information and accuracy have been rated acceptable (median 3.0 vs. median 5.0 in conventional neuronavigation). The mean utilization of the navigation pointer was 2.6 × /resection hour (AR) vs. 9.7 × /resection hour (neuronavigation); navigation effort was significantly reduced in AR (P < 0.001). Conclusions The main benefit of HUD-based AR visualization in brain tumor surgery is the integrated continuous display allowing for pointer-less navigation. Navigation view (PiP) provides the highest usability while blocking the operative field less frequently. Visualization quality will benefit from improvements in registration accuracy and depth impression. German clinical trials registration number. DRKS00016955. Supplementary Information The online version contains supplementary material available at 10.1007/s00701-021-05045-1.
Collapse
|
10
|
Lukyanchikov VA, Senko IV, Ryzhkova ES, Dmitriev AY. [Navigation in vascular neurosurgery]. ZHURNAL VOPROSY NEĬROKHIRURGII IMENI N. N. BURDENKO 2020; 84:82-89. [PMID: 32759931 DOI: 10.17116/neiro20208404182] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Literature review is devoted to the role of frameless neuronavigation in surgery of distal aneurysms, cavernomas, arteriovenous malformations, Kimmerle's anomaly and revascularization surgeries. Visualization methods used in preoperative preparation of patients with vascular lesions compatible with frameless neuronavigation and the methods of intraoperative visualization as an addition to navigation are described.
Collapse
Affiliation(s)
- V A Lukyanchikov
- Sklifosovsky Research Institute for Emergency Care, Moscow, Russia.,Peoples' Friendship University of Russia, Moscow, Russia
| | - I V Senko
- Sklifosovsky Research Institute for Emergency Care, Moscow, Russia.,Federal Center for Brain and Neurotechnologies, Moscow, Russia
| | - E S Ryzhkova
- Sklifosovsky Research Institute for Emergency Care, Moscow, Russia.,Peoples' Friendship University of Russia, Moscow, Russia
| | - A Yu Dmitriev
- Sklifosovsky Research Institute for Emergency Care, Moscow, Russia
| |
Collapse
|
11
|
Preoperative 3-Dimensional Angiography Data and Intraoperative Real-Time Vascular Data Integrated in Microscope-Based Navigation by Automatic Patient Registration Applying Intraoperative Computed Tomography. World Neurosurg 2018; 113:e414-e425. [DOI: 10.1016/j.wneu.2018.02.045] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2018] [Revised: 02/04/2018] [Accepted: 02/06/2018] [Indexed: 11/23/2022]
|