1
|
Pekov SI, Bormotov DS, Bocharova SI, Sorokin AA, Derkach MM, Popov IA. Mass spectrometry for neurosurgery: Intraoperative support in decision-making. MASS SPECTROMETRY REVIEWS 2025; 44:62-73. [PMID: 38571445 DOI: 10.1002/mas.21883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 02/29/2024] [Accepted: 03/23/2024] [Indexed: 04/05/2024]
Abstract
Ambient ionization mass spectrometry was proved to be a powerful tool for oncological surgery. Still, it remains a translational technique on the way from laboratory to clinic. Brain surgery is the most sensitive to resection accuracy field since the balance between completeness of resection and minimization of nerve fiber damage determines patient outcome and quality of life. In this review, we summarize efforts made to develop various intraoperative support techniques for oncological neurosurgery and discuss difficulties arising on the way to clinical implementation of mass spectrometry-guided brain surgery.
Collapse
Affiliation(s)
- Stanislav I Pekov
- Skolkovo Institute of Science and Technology, Moscow, Russian Federation
- Moscow Institute of Physics and Technology, Dolgoprudny, Russian Federation
- Siberian State Medical University, Tomsk, Russian Federation
| | - Denis S Bormotov
- Moscow Institute of Physics and Technology, Dolgoprudny, Russian Federation
| | | | - Anatoly A Sorokin
- Moscow Institute of Physics and Technology, Dolgoprudny, Russian Federation
| | - Maria M Derkach
- Moscow Institute of Physics and Technology, Dolgoprudny, Russian Federation
| | - Igor A Popov
- Moscow Institute of Physics and Technology, Dolgoprudny, Russian Federation
- Siberian State Medical University, Tomsk, Russian Federation
| |
Collapse
|
2
|
Asadi Z, Asadi M, Kazemipour N, Léger É, Kersten-Oertel M. A decade of progress: bringing mixed reality image-guided surgery systems in the operating room. Comput Assist Surg (Abingdon) 2024; 29:2355897. [PMID: 38794834 DOI: 10.1080/24699322.2024.2355897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/26/2024] Open
Abstract
Advancements in mixed reality (MR) have led to innovative approaches in image-guided surgery (IGS). In this paper, we provide a comprehensive analysis of the current state of MR in image-guided procedures across various surgical domains. Using the Data Visualization View (DVV) Taxonomy, we analyze the progress made since a 2013 literature review paper on MR IGS systems. In addition to examining the current surgical domains using MR systems, we explore trends in types of MR hardware used, type of data visualized, visualizations of virtual elements, and interaction methods in use. Our analysis also covers the metrics used to evaluate these systems in the operating room (OR), both qualitative and quantitative assessments, and clinical studies that have demonstrated the potential of MR technologies to enhance surgical workflows and outcomes. We also address current challenges and future directions that would further establish the use of MR in IGS.
Collapse
Affiliation(s)
- Zahra Asadi
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| | - Mehrdad Asadi
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| | - Negar Kazemipour
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| | - Étienne Léger
- Montréal Neurological Institute & Hospital (MNI/H), Montréal, Canada
- McGill University, Montréal, Canada
| | - Marta Kersten-Oertel
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| |
Collapse
|
3
|
Edalati S, Slobin J, Harsinay A, Vasan V, Taha MA, Del Signore A, Govindaraj S, Iloreta AM. Augmented and Virtual Reality Applications in Rhinology: A Scoping Review. Laryngoscope 2024; 134:4433-4440. [PMID: 38924127 DOI: 10.1002/lary.31602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Revised: 05/22/2024] [Accepted: 06/12/2024] [Indexed: 06/28/2024]
Abstract
OBJECTIVES Virtual reality (VR) and augmented reality (AR) are innovative technologies that have a wide range of potential applications in the health care industry. The aim of this study was to investigate the body of research on AR and VR applications in rhinology by performing a scoping review. DATA SOURCES PubMed, Scopus, and Embase. REVIEW METHODS According to PRISM-ScR guidelines, a scoping review of literature on the application of AR and/or VR in the context of Rhinology was conducted using PubMed, Scopus, and Embase. RESULTS Forty-nine articles from 1996 to 2023 met the criteria for review. Five broad types of AR and/or VR applications were found: preoperative, intraoperative, training/education, feasibility, and technical. The subsequent clinical domains were recognized: craniovertebral surgery, nasal endoscopy, transsphenoidal surgery, skull base surgery, endoscopic sinus surgery, and sinonasal malignancies. CONCLUSION AR and VR have comprehensive applications in Rhinology. AR for surgical navigation may have the most emerging potential in skull base surgery and endoscopic sinus surgery. VR can be utilized as an engaging training tool for surgeons and residents and as a distraction analgesia for patients undergoing office-based procedures. Additional research is essential to further understand the tangible effects of these technologies on measurable clinical results. Laryngoscope, 134:4433-4440, 2024.
Collapse
Affiliation(s)
- Shaun Edalati
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Jacqueline Slobin
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Ariel Harsinay
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Vikram Vasan
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Mohamed A Taha
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Anthony Del Signore
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Satish Govindaraj
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Alfred Marc Iloreta
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
4
|
Grote A, Neumann F, Menzler K, Carl B, Nimsky C, Bopp MHA. Augmented Reality in Extratemporal Lobe Epilepsy Surgery. J Clin Med 2024; 13:5692. [PMID: 39407752 PMCID: PMC11477171 DOI: 10.3390/jcm13195692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2024] [Revised: 09/20/2024] [Accepted: 09/21/2024] [Indexed: 10/20/2024] Open
Abstract
Background: Epilepsy surgery for extratemporal lobe epilepsy (ETLE) is challenging, particularly when MRI findings are non-lesional and seizure patterns are complex. Invasive diagnostic techniques are crucial for accurately identifying the epileptogenic zone and its relationship with surrounding functional tissue. Microscope-based augmented reality (AR) support, combined with navigation, may enhance intraoperative orientation, particularly in cases involving subtle or indistinct lesions, thereby improving patient outcomes and safety (e.g., seizure freedom and preservation of neuronal integrity). Therefore, this study was conducted to prove the clinical advantages of microscope-based AR support in ETLE surgery. Methods: We retrospectively analyzed data from ten patients with pharmacoresistant ETLE who underwent invasive diagnostics with depth and/or subdural grid electrodes, followed by resective surgery. AR support was provided via the head-up displays of the operative microscope, with navigation based on automatic intraoperative computed tomography (iCT)-based registration. The surgical plan included the suspected epileptogenic lesion, electrode positions, and relevant surrounding functional structures, all of which were visualized intraoperatively. Results: Six patients reported complete seizure freedom following surgery (ILAE 1), one patient was seizure-free at the 2-year follow-up, and one patient experienced only auras (ILAE 2). Two patients developed transient neurological deficits that resolved shortly after surgery. Conclusions: Microscope-based AR support enhanced intraoperative orientation in all cases, contributing to improved patient outcomes and safety. It was highly valued by experienced surgeons and as a training tool for less experienced practitioners.
Collapse
Affiliation(s)
- Alexander Grote
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (F.N.); (B.C.); (C.N.)
| | - Franziska Neumann
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (F.N.); (B.C.); (C.N.)
| | - Katja Menzler
- Department of Neurology, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
| | - Barbara Carl
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (F.N.); (B.C.); (C.N.)
- Department of Neurosurgery, Helios Dr. Horst Schmidt Kliniken, Ludwig-Erhard-Straße 100, 65199 Wiesbaden, Germany
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (F.N.); (B.C.); (C.N.)
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Miriam H. A. Bopp
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (F.N.); (B.C.); (C.N.)
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| |
Collapse
|
5
|
Prasad K, Fassler C, Miller A, Aweeda M, Pruthi S, Fusco JC, Daniel B, Miga M, Wu JY, Topf MC. More than meets the eye: Augmented reality in surgical oncology. J Surg Oncol 2024; 130:405-418. [PMID: 39155686 DOI: 10.1002/jso.27790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2024] [Accepted: 07/09/2024] [Indexed: 08/20/2024]
Abstract
BACKGROUND AND OBJECTIVES In the field of surgical oncology, there has been a desire for innovative techniques to improve tumor visualization, resection, and patient outcomes. Augmented reality (AR) technology superimposes digital content onto the real-world environment, enhancing the user's experience by blending digital and physical elements. A thorough examination of AR technology in surgical oncology has yet to be performed. METHODS A scoping review of intraoperative AR in surgical oncology was conducted according to the guidelines and recommendations of The Preferred Reporting Items for Systematic Review and Meta-analyzes Extension for Scoping Reviews (PRISMA-ScR) framework. All original articles examining the use of intraoperative AR during surgical management of cancer were included. Exclusion criteria included virtual reality applications only, preoperative use only, fluorescence, AR not specific to surgical oncology, and study design (reviews, commentaries, abstracts). RESULTS A total of 2735 articles were identified of which 83 were included. Most studies (52) were performed on animals or phantom models, while the remaining included patients. A total of 1112 intraoperative AR surgical cases were performed across the studies. The most common anatomic site was brain (20 articles), followed by liver (16), renal (9), and head and neck (8). AR was most often used for intraoperative navigation or anatomic visualization of tumors or critical structures but was also used to identify osteotomy or craniotomy planes. CONCLUSIONS AR technology has been applied across the field of surgical oncology to aid in localization and resection of tumors.
Collapse
Affiliation(s)
- Kavita Prasad
- Department of Otolaryngology-Head & Neck Surgery, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
| | - Carly Fassler
- Department of Otolaryngology-Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Alexis Miller
- Department of Otolaryngology-Head & Neck Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Marina Aweeda
- Department of Otolaryngology-Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Sumit Pruthi
- Department of Radiology, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Joseph C Fusco
- Department of Pediatric Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Bruce Daniel
- Department of Radiology, Stanford Health Care, Palo Alto, California, USA
| | - Michael Miga
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
| | - Jie Ying Wu
- Department of Computer Science, Vanderbilt University, Nashville, Tennessee, USA
| | - Michael C Topf
- Department of Otolaryngology-Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| |
Collapse
|
6
|
Bechev K, Yotova NI, Kostadinov K, Ilyov I, Markov D. Anatomical Features and Morphometric Characteristics of the Sphenoidal Sinus in MRI Studies. Cureus 2024; 16:e66764. [PMID: 39268260 PMCID: PMC11391885 DOI: 10.7759/cureus.66764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/13/2024] [Indexed: 09/15/2024] Open
Abstract
Differential access to pathological sellar processes and adjacent regions is determined by the anatomic structures identified through diagnostic imaging. Both direct endonasal access (microscopic or endoscopic) and sublabial access utilize the sphenoid sinus (SS) as the primary surgical pathway. Critical factors include the pneumatization of the sinus, its intermediate septa, and the presence of a double wall, consisting of a connective tissue membrane along the dorsal wall of the SS. The present study aims to demonstrate the significance of the size and type of the SS based on MRI measurements. The type of SS, its pneumatization, and the proximity of adjacent brain structures are crucial for different surgical approaches to the SS and pituitary fossa. In neurosurgical practice, six main types of sinuses are recognized: sphenoid body type, lateral type, clival type, lesser wing type, anterior type, and combined type. Failure to consider these variations can lead to damage to the cavernous sinus, Meckel's cave, nerve structures in the middle cranial fossa, planum sphenoidale, suprasellar region, and vital brainstem structures located on the clivus. Randomly included MRI measurements were conducted on 112 patients from Pulmed University Hospital, Plovdiv, Bulgaria, categorized into two cohorts based on gender, with mean ages of 51 years for men and 47.8 years for women. The measurements, recorded in centimeters, were obtained using two imaging software programs, RadiAnt DICOM Viewer (Medixant, Poznan, Poland) and Weasis DICOM Viewer (Nicolas Roduit, https://github.com/nroduit/Weasis). No statistically significant differences were observed between the measurements produced by the two programs. Measurements of the SS were taken in two equal groups, using three different projections: axial, sagittal, and coronal. The results for height, width, and depth showed average sizes of 2.73-3.04 cm in axial projections, 1.70-2.64 cm in sagittal projections, and 2.86-3.03 cm in coronal projections. The minor differences between axial and coronal measurements of the same parameters (height and width) are statistically acceptable and attributed to the varying angles of the MRI scans. These measurements are crucial for planning surgical access to the sellar and parasellar regions, determining the necessary bony resection of the posterior wall of the SS, and preventing complications from excessive bony trepanation.
Collapse
Affiliation(s)
- Kristian Bechev
- Neurological Surgery, Universitetska Mnogoprofilna Bolnitsa za Aktivno Lechenie (UMBAL) Pulmed, Plovdiv, BGR
| | - Nina I Yotova
- Anatomy, Medical University of Plovdiv, Plovdiv, BGR
| | - Kostadin Kostadinov
- Environmental Health, Research Institute, Medical University of Plovdiv, Plovdiv, BGR
- Social Medicine and Public Health, Faculty of Public Health, Medical University of Plovdiv, Plovdiv, BGR
| | - Ilko Ilyov
- Medicine, Medical University of Plovdiv, Plovdiv, BGR
| | - Daniel Markov
- General and Clinical Pathology, Medical University of Plovdiv, Plovdiv, BGR
| |
Collapse
|
7
|
Isikay I, Cekic E, Baylarov B, Tunc O, Hanalioglu S. Narrative review of patient-specific 3D visualization and reality technologies in skull base neurosurgery: enhancements in surgical training, planning, and navigation. Front Surg 2024; 11:1427844. [PMID: 39081485 PMCID: PMC11287220 DOI: 10.3389/fsurg.2024.1427844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Accepted: 07/02/2024] [Indexed: 08/02/2024] Open
Abstract
Recent advances in medical imaging, computer vision, 3-dimensional (3D) modeling, and artificial intelligence (AI) integrated technologies paved the way for generating patient-specific, realistic 3D visualization of pathological anatomy in neurosurgical conditions. Immersive surgical simulations through augmented reality (AR), virtual reality (VR), mixed reality (MxR), extended reality (XR), and 3D printing applications further increased their utilization in current surgical practice and training. This narrative review investigates state-of-the-art studies, the limitations of these technologies, and future directions for them in the field of skull base surgery. We begin with a methodology summary to create accurate 3D models customized for each patient by combining several imaging modalities. Then, we explore how these models are employed in surgical planning simulations and real-time navigation systems in surgical procedures involving the anterior, middle, and posterior cranial skull bases, including endoscopic and open microsurgical operations. We also evaluate their influence on surgical decision-making, performance, and education. Accumulating evidence demonstrates that these technologies can enhance the visibility of the neuroanatomical structures situated at the cranial base and assist surgeons in preoperative planning and intraoperative navigation, thus showing great potential to improve surgical results and reduce complications. Maximum effectiveness can be achieved in approach selection, patient positioning, craniotomy placement, anti-target avoidance, and comprehension of spatial interrelationships of neurovascular structures. Finally, we present the obstacles and possible future paths for the broader implementation of these groundbreaking methods in neurosurgery, highlighting the importance of ongoing technological advancements and interdisciplinary collaboration to improve the accuracy and usefulness of 3D visualization and reality technologies in skull base surgeries.
Collapse
Affiliation(s)
- Ilkay Isikay
- Department of Neurosurgery, Faculty of Medicine, Hacettepe University, Ankara, Türkiye
| | - Efecan Cekic
- Neurosurgery Clinic, Polatli Duatepe State Hospital, Ankara, Türkiye
| | - Baylar Baylarov
- Department of Neurosurgery, Faculty of Medicine, Hacettepe University, Ankara, Türkiye
| | - Osman Tunc
- Btech Innovation, METU Technopark, Ankara, Türkiye
| | - Sahin Hanalioglu
- Department of Neurosurgery, Faculty of Medicine, Hacettepe University, Ankara, Türkiye
| |
Collapse
|
8
|
Pojskić M, Bopp MHA, Saß B, Nimsky C. Single-Center Experience in Microsurgical Resection of Acoustic Neurinomas and the Benefit of Microscope-Based Augmented Reality. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:932. [PMID: 38929549 PMCID: PMC11487442 DOI: 10.3390/medicina60060932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Revised: 05/27/2024] [Accepted: 05/29/2024] [Indexed: 06/28/2024]
Abstract
Background and Objectives: Microsurgical resection with intraoperative neuromonitoring is the gold standard for acoustic neurinomas (ANs) which are classified as T3 or T4 tumors according to the Hannover Classification. Microscope-based augmented reality (AR) can be beneficial in cerebellopontine angle and lateral skull base surgery, since these are small areas packed with anatomical structures and the use of this technology enables automatic 3D building of a model without the need for a surgeon to mentally perform this task of transferring 2D images seen on the microscope into imaginary 3D images, which then reduces the possibility of error and provides better orientation in the operative field. Materials and Methods: All patients who underwent surgery for resection of ANs in our department were included in this study. Clinical outcomes in terms of postoperative neurological deficits and complications were evaluated, as well as neuroradiological outcomes for tumor remnants and recurrence. Results: A total of 43 consecutive patients (25 female, median age 60.5 ± 16 years) who underwent resection of ANs via retrosigmoid osteoclastic craniotomy with the use of intraoperative neuromonitoring (22 right-sided, 14 giant tumors, 10 cystic, 7 with hydrocephalus) by a single surgeon were included in this study, with a median follow up of 41.2 ± 32.2 months. A total of 18 patients underwent subtotal resection, 1 patient partial resection and 24 patients gross total resection. A total of 27 patients underwent resection in sitting position and the rest in semi-sitting position. Out of 37 patients who had no facial nerve deficit prior to surgery, 19 patients were intact following surgery, 7 patients had House Brackmann (HB) Grade II paresis, 3 patients HB III, 7 patients HB IV and 1 patient HB V. Wound healing deficit with cerebrospinal fluid (CSF) leak occurred in 8 patients (18.6%). Operative time was 317.3 ± 99 min. One patient which had recurrence and one further patient with partial resection underwent radiotherapy following surgery. A total of 16 patients (37.2%) underwent resection using fiducial-based navigation and microscope-based AR, all in sitting position. Segmented objects of interest in AR were the sigmoid and transverse sinus, tumor outline, cranial nerves (CN) VII, VIII and V, petrous vein, cochlea and semicircular canals and brain stem. Operative time and clinical outcome did not differ between the AR and the non-AR group. However, use of AR improved orientation in the operative field for craniotomy planning and microsurgical resection by identification of important neurovascular structures. Conclusions: The single-center experience of resection of ANs showed a high rate of gross total (GTR) and subtotal resection (STR) with low recurrence. Use of AR improves intraoperative orientation and facilitates craniotomy planning and AN resection through early improved identification of important anatomical relations to structures of the inner auditory canal, venous sinuses, petrous vein, brain stem and the course of cranial nerves.
Collapse
Affiliation(s)
- Mirza Pojskić
- Department of Neurosurgery, University of Marburg, 35037 Marburg, Germany; (M.H.A.B.); (B.S.); (C.N.)
| | - Miriam H. A. Bopp
- Department of Neurosurgery, University of Marburg, 35037 Marburg, Germany; (M.H.A.B.); (B.S.); (C.N.)
- Marburg Center for Mind, Brain and Behavior (MCMBB), 35032 Marburg, Germany
| | - Benjamin Saß
- Department of Neurosurgery, University of Marburg, 35037 Marburg, Germany; (M.H.A.B.); (B.S.); (C.N.)
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, 35037 Marburg, Germany; (M.H.A.B.); (B.S.); (C.N.)
- Marburg Center for Mind, Brain and Behavior (MCMBB), 35032 Marburg, Germany
| |
Collapse
|
9
|
Qi Z, Jin H, Xu X, Wang Q, Gan Z, Xiong R, Zhang S, Liu M, Wang J, Ding X, Chen X, Zhang J, Nimsky C, Bopp MHA. Head model dataset for mixed reality navigation in neurosurgical interventions for intracranial lesions. Sci Data 2024; 11:538. [PMID: 38796526 PMCID: PMC11127921 DOI: 10.1038/s41597-024-03385-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 05/15/2024] [Indexed: 05/28/2024] Open
Abstract
Mixed reality navigation (MRN) technology is emerging as an increasingly significant and interesting topic in neurosurgery. MRN enables neurosurgeons to "see through" the head with an interactive, hybrid visualization environment that merges virtual- and physical-world elements. Offering immersive, intuitive, and reliable guidance for preoperative and intraoperative intervention of intracranial lesions, MRN showcases its potential as an economically efficient and user-friendly alternative to standard neuronavigation systems. However, the clinical research and development of MRN systems present challenges: recruiting a sufficient number of patients within a limited timeframe is difficult, and acquiring low-cost, commercially available, medically significant head phantoms is equally challenging. To accelerate the development of novel MRN systems and surmount these obstacles, the study presents a dataset designed for MRN system development and testing in neurosurgery. It includes CT and MRI data from 19 patients with intracranial lesions and derived 3D models of anatomical structures and validation references. The models are available in Wavefront object (OBJ) and Stereolithography (STL) formats, supporting the creation and assessment of neurosurgical MRN applications.
Collapse
Affiliation(s)
- Ziyu Qi
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043, Marburg, Germany.
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China.
| | - Haitao Jin
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Medical School of Chinese PLA General Hospital, 100853, Beijing, China
- NCO School, Army Medical University, 050081, Shijiazhuang, China
| | - Xinghua Xu
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
| | - Qun Wang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
| | - Zhichao Gan
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Medical School of Chinese PLA General Hospital, 100853, Beijing, China
| | - Ruochu Xiong
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Department of Neurosurgery, Division of Medicine, Graduate School of Medical Sciences, Kanazawa University, Takara-machi 13-1, 920-8641, Kanazawa, Ishikawa, Japan
| | - Shiyu Zhang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Medical School of Chinese PLA General Hospital, 100853, Beijing, China
| | - Minghang Liu
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Medical School of Chinese PLA General Hospital, 100853, Beijing, China
| | - Jingyue Wang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Medical School of Chinese PLA General Hospital, 100853, Beijing, China
| | - Xinyu Ding
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
- Medical School of Chinese PLA General Hospital, 100853, Beijing, China
| | - Xiaolei Chen
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China
| | - Jiashu Zhang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, 100853, Beijing, China.
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043, Marburg, Germany
- Center for Mind, Brain and Behavior (CMBB), 35043, Marburg, Germany
| | - Miriam H A Bopp
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043, Marburg, Germany.
- Center for Mind, Brain and Behavior (CMBB), 35043, Marburg, Germany.
| |
Collapse
|
10
|
Jiang L, Tian J, Guo C, Zhang Y, Qian M, Wang X, Wang Z, Chen Y. Comparison of the efficacy of neuronavigation-assisted intracerebral hematoma puncture and drainage with neuroendoscopic hematoma removal in treatment of hypertensive cerebral hemorrhage. BMC Surg 2024; 24:86. [PMID: 38475783 DOI: 10.1186/s12893-024-02378-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Accepted: 03/01/2024] [Indexed: 03/14/2024] Open
Abstract
OBJECTIVE To compare neuronavigation-assisted intracerebral hematoma puncture and drainage with neuroendoscopic hematoma removal for treatment of hypertensive cerebral hemorrhage. METHOD Ninety-one patients with hypertensive cerebral hemorrhage admitted to our neurosurgery department from June 2022 to May 2023 were selected: 47 patients who underwent endoscopic hematoma removal with the aid of neuronavigation in observation Group A and 44 who underwent intracerebral hematoma puncture and drainage in control Group B. The duration of surgery, intraoperative bleeding, hematoma clearance rate, pre- and postoperative GCS score, National Institutes of Health Stroke Scale (NIHSS) score, mRS score and postoperative complications were compared between the two groups. RESULTS The duration of surgery, intraoperative bleeding and hematoma clearance were significantly lower in Group B than in Group A (p < 0.05). Conversely, no significant differences in the preoperative, 7-day postoperative, 14-day postoperative or 1-month postoperative GCS or NIHSS scores or the posthealing mRS score were observed between Groups A and B. However, the incidence of postoperative complications was significantly greater in Group B than in Group A (p < 0.05), with the most significant difference in incidence of intracranial infection (p < 0.05). CONCLUSION Both neuronavigation-assisted intracerebral hematoma puncture and drainage and neuroendoscopic hematoma removal are effective at improving the outcome of patients with hypertensive cerebral hemorrhage. The disadvantage of neuronavigation is that the incidence of complications is significantly greater than that of other methods; postoperative care and prevention of complications should be strengthened in clinical practice.
Collapse
Affiliation(s)
- Lei Jiang
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| | - Jinjie Tian
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| | - Chao Guo
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| | - Yi Zhang
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China.
| | - Ming Qian
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| | - Xuejian Wang
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| | - Zhifeng Wang
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| | - Yang Chen
- Department of Neurosurgery, Second Affiliated Hospital of Nantong University, Nantong, Jiangsu Province, China
| |
Collapse
|
11
|
Begagić E, Bečulić H, Pugonja R, Memić Z, Balogun S, Džidić-Krivić A, Milanović E, Salković N, Nuhović A, Skomorac R, Sefo H, Pojskić M. Augmented Reality Integration in Skull Base Neurosurgery: A Systematic Review. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:335. [PMID: 38399622 PMCID: PMC10889940 DOI: 10.3390/medicina60020335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Revised: 02/05/2024] [Accepted: 02/09/2024] [Indexed: 02/25/2024]
Abstract
Background and Objectives: To investigate the role of augmented reality (AR) in skull base (SB) neurosurgery. Materials and Methods: Utilizing PRISMA methodology, PubMed and Scopus databases were explored to extract data related to AR integration in SB surgery. Results: The majority of 19 included studies (42.1%) were conducted in the United States, with a focus on the last five years (77.8%). Categorization included phantom skull models (31.2%, n = 6), human cadavers (15.8%, n = 3), or human patients (52.6%, n = 10). Microscopic surgery was the predominant modality in 10 studies (52.6%). Of the 19 studies, surgical modality was specified in 18, with microscopic surgery being predominant (52.6%). Most studies used only CT as the data source (n = 9; 47.4%), and optical tracking was the prevalent tracking modality (n = 9; 47.3%). The Target Registration Error (TRE) spanned from 0.55 to 10.62 mm. Conclusion: Despite variations in Target Registration Error (TRE) values, the studies highlighted successful outcomes and minimal complications. Challenges, such as device practicality and data security, were acknowledged, but the application of low-cost AR devices suggests broader feasibility.
Collapse
Affiliation(s)
- Emir Begagić
- Department of General Medicine, School of Medicine, University of Zenica, Travnička 1, 72000 Zenica, Bosnia and Herzegovina;
| | - Hakija Bečulić
- Department of Neurosurgery, Cantonal Hospital Zenica, Crkvice 67, 72000 Zenica, Bosnia and Herzegovina; (H.B.)
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000 Zenica, Bosnia and Herzegovina;
| | - Ragib Pugonja
- Department of Anatomy, School of Medicine, University of Zenica, Travnička 1, 72000 Zenica, Bosnia and Herzegovina;
| | - Zlatan Memić
- Department of General Medicine, School of Medicine, University of Zenica, Travnička 1, 72000 Zenica, Bosnia and Herzegovina;
| | - Simon Balogun
- Division of Neurosurgery, Department of Surgery, Obafemi Awolowo University Teaching Hospitals Complex, Ilesa Road PMB 5538, Ile-Ife 220282, Nigeria
| | - Amina Džidić-Krivić
- Department of Neurology, Cantonal Hospital Zenica, Crkvice 67, 72000 Zenica, Bosnia and Herzegovina
| | - Elma Milanović
- Neurology Clinic, Clinical Center University of Sarajevo, Bolnička 25, 71000 Sarajevo, Bosnia and Herzegovina
| | - Naida Salković
- Department of General Medicine, School of Medicine, University of Tuzla, Univerzitetska 1, 75000 Tuzla, Bosnia and Herzegovina;
| | - Adem Nuhović
- Department of General Medicine, School of Medicine, University of Sarajevo, Univerzitetska 1, 71000 Sarajevo, Bosnia and Herzegovina;
| | - Rasim Skomorac
- Department of Neurosurgery, Cantonal Hospital Zenica, Crkvice 67, 72000 Zenica, Bosnia and Herzegovina; (H.B.)
- Department of Surgery, School of Medicine, University of Zenica, Travnička 1, 72000 Zenica, Bosnia and Herzegovina
| | - Haso Sefo
- Neurosurgery Clinic, Clinical Center University of Sarajevo, Bolnička 25, 71000 Sarajevo, Bosnia and Herzegovina
| | - Mirza Pojskić
- Department of Neurosurgery, University Hospital Marburg, Baldingerstr., 35033 Marburg, Germany
| |
Collapse
|
12
|
van Doormaal JAM, van Doormaal TPC. Augmented Reality in Neurosurgery. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1462:351-374. [PMID: 39523276 DOI: 10.1007/978-3-031-64892-2_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
Augmented Reality (AR) involves superimposing digital content onto the real environment. AR has evolved into a viable tool in neurosurgery, enhancing intraoperative navigation, medical education and surgical training by integrating anatomical data with the real world. Neurosurgical AR relies on several key techniques to be successful, which includes image segmentation, model rendering, AR projection, and image-to-patient registration. For each of these technical components, different solutions exist, with each having their own advantages and limitations.Intraoperative AR applications cover diverse neurosurgical disciplines including vascular, oncological, spinal, and functional surgeries. Preliminary studies indicate that AR may improve the understanding of complex anatomical structures and offer sufficient accuracy for use as a navigational tool. Additionally, AR shows promise in enhancing surgical training and patient education through interactive 3D models, aiding in the comprehension of intricate anatomical details. Despite its potential, the widespread adoption of AR in clinical settings depends on overcoming technical limitations and validating its clinical efficacy.
Collapse
Affiliation(s)
- Jesse A M van Doormaal
- Department of Neurosurgery, University Medical Centre Utrecht, Utrecht, The Netherlands.
| | | |
Collapse
|
13
|
Kos TM, Colombo E, Bartels LW, Robe PA, van Doormaal TPC. Evaluation Metrics for Augmented Reality in Neurosurgical Preoperative Planning, Surgical Navigation, and Surgical Treatment Guidance: A Systematic Review. Oper Neurosurg (Hagerstown) 2023; 26:01787389-990000000-01007. [PMID: 38146941 PMCID: PMC11008635 DOI: 10.1227/ons.0000000000001009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 10/10/2023] [Indexed: 12/27/2023] Open
Abstract
BACKGROUND AND OBJECTIVE Recent years have shown an advancement in the development of augmented reality (AR) technologies for preoperative visualization, surgical navigation, and intraoperative guidance for neurosurgery. However, proving added value for AR in clinical practice is challenging, partly because of a lack of standardized evaluation metrics. We performed a systematic review to provide an overview of the reported evaluation metrics for AR technologies in neurosurgical practice and to establish a foundation for assessment and comparison of such technologies. METHODS PubMed, Embase, and Cochrane were searched systematically for publications on assessment of AR for cranial neurosurgery on September 22, 2022. The findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. RESULTS The systematic search yielded 830 publications; 114 were screened full text, and 80 were included for analysis. Among the included studies, 5% dealt with preoperative visualization using AR, with user perception as the most frequently reported metric. The majority (75%) researched AR technology for surgical navigation, with registration accuracy, clinical outcome, and time measurements as the most frequently reported metrics. In addition, 20% studied the use of AR for intraoperative guidance, with registration accuracy, task outcome, and user perception as the most frequently reported metrics. CONCLUSION For quality benchmarking of AR technologies in neurosurgery, evaluation metrics should be specific to the risk profile and clinical objectives of the technology. A key focus should be on using validated questionnaires to assess user perception; ensuring clear and unambiguous reporting of registration accuracy, precision, robustness, and system stability; and accurately measuring task performance in clinical studies. We provided an overview suggesting which evaluation metrics to use per AR application and innovation phase, aiming to improve the assessment of added value of AR for neurosurgical practice and to facilitate the integration in the clinical workflow.
Collapse
Affiliation(s)
- Tessa M. Kos
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Elisa Colombo
- Department of Neurosurgery, Clinical Neuroscience Center, Universitätsspital Zürich, Zurich, The Netherlands
| | - L. Wilbert Bartels
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Pierre A. Robe
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Tristan P. C. van Doormaal
- Department of Neurosurgery, Clinical Neuroscience Center, Universitätsspital Zürich, Zurich, The Netherlands
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
14
|
Campisi BM, Costanzo R, Gulino V, Avallone C, Noto M, Bonosi L, Brunasso L, Scalia G, Iacopino DG, Maugeri R. The Role of Augmented Reality Neuronavigation in Transsphenoidal Surgery: A Systematic Review. Brain Sci 2023; 13:1695. [PMID: 38137143 PMCID: PMC10741598 DOI: 10.3390/brainsci13121695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 12/01/2023] [Accepted: 12/06/2023] [Indexed: 12/24/2023] Open
Abstract
In the field of minimally invasive neurosurgery, microscopic transsphenoidal surgery (MTS) and endoscopic transsphenoidal surgery (ETS) have been widely accepted as a safe approach for pituitary lesions and, more recently, their indications have been extended to lesions at various skull base regions. It is mandatory during transsphenoidal surgery (TS) to identify key anatomical landmarks in the sphenoid sinus and distinguish them from the lesion. Over the years, many intraoperative tools have been introduced to improve the neuronavigation systems aiming to achieve safer and more accurate neurosurgical interventions. However, traditional neuronavigation systems may lose the accuracy of real-time location due to the discrepancy between the actual surgical field and the preoperative 2D images. To deal with this, augmented reality (AR)-a new sophisticated 3D technology that superimposes computer-generated virtual objects onto the user's view of the real world-has been considered a promising tool. Particularly, in the field of TS, AR can minimize the anatomic challenges of traditional endoscopic or microscopic surgery, aiding in surgical training, preoperative planning and intra-operative orientation. The aim of this systematic review is to analyze the potential future role of augmented reality, both in endoscopic and microscopic transsphenoidal surgeries.
Collapse
Affiliation(s)
- Benedetta Maria Campisi
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Roberta Costanzo
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Vincenzo Gulino
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Chiara Avallone
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Manfredi Noto
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Lapo Bonosi
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Lara Brunasso
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Gianluca Scalia
- Neurosurgery Unit, Department of Head and Neck Surgery, Garibaldi Hospital, 95122 Catania, Italy;
| | - Domenico Gerardo Iacopino
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| | - Rosario Maugeri
- Neurosurgical Clinic, AOUP “Paolo Giaccone”, Post Graduate Residency Program in Neurologic Surgery, Department of Biomedicine Neurosciences and Advanced Diagnostics, School of Medicine, University of Palermo, 90127 Palermo, Italy; (B.M.C.); (V.G.); (C.A.); (M.N.); (L.B.); (L.B.); (D.G.I.); (R.M.)
| |
Collapse
|
15
|
Qi Z, Bopp MHA, Nimsky C, Chen X, Xu X, Wang Q, Gan Z, Zhang S, Wang J, Jin H, Zhang J. A Novel Registration Method for a Mixed Reality Navigation System Based on a Laser Crosshair Simulator: A Technical Note. Bioengineering (Basel) 2023; 10:1290. [PMID: 38002414 PMCID: PMC10669875 DOI: 10.3390/bioengineering10111290] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Accepted: 11/01/2023] [Indexed: 11/26/2023] Open
Abstract
Mixed Reality Navigation (MRN) is pivotal in augmented reality-assisted intelligent neurosurgical interventions. However, existing MRN registration methods face challenges in concurrently achieving low user dependency, high accuracy, and clinical applicability. This study proposes and evaluates a novel registration method based on a laser crosshair simulator, evaluating its feasibility and accuracy. A novel registration method employing a laser crosshair simulator was introduced, designed to replicate the scanner frame's position on the patient. The system autonomously calculates the transformation, mapping coordinates from the tracking space to the reference image space. A mathematical model and workflow for registration were designed, and a Universal Windows Platform (UWP) application was developed on HoloLens-2. Finally, a head phantom was used to measure the system's target registration error (TRE). The proposed method was successfully implemented, obviating the need for user interactions with virtual objects during the registration process. Regarding accuracy, the average deviation was 3.7 ± 1.7 mm. This method shows encouraging results in efficiency and intuitiveness and marks a valuable advancement in low-cost, easy-to-use MRN systems. The potential for enhancing accuracy and adaptability in intervention procedures positions this approach as promising for improving surgical outcomes.
Collapse
Affiliation(s)
- Ziyu Qi
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
| | - Miriam H. A. Bopp
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Xiaolei Chen
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
| | - Xinghua Xu
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
| | - Qun Wang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
| | - Zhichao Gan
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Shiyu Zhang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Jingyue Wang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Haitao Jin
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
- Medical School of Chinese PLA, Beijing 100853, China
- NCO School, Army Medical University, Shijiazhuang 050081, China
| | - Jiashu Zhang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (X.C.); (X.X.); (Q.W.); (Z.G.); (S.Z.); (J.W.); (H.J.)
| |
Collapse
|
16
|
Hey G, Guyot M, Carter A, Lucke-Wold B. Augmented Reality in Neurosurgery: A New Paradigm for Training. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:1721. [PMID: 37893439 PMCID: PMC10608758 DOI: 10.3390/medicina59101721] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 09/23/2023] [Accepted: 09/24/2023] [Indexed: 10/29/2023]
Abstract
Augmented reality (AR) involves the overlay of computer-generated images onto the user's real-world visual field to modify or enhance the user's visual experience. With respect to neurosurgery, AR integrates preoperative and intraoperative imaging data to create an enriched surgical experience that has been shown to improve surgical planning, refine neuronavigation, and reduce operation time. In addition, AR has the potential to serve as a valuable training tool for neurosurgeons in a way that minimizes patient risk while facilitating comprehensive training opportunities. The increased use of AR in neurosurgery over the past decade has led to innovative research endeavors aiming to develop novel, more efficient AR systems while also improving and refining present ones. In this review, we provide a concise overview of AR, detail current and emerging uses of AR in neurosurgery and neurosurgical training, discuss the limitations of AR, and provide future research directions. Following the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), 386 articles were initially identified. Two independent reviewers (GH and AC) assessed article eligibility for inclusion, and 31 articles are included in this review. The literature search included original (retrospective and prospective) articles and case reports published in English between 2013 and 2023. AR assistance has shown promise within neuro-oncology, spinal neurosurgery, neurovascular surgery, skull-base surgery, and pediatric neurosurgery. Intraoperative use of AR was found to primarily assist with surgical planning and neuronavigation. Similarly, AR assistance for neurosurgical training focused primarily on surgical planning and neuronavigation. However, studies included in this review utilize small sample sizes and remain largely in the preliminary phase. Thus, future research must be conducted to further refine AR systems before widespread intraoperative and educational use.
Collapse
Affiliation(s)
- Grace Hey
- College of Medicine, University of Florida, Gainesville, FL 32610, USA
| | - Michael Guyot
- College of Medicine, University of Florida, Gainesville, FL 32610, USA
| | - Ashley Carter
- Eastern Virginia Medical School, Norfolk, VA 23507, USA
| | - Brandon Lucke-Wold
- Department of Neurosurgery, University of Florida, Gainesville, FL 32610, USA
| |
Collapse
|
17
|
Enkaoua A, Islam M, Ramalhinho J, Dowrick T, Booker J, Khan DZ, Marcus HJ, Clarkson MJ. Image-guidance in endoscopic pituitary surgery: an in-silico study of errors involved in tracker-based techniques. Front Surg 2023; 10:1222859. [PMID: 37780914 PMCID: PMC10540627 DOI: 10.3389/fsurg.2023.1222859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 08/11/2023] [Indexed: 10/03/2023] Open
Abstract
Background Endoscopic endonasal surgery is an established minimally invasive technique for resecting pituitary adenomas. However, understanding orientation and identifying critical neurovascular structures in this anatomically dense region can be challenging. In clinical practice, commercial navigation systems use a tracked pointer for guidance. Augmented Reality (AR) is an emerging technology used for surgical guidance. It can be tracker based or vision based, but neither is widely used in pituitary surgery. Methods This pre-clinical study aims to assess the accuracy of tracker-based navigation systems, including those that allow for AR. Two setups were used to conduct simulations: (1) the standard pointer setup, tracked by an infrared camera; and (2) the endoscope setup that allows for AR, using reflective markers on the end of the endoscope, tracked by infrared cameras. The error sources were estimated by calculating the Euclidean distance between a point's true location and the point's location after passing it through the noisy system. A phantom study was then conducted to verify the in-silico simulation results and show a working example of image-based navigation errors in current methodologies. Results The errors of the tracked pointer and tracked endoscope simulations were 1.7 and 2.5 mm respectively. The phantom study showed errors of 2.14 and 3.21 mm for the tracked pointer and tracked endoscope setups respectively. Discussion In pituitary surgery, precise neighboring structure identification is crucial for success. However, our simulations reveal that the errors of tracked approaches were too large to meet the fine error margins required for pituitary surgery. In order to achieve the required accuracy, we would need much more accurate tracking, better calibration and improved registration techniques.
Collapse
Affiliation(s)
- Aure Enkaoua
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Mobarakol Islam
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - João Ramalhinho
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Thomas Dowrick
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - James Booker
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Division of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Danyal Z. Khan
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Division of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Hani J. Marcus
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Division of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Matthew J. Clarkson
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| |
Collapse
|
18
|
Goto Y, Kawaguchi A, Inoue Y, Nakamura Y, Oyama Y, Tomioka A, Higuchi F, Uno T, Shojima M, Kin T, Shin M. Efficacy of a Novel Augmented Reality Navigation System Using 3D Computer Graphic Modeling in Endoscopic Transsphenoidal Surgery for Sellar and Parasellar Tumors. Cancers (Basel) 2023; 15:cancers15072148. [PMID: 37046809 PMCID: PMC10093001 DOI: 10.3390/cancers15072148] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 03/30/2023] [Accepted: 04/03/2023] [Indexed: 04/14/2023] Open
Abstract
In endoscopic transsphenoidal skull base surgery, knowledge of tumor location on imaging and the anatomic structures is required simultaneously. However, it is often difficult to accurately reconstruct the endoscopic vision of the surgical field from the pre-surgical radiographic images because the lesion remarkably displaces the geography of normal anatomic structures. We created a precise three-dimensional computer graphic model from preoperative radiographic data that was then superimposed on a visual image of the actual surgical field and displayed on a video monitor during endoscopic transsphenoidal surgery. We evaluated the efficacy of this augmented reality (AR) navigation system in 15 consecutive patients with sellar and parasellar tumors. The average score overall was 4.7 [95% confidence interval: 4.58-4.82], which indicates that the AR navigation system was as useful as or more useful than conventional navigation in certain patients. In two patients, AR navigation was assessed as less useful than conventional navigation because perception of the depth of the lesion was more difficult. The developed system was more useful than conventional navigation for facilitating an immediate three-dimensional understanding of the lesion and surrounding structures.
Collapse
Affiliation(s)
- Yoshiaki Goto
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Ai Kawaguchi
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Yuki Inoue
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Yuki Nakamura
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Yuta Oyama
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Arisa Tomioka
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Fumi Higuchi
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Takeshi Uno
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Masaaki Shojima
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| | - Taichi Kin
- Department of Neurosurgery, University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo 133-8655, Japan
| | - Masahiro Shin
- Department of Neurosurgery, University of Teikyo Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo 179-8606, Japan
| |
Collapse
|
19
|
Bopp MHA, Corr F, Saß B, Pojskic M, Kemmling A, Nimsky C. Augmented Reality to Compensate for Navigation Inaccuracies. SENSORS (BASEL, SWITZERLAND) 2022; 22:9591. [PMID: 36559961 PMCID: PMC9787763 DOI: 10.3390/s22249591] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Revised: 11/22/2022] [Accepted: 12/05/2022] [Indexed: 06/17/2023]
Abstract
This study aims to report on the capability of microscope-based augmented reality (AR) to evaluate registration and navigation accuracy with extracranial and intracranial landmarks and to elaborate on its opportunities and obstacles in compensation for navigation inaccuracies. In a consecutive single surgeon series of 293 patients, automatic intraoperative computed tomography-based registration was performed delivering a high initial registration accuracy with a mean target registration error of 0.84 ± 0.36 mm. Navigation accuracy is evaluated by overlaying a maximum intensity projection or pre-segmented object outlines within the recent focal plane onto the in situ patient anatomy and compensated for by translational and/or rotational in-plane transformations. Using bony landmarks (85 cases), there was two cases where a mismatch was seen. Cortical vascular structures (242 cases) showed a mismatch in 43 cases and cortex representations (40 cases) revealed two inaccurate cases. In all cases, with detected misalignment, a successful spatial compensation was performed (mean correction: bone (6.27 ± 7.31 mm), vascular (3.00 ± 1.93 mm, 0.38° ± 1.06°), and cortex (5.31 ± 1.57 mm, 1.75° ± 2.47°)) increasing navigation accuracy. AR support allows for intermediate and straightforward monitoring of accuracy, enables compensation of spatial misalignments, and thereby provides additional safety by increasing overall accuracy.
Collapse
Affiliation(s)
- Miriam H. A. Bopp
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Felix Corr
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany
- EDU Institute of Higher Education, Villa Bighi, Chaplain’s House, KKR 1320 Kalkara, Malta
| | - Benjamin Saß
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany
| | - Mirza Pojskic
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany
| | - André Kemmling
- Department of Neuroradiology, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| |
Collapse
|