1
|
Sharma N, Mallela AN, Khan T, Canton SP, Kass NM, Steuer F, Jardini J, Biehl J, Andrews EG. Evolution of the meta-neurosurgeon: A systematic review of the current technical capabilities, limitations, and applications of augmented reality in neurosurgery. Surg Neurol Int 2024; 15:146. [PMID: 38742013 PMCID: PMC11090549 DOI: 10.25259/sni_167_2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 04/05/2024] [Indexed: 05/16/2024] Open
Abstract
Background Augmented reality (AR) applications in neurosurgery have expanded over the past decade with the introduction of headset-based platforms. Many studies have focused on either preoperative planning to tailor the approach to the patient's anatomy and pathology or intraoperative surgical navigation, primarily realized as AR navigation through microscope oculars. Additional efforts have been made to validate AR in trainee and patient education and to investigate novel surgical approaches. Our objective was to provide a systematic overview of AR in neurosurgery, provide current limitations of this technology, as well as highlight several applications of AR in neurosurgery. Methods We performed a literature search in PubMed/Medline to identify papers that addressed the use of AR in neurosurgery. The authors screened three hundred and seventy-five papers, and 57 papers were selected, analyzed, and included in this systematic review. Results AR has made significant inroads in neurosurgery, particularly in neuronavigation. In spinal neurosurgery, this primarily has been used for pedicle screw placement. AR-based neuronavigation also has significant applications in cranial neurosurgery, including neurovascular, neurosurgical oncology, and skull base neurosurgery. Other potential applications include operating room streamlining, trainee and patient education, and telecommunications. Conclusion AR has already made a significant impact in neurosurgery in the above domains and has the potential to be a paradigm-altering technology. Future development in AR should focus on both validating these applications and extending the role of AR.
Collapse
Affiliation(s)
- Nikhil Sharma
- School of Medicine, University of Pittsburgh, Pittsburgh, United States
| | - Arka N. Mallela
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, United States
| | - Talha Khan
- Department of Computing and Information, University of Pittsburgh, Pittsburgh, United States
| | - Stephen Paul Canton
- Department of Orthopaedic Surgery, University of Pittsburgh Medical Center, Pittsburgh, United States
| | | | - Fritz Steuer
- School of Medicine, University of Pittsburgh, Pittsburgh, United States
| | - Jacquelyn Jardini
- Department of Biology, Haverford College, Haverford, Pennsylvania, United States
| | - Jacob Biehl
- Department of Computing and Information, University of Pittsburgh, Pittsburgh, United States
| | - Edward G. Andrews
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, United States
| |
Collapse
|
2
|
Kos TM, Colombo E, Bartels LW, Robe PA, van Doormaal TPC. Evaluation Metrics for Augmented Reality in Neurosurgical Preoperative Planning, Surgical Navigation, and Surgical Treatment Guidance: A Systematic Review. Oper Neurosurg (Hagerstown) 2023; 26:01787389-990000000-01007. [PMID: 38146941 PMCID: PMC11008635 DOI: 10.1227/ons.0000000000001009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 10/10/2023] [Indexed: 12/27/2023] Open
Abstract
BACKGROUND AND OBJECTIVE Recent years have shown an advancement in the development of augmented reality (AR) technologies for preoperative visualization, surgical navigation, and intraoperative guidance for neurosurgery. However, proving added value for AR in clinical practice is challenging, partly because of a lack of standardized evaluation metrics. We performed a systematic review to provide an overview of the reported evaluation metrics for AR technologies in neurosurgical practice and to establish a foundation for assessment and comparison of such technologies. METHODS PubMed, Embase, and Cochrane were searched systematically for publications on assessment of AR for cranial neurosurgery on September 22, 2022. The findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. RESULTS The systematic search yielded 830 publications; 114 were screened full text, and 80 were included for analysis. Among the included studies, 5% dealt with preoperative visualization using AR, with user perception as the most frequently reported metric. The majority (75%) researched AR technology for surgical navigation, with registration accuracy, clinical outcome, and time measurements as the most frequently reported metrics. In addition, 20% studied the use of AR for intraoperative guidance, with registration accuracy, task outcome, and user perception as the most frequently reported metrics. CONCLUSION For quality benchmarking of AR technologies in neurosurgery, evaluation metrics should be specific to the risk profile and clinical objectives of the technology. A key focus should be on using validated questionnaires to assess user perception; ensuring clear and unambiguous reporting of registration accuracy, precision, robustness, and system stability; and accurately measuring task performance in clinical studies. We provided an overview suggesting which evaluation metrics to use per AR application and innovation phase, aiming to improve the assessment of added value of AR for neurosurgical practice and to facilitate the integration in the clinical workflow.
Collapse
Affiliation(s)
- Tessa M. Kos
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Elisa Colombo
- Department of Neurosurgery, Clinical Neuroscience Center, Universitätsspital Zürich, Zurich, The Netherlands
| | - L. Wilbert Bartels
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Pierre A. Robe
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Tristan P. C. van Doormaal
- Department of Neurosurgery, Clinical Neuroscience Center, Universitätsspital Zürich, Zurich, The Netherlands
- Department of Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
3
|
Zoia C, Mantovani G, Müther M, Suero Molina E, Scerrati A, De Bonis P, Cornelius J, Roche P, Tatagiba M, Jouanneau E, Manet R, Schroeder H, Cavallo L, Kasper E, Meling T, Mazzatenta D, Daniel R, Messerer M, Visocchi M, Froelich S, Bruneau M, Spena G. Through the orbit and beyond: Current state and future perspectives in endoscopic orbital surgery on behalf of the EANS frontiers committee in orbital tumors and the EANS skull base section. BRAIN & SPINE 2023; 3:102669. [PMID: 37720459 PMCID: PMC10500473 DOI: 10.1016/j.bas.2023.102669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 08/16/2023] [Accepted: 08/25/2023] [Indexed: 09/19/2023]
Abstract
Introduction Orbital surgery has always been disputed among specialists, mainly neurosurgeons, otorhinolaryngologists, maxillofacial surgeons and ophthalmologists. The orbit is a borderland between intra- and extracranial compartments; Krönlein's lateral orbitotomy and the orbitozygomatic infratemporal approach are the historical milestones of modern orbital-cranial surgery. Research question Since its first implementation, endoscopy has significantly impacted neurosurgery, changing perspectives and approaches to the skull base. Since its first application in 2009, transorbital endoscopic surgery opened the way for new surgical scenario, previously feasible only with extensive tissue dissection. Material and methods A PRISMA based literature search was performed to select the most relevant papers on the topic. Results Here, we provide a narrative review on the current state and future trends in endoscopic orbital surgery. Discussion and conclusion This manuscript is a joint effort of the EANS frontiers committee in orbital tumors and the EANS skull base section.
Collapse
Affiliation(s)
- C. Zoia
- UOC Neurochirurgia, Ospedale Moriggia Pelascini, Gravedona e Uniti, Italy
| | - G. Mantovani
- Neurosurgery Unit, Department of Translational Medicine, University of Ferrara, Ferrara, Italy
| | - M. Müther
- Department of Neurosurgery, University Hospital of Münster, Münster, Germany
| | - E. Suero Molina
- Department of Neurosurgery, University Hospital of Münster, Münster, Germany
| | - A. Scerrati
- Neurosurgery Unit, Department of Translational Medicine, University of Ferrara, Ferrara, Italy
| | - P. De Bonis
- Neurosurgery Unit, Department of Translational Medicine, University of Ferrara, Ferrara, Italy
| | - J.F. Cornelius
- Department of Neurosurgery, Medical Faculty, Heinrich-Heine-University, Düsseldorf, Germany
| | - P.H. Roche
- Department of Neurosurgery, Aix-Marseille Université, Assistance Publique-Hôpitaux de Marseille, Hôpital Nord, Marseille, France
| | - M. Tatagiba
- Department of Neurosurgery, University Hospital Tübingen, Tübingen, Germany
| | - E. Jouanneau
- Department of Neurosurgery, Hôpital Neurologique Pierre Wertheimer, Lyon, France
| | - R. Manet
- Department of Neurosurgery, Hôpital Neurologique Pierre Wertheimer, Lyon, France
| | - H.W.S. Schroeder
- Department of Neurosurgery, University Medicine Greifswald, Germany
| | - L.M. Cavallo
- Department of Neurosciences and Reproductive and Dental Sciences, Division of Neurosurgery, Federico II University of Naples, Policlinico Federico II University Hospital, Italy
| | - E.M. Kasper
- Department of Neurosurgery, Steward Medical Group, Brighton, USA
| | - T.R. Meling
- Department of Neurosurgery, The National Hospital, Rigshospitalet, Copenhagen, Denmark
| | - D. Mazzatenta
- Department of Neurosurgery, Neurological Sciences Institut IRCCS, Bologna, Italy
| | - R.T. Daniel
- Department of Neurosurgery, Department of Neuroscience, Centre Hospitalier Universitaire Vaudois, University Hospital, Lausanne, Switzerland
| | - M. Messerer
- Department of Neurosurgery, Department of Neuroscience, Centre Hospitalier Universitaire Vaudois, University Hospital, Lausanne, Switzerland
| | - M. Visocchi
- Department of Neurosurgery, Institute of Neurosurgery Catholic University of Rome, Italy
| | - S. Froelich
- Department of Neurosurgery, Lariboisière Hospital, Université Paris Diderot, Paris, France
| | - M. Bruneau
- Department of Neurosurgery, Universitair Ziekenhuis Brussel, Vrije Universiteit Brussel, Brussels, Belgium
| | - G. Spena
- Neurosurgery Unit, IRCSS San Matteo Hospital, Pavia, Italy
| |
Collapse
|
4
|
Satoh M, Nakajima T, Watanabe E, Kawai K. Augmented Reality in Stereotactic Neurosurgery: Current Status and Issues. Neurol Med Chir (Tokyo) 2023; 63:137-140. [PMID: 36682793 PMCID: PMC10166603 DOI: 10.2176/jns-nmc.2022-0278] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
Abstract
Stereotactic neurosurgery is an established technique, but it has several limitations. In frame-based stereotaxy using a stereotactic frame, frame setting errors may decrease the accuracy of the procedure. Frameless stereotaxy using neuronavigation requires surgeons to shift their view from the surgical field to the navigation display and to advance the needle while assuming a physically uncomfortable position. To overcome these limitations, several researchers have applied augmented reality in stereotactic neurosurgery. Augmented reality enables surgeons to visualize the information regarding the target and preplanned trajectory superimposed over the actual surgical field. In frame-based stereotaxy, a researcher applies tablet computer-based augmented reality to check for the setting errors of the stereotactic frame, thereby improving the safety of the procedure. Several researchers have reported performing frameless stereotaxy guided by head-mounted-display-based augmented reality that enables surgeons to advance the needle at a more natural posture. These studies have shown that augmented reality can address the limitations of stereotactic neurosurgery. Conversely, they have also revealed the limited accuracy of current augmented reality systems for small targets, which indicates that further development of augmented reality systems is needed.
Collapse
Affiliation(s)
- Makoto Satoh
- Department of Neurosurgery, Jichi Medical University
| | | | - Eiju Watanabe
- Department of Neurosurgery, Jichi Medical University
| | - Kensuke Kawai
- Department of Neurosurgery, Jichi Medical University
| |
Collapse
|
5
|
Boaro A, Moscolo F, Feletti A, Polizzi G, Nunes S, Siddi F, Broekman M, Sala F. Visualization, navigation, augmentation. The ever-changing perspective of the neurosurgeon. BRAIN & SPINE 2022; 2:100926. [PMID: 36248169 PMCID: PMC9560703 DOI: 10.1016/j.bas.2022.100926] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 07/23/2022] [Accepted: 08/10/2022] [Indexed: 11/22/2022]
Abstract
Introduction The evolution of neurosurgery coincides with the evolution of visualization and navigation. Augmented reality technologies, with their ability to bring digital information into the real environment, have the potential to provide a new, revolutionary perspective to the neurosurgeon. Research question To provide an overview on the historical and technical aspects of visualization and navigation in neurosurgery, and to provide a systematic review on augmented reality (AR) applications in neurosurgery. Material and methods We provided an overview on the main historical milestones and technical features of visualization and navigation tools in neurosurgery. We systematically searched PubMed and Scopus databases for AR applications in neurosurgery and specifically discussed their relationship with current visualization and navigation systems, as well as main limitations. Results The evolution of visualization in neurosurgery is embodied by four magnification systems: surgical loupes, endoscope, surgical microscope and more recently the exoscope, each presenting independent features in terms of magnification capabilities, eye-hand coordination and the possibility to implement additional functions. In regard to navigation, two independent systems have been developed: the frame-based and the frame-less systems. The most frequent application setting for AR is brain surgery (71.6%), specifically neuro-oncology (36.2%) and microscope-based (29.2%), even though in the majority of cases AR applications presented their own visualization supports (66%). Discussion and conclusions The evolution of visualization and navigation in neurosurgery allowed for the development of more precise instruments; the development and clinical validation of AR applications, have the potential to be the next breakthrough, making surgeries safer, as well as improving surgical experience and reducing costs.
Collapse
Affiliation(s)
- A. Boaro
- Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| | - F. Moscolo
- Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| | - A. Feletti
- Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| | - G.M.V. Polizzi
- Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| | - S. Nunes
- Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| | - F. Siddi
- Department of Neurosurgery, Haaglanden Medical Center, The Hague, Zuid-Holland, the Netherlands
| | - M.L.D. Broekman
- Department of Neurosurgery, Haaglanden Medical Center, The Hague, Zuid-Holland, the Netherlands
- Department of Neurosurgery, Leiden University Medical Center, Leiden, Zuid-Holland, the Netherlands
| | - F. Sala
- Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| |
Collapse
|