Neurosurgical craniotomy localization using a virtual reality planning system versus intraoperative image–guided navigation

The use of advanced technology for preoperative planning in cranial surgery - A survey by the EANS Young Neurosurgeons Committee

Introduction

Technological advancements provided several preoperative tools allowing for precise preoperative planning in cranial neurosurgery, aiming to increase the efficacy and safety of surgery. However, little data are available regarding if and how young neurosurgeons are trained in using such technologies, how often they use them in clinical practice, and how valuable they consider these technologies.

Research question

How frequently these technologies are used during training and clinical practice as well as to how their perceived value can be qualitatively assessed.

Materials and methods

The Young Neurosurgeons' Committee (YNC) of the European Association of Neurosurgical Societies (EANS) distributed a 14-items survey among young neurosurgeons between June 1st and August 31st, 2022.

Results

A total of 441 responses were collected. Most responders (42.34%) received "formal" training during their residency. Planning techniques were used mainly in neuro-oncology (90.86%), and 3D visualization of patients' DICOM dataset using open-source software was the most frequently used (>20 times/month, 20.34% of responders). Software for 3D visualization of patients' DICOM dataset was the most valuable technology, especially for planning surgical approach (42.03%). Conversely, simulation based on augmented/mixed/virtual reality was considered the less valuable tool, being rated below sufficiency by 39.7% of responders.

Discussion and conclusion

Training for using preoperative planning technologies in cranial neurosurgery is provided by neurosurgical residency programs. Software for 3D visualization of DICOM datasets is the most valuable and used tool, especially in neuro-oncology. Interestingly, simulation tools based on augmented/virtual/mixed reality are considered less valuable and, therefore, less used than other technologies.

Photorealistic 3-Dimensional Models of the Anatomy and Neurosurgical Approaches to the V2, V3, and V4 Segments of the Vertebral Artery

BACKGROUND

The vertebral artery (VA) has a tortuous course subdivided into 4 segments (V1-V4). For neurosurgeons, a thorough knowledge of the 3-dimensional (3D) anatomy at different segments is a prerequisite for safe surgery. New technologies allowing creation of photorealistic 3D models may enhance the anatomic understanding of this complex region.

OBJECTIVE

To create photorealistic 3D models illustrating the anatomy and surgical steps needed for safe neurosurgical exposure of the VA.

METHODS

We dissected 2 latex injected cadaver heads. Anatomic layered dissections were performed on the first specimen. On the second specimen, the two classical approaches to the VA (far lateral and anterolateral) were realized. Every step of dissection was scanned using photogrammetry technology that allowed processing of 3D data from 2-dimensional photographs by a simplified algorithm mainly based on a dedicated mobile phone application and open-source 3D modeling software. For selected microscopic 3D anatomy, we used an operating microscope to generate 3D models.

RESULTS

Classic anatomic (n=17) and microsurgical (n=12) 3D photorealistic models based on cadaver dissections were created. The models allow observation of the spatial relations of each anatomic structure of interest and have an immersive view of the approaches to the V2-V4 segments of the VA. Once generated, these models may easily be shared on any digital device or web-based platforms for 3D visualization.

CONCLUSIONS

Photorealistic 3D scanning technology is a promising tool to present complex anatomy in a more comprehensive way. These 3D models can be used for education, training, and potentially preoperative planning.

Standardization of Strategies to Perform a Parafascicular Tubular Approach for the Resection of Brain Tumors in Eloquent Areas

Objective: The aim of this work is to define a methodological strategy for the minimally invasive tubular retractor (MITR) parafascicular transulcal approach (PTA) for the management of brain tumors sited in eloquent areas. Methods: An observational prospective study was designed to evaluate the benefits of PTA associated with MITRs, tractography and intraoperative cortical stimulation. They study was conducted from June 2018 to June 2021. Information regarding white matter tracts was processed, preventing a potential damage during the approach and/or resection. All patients older than 18 years who had a single brain tumor lesion were included in the study. Patients with a preoperative Karnofsky Performance Scale (KPS) score greater than 70% and a Glasgow Coma Scale (GCS) score > 14 points were included. Results: 72 patients were included in the study, the mean age was 49.6, the most affected gender was male, 12.5% presented aphasia, 11.1% presented paraphasia, 41.6% had motor deficit, 9.7% had an affection in the optic pathway, the most frequently affected region was the frontal lobe (26.3%), the most frequent lesions were high-grade gliomas (34.7%) and the measurement of the incisions was on average 5.58 cm. Of the patients, 94.4% underwent a total macroscopic resection and 90.2% did not present new postoperative neurological deficits. In all cases, a PTA was used. Conclusion: Tubular minimally invasive approaches (MIAs) allow one to perform maximal safe resection of brain tumors in eloquent areas, through small surgical corridors. Future comparative studies between traditional and minimally invasive techniques are required to further investigate the potential of these surgical nuances.

A data-centric artificial intelligent and extended reality technology in smart healthcare systems

Extended reality (XR) solutions are quietly maturing, and their novel use cases are already being investigated, particularly in the healthcare industry. By 2022, the extended reality market is anticipated to be worth $209 billion. Certain diseases, such as Alzheimer's, Schizophrenia, Stroke rehabilitation stimulating specific areas of the patient's brain, healing brain injuries, surgeon training, realistic 3D visualization, touch-free interfaces, and teaching social skills to children with autism, have shown promising results with XR-assisted treatments. Similar effects have been used in video game therapies like Akili Interactive's EndeavorRx, which has previously been approved by the Food and Drug Administration (FDA) as a treatment regimen for children with attention deficit hyperactivity disorder (ADHD). However, while these improvements have received positive feedback, the field of XR-assisted patient treatment is in its infancy. The growth of XR in the healthcare sphere has the potential to transform the delivery of medical services. Imagine an elderly patient in a remote setting having a consultation with a world-renowned expert without ever having to leave their house. Rather than operating on cadavers in a medical facility, a surgical resident does surgery in a virtual setting at home. On the first try, a nurse uses a vein finder to implant an IV. Through cognitive treatment in a virtual world, a war veteran recovers from post-traumatic stress disorder (PTSD). The paper discusses the potential impact of XR in transforming the healthcare industry, as well as its use cases, challenges, XR tools and techniques for intelligent health care, recent developments of XR in intelligent healthcare services, and the potential benefits and future aspects of XR techniques in the medical domain.

Virtual and Augmented Reality in Neurosurgery: The Evolution of its Application and Study Designs

BACKGROUND

As the art of neurosurgery evolves in the 21st century, more emphasis is placed on minimally invasive techniques, which require technical precision. Simultaneously, the reduction on training hours continues, and teachers of neurosurgery faces "double jeopardy"-with harder skills to teach and less time to teach them. Mixed reality appears as the neurosurgical educators' natural ally: Virtual reality facilitates the learning of spatial relationships and permits rehearsal of skills, while augmented reality can make procedures safer and more efficient. Little wonder then, that the body of literature on mixed reality in neurosurgery has grown exponentially.

METHODS

Publications involving virtual and augmented reality in neurosurgery were examined. A total of 414 papers were included, and they were categorized according to study design and analyzed.

RESULTS

Half of the papers were published within the last 3 years alone. Whereas in the earlier half, most of the publications involved experiments in virtual reality simulation and the efficacy of skills acquisition, many of the more recent publication are proof-of-concept studies. This attests to the evolution of mixed reality in neurosurgery. As the technology advances, neurosurgeons are finding more applications, both in training and clinical practice.

CONCLUSIONS

With parallel advancement in Internet speed and artificial intelligence, the utilization of mixed reality will permeate neurosurgery. From solving staff problems in global neurosurgery, to mitigating the deleterious effect of duty-hour reductions, to improving individual operations, mixed reality will have a positive effect in many aspects of neurosurgery.

Virtual Reality in the Neurosciences: Current Practice and Future Directions

Virtual reality has made numerous advancements in recent years and is used with increasing frequency for education, diversion, and distraction. Beginning several years ago as a device that produced an image with only a few pixels, virtual reality is now able to generate detailed, three-dimensional, and interactive images. Furthermore, these images can be used to provide quantitative data when acting as a simulator or a rehabilitation device. In this article, we aim to draw attention to these areas, as well as highlight the current settings in which virtual reality (VR) is being actively studied and implemented within the field of neurosurgery and the neurosciences. Additionally, we discuss the current limitations of the applications of virtual reality within various settings. This article includes areas in which virtual reality has been used in applications both inside and outside of the operating room, such as pain control, patient education and counseling, and rehabilitation. Virtual reality's utility in neurosurgery and the neurosciences is widely growing, and its use is quickly becoming an integral part of patient care, surgical training, operative planning, navigation, and rehabilitation.

Microsurgical clipping of middle cerebral artery aneurysms: preoperative planning using virtual reality to reduce procedure time

OBJECTIVE

The authors sought to evaluate the impact of virtual reality (VR) applications for preoperative planning and rehearsal on the total procedure time of microsurgical clipping of middle cerebral artery (MCA) ruptured and unruptured aneurysms compared with standard surgical planning.

METHODS

A retrospective review of 21 patients from 2016 to 2019 was conducted to determine the impact on the procedure time of MCA aneurysm clipping after implementing VR for preoperative planning and rehearsal. The control group consisted of patients whose procedures were planned with standard CTA and DSA scans (n = 11). The VR group consisted of patients whose procedures were planned with a patient-specific 360° VR (360VR) model (n = 10). The 360VR model was rendered using CTA and DSA data when available. Each patient was analyzed and scored with a case complexity (CC) 5-point grading scale accounting for aneurysm size, incorporation of M2 branches, and aspect ratio, with 1 being the least complex and 5 being the most complex. The mean procedure times were compared between the VR group and the control group, as were the mean CC score between the groups. Comorbidities and aneurysm conduction (ruptured vs unruptured) were also taken into consideration for the comparison.

RESULTS

The mean CC scores for the control group and VR group were 2.45 ± 1.13 and 2.30 ± 0.48, respectively. CC was not significantly different between the two groups (p = 0.69). The mean procedure time was significantly lower for the VR group compared with the control group (247.80 minutes vs 328.27 minutes; p = 0.0115), particularly for the patients with a CC score of 2 (95% CI, p = 0.0064). A Charlson Comorbidity Index score was also calculated for each group, but no statistical significance was found (VR group, 2.8 vs control group, 1.8, p = 0.14).

CONCLUSIONS

In this study, usage of 360VR models for planning the craniotomy and rehearsing with various clip sizes and configurations resulted in an 80-minute decrease in procedure time. These findings have suggested the potential of VR technology in improving surgical efficiency for aneurysm clipping procedures regardless of complexity, while making the procedure faster and safer.

Presurgical and Intraoperative Augmented Reality in Neuro-Oncologic Surgery: Clinical Experiences and Limitations

Virtual reality (VR) and augmented reality (AR) represent novel adjuncts for neurosurgical planning in neuro-oncology. In addition to established use in surgical and medical training, VR/AR are gaining traction for clinical use preoperatively and intraoperatively. To understand the utility of VR/AR in the clinical setting, we conducted a literature search in Ovid MEDLINE and EMBASE with various search terms designed to capture the use of VR/AR in neurosurgical procedures for resection of cranial tumors. The search retrieved 302 articles, of which 35 were subjected to full-text review; 19 full-text articles were included in the review. Key findings highlighted by the individual authors were extracted and summarized into themes to present the value of VR/AR in the clinical setting. These studies included various VR/AR systems applied to surgeries involving heterogeneous pathologies and outcome measures. Overall, VR/AR were found to be qualitatively advantageous due to enhanced visualization of complex anatomy and improved intraoperative lesion localization. When these technologies were compared with existing neuronavigation systems, quantitative clinical benefits were also reported. The capacity to visualize three-dimensional images superimposed on patient anatomy is a potentially valuable tool in complex neurosurgical environments. Surgical limitations may be addressed through future advances in image registration and tracking as well as intraoperatively acquired imaging with the ability to yield real-time virtual models.

Neurosurgical Virtual Reality Simulation for Brain Tumor Using High-definition Computer Graphics: A Review of the Literature

Simulation and planning of surgery using a virtual reality model is becoming common with advances in computer technology. In this study, we conducted a literature search to find trends in virtual simulation of surgery for brain tumors. A MEDLINE search for “neurosurgery AND (simulation OR virtual reality)” retrieved a total of 1,298 articles published in the past 10 years. After eliminating studies designed solely for education and training purposes, 28 articles about the clinical application remained. The finding that the vast majority of the articles were about education and training rather than clinical applications suggests that several issues need be addressed for clinical application of surgical simulation. In addition, 10 of the 28 articles were from Japanese groups. In general, the 28 articles demonstrated clinical benefits of virtual surgical simulation. Simulation was particularly useful in better understanding complicated spatial relations of anatomical landmarks and in examining surgical approaches. In some studies, Virtual reality models were used on either surgical navigation system or augmented reality technology, which projects virtual reality images onto the operating field. Reported problems were difficulties in standardized, objective evaluation of surgical simulation systems; inability to respond to tissue deformation caused by surgical maneuvers; absence of the system functionality to reflect features of tissue (e.g., hardness and adhesion); and many problems with image processing. The amount of description about image processing tended to be insufficient, indicating that the level of evidence, risk of bias, precision, and reproducibility need to be addressed for further advances and ultimately for full clinical application.

Android application for determining surgical variables in brain-tumor resection procedures

The fidelity of image-guided neurosurgical procedures is often compromised due to the mechanical deformations that occur during surgery. In recent work, a framework was developed to predict the extent of this brain shift in brain-tumor resection procedures. The approach uses preoperatively determined surgical variables to predict brain shift and then subsequently corrects the patient's preoperative image volume to more closely match the intraoperative state of the patient's brain. However, a clinical workflow difficulty with the execution of this framework is the preoperative acquisition of surgical variables. To simplify and expedite this process, an Android, Java-based application was developed for tablets to provide neurosurgeons with the ability to manipulate three-dimensional models of the patient's neuroanatomy and determine an expected head orientation, craniotomy size and location, and trajectory to be taken into the tumor. These variables can then be exported for use as inputs to the biomechanical model associated with the correction framework. A multisurgeon, multicase mock trial was conducted to compare the accuracy of the virtual plan to that of a mock physical surgery. It was concluded that the Android application was an accurate, efficient, and timely method for planning surgical variables.

Assessment of the Accuracy and Errors of Head-Up Display by an Optical Neuronavigation System in Brain Tumor Surgery

BACKGROUND: A head-up display (HUD) in which navigational information is projected into the microscope view may enable surgeons to perform operations more efficiently. Projecting depictions of both tumor and important intracranial structures on the HUD may facilitate safe surgery.

OBJECTIVE: To investigate accuracy and errors regarding important intracranial structures, errors due to brain shifts, and preservation rates for important intracranial structures.

METHODS: A total of 184 surgeries in 172 patients were performed using this operation system. Postoperatively, we determined accuracy and errors for actual structures and virtual reality on the HUD and performed statistical analyses.

RESULTS: Preresection accuracy for important intracranial structures was highest for the internal carotid artery (ICA; 90.4%) and lowest for the posterior inferior cerebellar artery (53.6%). Differences between pre- and postresection accuracy were greatest, in descending order, for the cortical vein (P < .0001), V4 segment of vertebral artery (P < .0001), and anterior inferior cerebellar artery (P = .00780), whereas differences between pre- and postresection errors were smallest for the cranial nerve V (P = .500), middle cerebral artery (P = .0313), and ICA (P = .0313). Cases of poor preresection accuracy and large differences in pre- to postresection accuracy were seen in the prone position.

CONCLUSION: A reliable surgical resection rate was achieved using the HUD, and reliable preservation of important intracranial structures was also possible. Accuracy was concluded to be within an acceptable range.

Augmented reality-assisted bypass surgery: embracing minimal invasiveness

OBJECTIVE

The overlay of virtual images on the surgical field, defined as augmented reality, has been used for image guidance during various neurosurgical procedures. Although this technology could conceivably address certain inherent problems of extracranial-to-intracranial bypass procedures, this potential has not been explored to date. We evaluate the usefulness of an augmented reality-based setup, which could help in harvesting donor vessels through their precise localization in real-time, in performing tailored craniotomies, and in identifying preoperatively selected recipient vessels for the purpose of anastomosis.

METHODS

Our method was applied to 3 patients with Moya-Moya disease who underwent superficial temporal artery-to-middle cerebral artery anastomoses and 1 patient who underwent an occipital artery-to-posteroinferior cerebellar artery bypass because of a dissecting aneurysm of the vertebral artery. Patients' heads, skulls, and extracranial and intracranial vessels were segmented preoperatively from 3-dimensional image data sets (3-dimensional digital subtraction angiography, angio-magnetic resonance imaging, angio-computed tomography), and injected intraoperatively into the operating microscope's eyepiece for image guidance.

RESULTS

In each case, the described setup helped in precisely localizing donor and recipient vessels and in tailoring craniotomies to the injected images.

CONCLUSIONS

The presented system based on augmented reality can optimize the workflow of extracranial-to-intracranial bypass procedures by providing essential anatomical information, entirely integrated to the surgical field, and help to perform minimally invasive procedures.

Emerging new trends in neurosurgical technologies

There has been tremendous progress in the modern day technologies causing a rapid evolution in the field of neurosurgery. The neurosurgeons have been equipped with the latest advancements such as the use of robotics in surgery, the image-guided neurosurgical procedures, and the stereotactic neurosurgery. In addition, the preoperative screening techniques have drastically improved the success of the surgical procedure. Neuronavigation has allowed the precise localization of the deep-seated brain structures thereby helping in the accurate operation of the affected regions without stirring the normal brain tissues. Such preciseness has helped in the improvement of the patient outcome. All these aspects have been discussed in detail in this review with a focus on their developmental background.

Neuronavigation in the surgical management of brain tumors: current and future trends

Neuronavigation has become an ubiquitous tool in the surgical management of brain tumors. This review describes the use and limitations of current neuronavigational systems for brain tumor biopsy and resection. Methods for integrating intraoperative imaging into neuronavigational datasets developed to address the diminishing accuracy of positional information that occurs over the course of brain tumor resection are discussed. In addition, the process of integration of functional MRI and tractography into navigational models is reviewed. Finally, emerging concepts and future challenges relating to the development and implementation of experimental imaging technologies in the navigational environment are explored.

3D preoperative planning in the ER with OsiriX®: when there is no time for neuronavigation

The evaluation of patients in the emergency room department (ER) through more accurate imaging methods such as computed tomography (CT) has revolutionized their assistance in the early 80s. However, despite technical improvements seen during the last decade, surgical planning in the ER has not followed the development of image acquisition methods. The authors present their experience with DICOM image processing as a navigation method in the ER. The authors present 18 patients treated in the Emergency Department of the Hospital das Clínicas of the University of Sao Paulo. All patients were submitted to volumetric CT. We present patients with epidural hematomas, acute/subacute subdural hematomas and contusional hematomas. Using a specific program to analyze images in DICOM format (OsiriX^®), the authors performed the appropriate surgical planning. The use of 3D surgical planning made it possible to perform procedures more accurately and less invasively, enabling better postoperative outcomes. All sorts of neurosurgical emergency pathologies can be treated appropriately with no waste of time. The three-dimensional processing of images in the preoperative evaluation is easy and possible even within the emergency care. It should be used as a tool to reduce the surgical trauma and it may dispense methods of navigation in many cases.

Advanced 3-Dimensional Planning in Neurosurgery

During the past decades, medical applications of virtual reality technology have been developing rapidly, ranging from a research curiosity to a commercially and clinically important area of medical informatics and technology. With the aid of new technologies, the user is able to process large amounts of data sets to create accurate and almost realistic reconstructions of anatomic structures and related pathologies. As a result, a 3-diensional (3-D) representation is obtained, and surgeons can explore the brain for planning or training. Further improvement such as a feedback system increases the interaction between users and models by creating a virtual environment. Its use for advanced 3-D planning in neurosurgery is described. Different systems of medical image volume rendering have been used and analyzed for advanced 3-D planning: 1 is a commercial “ready-to-go” system (Dextroscope, Bracco, Volume Interaction, Singapore), whereas the others are open-source-based software (3-D Slicer, FSL, and FreesSurfer). Different neurosurgeons at our institution experienced how advanced 3-D planning before surgery allowed them to facilitate and increase their understanding of the complex anatomic and pathological relationships of the lesion. They all agreed that the preoperative experience of virtually planning the approach was helpful during the operative procedure. Virtual reality for advanced 3-D planning in neurosurgery has achieved considerable realism as a result of the available processing power of modern computers. Although it has been found useful to facilitate the understanding of complex anatomic relationships, further effort is needed to increase the quality of the interaction between the user and the model.

Intraoperative image guidance in neurosurgery: development, current indications, and future trends

Introduction. As minimally invasive surgery becomes the standard of care in neurosurgery, it is imperative that surgeons become skilled in the use of image-guided techniques. The development of image-guided neurosurgery represents a substantial improvement in the microsurgical treatment of tumors, vascular malformations, and other intracranial lesions. Objective. There have been numerous advances in neurosurgery which have aided the neurosurgeon to achieve accurate removal of pathological tissue with minimal disruption of surrounding healthy neuronal matter including the development of microsurgical, endoscopic, and endovascular techniques. Neuronavigation systems and intraoperative imaging should improve success in cranial neurosurgery. Additional functional imaging modalities such as PET, SPECT, DTI (for fiber tracking), and fMRI can now be used in order to reduce neurological deficits resulting from surgery; however the positive long-term effect remains questionable for many indications. Method. PubMed database search using the search term "image guided neurosurgery." More than 1400 articles were published during the last 25 years. The abstracts were scanned for prospective comparative trials. Results and Conclusion. 14 comparative trials are published. To date significant data amount show advantages in intraoperative accuracy influencing the perioperative morbidity and long-term outcome only for cerebral glioma surgery.

Personalized health care system with virtual reality rehabilitation and appropriate information for seniors

The concept of the information society is now a common one, as opposed to the industrial society that dominated the economy during the last years. It is assumed that all sectors should have access to information and reap its benefits. Elderly people are, in this respect, a major challenge, due to their lack of interest in technological progress and their lack of knowledge regarding the potential benefits that information society technologies might have on their lives. The Naviga Project (An Open and Adaptable Platform for the Elderly and Persons with Disability to Access the Information Society) is a European effort, whose main goal is to design and develop a technological platform allowing elder people and persons with disability to access the internet and the information society. Naviga also allows the creation of services targeted to social networks, mind training and personalized health care. In this paper we focus on the health care and information services designed on the project, the technological platform developed and details of two representative elements, the virtual reality hand rehabilitation and the health information intelligent system.