Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room

PURPOSE OF REVIEW

Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development.

RECENT FINDINGS

To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.

Evolution of the meta-neurosurgeon: A systematic review of the current technical capabilities, limitations, and applications of augmented reality in neurosurgery

Background

Augmented reality (AR) applications in neurosurgery have expanded over the past decade with the introduction of headset-based platforms. Many studies have focused on either preoperative planning to tailor the approach to the patient's anatomy and pathology or intraoperative surgical navigation, primarily realized as AR navigation through microscope oculars. Additional efforts have been made to validate AR in trainee and patient education and to investigate novel surgical approaches. Our objective was to provide a systematic overview of AR in neurosurgery, provide current limitations of this technology, as well as highlight several applications of AR in neurosurgery.

Methods

We performed a literature search in PubMed/Medline to identify papers that addressed the use of AR in neurosurgery. The authors screened three hundred and seventy-five papers, and 57 papers were selected, analyzed, and included in this systematic review.

Results

AR has made significant inroads in neurosurgery, particularly in neuronavigation. In spinal neurosurgery, this primarily has been used for pedicle screw placement. AR-based neuronavigation also has significant applications in cranial neurosurgery, including neurovascular, neurosurgical oncology, and skull base neurosurgery. Other potential applications include operating room streamlining, trainee and patient education, and telecommunications.

Conclusion

AR has already made a significant impact in neurosurgery in the above domains and has the potential to be a paradigm-altering technology. Future development in AR should focus on both validating these applications and extending the role of AR.

Single institution series describing external ventricular drain (EVD) placement and short- and long-term complications related to placement accuracy

Background

The placement of an external ventricular drain (EVD) for the treatment of acute hydrocephalus is one of the most common life-saving procedures that neurosurgeons perform worldwide. There are many well-known complications associated with EVD placement, including tract hemorrhages, intra-parenchymal and subdural hemorrhages, infection, and catheter misplacement. Given the variety of complications associated with EVD placement and the inconsistent findings on the relationship of accuracy to complications, the present study reviewed short- and long-term complications related to EVD placement at our institution.

Methods

A retrospective review was conducted for all consecutive patients who underwent bedside EVD placement for any indication between December 2020 and December 2021. Collected variables included demographic information, etiology of disease state, pre-and post-operative head computed tomography measurements, and post-procedural metrics (immediate and delayed complications).

Results

A total of 124 patients qualified for inclusion in our study. EVDs that were non-functioning/exchanged were not significantly related to age, accuracy, ventriculomegaly, sex, disposition, laterality, type of EVD used, intraventricular hemorrhage (IVH), etiology, or Kakarla Grade (KG) (all P > 0.17). The need for a second EVD was similarly not related to age, accuracy, ventriculomegaly, sex, disposition, location, laterality, type of EVD used, IVH, etiology, or KG (all P > 0.130). Patients who died, however, were significantly more likely to have a second contralateral EVD placed (18.2% vs. 4.9% P = 0.029). We also found that left-sided EVDs were significantly more likely to fail within seven days of placement (29.4% vs 13.3%, P = 0.037; relative risk (RR) 1.93, 95% confidence interval: 1.09-3.43), unrelated to age, sex, etiology, type of EVD, IVH, location of the procedure, or accuracy (all P > 0.07). This remained significant when using a binary logistic regression to control for ventriculomegaly, accuracy, mortality, age, sex, and etiology (P = 0.021, B = 3.43).

Conclusion

In our cohort, although a clear relationship between inaccuracy and complication rates was not found, our data did demonstrate that left-sided EVDs were more likely to fail within the immediate postoperative time point, and patients who died were more likely to have a second, contralateral EVD placed.

Understanding Effects of Visual Feedback Delay in AR on Fine Motor Surgical Tasks

Latency is a pervasive issue in various systems that can significantly impact motor performance and user perception. In medical settings, latency can hinder surgeons' ability to quickly correct movements, resulting in an experience that doesn't align with user expectations and standards of care. Despite numerous studies reporting on the negative effects of latency, there is still a gap in understanding how it impacts the use of augmented reality (AR) in medical settings. This study aims to address this gap by examining how latency impacts motor task performance and subjective perceptions, such as cognitive load, on two display types: a monitor display, traditionally used inside an operating room (OR), and a Microsoft HoloLens 2 display. Our findings indicate that both level of latency and display type impact motor performance, and higher latencies on the HoloLens result in relatively poor performance. However, cognitive load was found to be unrelated to display type or latency, but was dependent on the surgeon's training level. Surgeons did not compromise accuracy to gain more speed and were generally well aware of the latency in the system irrespective of their performance on task. Our study provides valuable insights into acceptable thresholds of latency for AR displays and proposes design implications for the successful implementation and use of AR in surgical settings.

Bibliometric analysis of the top 100 cited articles on stereotactic radiosurgery of intracranial meningiomas

BACKGROUND

Sterotactic radiosurgery is becoming an integral modality in the management of intracranial meningiomas, both as the primary treatment or as adjuvant therapy. This study analyzes the scholarly impact of the top 100 cited articles on the stereotactic radiosurgical management of intracranial meningiomas.

METHODS

A ranked list of the 100 most-cited articles was generated using the Scopus database by searching the keywords 'intracranial meningioma' and 'stereotactic radiosurgery'. All articles were then evaluated on multiple criteria regarding both the publication of the articles (year of publication, journal, country of origin, and authors) as well as their methods and foci (type of study, location of studied meningiomas, and type of radiosurgical modality). Quantitaitve and qualitative analyses were then performed from the collected data.

RESULTS

The most frequently cited articles on stereotactic radiosurgical management of intracranial meningiomas were published between 1990 and 2016. The average citation-per-year across all papers in the list was 6.1. The most studied anatomic area of intracranial meningiomas was the skull base, with the cavernous sinus being the most well-studied specific site. The most utilized stereotactic radiosurgical modality was Gamma Knife radiosurgery. The country with the highest number of publications was the United States. Twenty-six percent of the articles were published in the journal Neurosurgery; Lunsford, Kondziolka, Flickinger, Sheehan, and Pollock were respectively the most frequent listed authors among this list. The most active academic institute publishing on this topic was the University of Pittsburgh Medical Center.

CONCLUSION

Stereotactic radiosurgery is an integral modality in the management of intracranial meningiomas. This bibliometric analysis sheds the light on the ways in which intracranial meningiomas have been studied in the past two decades in order to identify trends among neurosurgeons and radiation oncologists and to reveal areas of rising and declining focus.

Tetra-compartmental spinal infection with conus medullaris syndrome: illustrative case

BACKGROUND

Recent literature suggests that spinal infections are increasing in prevalence. Any compartment can be infected in the spine; however, multicompartmental infections are rare.

OBSERVATIONS

To the authors' knowledge, this report is the only reported case of a tetra-compartmental spinal infection consisting of epidural, subdural, subarachnoid, and intramedullary components with a contiguous lumbar spondylodiscitis resulting in conus medullaris syndrome requiring surgical intervention.

LESSONS

This case highlights the importance of surgical intervention in severe cases such as the one illustrated in this report. Second, magnetic resonance imaging with and without contrast is required to check for spreading of the infection as these findings may change the surgical approach. Last, the use of intraoperative ultrasound is paramount to evaluate the subdural and intramedullary compartments in severe cases.

Arachnoid webs causing rostral syrinx due to ball-valve effect: an illustrative report of two cases

An arachnoid web is a pathological formation of the arachnoid membrane. It is a rare phenomenon but is known to lead to syrinx formation in the spinal cord along with pain and neurological deficits. On imaging, the 'scalpel sign' is pathognomonic for an arachnoid web. The etiology of syrinx formation from an arachnoid web is currently unknown. This report documents the only two cases of arachnoid webs with an extensive syrinx in which a likely pathophysiologic mechanism is identified. Both cases presented with motor deficits. The patients had no history of trauma or infection. After extensive workup in both patients and observation of the scalpel sign an arachnoid web was suspected. In both cases, the patients were treated surgically after an arachnoid web was suspected. Intra-operative ultrasound visualized in both cases demonstrates a fenestration in the web that allowed passage of cerebrospinal fluid in a rostral-caudal direction due to a ball-valve effect.

Combined exploratory laparotomy, transpsoas, and thoracic approach to resection of a giant spinal ganglioneuroma: illustrative case

BACKGROUND

Ganglioneuromas are rare peripheral nervous system tumors of neural crest origin. Most are often asymptomatic and incidentally found, but large tumors can cause mass effect. Herein, the authors report a case of a giant ganglioneuroma that arose from the lumbar foramina into the retroperitoneal and thoracic cavities.

OBSERVATIONS

A 62-year-old female presented with low back pain, left lower extremity swelling, and increased sensation of an abdominal mass. Surgical treatment options were reviewed with the patient and coordinated care was planned by surgical oncological specialists. The patient opted for multistage exploratory laparotomy for abdominal mobilization, diaphragm resection, and en bloc resection with neuromonitoring. After surgery, the patient experienced significant improvement in symptoms.

LESSONS

A combined surgical exposure involving gastrointestinal, thoracic, and neurological surgeons can be important in the safe resection of ganglioneuromas that span multiple body cavities. Hence, a thorough preoperative assessment could help plan surgery accordingly.

A systematic comparison of the accuracy of monocular RGB tracking and LiDAR for neuronavigation

With the advent of augmented reality (AR), the use of AR-guided systems in the field of medicine has gained traction. However, the wide-scale adaptation of these systems requires highly accurate and reliable tracking. In this work, the tracking accuracy of two technology platforms, LiDAR and Vuforia, are developed and rigorously tested for a catheter placement neurological procedure. Several experiments (900) are performed for each technology across various combinations of catheter lengths and insertion trajectories. This analysis shows that the LiDAR platform outperformed Vuforia; which is the state-of-the-art in monocular RGB tracking solutions. LiDAR had 75% less radial distance error and 26% less angle deviation error. Results provide key insights into the value and utility of LiDAR-based tracking in AR guidance systems.

The application of augmented reality-based navigation for accurate target acquisition of deep brain sites: advances in neurosurgical guidance

OBJECTIVE

The objective of this study is to quantify the navigational accuracy of an advanced augmented reality (AR)-based guidance system for neurological surgery, biopsy, and/or other minimally invasive neurological surgical procedures.

METHODS

Five burr holes were drilled through a plastic cranium, and 5 optical fiducials (AprilTags) printed with CT-visible ink were placed on the frontal, temporal, and parietal bones of a human skull model. Three 0.5-mm-diameter targets were mounted in the interior of the skull on nylon posts near the level of the tentorium cerebelli and the pituitary fossa. The skull was filled with ballistic gelatin to simulate brain tissue. A CT scan was taken and virtual needle tracts were annotated on the preoperative 3D workstation for the combination of 3 targets and 5 access holes (15 target tracts). The resulting annotated study was uploaded to and launched by VisAR software operating on the HoloLens 2 holographic visor by viewing an encrypted, printed QR code assigned to the study by the preoperative workstation. The DICOM images were converted to 3D holograms and registered to the skull by alignment of the holographic fiducials with the AprilTags attached to the skull. Five volunteers, familiar with the VisAR, used the software/visor combination to navigate an 18-gauge needle/trocar through the series of burr holes to the target, resulting in 70 data points (15 for 4 users and 10 for 1 user). After each attempt the needle was left in the skull, supported by the ballistic gelatin, and a high-resolution CT was taken. Radial error and angle of error were determined using vector coordinates. Summary statistics were calculated individually and collectively.

RESULTS

The combined angle of error of was 2.30° ± 1.28°. The mean radial error for users was 3.62 ± 1.71 mm. The mean target depth was 85.41 mm.

CONCLUSIONS

The mean radial error and angle of error with the associated variance measures demonstrates that VisAR navigation may have utility for guiding a small needle to neural lesions, or targets within an accuracy of 3.62 mm. These values are sufficiently accurate for the navigation of many neurological procedures such as ventriculostomy.

Three decades of progress from surgery to medical therapy for isolated neuroaxis BRAF V600E–positive Langerhans cell histiocytosis management: illustrative case

BACKGROUND

“Langerhans cell histiocytosis” (LCH) is a term that encompasses single-system or multisystem disorders traditionally characterized by a proliferation of clonal CD1a+/CD207+ myeloid-derived histiocytes. In most cases of LCH, mitogen-activated protein kinase (MAPK) pathway somatic mutations lead to near universal upregulation of phosphorylated extracellular signal-regulated kinase expression. The clinical manifestations of LCH are numerous, but bone involvement is common. Intracranial lesions, especially as isolated manifestations, are rare.

OBSERVATIONS

The authors presented the case of a long-term survivor of exclusive intracranial LCH that manifested with isolated craniofacial bone and intraparenchymal central nervous system recurrences, which were managed with 3 decades of multimodal therapy. The patient was initially diagnosed with LCH at age 2 years, and the authors documented the manifestations of disease and treatment for 36 years. Most of the patient’s treatment course occurred before the discovery of BRAF V600E. Treatments initially consisted of chemotherapy, radiosurgery, and open resections for granulomatous LCH lesions. Into young adulthood, the patient had a minimal disease burden but still required additional radiosurgical procedures and open resections.

LESSONS

Surgical treatments alleviated the patient’s immediate symptoms and allowed for tumor burden control. However, surgical interventions did not cure the underlying, aggressive disease. In the current era, access to systemic MAPK inhibitor therapy for histiocytic lesions may offer improved outcomes.

Posterior Communicating Artery Giving Rise to Shared-Origin Anterior Choroidal Artery: Case Illustration

BACKGROUND

The origin point of the anterior choroidal artery (AChA) is variable, typically arising from the supraclinoid internal carotid artery (ICA) distal to the posterior communicating artery (PComA) on either the posterolateral or posterior aspect of the ICA. Variations of AChA origin have important clinical implications, and rare origins reported previously include the ICA bifurcation and middle cerebral artery. We provide illustrations of a case of a shared-origin PComA and AChA.

CASE DESCRIPTION

A young girl presented with intracranial hemorrhage and underwent angiography to evaluate for an underlying cause. Ultimately, 3-dimensional rotational angiography incidentally demonstrated a common origin of the AChA with the PComA.

CONCLUSIONS

A rare case of a shared-origin AChA and PComA is reported for angiographic illustration. The radiologic findings, embryology behind the development of the AChA, and neurosurgical and neurovascular relevance of this variant are discussed. The importance of recognizing the origin of the AChA is emphasized.

Glioblastoma exosomes and IGF-1R/AS-ODN are immunogenic stimuli in a translational research immunotherapy paradigm

Glioblastomas are primary intracranial tumors for which there is no cure. Patients receiving standard of care, chemotherapy and irradiation, survive approximately 15 months prompting studies of alternative therapies including vaccination. In a pilot study, a vaccine consisting of Lucite diffusion chambers containing irradiated autologous tumor cells pre-treated with an antisense oligodeoxynucleotide (AS-ODN) directed against the insulin-like growth factor type 1 receptor was found to elicit positive clinical responses in 8/12 patients when implanted in the rectus sheath for 24 h. Our preliminary observations supported an immune response, and we have since reopened a second Phase 1 trial to assess this possibility among other exploratory objectives. The current study makes use of a murine glioma model and samples from glioblastoma patients in this second Phase 1 trial to investigate this novel therapeutic intervention more thoroughly. Implantation of the chamber-based vaccine protected mice from tumor challenge, and we posit this occurred through the release of immunostimulatory AS-ODN and antigen-bearing exosomes. Exosomes secreted by glioblastoma cultures are immunogenic, eliciting and binding antibodies present in the sera of immunized mice. Similarly, exosomes released by human glioblastoma cells bear antigens recognized by the sera of 6/12 patients with recurrent glioblastomas. These results suggest that the release of AS-ODN together with selective release of exosomes from glioblastoma cells implanted in chambers may drive the therapeutic effect seen in the pilot vaccine trial.