Pedicle Screw Placement Using Augmented Reality Surgical Navigation With Intraoperative 3D Imaging: A First In-Human Prospective Cohort Study

Low Radiation Protocol for Intraoperative Robotic C-Arm Can Enhance Adolescent Idiopathic Scoliosis Deformity Correction Accuracy and Safety

STUDY DESIGN

Retrospective case-series study.

OBJECTIVES

To assess (1) low cone beam CT (CBCT) mediated intraoperative navigation to limit radiation exposure without compromising surgical accuracy, and (2) the potential of intraoperative C-arm CBCT navigation to augment pedicle screw (PS) placement accuracy in AIS surgery compared to pre-surgery CT-based planning.

METHODS

The first part involved a prospective phantom study, comparing radiation doses for conventional CT, and standard (6sDCT) and a low dose (5sDCT) Artis Zeego®-imaging. Next, 5sDCT- and 6sDCT-navigation were compared on PS accuracy and radiation exposure during AIS correction. The final part compared surgical AIS deformity correction through intraoperative 5sDCT navigation to a matched cohort treated using conventional pre-surgery CT-scans for navigation. Outcome parameters included operation time, skin dose (SD), dose area product (DAP), intraoperative blood loss, postoperative complications, and PS deviation rates.

RESULTS

The phantom study demonstrated a reduction in radiation for the 5sDCT protocol. Moreover, 5sDCT-imaged patients (n = 15) showed a significantly lower SD (-27.41%) and DAP (-30.92%), without compromising PS accuracy compared with 6sDCT-settings (n = 15). Finally, AIS correction through intraoperative CBCT C-arm navigation (n = 27) significantly reduced screw deviation rates (6.83% versus 10.75%, P = .016) without increasing operation times, compared with conventional CT (n = 37).

CONCLUSIONS

Intraoperative navigation using a CBCT C-arm system improved the accuracy of PS insertion and reduced surgery time. Moreover, it reduced radiation exposure compared with conventional CT, which was further curtailed by adapting the low-dose 5sDCT protocol. In short, our study highlights the benefits of intraoperative CBCT navigation for PS placement in AIS surgery.

Development of Augmented Reality Vision for Osteosynthesis Using a 3D Camera

BACKGROUND

We developed a 3D camera system to track motion in a surgical field. This system has the potential to introduce augmented reality (AR) systems non-invasively, eliminating the need for the invasive AR markers conventionally required. The present study was performed to verify the real-time tracking accuracy of this system, assess the feasibility of integrating this system into the surgical workflow, and establish its potential to enhance the accuracy and efficiency of orthopedic procedures.

METHODS

To evaluate the accuracy of AR technology using a 3D camera, a forearm bone model was created. The forearm model was depicted using a 3D camera, and its accuracy was verified in terms of the positional relationship with a 3D bone model created from previously imaged CT data. Images of the surgical field (capturing the actual forearm) were taken and saved in nine poses by rotating the forearm from pronation to supination. The alignment of the reference points was computed at the three points of CT versus the three points of the 3D camera, yielding a 3D rotation matrix representing the positional relationship. In the original system, a stereo vision-based 3D camera, with a depth image resolution of 1280×720 pixels, 30 frames per second, and a lens field of view of 64 specifications, with a baseline of 3 cm, capable of optimally acquiring real-time 3D data at a distance of 40-60 cm from the subject was used. In the modified system, the following modifications were made to improve tracking performance: (1) color filter processing was changed from HSV to RGB, (2) positional detection accuracy was modified with supporting marker sizes of 8 mm in diameter, and (3) the detection of marker positions was stabilized by calculating the marker position for each frame. Tracking accuracy was examined with the original system and modified system for the following parameters: differences in the rotation matrix, maximum and minimum inter-reference point errors between CT-based and camera-based 3D data, and the average error for the three reference points.

RESULTS

In the original system, the average difference in rotation matrices was 5.51±2.68 mm. Average minimum and maximum errors were 1.10±0.61 and 15.53±12.51 mm, respectively. The average error of reference points was 6.26±4.49 mm. In the modified system, the average difference in rotation matrices was 4.22±1.73 mm. Average minimum and maximum errors were 0.79±0.49 and 1.94±0.87 mm, respectively. The average error of reference points was 1.41±0.58 mm. In the original system, once tracking failed, it was difficult to recover tracking accuracy. This resulted in a large maximum error in supination positions. These issues were resolved by the modified system. Significant improvements were achieved in maximum errors and average errors using the modified system (P<0.05).

CONCLUSION

AR technology using a 3D camera was developed. This system allows direct comparisons of 3D data from preoperative CT scans with 3D data acquired from the surgical field using a 3D camera. This method has the advantage of introducing AR into the surgical field without invasive markers.

Extended reality in cranial and spinal neurosurgery - a bibliometric analysis

PURPOSE

This bibliometric analysis of the top 100 cited articles on extended reality (XR) in neurosurgery aimed to reveal trends in this research field. Gender differences in authorship and global distribution of the most-cited articles were also addressed.

METHODS

A Web of Science electronic database search was conducted. The top 100 most-cited articles related to the scope of this review were retrieved and analyzed for trends in publications, journal characteristics, authorship, global distribution, study design, and focus areas. After a brief description of the top 100 publications, a comparative analysis between spinal and cranial publications was performed.

RESULTS

From 2005, there was a significant increase in spinal neurosurgery publications with a focus on pedicle screw placement. Most articles were original research studies, with an emphasis on augmented reality (AR). In cranial neurosurgery, there was no notable increase in publications. There was an increase in studies assessing both AR and virtual reality (VR) research, with a notable emphasis on VR compared to AR. Education, surgical skills assessment, and surgical planning were more common themes in cranial studies compared to spinal studies. Female authorship was notably low in both groups, with no significant increase over time. The USA and Canada contributed most of the publications in the research field.

CONCLUSIONS

Research regarding the use of XR in neurosurgery increased significantly from 2005. Cranial research focused on VR and resident education while spinal research focused on AR and neuronavigation. Female authorship was underrepresented. North America provides most of the high-impact research in this area.

Top 25 Most Cited Articles on Intraoperative Computer Tomography-Guided Navigation in Spine Surgery

BACKGROUND

In recent years, the use of intraoperative computer tomography-guided (CT-guided) navigation has gained significant popularity among health care providers who perform minimally invasive spine surgery. This review aims to identify and analyze trends in the literature related to the widespread adoption of CT-guided navigation in spine surgery, emphasizing the shift from conventional fluoroscopy-based techniques to CT-guided navigation.

METHODS

Articles pertaining to this study were identified via a database review and were hierarchically organized based on the number of citations. An "advanced document search" was performed on September 28th, 2022, utilizing Boolean search operator terms. The 25 most referenced articles were combined into a primary list after sorting results in descending order based on the total number of citations.

RESULTS

The "Top 25" list for intraoperative CT-guided navigation in spine surgery cumulatively received a total of 2742 citations, with an average of 12 new citations annually. The number of citations ranged from 246 for the most cited article to 60 for the 25th most cited article. The most cited article was a paper by Siewerdsen et al., with 246 total citations, averaging 15 new citations per year.

CONCLUSIONS

Intraoperative CT-guided navigation is 1 of many technological advances that is used to increase surgical accuracy, and it has become an increasingly popular alternative to conventional fluoroscopy-based techniques. Given the increasing adoption of intraoperative CT-guided navigation in spine surgery, this review provides impactful evidence for its utility in spine surgery.

Innovations in Spine Surgery: A Narrative Review of Current Integrative Technologies

Neurosurgical technologies have become increasingly more adaptive, featuring real-time and patient-specific guidance in preoperative, intraoperative, and postoperative settings. This review offers insight into how these integrative innovations compare with conventional approaches in spine surgery, focusing on machine learning (ML), artificial intelligence, augmented reality and virtual reality, and spinal navigation systems. Data on technology applications, diagnostic and procedural accuracy, intraoperative times, radiation exposures, postoperative outcomes, and costs were extracted and compared with conventional methods to assess their advantages and limitations. Preoperatively, augmented reality and virtual reality have applications in surgical training and planning that are more immersive, case specific, and risk-free and have been shown to enhance accuracy and reduce complications. ML algorithms have demonstrated high accuracy in predicting surgical candidacy (up to 92.1%) and tailoring personalized treatments based on patient-specific variables. Intraoperatively, advantages include more accurate pedicle screw insertion (96%-99% with ML), enhanced visualization, reduced radiation exposure (49 μSv with O-arm navigation vs. 556 μSv with fluoroscopy), increased efficiency, and potential for fewer intraoperative complications compared with conventional approaches. Postoperatively, certain ML and artificial intelligence models have outperformed conventional methods in predicting all postoperative complications of >6000 patients as well as predicting variables contributing to in-hospital and 90-day mortality. However, applying these technologies comes with limitations, such as longer operative times (up to 35.6% longer) with navigation, dependency on datasets, costs, accessibility, steep learning curve, and inherent software malfunctions. As these technologies advance, continuing to assess their efficacy and limitations will be crucial to their successful integration within spine surgery.

Augmented Reality and Virtual Reality in Spine Surgery: A Comprehensive Review

Augmented reality (AR) and virtual reality (VR) are powerful technologies with proven utility and tremendous potential. Spine surgery, in particular, may benefit from these developing technologies for resident training, preoperative education for patients, surgical planning and execution, and patient rehabilitation. In this review, the history, current applications, challenges, and future of AR/VR in spine surgery are examined.

Accuracy of augmented reality-assisted pedicle screw placement: a systematic review

OBJECTIVE

Conventional freehand methods of pedicle screw placement are associated with significant complications due to close proximity to neural and vascular structures. Recent advances in augmented reality surgical navigation (ARSN) have led to its adoption into spine surgery. However, little is known regarding its overall accuracy. The purpose of this study is to delineate the overall accuracy of ARSN pedicle screw placement across various models.

METHODS

A systematic review was conducted of Medline/PubMed, Cochrane and Embase Library databases according to the PRISMA guidelines. Relevant data extracted included reports of pedicle screw placement accuracy and breaches, as defined by the Gertzbein-Robbins classification, in addition to deviation from pre-planned trajectory and entry point. Accuracy was defined as the summation of grade 0 and grade 1 events per the Gertzbein-Robbins classification.

RESULTS

Twenty studies reported clinically accurate placed screws. The range of clinically accurate placed screws was 26.3-100%, with 2095 screws (93.1%) being deemed clinically accurate. Furthermore, 5.4% (112/2088) of screws were reported as grade two breaches, 1.6% (33/2088) grade 3 breaches, 3.1% (29/926) medial breaches and 2.3% (21/926) lateral breaches. Mean linear deviation ranged from 1.3 to 5.99 mm, while mean angular/trajectory deviation ranged 1.6°-5.88°.

CONCLUSION

The results of this study highlight the overall accuracy of ARSN pedicle screw placement. However, further robust prospective studies are needed to accurately compare to conventional methods of pedicle screw placement.

Effects of Augmented Reality on Thoracolumbar Pedicle Screw Instrumentation Across Different Levels of Surgical Experience

OBJECTIVE

Augmented reality (AR) is an emerging technology that may accelerate skill acquisition and improve accuracy of thoracolumbar pedicle screw placements. We aimed to quantify the relative assistance of AR compared with freehand (FH) pedicle screw accuracy across different surgical experience levels.

METHODS

A spine fellowship-trained and board-certified attending neurosurgeon, postgraduate year 4 neurosurgery resident, and second-year medical student placed 32 FH and 32 AR-assisted thoracolumbar pedicle screws in 3 cadavers. A cableless, voice-activated AR system was paired with a headset. Accuracy was assessed using χ2 analysis and the Gertzbein-Robbins scale. Angular error, distance error, and time per pedicle screw were collected and compared.

RESULTS

The attending neurosurgeon had 91.6% (11/12) clinically acceptable (Gertzbein-Robbins scale A or B) insertion in both FH and AR groups; the resident neurosurgeon had 100% (9/9) FH and AR in both cases; the medical student had 72.3% (8/11) FH accuracy and 81.8% (9/11) AR accuracy. The medical student displayed significantly lower ideal (Gertzbein-Robbins scale A) FH accuracy compared with the resident neurosurgeon (P = 0.017) and attending neurosurgeon (P = 0.005), but no difference when using AR. FH screw placement was faster by both the attending neurosurgeon (median 46 seconds vs. 94.5 seconds, P = 0.0047) and the neurosurgery resident neurosurgeon (median 144 seconds vs. 140 seconds, P = 0.05). Total clinically acceptable AR and FH accuracy was 90.6% (29/32) and 87.5% (28/32), respectively (P = 0.69).

CONCLUSIONS

AR screw placement allowed an inexperienced medical student to double their accuracy in 1 training session. With subsequent iterations, this promising technology could serve as an important tool for surgical training.

Machine Learning in Spine Surgery: A Narrative Review

Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Established surgical navigation systems for pedicle screw placement have been proven to be accurate, but still reveal limitations in registration or surgical guidance. Registration of preoperative data to the intraoperative anatomy remains a time-consuming, error-prone task that includes exposure to harmful radiation. Surgical guidance through conventional displays has well-known drawbacks, as information cannot be presented in-situ and from the surgeon's perspective. Consequently, radiation-free and more automatic registration methods with subsequent surgeon-centric navigation feedback are desirable. In this work, we present a marker-less approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner. A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models, which then is refined for each vertebra individually and updated in real-time with GPU acceleration while handling surgeon occlusions. An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system. The registration method was verified on a public dataset with a median of 100% successful registrations, a median target registration error of 2.7 mm, a median screw trajectory error of 1.6°and a median screw entry point error of 2.3 mm. Additionally, the whole pipeline was validated in an ex-vivo surgery, yielding a 100% screw accuracy and a median target registration error of 1.0 mm. Our results meet clinical demands and emphasize the potential of RGB-D data for fully automatic registration approaches in combination with augmented reality guidance.

Augmented reality in spine surgery - past, present, and future

BACKGROUND CONTEXT

Augmented reality (AR) is increasingly recognized as a valuable tool in spine surgery. Here we provides an overview of the key developments and technological milestones that have laid the foundation for AR applications in this field. We also assess the quality of existing studies on AR systems in spine surgery and explore potential future applications.

PURPOSE

The purpose of this narrative review is to examine the role of AR in spine surgery. It aims to highlight the evolution of AR technology in this context, evaluate the existing body of research, and outline potential future directions for integrating AR into spine surgery.

STUDY DESIGN

Narrative review.

METHODS

We conducted a thorough literature search to identify studies and developments related to AR in spine surgery. Relevant articles, reports, and technological advancements were analyzed to establish the historical context and current state of AR in this field.

RESULTS

The review identifies significant milestones in the development of AR technology for spine surgery. It discusses the growing body of research and highlights the strengths and weaknesses of existing investigations. Additionally, it presents insights into the potential for AR to enhance spine surgical education and speculates on future applications.

CONCLUSIONS

Augmented reality has emerged as a promising adjunct in spine surgery, with notable advancements and research efforts. The integration of AR into the spine surgery operating room holds promise, as does its potential to revolutionize surgical education. Future applications of AR in spine surgery may include real-time navigation, enhanced visualization, and improved patient outcomes. Continued development and evaluation of AR technology are essential for its successful implementation in this specialized surgical field.

Evaluating a cutting-edge augmented reality-supported navigation system for spinal instrumentation

OBJECTIVE

Dorsal instrumentation using pedicle screws is a standard treatment for multiple spinal pathologies, such as trauma, infection, or degenerative indications. Intraoperative three-dimensional (3D) imaging and navigated pedicle screw placement are used at multiple centers. For the present study, we evaluated a new navigation system enabling augmented reality (AR)-supported pedicle screw placement while integrating navigation cameras into the reference array and drill guide. The present study aimed to evaluate its clinical application regarding safety, efficacy, and accuracy.

METHODS

A total of 20 patients were operated on between 06/2021 and 01/2022 using the new technique for intraoperative navigation. Intraoperative data with a focus on accuracy and patient safety, including patient outcome, were analyzed. The accuracy of pedicle screw placement was evaluated by intraoperative CT imaging.

RESULTS

A median of 8 (4-18) pedicle screws were placed in each case. Percutaneous instrumentation was performed in 14 patients (70%). The duration of pedicle screw placement (duration scan-scan) was 56 ± 26 (30-107) min. Intraoperative screw revision was necessary for 3 of 180 pedicle screws (1.7%). Intraoperatively, no major complications occurred-one case of delay due to software issues and one case of difficult screw placement were reported.

CONCLUSION

The current study's results could confirm the use of the present AR-supported system for navigated pedicle screw placement for dorsal instrumentation in clinical routine. It provides a reliable and safe tool for 3D imaging-based pedicle screw placement, only requires a minimal intraoperative setup, and provides new opportunities by integrating AR.

Using Novel Segmentation Technology to Define Safe Corridors for Minimally Invasive Posterior Lumbar Interbody Fusion

BACKGROUND AND OBJECTIVES

There has been a rise in minimally invasive methods to access the intervertebral disk space posteriorly given their decreased tissue destruction, lower blood loss, and earlier return to work. Two such options include the percutaneous lumbar interbody fusion through the Kambin triangle and the endoscopic transfacet approach. However, without accurate preoperative visualization, these approaches carry risks of damaging surrounding structures, especially the nerve roots. Using novel segmentation technology, our goal was to analyze the anatomic borders and relative sizes of the safe triangle, trans-Kambin, and the transfacet corridors to assist surgeons in planning a safe approach and determining cannula diameters.

METHODS

The areas of the safe triangle, Kambin, and transfacet corridors were measured using commercially available software (BrainLab, Munich, Germany). For each approach, the exiting nerve root, traversing nerve roots, theca, disk, and vertebrae were manually segmented on 3-dimensional T2-SPACE magnetic resonance imaging using a region-growing algorithm. The triangles' borders were delineated ensuring no overlap between the area and the nerves.

RESULTS

A total of 11 patients (65.4 ± 12.5 years, 33.3% female) were retrospectively reviewed. The Kambin, safe, and transfacet corridors were measured bilaterally at the operative level. The mean area (124.1 ± 19.7 mm2 vs 83.0 ± 11.7 mm2 vs 49.5 ± 11.4 mm2) and maximum permissible cannula diameter (9.9 ± 0.7 mm vs 6.8 ± 0.5 mm vs 6.05 ± 0.7 mm) for the transfacet triangles were significantly larger than Kambin and the traditional safe triangles, respectively (P < .001).

CONCLUSION

We identified, in 3-dimensional, the borders for the transfacet corridor: the traversing nerve root extending inferiorly until the caudal pedicle, the theca medially, and the exiting nerve root superiorly. These results illustrate the utility of preoperatively segmenting anatomic landmarks, specifically the nerve roots, to help guide decision-making when selecting the optimal operative approach.

Two-Year Clinical and Radiographic Outcomes for Percutaneous Lumbar Interbody Fusion With an Expandable Titanium Cage Through Kambin's Triangle Without Facetectomy

BACKGROUND

There has been heightened interest in performing percutaneous lumbar interbody fusions (percLIFs) through Kambin's triangle, an anatomic corridor allowing entrance into the disc space. However, due to its novelty, there are limited data regarding the long-term benefits of this procedure. Our objective was to determine the long-term efficacy and durability of the percutaneous insertion of an expandable titanium cage through Kambin's triangle without facetectomy.

METHODS

A retrospective review of patients undergoing percLIF via Kambin's triangle using an expandable titanium cage was performed. Demographics, visual analog scale (VAS) scores, Oswestry Disability Index (ODI), radiographic measurements, perioperative variables, and complications were recorded. VAS, ODI, and radiographic measurements were compared with baseline using the generalized estimating equations assuming normally distributed data. Fusion was assessed with computed tomography (CT) at 1 and 2 years after the procedure.

RESULTS

A total of 49 patients were included. Spondylolisthesis, lumbar lordosis (LL), sacral slope, pelvic tilt, and anterior/posterior disc space height were all significantly improved postoperatively at each time point of 3, 6, 12, and 24 months (P < 0.001). Pelvic incidence-LL mismatch decreased significantly at each follow-up (P < 0.001) with a mean reduction of 4° by 24 months. VAS back scores reduced by >2 points at the 6, 12, and 24 month follow-ups. ODI scores reduced by >15 points at the 12- and 24-month follow-ups. Of the patients who had 1- and 2-year CT images, fusion rates at those time points were 94.4% (17/18) and 87.5% (7/8), respectively. The mean annual rate of surgically significant adjacent segment disease was 2.74% through an average follow-up of 2.74 years.

CONCLUSION

These results highlight that percLIF, a procedure done without an endoscope or facetectomy, can be performed using an expandable titanium cage through Kambin's triangle with excellent radiographic and clinical results.

CLINICAL RELEVANCE

percLIF via Kambin's triangle is a safe and succesful procedure with long-term improvements in both clinical and radiographic outcomes.

LEVEL OF EVIDENCE: 3

Evaluation of single-stage vision models for pose estimation of surgical instruments

PURPOSE

Multiple applications in open surgical environments may benefit from adoption of markerless computer vision depending on associated speed and accuracy requirements. The current work evaluates vision models for 6-degree of freedom pose estimation of surgical instruments in RGB scenes. Potential use cases are discussed based on observed performance.

METHODS

Convolutional neural nets were developed with simulated training data for 6-degree of freedom pose estimation of a representative surgical instrument in RGB scenes. Trained models were evaluated with simulated and real-world scenes. Real-world scenes were produced by using a robotic manipulator to procedurally generate a wide range of object poses.

RESULTS

CNNs trained in simulation transferred to real-world evaluation scenes with a mild decrease in pose accuracy. Model performance was sensitive to input image resolution and orientation prediction format. The model with highest accuracy demonstrated mean in-plane translation error of 13 mm and mean long axis orientation error of 5[Formula: see text] in simulated evaluation scenes. Similar errors of 29 mm and 8[Formula: see text] were observed in real-world scenes.

CONCLUSION

6-DoF pose estimators can predict object pose in RGB scenes with real-time inference speed. Observed pose accuracy suggests that applications such as coarse-grained guidance, surgical skill evaluation, or instrument tracking for tray optimization may benefit from markerless pose estimation.

Applications of Extended Reality in Orthopaedic Surgery

➤ Extended reality is a term that encompasses different modalities, including virtual reality, augmented reality, and mixed reality.➤ Although fully immersive virtual reality has benefits for developing procedural memory and technical skills, augmented and mixed reality are more appropriate modalities for preoperative planning and intraoperative utilization.➤ Current investigations on the role of extended reality in preoperative planning and intraoperative utilization are still in the early stages, but preliminarily show that extended reality technologies can help surgeons to be more accurate and efficient.

Advances and Evolving Challenges in Spinal Deformity Surgery

BACKGROUND

Surgical intervention is a critical tool to address adult spinal deformity (ASD). Given the evolution of spinal surgical techniques, we sought to characterize developments in ASD correction and barriers impacting clinical outcomes.

METHODS

We conducted a literature review utilizing PubMed, Embase, Web of Science, and Google Scholar to examine advances in ASD surgical correction and ongoing challenges from patient and clinician perspectives. ASD procedures were examined across pre-, intra-, and post-operative phases.

RESULTS

Several factors influence the effectiveness of ASD correction. Standardized radiographic parameters and three-dimensional modeling have been used to guide operative planning. Complex minimally invasive procedures, targeted corrections, and staged procedures can tailor surgical approaches while minimizing operative time. Further, improvements in osteotomy technique, intraoperative navigation, and enhanced hardware have increased patient safety. However, challenges remain. Variability in patient selection and deformity undercorrection have resulted in heterogenous clinical responses. Surgical complications, including blood loss, infection, hardware failure, proximal junction kyphosis/failure, and pseudarthroses, pose barriers. Although minimally invasive approaches are being utilized more often, clinical validation is needed.

CONCLUSIONS

The growing prevalence of ASD requires surgical solutions that can lead to sustained symptom resolution. Leveraging computational and imaging advances will be necessary as we seek to provide comprehensive treatment plans for patients.

Exposure to Extended Reality and Artificial Intelligence-Based Manifestations: A Primer on the Future of Hip and Knee Arthroplasty

BACKGROUND

Software-infused services, from robot-assisted and wearable technologies to artificial intelligence (AI)-laden analytics, continue to augment clinical orthopaedics - namely hip and knee arthroplasty. Extended reality (XR) tools, which encompass augmented reality, virtual reality, and mixed reality technology, represent a new frontier for expanding surgical horizons to maximize technical education, expertise, and execution. The purpose of this review is to critically detail and evaluate the recent developments surrounding XR in the field of hip and knee arthroplasty and to address potential future applications as they relate to AI.

METHODS

In this narrative review surrounding XR, we discuss (1) definitions, (2) techniques, (3) studies, (4) current applications, and (5) future directions. We highlight XR subsets (augmented reality, virtual reality, and mixed reality) as they relate to AI in the increasingly digitized ecosystem within hip and knee arthroplasty.

RESULTS

A narrative review of the XR orthopaedic ecosystem with respect to XR developments is summarized with specific emphasis on hip and knee arthroplasty. The XR as a tool for education, preoperative planning, and surgical execution is discussed with future applications dependent upon AI to potentially obviate the need for robotic assistance and preoperative advanced imaging without sacrificing accuracy.

CONCLUSION

In a field where exposure is critical to clinical success, XR represents a novel stand-alone software-infused service that optimizes technical education, execution, and expertise but necessitates integration with AI and previously validated software solutions to offer opportunities that improve surgical precision with or without the use of robotics and computed tomography-based imaging.

Augmented Reality in Neurosurgery: A New Paradigm for Training

Augmented reality (AR) involves the overlay of computer-generated images onto the user's real-world visual field to modify or enhance the user's visual experience. With respect to neurosurgery, AR integrates preoperative and intraoperative imaging data to create an enriched surgical experience that has been shown to improve surgical planning, refine neuronavigation, and reduce operation time. In addition, AR has the potential to serve as a valuable training tool for neurosurgeons in a way that minimizes patient risk while facilitating comprehensive training opportunities. The increased use of AR in neurosurgery over the past decade has led to innovative research endeavors aiming to develop novel, more efficient AR systems while also improving and refining present ones. In this review, we provide a concise overview of AR, detail current and emerging uses of AR in neurosurgery and neurosurgical training, discuss the limitations of AR, and provide future research directions. Following the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), 386 articles were initially identified. Two independent reviewers (GH and AC) assessed article eligibility for inclusion, and 31 articles are included in this review. The literature search included original (retrospective and prospective) articles and case reports published in English between 2013 and 2023. AR assistance has shown promise within neuro-oncology, spinal neurosurgery, neurovascular surgery, skull-base surgery, and pediatric neurosurgery. Intraoperative use of AR was found to primarily assist with surgical planning and neuronavigation. Similarly, AR assistance for neurosurgical training focused primarily on surgical planning and neuronavigation. However, studies included in this review utilize small sample sizes and remain largely in the preliminary phase. Thus, future research must be conducted to further refine AR systems before widespread intraoperative and educational use.

The use of hybrid operating rooms in neurosurgery, advantages, disadvantages, and future perspectives: a systematic review

BACKGROUND

Hybrid operating rooms (hybrid-ORs) combine the functionalities of a conventional surgical theater with the advanced imaging technologies of a radiological suite. Hybrid-ORs are usually equipped with CBCT devices providing both 2D and 3D imaging capability that can be used for both interventional radiology and image guided surgical applications. Across all fields of surgery, the use of hybrid-ORs is gaining in traction, and neurosurgery is no exception. We hence aimed to comprehensively review the use of hybrid-ORs, the associated advantages, and disadvantages specific to the field of neurosurgery.

MATERIALS AND METHODS

Electronic databases were searched for all studies on hybrid-ORs from inception to May 2022. Findings of matching studies were pooled to strengthen the current body of evidence.

RESULTS

Seventy-four studies were included in this review. Hybrid-ORs were mainly used in endovascular surgery (n = 41) and spine surgery (n = 33). Navigation systems were the most common additional technology employed along with the CBCT systems in the hybrid-ORs. Reported advantages of hybrid-ORs included immediate assessment of outcomes, reduced surgical revision rate, and the ability to perform combined open and endovascular procedures, among others. Concerns about increased radiation exposure and procedural time were some of the limitations mentioned.

CONCLUSION

In the field of neurosurgery, the use of hybrid-ORs for different applications is increasing. Hybrid-ORs provide preprocedure, intraprocedure, and end-of-procedure imaging capabilities, thereby increasing surgical precision, and reducing the need for postoperative imaging and correction surgeries. Despite these advantages, radiation exposure to patient and staff is an important concern.

Applications of Augmented Reality in Orthopaedic Spine Surgery

The application of augmented reality (AR) in surgical settings has primarily been as a navigation tool in the operating room because of its ease of use and minimal effect on surgical procedures. The surgeon can directly face the surgical field while viewing 3D anatomy virtually, thus reducing the need to look at an external display, such as a navigation system. Applications of AR are being explored in spine surgery. The basic principles of AR include data preparation, registration, tracking, and visualization. Current literature provides sufficient preclinical and clinical data evidence for the use of AR technology in spine surgery. AR systems are efficient assistive devices, providing greater accuracy for insertion points, more comfort for surgeons, and reduced operating time. AR technology also has beneficial applications in surgical training, education, and telementorship for spine surgery. However, costs associated with specially designed imaging equipment and physicians' comfort in using this technology continue to remain barriers to its adoption. As this technology evolves to a more widespread use, future applications will be directed by the cost-effectiveness of AR-assisted surgeries.

Augmented Reality-Assisted Spine Surgery: An Early Experience Demonstrating Safety and Accuracy with 218 Screws

STUDY DESIGN

Prospective cohort study.

OBJECTIVES

In spine surgery, accurate screw guidance is critical to achieving satisfactory fixation. Augmented reality (AR) is a novel technology to assist in screw placement and has shown promising results in early studies. This study aims to provide our early experience evaluating safety and efficacy with an Food and Drug Administration-approved head-mounted (head-mounted device augmented reality (HMD-AR)) device.

METHODS

Consecutive adult patients undergoing AR-assisted thoracolumbar fusion between October 2020 and August 2021 with 2 -week follow-up were included. Preoperative, intraoperative, and postoperative data were collected to include demographics, complications, revision surgeries, and AR performance. Intraoperative 3D imaging was used to assess screw accuracy using the Gertzbein-Robbins (G-R) grading scale.

RESULTS

Thirty-two patients (40.6% male) were included with a total of 222 screws executed using HMD-AR. Intraoperatively, 4 (1.8%) were deemed misplaced and revised using AR or freehand. The remaining 218 (98.2%) screws were placed accurately. There were no intraoperative adverse events or complications, and AR was not abandoned in any case. Of the 208 AR-placed screws with 3D imaging confirmation, 97.1% were considered clinically accurate (91.8% Grade A, 5.3% Grade B). There were no early postoperative surgical complications or revision surgeries during the 2 -week follow-up.

CONCLUSIONS

This early experience study reports an overall G-R accuracy of 97.1% across 218 AR-guided screws with no intra or early postoperative complications. This shows that HMD-AR-assisted spine surgery is a safe and accurate tool for pedicle, cortical, and pelvic fixation. Larger studies are needed to continue to support this compelling evolution in spine surgery.

Augmented Reality in Minimally Invasive Spinal Surgery: A Narrative Review of Available Technology

INTRODUCTION

Spine surgery has undergone significant changes in approach and technique. With the adoption of intraoperative navigation, minimally invasive spinal surgery (MISS) has arguably become the gold standard. Augmented reality (AR) has now emerged as a front-runner in anatomical visualization and narrower operative corridors. In effect, AR is poised to revolutionize surgical training and operative outcomes. Our study examines the current literature on AR-assisted MISS, synthesizes findings, and creates a narrative highlighting the history and future of AR in spine surgery.

MATERIAL AND METHODS

Relevant literature was gathered using the PubMed (Medline) database from 1975 to 2023. Pedicle screw placement models were the primary intervention in AR. These were compared to the outcomes of traditional MISS RESULTS: We found that AR devices on the market show promising clinical outcomes in preoperative training and intraoperative use. Three prominent systems were as follows: XVision, HoloLens, and ImmersiveTouch. In the studies, surgeons, residents, and medical students had opportunities to operate AR systems, showcasing their educational potential across each phase of learning. Specifically, one facet described training with cadaver models to gauge accuracy in pedicle screw placement. AR-MISS exceeded free-hand methods without unique complications or contraindications.

CONCLUSIONS

While still in its infancy, AR has already proven beneficial for educational training and intraoperative MISS applications. We believe that with continued research and advancement of this technology, AR is poised to become a dominant player within the fundamentals of surgical education and MISS operative technique.

A Pilot Human Cadaveric Study on Accuracy of the Augmented Reality Surgical Navigation System for Thoracolumbar Pedicle Screw Insertion Using a New Intraoperative Rapid Registration Method

To evaluate the feasibility and accuracy of AR-assisted pedicle screw placement using a new intraoperative rapid registration method of combining preoperative CT scanning and intraoperative C-arm 2D fluoroscopy in cadavers. Five cadavers with intact thoracolumbar spines were employed in this study. Intraoperative registration was performed using anteroposterior and lateral views of preoperative CT scanning and intraoperative 2D fluoroscopic images. Patient-specific targeting guides were used for pedicle screw placement from Th1-L5, totaling 166 screws. Instrumentation for each side was randomized (augmented reality surgical navigation (ARSN) vs. C-arm) with an equal distribution of 83 screws in each group. CT was performed to evaluate the accuracy of both techniques by assessing the screw positions and the deviations between the inserted screws and planned trajectories. Postoperative CT showed that 98.80% (82/83) screws in ARSN group and 72.29% (60/83) screws in C-arm group were within the 2-mm safe zone (p < 0.001). The mean time for instrumentation per level in ARSN group was significantly shorter than that in C-arm group (56.17 ± 3.33 s vs. 99.22 ± 9.03 s, p < 0.001). The overall intraoperative registration time was 17.2 ± 3.5 s per segment. AR-based navigation technology can provide surgeons with accurate guidance of pedicle screw insertion and save the operation time by using the intraoperative rapid registration method of combining preoperative CT scanning and intraoperative C-arm 2D fluoroscopy.

[Camera-based navigation in the hybrid operating room]

Camera-based navigation in the hybrid operating room represents a possibility for precise, low-complication and efficient pedicle screw insertion in spinal surgery. In addition to increasing patient safety, the use of camera-based navigation as an orientation aid for the surgeon reduces radiation exposure. Camera-based navigation focuses on the surgeon's anatomical knowledge of landmarks, preoperative image acquisition, and subsequent information integration by the navigation software. The information provided from volume tomography (cone beam computed tomography, CBCT) and surface referencing through the video input from four optical cameras and the associated surface markers is collected, processed, optimized and customized by the software used. The result is the creation of a trajectory that allows the surgeon to analyze and evaluate complex anatomical structures more easily and facilitates the performance of the planned procedure. Minimally invasive insertion of pedicle screws using surface-reference navigation (augmented reality surgical navigation; ARSN) provides comparable accuracy to conventional fluoroscopic insertion of pedicle screws while reducing radiation by eliminating the need for postoperative computed tomographic imaging.

Interpretation and Use of Applied/Operational Machine Learning and Artificial Intelligence in Surgery

Applications for artificial intelligence (AI) and machine learning in surgery include image interpretation, data summarization, automated narrative construction, trajectory and risk prediction, and operative navigation and robotics. The pace of development has been exponential, and some AI applications are working well. However, demonstrations of clinical utility, validity, and equity have lagged algorithm development and limited widespread adoption of AI into clinical practice. Outdated computing infrastructure and regulatory challenges which promote data silos are key barriers. Multidisciplinary teams will be needed to address these challenges and to build AI systems that are relevant, equitable, and dynamic.

Usage of augmented reality for interventional neuraxial procedures: A phantom-based study

BACKGROUND

Neuraxial access is necessary for an array of procedures in anaesthesia, interventional pain medicine and neurosurgery. The commonly used anatomical landmark technique is challenging and requires practical experience.

OBJECTIVE

We aimed to evaluate the technical feasibility of an augmented reality-guided approach for neuraxial access and tested the hypothesis that its use would improve success as the primary outcome. As secondary outcomes, we measured accuracy and the procedural duration compared with the classical landmark approach.

DESIGN

A randomised phantom-based study.

SETTING

The three-dimensional image of a thoracolumbar phantom spine model with the surrounding soft tissue was created with a neurosurgical planning workstation and ideal trajectories to the epidural space on the levels T10-L1 were planned using a paramedian approach. Both the three-dimensional holographic image of the spine and the trajectories were transferred to an augmented reality-headset. Four probands (two anaesthesiologists, one neuroradiologist and one stereotactic neurosurgeon) performed 20 attempts, 10 each of either conventional landmark or augmented reality-guided epidural punctures, where anatomical level, side and sequence of modality were all randomised.

OUTCOME MEASURES

Accuracy was assessed by measuring Euclidean distance and lateral deviation from the predefined target point. Success of epidural puncture on the first attempt was compared between the conventional and the augmented reality-guided approaches.

RESULTS

Success was achieved in 82.5% of the attempts using augmented reality technique, compared with 40% with the conventional approach [ P  = 0.0002, odds ratio (OR) for success: 7.07]. Euclidean distance (6.1 vs. 12 mm, P  < 0.0001) and lateral deviation (3.7 vs. 9.2 mm, P  < 0.0001) were significantly smaller using augmented reality. Augmented reality-guided puncture was significantly faster than with the conventional landmark approach (52.5 vs. 67.5 s, P  = 0.0015).

CONCLUSION

Augmented reality guidance significantly improved the accuracy and success in an experimental phantom model of epidural puncture. With further technical development, augmented reality guidance might prove helpful in anatomically challenging neuraxial procedures.

Clinical applications of augmented reality in orthopaedic surgery: a comprehensive narrative review

PURPOSE

The development of augmented reality (AR) technology allows orthopaedic surgeons to incorporate and visualize surgical data, assisting the execution of both routine and complex surgical operations. Uniquely, AR technology allows a surgeon to view the surgical field and superimpose peri-operative imaging, anatomical landmarks, navigation guidance, and more, all in one view without the need for conjugate gaze between multiple screens. The aim of this literature review was to introduce the fundamental requirements for an augmented reality system and to assess the current applications, outcomes, and potential limitations to this technology.

METHODS

A literature search was performed using MEDLINE and Embase databases, by two independent reviewers, who then collaboratively synthesized and collated the results of the literature search into a narrative review focused on the applications of augmented reality in major orthopaedic sub-specialties.

RESULTS

Current technology requires that pre-operative patient data be acquired, and AR-compatible models constructed. Intra-operatively, to produce manipulatable virtual images into the user's view in real time, four major components are required including a camera, computer image processing technology, tracking tools, and an output screen. The user is provided with a heads-up display, which is a transparent display, enabling the user to look at both their natural view and the computer-generated images. Currently, high-quality evidence for clinical implementation of AR technology in the orthopaedic surgery operating room is lacking; however, growing in vitro literature highlights a multitude of potential applications, including increasing operative accuracy, improved biomechanical angular and alignment parameters, and potentially reduced operative time.

CONCLUSION

While the application of AR systems in surgery is currently in its infancy, we anticipate rapid and widespread implementation of this technology in various orthopaedic sub-specialties.

Out-of-Plane Needle Placements Using 3D Augmented Reality Protractor on Smartphone: An Experimental Phantom Study

PURPOSE

To evaluate the accuracy of needle placement using a three-dimensional (3D) augmented reality (AR) protractor on smartphones (AR Puncture).

MATERIALS AND METHODS

An AR protractor that can be rotated in three directions against the CT plane with angle guidance lines for smartphones was developed. The protractor center can be adjusted to an entry point by manually moving the smartphone with the protractor center fixed at the center of the screen (Fix-On-Screen) or by image tracking with a printed QR code placed at an entry point (QR-Tracking). Needle placement was performed by viewing a target line in the tangent direction with the Bull's eye method. The needle placement errors placed by four operators in six out-of-plane directions in a phantom using a smartphone (iPhone XR, Apple, Cupertino, CA, USA) were compared with two registration methods.

RESULTS

No significant difference in the average needle placement error was observed between the Fix-On-Screen and QR-Tracking methods (5.6 ± 1.7 mm vs. 6.1 ± 2.9 mm, p = 0.475). The average procedural time of the Fix-On-Screen method was shorter than that of the QR-Tracking method (71.0 ± 23.9 s vs. 98.4 ± 59.5 s, p = 0.042).

CONCLUSION

The accuracies of out-of-plane needle placements using the 3D AR protractor with the two registration methods were equally high, with short procedure times. In clinical use, the Fix-On-Screen registration method would be more convenient because no additional markers are required.

Modified pedicle screw fixation under guidance of stress analysis for cervicothoracic junction: Surgical technique and outcomes

BACKGROUND

In cervicothoracic junction, the use of strong fixation device such as pedicle screw placement is often needed.

OBJECTIVE

The current study aimed to evaluate the accuracy and safety of pedicle screw placement using stress conduction analysis in the clinical application.

METHODS

We retrospectively collected patients who underwent pedicle screw internal fixation in cervicothoracic junction. Patients were divided into conventional nail placement (Group A) and modified pedicle screw implantation under guidance of stress analysis (Group B) according to the methods of pedicle screw placement. The accuracy of pedicle screw placement was assessed by computed tomography (CT) examination, and the success rate was calculated.

RESULTS

A total of 80 patients who underwent pedicle screw internal fixation in cervicothoracic junction were included. There were no obvious differences in baseline characteristics between two groups. The success rate of total screw placement, cervical spine screw placement and upper thoracic spine screw placement in Group B was higher than those in Group A (P< 0.001, P= 0.005, P= 0.008). Additionally, Heary Grade I in the Group B was higher than Group A (P= 0.001).

CONCLUSION

Stress analysis-guided technique can increase the accuracy of pedicle screw placement. Importantly, it meets the requirements of internal fixation of the cervicothoracic junction.

Augmented Reality-Assisted Navigation System for Transforaminal Epidural Injection

Purpose

Multiple studies have attempted to demonstrate the benefits of augmented reality (AR)-assisted navigation systems in surgery. Lumbosacral transforaminal epidural injection is an effective treatment commonly used in patients with radiculopathy due to spinal degenerative pathologies. However, few studies have applied AR-assisted navigation systems to this procedure. The study aimed to investigate the safety and effectiveness of an AR-assisted navigation system for transforaminal epidural injection.

Patients and Methods

Through a real-time tracking system and a wireless network to the head-mounted display, computed tomography images of the spine and the path of a spinal needle to the target were visualized on a torso phantom with respiration movements installed. From L1/L2 to L5/S1, needle insertions were performed using an AR-assisted system on the left side of the phantom, and the conventional method was performed on the right side.

Results

The procedure duration was approximately three times shorter, and the number of radiographs required was reduced in the experimental group compared to the control group. The distance from the needle tips to the target areas in the plan showed no significant difference between the two groups. (AR group 1.7 ± 2.3mm, control group 3.2 ± 2.8mm, P value 0.067).

Conclusion

An AR-assisted navigation system may be used to reduce the time required for spinal interventions and ensure the safety of patients and physicians in view of radiation exposure. Further studies are essential to apply AR-assisted navigation systems to spine interventions.

Mixed Reality Interfaces for Achieving Desired Views with Robotic X-ray Systems

Robotic X-ray C-arm imaging systems can precisely achieve any position and orientation relative to the patient. Informing the system, however, what pose exactly corresponds to a desired view is challenging. Currently these systems are operated by the surgeon using joysticks, but this interaction paradigm is not necessarily effective because users may be unable to efficiently actuate more than a single axis of the system simultaneously. Moreover, novel robotic imaging systems, such as the Brainlab Loop-X, allow for independent source and detector movements, adding even more complexity. To address this challenge, we consider complementary interfaces for the surgeon to command robotic X-ray systems effectively. Specifically, we consider three interaction paradigms: (1) the use of a pointer to specify the principal ray of the desired view relative to the anatomy, (2) the same pointer, but combined with a mixed reality environment to synchronously render digitally reconstructed radiographs from the tool's pose, and (3) the same mixed reality environment but with a virtual X-ray source instead of the pointer. Initial human-in-the-loop evaluation with an attending trauma surgeon indicates that mixed reality interfaces for robotic X-ray system control are promising and may contribute to substantially reducing the number of X-ray images acquired solely during "fluoro hunting" for the desired view or standard plane.

Percutaneous thoraco-lumbar-sacral pedicle screw placement accuracy results from a multi-center, prospective clinical study using a skin marker-based optical navigation system

STUDY DESIGN

Prospective multi-center study.

OBJECTIVE

The study aimed to evaluate the accuracy of pedicle screw placement using a skin marker-based optical surgical navigation system for minimal invasive thoraco-lumbar-sacral pedicle screw placement.

METHODS

The study was performed in a hybrid Operating Room with a video camera-based navigation system integrated in the imaging hardware. The patient was tracked with non-invasive skin markers while the instrument tracking was via an on-shaft optical marker pattern. The screw placement accuracy assessment was performed by three independent reviewers, using the Gertzbein grading. The screw placement time as well as the staff and patient radiation doses was also measured.

RESULTS

In total, 211 screws in 39 patients were analyzed for screw placement accuracy. Of these 32.7% were in the thoracic region, 59.7% were in the lumbar region, and 7.6% were in the sacral region. An overall accuracy of 98.1% was achieved. No screws were deemed severely misplaced (Gertzbein grading 3). The average time for screw placement was 6 min and 25 secs (± 3 min 33 secs). The average operator radiation dose per subject was 40.3 µSv. The mean patient effective dose (ED) was 11.94 mSv.

CONCLUSION

Skin marker-based ON can be used to achieve very accurate thoracolumbarsacral pedicle screw placements.

AR-Supported Supervision of Conditional Autonomous Robots: Considerations for Pedicle Screw Placement in the Future

Robotic assistance is applied in orthopedic interventions for pedicle screw placement (PSP). While current robots do not act autonomously, they are expected to have higher autonomy under surgeon supervision in the mid-term. Augmented reality (AR) is promising to support this supervision and to enable human–robot interaction (HRI). To outline a futuristic scenario for robotic PSP, the current workflow was analyzed through literature review and expert discussion. Based on this, a hypothetical workflow of the intervention was developed, which additionally contains the analysis of the necessary information exchange between human and robot. A video see-through AR prototype was designed and implemented. A robotic arm with an orthopedic drill mock-up simulated the robotic assistance. The AR prototype included a user interface to enable HRI. The interface provides data to facilitate understanding of the robot’s ”intentions”, e.g., patient-specific CT images, the current workflow phase, or the next planned robot motion. Two-dimensional and three-dimensional visualization illustrated patient-specific medical data and the drilling process. The findings of this work contribute a valuable approach in terms of addressing future clinical needs and highlighting the importance of AR support for HRI.

Practical Use of Augmented Reality Modeling to Guide Revision Spine Surgery: An Illustrative Case of Hardware Failure and Overriding Spondyloptosis

BACKGROUND AND IMPORTANCE

Augmented reality (AR) is a novel technology with broadening applications to neurosurgery. In deformity spine surgery, it has been primarily directed to the more precise placement of pedicle screws. However, AR may also be used to generate high fidelity three-dimensional (3D) spine models for cases of advanced deformity with existing instrumentation. We present a case in which an AR-generated 3D model was used to facilitate and expedite the removal of embedded instrumentation and guide the reduction of an overriding spondyloptotic deformity.

CLINICAL PRESENTATION

A young adult with a remote history of a motor vehicle accident treated with long-segment posterior spinal stabilization presented with increasing back pain and difficulty sitting upright in a wheelchair. Imaging revealed pseudoarthrosis with multiple rod fractures resulting in an overriding spondyloptosis of T6 on T9. An AR-generated 3D model was useful in the intraoperative localization of rod breaks and other extensively embedded instrumentation. Real-time model thresholding expedited the safe explanation of the defunct system and correction of the spondyloptosis deformity.

CONCLUSION

An AR-generated 3D model proved instrumental in a revision case of hardware failure and high-grade spinal deformity.

Navigation Techniques in Endoscopic Spine Surgery

Endoscopic spine surgery (ESS) advances the principles of minimally invasive surgery, including minor collateral tissue damage, reduced blood loss, and faster recovery times. ESS allows for direct access to the spine through small incisions and direct visualization of spinal pathology via an endoscope. While this technique has many applications, there is a steep learning curve when adopting ESS into a surgeon's practice. Two types of navigation, optical and electromagnetic, may allow for widespread utilization of ESS by engendering improved orientation to surgical anatomy and reduced complication rates. The present review discusses these two available navigation technologies and their application in endoscopic procedures by providing case examples. Furthermore, we report on the future directions of navigation within the discipline of ESS.

First Clinical Experience with a Novel 3D C-Arm-Based System for Navigated Percutaneous Thoracolumbar Pedicle Screw Placement

Background and Objectives: Navigated pedicle screw placement is becoming increasingly popular, as it has been shown to reduce the rate of screw misplacement. We present our intraoperative workflow and initial experience in terms of safety, efficiency, and clinical feasibility with a novel system for a 3D C-arm cone beam computed-tomography-based navigation of thoracolumbar pedicle screws. Materials and Methods: The first 20 consecutive cases of C-arm cone beam computed-tomography-based percutaneous pedicle screw placement using a novel navigation system were included in this study. Procedural data including screw placement time and patient radiation dose were prospectively collected. Final pedicle screw accuracy was assessed using the Gertzbein–Robbins grading system. Results: In total, 156 screws were placed. The screw accuracy was 94.9%. All the pedicle breaches occurred on the lateral pedicle wall, and none caused clinical complications. On average, a time of 2:42 min was required to place a screw. The mean intraoperative patient radiation exposure was 7.46 mSv. Conclusions: In summary, the investigated combination of C-arm CBCT-based navigation proved to be easy to implement and highly reliable. It facilitates the accurate and efficient percutaneous placement of pedicle screws in the thoracolumbar spine. The careful use of intraoperative imaging maintains the intraoperative radiation exposure to the patient at a moderate level.

The application of artificial intelligence in spine surgery

Due to its obvious advantages in processing big data and image information, the combination of artificial intelligence and medical care may profoundly change medical practice and promote the gradual transition from traditional clinical care to precision medicine mode. In this artical, we reviewed the relevant literatures and found that artificial intelligence was widely used in spine surgery. The application scenarios included etiology, diagnosis, treatment, postoperative prognosis and decision support systems of spinal diseases. The shift to artificial intelligence model in medicine constantly improved the level of doctors' diagnosis and treatment and the development of orthopedics.

Accuracy of augmented reality-guided drainage versus stereotactic and conventional puncture in an intracerebral hemorrhage phantom model

BACKGROUND

Minimally invasive intracranial drain placement is a common neurosurgical emergency procedure in patients with intracerebral hemorrhage (ICH). We aimed to retrospectively investigate the accuracy of conventional freehand (bedside) hemorrhage drain placement and to prospectively compare the accuracy of augmented/mixed reality-guided (AR) versus frame-based stereotaxy-guided (STX) and freehand drain placement in a phantom model.

METHODS

A retrospective, single-center analysis evaluated the accuracy of drain placement in 73 consecutive ICH with a visual rating of postinterventional CT data. In a head phantom with a simulated deep ICH, five neurosurgeons performed four punctures for each technique: STX, AR, and the freehand technique. The Euclidean distance to the target point and the lateral deviation of the achieved trajectory from the planned trajectory at target point level were compared between the three methods.

RESULTS

Analysis of the clinical cases revealed an optimal drainage position in only 46/73 (63%). Correction of the drain was necessary in 23/73 cases (32%). In the phantom study, accuracy of AR was significantly higher than the freehand method (P<0.001 for both Euclidean and lateral distances). The Euclidean distance using AR (median 3 mm) was close to that using STX (median 1.95 mm; P=0.023).

CONCLUSIONS

We demonstrated that the accuracy of the freehand technique was low and that subsequent position correction was common. In a phantom model, AR drainage placement was significantly more precise than the freehand method. AR has great potential to increase precision of emergency intracranial punctures in a bedside setting.

Beyond Placement of Pedicle Screws - New Applications for Robotics in Spine Surgery: A Multi-Surgeon, Single-Institution Experience

Interest in robotic-assisted spine surgery has grown as surgeon comfort and technology has evolved to maximize benefits of time saving and precision. However, the Food and Drug Administration (FDA) has currently only approved robotics to assist in determining the ideal trajectory for pedicle screw placement after extensive research supporting its efficacy and efficiency. To be considered a durable and effective option, robotics need to expand beyond the indication of just placing pedicle screws. This article aims to illustrate a multi-surgeon, single-institution experience with unique applications of robotic technologies in spine surgery. We will explore accessing Kambin's Triangle in percutaneous transforaminal interbody fusion (percLIF), iliac fixation in metastatic cancer, and sacroiliac (SI) fusions. Each of these topics will be covered in depth with associated background information and subsequent discussion. We show that with proper understanding of its limitations, robots can help surgeons perform difficult surgeries in a safe manner.

Minimally Invasive Spine Surgery: An Overview

Spinal surgery is undergoing a major transformation toward a minimally invasive paradigm. This shift is being driven by multiple factors, including the need to address spinal problems in an older and sicker population, as well as changes in patient preferences and reimbursement patterns. Increasingly, minimally invasive surgical techniques are being used in place of traditional open approaches due to significant advancements and implementation of intraoperative imaging and navigation technologies. However, in some patients, due to specific anatomic or pathologic factors, minimally invasive techniques are not always possible. Numerous algorithms have been described, and additional efforts are underway to better optimize patient selection for minimally invasive spinal surgery (MISS) procedures in order to achieve optimal outcomes. Numerous unique MISS approaches and techniques have been described, and several have become fundamental. Investigators are evaluating combinations of MISS techniques to further enhance the surgical workflow, patient safety, and efficiency.

Augmented Reality in Orthopedic Surgery and Its Application in Total Joint Arthroplasty: A Systematic Review

The development of augmented reality (AR) and its application in total joint arthroplasty aims at improving the accuracy and precision in implant components’ positioning, hopefully leading to increased outcomes and survivorship. However, this field is far from being thoroughly explored. We therefore performed a systematic review of the literature in order to examine the application, the results, and the different AR systems available in TJA. A systematic review of the literature according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was performed. A comprehensive search of PubMed, MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews was conducted for English articles on the application of augmented reality in total joint arthroplasty using various combinations of keywords since the inception of the database to 31 March 2022. Accuracy was intended as the mean error from the targeted positioning angle and compared as mean values and standard deviations. In all, 14 articles met the inclusion criteria. Among them, four studies reported on the application of AR in total knee arthroplasty, six studies on total hip arthroplasty, three studies reported on reverse shoulder arthroplasty, and one study on total elbow arthroplasty. Nine of the included studies were preclinical (sawbones or cadaveric), while five of them reported results of AR’s clinical application. The main common feature was the high accuracy and precision when implant positioning was compared with preoperative targeted angles with errors ≤2 mm and/or ≤2°. Despite the promising results in terms of increased accuracy and precision, this technology is far from being widely adopted in daily clinical practice. However, the recent exponential growth in machine learning techniques and technologies may eventually lead to the resolution of the ongoing limitations including depth perception and their high complexity, favorably encouraging the widespread usage of AR systems.

Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI

Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.

Pedicle Screw Placement Using Intraoperative Computed Tomography and Computer-Aided Spinal Navigation Improves Screw Accuracy and Avoids Postoperative Revisions: Single-Center Analysis of 1400 Pedicle Screws

OBJECTIVE

Intraoperative computed tomography and navigation (iCT-Nav) is increasingly used to aid spinal instrumentation. We aimed to document the accuracy and revision rate of pedicle screw placement across many screws placed using iCT-Nav. We also assess patient-level factors predictive of high-grade pedicle breach.

METHODS

Medical records of patients who underwent iCT-Nav pedicle screw placement between 2015 and 2017 at a single center were retrospectively reviewed. Screw placement accuracy was individually assessed for each screw using the 2-mm incremental grading system for pedicle breach. Predictors of high-grade (>2 mm) breach were identified using multiple logistic regression.

RESULTS

In total, 1400 pedicle screws were placed in 208 patients undergoing cervicothoracic (29; 13.9%), thoracic (30; 14.4), thoracolumbar (19; 9.1%) and lumbar (130; 62.5%) surgeries. iCT-Nav afforded high-accuracy screw placement, with 1356 of 1400 screws (96.9%) being placed accurately. In total, 37 pedicle screws (2.64%) were revised intraoperatively during the index surgery across 31 patients, with no subsequent returns to the operating room because of screw malpositioning. After correcting for potential confounders, males were less likely to have a high-grade breach (odds ratio [OR] 0.21; 95% confidence interval [CI] 0.10-0.59, P = 0.003) whereas lateral (OR 6.21; 95% CI 2.47-15.52, P < 0.001) or anterior (OR 5.79; 95% CI2.11-15.88, P = 0.001) breach location were predictive of a high-grade breach.

CONCLUSIONS

iCT-Nav with postinstrumentation intraoperative imaging is associated with a reduced need for costly postoperative return to the operating room for screw revision. In comparison with studies of navigation without iCT where 1.5%-1.7% of patients returned for a second surgery, we report 0 revision surgeries due to screw malpositioning.

Spine Surgery Assisted by Augmented Reality: Where Have We Been?

This present systematic review examines spine surgery literature supporting augmented reality (AR) technology and summarizes its current status in spinal surgery technology. Database search strategies were retrieved from PubMed, Web of Science, Cochrane Library, Embase, from the earliest records to April 1, 2021. Our review briefly examines the history of AR, and enumerates different device application workflows in a variety of spinal surgeries. We also sort out the pros and cons of current mainstream AR devices and the latest updates. A total of 45 articles are included in our review. The most prevalent surgical applications included are the augmented reality surgical navigation system and head-mounted display. The most popular application of AR is pedicle screw instrumentation in spine surgery, and the primary responsible surgical levels are thoracic and lumbar. AR guidance systems show high potential value in practical clinical applications for the spine. The overall number of cases in AR-related studies is still rare compared to traditional surgical-assisted techniques. These lack long-term clinical efficacy and robust surgical-related statistical data. Changing healthcare laws as well as the increasing prevalence of spinal surgery are generating critical data that determines the value of AR technology.

Machine Learning Applications of Surgical Imaging for the Diagnosis and Treatment of Spine Disorders: Current State of the Art

Recent developments in machine learning (ML) methods demonstrate unparalleled potential for application in the spine. The ability for ML to provide diagnostic faculty, produce novel insights from existing capabilities, and augment or accelerate elements of surgical planning and decision making at levels equivalent or superior to humans will tremendously benefit spine surgeons and patients alike. In this review, we aim to provide a clinically relevant outline of ML-based technology in the contexts of spinal deformity, degeneration, and trauma, as well as an overview of commercial-level and precommercial-level surgical assist systems and decisional support tools. Furthermore, we briefly discuss potential applications of generative networks before highlighting some of the limitations of ML applications. We conclude that ML in spine imaging represents a significant addition to the neurosurgeon's armamentarium-it has the capacity to directly address and manifest clinical needs and improve diagnostic and procedural quality and safety-but is yet subject to challenges that must be addressed before widespread implementation.

Intra-operative wearable visualization in spine surgery: past, present, and future

The history of modern surgery has run parallel to the invention and development of intra-operative visualization techniques. The first operating room, built in 1804 at Pennsylvania Hospital, demonstrates this principle: illumination of the surgical field by the Sun through an overhead skylight allowed surgeries to proceed even prior to the invention of anesthesia or sterile technique. Surgeries were restricted to begin around when the Sun was at its zenith; without adequate light from the Sun and skylight, surgeons were unable to achieve adequate visualization. In the years since, new visualization instruments have expanded the scope and success of surgical intervention. Spine surgery in particular has benefited greatly from improved visualization technologies, due to the complex and intricate nervous, vascular and musculoskeletal structures that are closely intertwined which surgeons must manipulate. Over time, new technologies have also advanced to take up smaller footprints, leading to the rise of wearable tools that surgeons don intra-operatively to better visualize the surgical field. As surgical techniques shift to more minimally invasive methods, reliable, fidelitous, and ergonomic wearables are of growing importance. Here, we discuss the past and present of wearable visualization tools, from the first surgical loupes to cutting-edge augmented reality (AR) goggles, and comment on how emerging innovations will continue to revolutionize spine surgery.

Operator independent reliability of direct augmented reality navigated pedicle screw placement and rod bending

Background

AR based navigation of spine surgeries may not only provide accurate surgical execution but also operator independency by compensating for potential skill deficits. “Direct” AR-navigation, namely superposing trajectories on anatomy directly, have not been investigated regarding their accuracy and operator's dependence.

Purpose of this study was to prove operator independent reliability and accuracy of both AR assisted pedicle screw navigation and AR assisted rod bending in a cadaver setting.

Methods

Two experienced spine surgeons and two biomedical engineers (laymen) performed independently from each other pedicle screw instrumentations from L1-L5 in a total of eight lumbar cadaver specimens (20 screws/operator) using a fluoroscopy-free AR based navigation method. Screw fitting rods from L1 to S2-Ala-Ileum were bent bilaterally using an AR based rod bending navigation method (4 rods/operator). Outcome measures were pedicle perforations, accuracy compared to preoperative plan, registration time, navigation time, total rod bending time and operator's satisfaction for these procedures.

Results

97.5% of all screws were safely placed (<2 mm perforation), overall mean deviation from planned trajectory was 6.8±3.9°, deviation from planned entry point was 4±2.7 mm, registration time per vertebra was 2:25 min (00:56 to 10:00 min), navigation time per screw was 1:07 min (00:15 to 12:43 min) rod bending time per rod was 4:22 min (02:07 to 10:39 min), operator's satisfaction with AR based screw and rod navigation was 5.38±0.67 (1 to 6, 6 being the best rate). Comparison of surgeons and laymen revealed significant difference in navigation time (1:01 min; 00:15 to 3:00 min vs. 01:37 min; 00:23 to 12:43 min; p = 0.004, respectively) but not in pedicle perforation rate.

Conclusions

Direct AR based screw and rod navigation using a surface digitization registration technique is reliable and independent of surgical experience. The accuracy of pedicle screw insertion in the lumbar spine is comparable with the current standard techniques.