Pedicle Screw Placement Using Augmented Reality Surgical Navigation With Intraoperative 3D Imaging: A First In-Human Prospective Cohort Study

The role of virtual and augmented reality in orthopedic trauma surgery: From diagnosis to rehabilitation

Virtual and augmented reality have been used to assist and improve human capabilities in many fields. Most recent advances allow the usage of these technologies for personal and professional purposes. In particular, they have been progressively introduced in many medical procedures since the last century. Thanks to immersive training systems and a better comprehension of the ongoing procedure, their main objectives are to increase patient safety and decrease recovery time. The current and future possibilities of virtual and augmented reality in the context of bone fracture reduction are the main focus of this review. This medical procedure requires meticulous planning and a complex intervention in many cases, hence becoming a promising candidate to be benefited from this kind of technology. In this paper, we exhaustively analyze the impact of virtual and augmented reality to bone fracture healing, detailing each task from diagnosis to rehabilitation. Our primary goal is to introduce novel researchers to current trends applied to orthopedic trauma surgery, proposing new lines of research. To that end, we propose and evaluate a set of qualitative metrics to highlight the most promising challenges of virtual and augmented reality technologies in this context.

Towards Optical Imaging for Spine Tracking without Markers in Navigated Spine Surgery

Surgical navigation systems are increasingly used for complex spine procedures to avoid neurovascular injuries and minimize the risk for reoperations. Accurate patient tracking is one of the prerequisites for optimal motion compensation and navigation. Most current optical tracking systems use dynamic reference frames (DRFs) attached to the spine, for patient movement tracking. However, the spine itself is subject to intrinsic movements which can impact the accuracy of the navigation system. In this study, we aimed to detect the actual patient spine features in different image views captured by optical cameras, in an augmented reality surgical navigation (ARSN) system. Using optical images from open spinal surgery cases, acquired by two gray-scale cameras, spinal landmarks were identified and matched in different camera views. A computer vision framework was created for preprocessing of the spine images, detecting and matching local invariant image regions. We compared four feature detection algorithms, Speeded Up Robust Feature (SURF), Maximal Stable Extremal Region (MSER), Features from Accelerated Segment Test (FAST), and Oriented FAST and Rotated BRIEF (ORB) to elucidate the best approach. The framework was validated in 23 patients and the 3D triangulation error of the matched features was < 0 . 5 mm. Thus, the findings indicate that spine feature detection can be used for accurate tracking in navigated surgery.

Hyperspectral Imaging for Skin Feature Detection: Advances in Markerless Tracking for Spine Surgery

In spinal surgery, surgical navigation is an essential tool for safe intervention, including the placement of pedicle screws without injury to nerves and blood vessels. Commercially available systems typically rely on the tracking of a dynamic reference frame attached to the spine of the patient. However, the reference frame can be dislodged or obscured during the surgical procedure, resulting in loss of navigation. Hyperspectral imaging (HSI) captures a large number of spectral information bands across the electromagnetic spectrum, providing image information unseen by the human eye. We aim to exploit HSI to detect skin features in a novel methodology to track patient position in navigated spinal surgery. In our approach, we adopt two local feature detection methods, namely a conventional handcrafted local feature and a deep learning-based feature detection method, which are compared to estimate the feature displacement between different frames due to motion. To demonstrate the ability of the system in tracking skin features, we acquire hyperspectral images of the skin of 17 healthy volunteers. Deep-learned skin features are detected and localized with an average error of only 0.25 mm, outperforming the handcrafted local features with respect to the ground truth based on the use of optical markers.

Diffuse reflectance spectroscopy for breach detection during pedicle screw placement: a first in vivo investigation in a porcine model

Background

The safe and accurate placement of pedicle screws remains a critical step in open and minimally invasive spine surgery, emphasizing the need for intraoperative guidance techniques. Diffuse reflectance spectroscopy (DRS) is an optical sensing technology that may provide intraoperative guidance in pedicle screw placement.

Purpose

The study presents the first in vivo minimally invasive procedure using DRS sensing at the tip of a Jamshidi needle with an integrated optical K-wire. We investigate the effect of tissue perfusion and probe-handling conditions on the reliability of fat fraction measurements for breach detection in vivo.

Methods

A Jamshidi needle with an integrated fiber-optic K-wire was gradually inserted into the vertebrae under intraoperative image guidance. The fiber-optic K-wire consisted of two optical fibers with a fiber-to-fiber distance of 1.024 mm. DRS spectra in the wavelength range of 450 to 1600 nm were acquired at several positions along the path inside the vertebrae. Probe-handling conditions were varied by changing the amount of pressure exerted on the probe within the vertebrae. Continuous spectra were recorded as the probe was placed in the center of the vertebral body while the porcine specimen was sacrificed via a lethal injection.

Results

A typical insertion of the fiber-optic K-wire showed a drop in fat fraction during an anterior breach as the probe transitioned from cancellous to cortical bone. Fat fraction measurements were found to be similar irrespective of the amount of pressure exerted on the probe (p = 0.65). The 95% confidence interval of fat fraction determination was found in the narrow range of 1.5–3.6% under various probe-handling conditions. The fat fraction measurements remained stable during 70 min of decreased blood flow after the animal was sacrificed.

Discussions

These findings indicate that changes in tissue perfusion and probe-handling conditions have a relatively low measureable effect on the DRS signal quality and thereby on the determination of fat fraction as a breach detection signal.

Conclusions

Fat fraction quantification for intraoperative pedicle screw breach detection is reliable, irrespective of changes in tissue perfusion and probe-handling conditions.

Augmented reality-based navigation increases precision of pedicle screw insertion

Background

Precise insertion of pedicle screws is important to avoid injury to closely adjacent neurovascular structures. The standard method for the insertion of pedicle screws is based on anatomical landmarks (free-hand technique). Head-mounted augmented reality (AR) devices can be used to guide instrumentation and implant placement in spinal surgery. This study evaluates the feasibility and precision of AR technology to improve precision of pedicle screw insertion compared to the current standard technique.

Methods

Two board-certified orthopedic surgeons specialized in spine surgery and two novice surgeons were each instructed to drill pilot holes for 40 pedicle screws in eighty lumbar vertebra sawbones models in an agar-based gel. One hundred and sixty pedicles were randomized into two groups: the standard free-hand technique (FH) and augmented reality technique (AR). A 3D model of the vertebral body was superimposed over the AR headset. Half of the pedicles were drilled using the FH method, and the other half using the AR method.

Results

The average minimal distance of the drill axis to the pedicle wall (MAPW) was similar in both groups for expert surgeons (FH 4.8 ± 1.0 mm vs. AR 5.0 ± 1.4 mm, p = 0.389) but for novice surgeons (FH 3.4 mm ± 1.8 mm, AR 4.2 ± 1.8 mm, p = 0.044).

Expert surgeons showed 0 primary drill pedicle perforations (PDPP) in both the FH and AR groups. Novices showed 3 (7.5%) PDPP in the FH group and one perforation (2.5%) in the AR group, respectively (p > 0.005).

Experts showed no statistically significant difference in average secondary screw pedicle perforations (SSPP) between the AR and the FH set 6-, 7-, and 8-mm screws (p > 0.05). Novices showed significant differences of SSPP between most groups: 6-mm screws, 18 (45%) vs. 7 (17.5%), p = 0.006; 7-mm screws, 20 (50%) vs. 10 (25%), p = 0.013; and 8-mm screws, 22 (55%) vs. 15 (37.5%), p = 0.053, in the FH and AR group, respectively. In novices, the average optimal medio-lateral convergent angle (oMLCA) was 3.23° (STD 4.90) and 0.62° (STD 4.56) for the FH and AR set screws (p = 0.017), respectively. Novices drilled with a higher precision with respect to the cranio-caudal inclination angle (CCIA) category (p = 0.04) with AR.

Conclusion

In this study, the additional anatomical information provided by the AR headset superimposed to real-world anatomy improved the precision of drilling pilot holes for pedicle screws in a laboratory setting and decreases the effect of surgeon’s experience. Further technical development and validations studies are currently being performed to investigate potential clinical benefits of the herein described AR-based navigation approach.

Design and control of an image-guided robot for spine surgery in a hybrid OR

BACKGROUND

Minimally invasive spine (MIS) fusion surgery requires image guidance and expert manual dexterity for a successful, efficient, and accurate pedicle screw placement. Operating room (OR)-integrated robotic solution can provide precise assistance to potentially minimize complication rates and facilitate difficult MIS procedures.

METHODS

A 5-degrees of freedom robot was designed specifically for a hybrid OR with integrated surgical navigation for guiding pedicle screw pilot holes. The system automatically aligns an instrument following the surgical plan using only instrument tracking feedback. Contrary to commercially available robotic systems, no tracking markers on the robotic arm are required. The system was evaluated in a cadaver study.

RESULTS

The mean targeting error (N = 34) was 1.27±0.57 mm and 1.62±0.85°, with 100% of insertions graded as clinically acceptable.

CONCLUSIONS

A fully integrated robotic guidance system, including intra-op imaging, planning, and physical guidance with optimized robot design and control, can improve workflow and provide pedicle screw guidance with less than 2 mm targeting error.

Feasibility and accuracy of a robotic guidance system for navigated spine surgery in a hybrid operating room: a cadaver study

The combination of navigation and robotics in spine surgery has the potential to accurately identify and maintain bone entry position and planned trajectory. The goal of this study was to examine the feasibility, accuracy and efficacy of a new robot-guided system for semi-automated, minimally invasive, pedicle screw placement. A custom robotic arm was integrated into a hybrid operating room (OR) equipped with an augmented reality surgical navigation system (ARSN). The robot was mounted on the OR-table and used to assist in placing Jamshidi needles in 113 pedicles in four cadavers. The ARSN system was used for planning screw paths and directing the robot. The robot arm autonomously aligned with the planned screw trajectory, and the surgeon inserted the Jamshidi needle into the pedicle. Accuracy measurements were performed on verification cone beam computed tomographies with the planned paths superimposed. To provide a clinical grading according to the Gertzbein scale, pedicle screw diameters were simulated on the placed Jamshidi needles. A technical accuracy at bone entry point of 0.48 ± 0.44 mm and 0.68 ± 0.58 mm was achieved in the axial and sagittal views, respectively. The corresponding angular errors were 0.94 ± 0.83° and 0.87 ± 0.82°. The accuracy was statistically superior (p < 0.001) to ARSN without robotic assistance. Simulated pedicle screw grading resulted in a clinical accuracy of 100%. This study demonstrates that the use of a semi-automated surgical robot for pedicle screw placement provides an accuracy well above what is clinically acceptable.

Conventional versus stereotactic image guided pedicle screw placement during spinal deformity correction: a retrospective propensity score-matched study of a national longitudinal database

PURPOSE/AIM

To compare complications, readmissions, revisions, and payments between navigated and conventional pedicle screw fixation for treatment of spine deformity.

METHODS

The Thomson Reuters MarketScan national longitudinal database was used to identify patients undergoing osteotomy, posterior instrumentation, and fusion for treatment of spinal deformity with or without image-guided navigation between 2007-2016. Conventional and navigated groups were propensity-matched (1:1) to normalize differences between demographics, comorbidities, and surgical characteristics. Clinical outcomes and charges were compared between matched groups using bivariate analyses.

RESULTS

A total of 4,604 patients were identified as having undergone deformity correction, of which 286 (6.2%) were navigated. Propensity-matching resulted in a total of 572 well-matched patients for subsequent analyses, of which half were navigated. Rate of mechanical instrumentation-related complications was found to be significantly lower for navigated procedures (p = 0.0371). Navigation was also associated with lower rates of 90-day unplanned readmissions (p = 0.0295), as well as 30- and 90-day postoperative revisions (30-day: p = 0.0304, 90-day: p = 0.0059). Hospital, physician, and total payments favored the conventional group for initial admission (p = 0.0481, 0.0001, 0.0019, respectively); however, when taking into account costs of readmissions, hospital payments became insignificantly different between the two groups.

CONCLUSIONS

Procedures involving image-guided navigation resulted in decreased instrumentation-related complications, unplanned readmissions, and postoperative revisions, highlighting its potential utility for the treatment of spine deformity. Future advances in navigation technologies and methodologies can continue to improve clinical outcomes, decrease costs, and facilitate widespread adoption of navigation for deformity correction.

Surgeon proficiency in robot-assisted spine surgery

Continuous technical improvement in spinal surgical procedures, with the aim of enhancing patient outcomes, can be assisted by the deployment of advanced technologies including navigation, intraoperative CT imaging, and surgical robots. The latest generation of robotic surgical systems allows the simultaneous application of a range of digital features that provide the surgeon with an improved view of the surgical field, often through a narrow portal.

There is emerging evidence that procedure-related complications and intraoperative blood loss can be reduced if the new technologies are used by appropriately trained surgeons. Acceptance of the role of surgical robots has increased in recent years among a number of surgical specialities including general surgery, neurosurgery, and orthopaedic surgeons performing major joint arthroplasty. However, ethical challenges have emerged with the rollout of these innovations, such as ensuring surgeon competence in the use of surgical robotics and avoiding financial conflicts of interest. Therefore, it is essential that trainees aspiring to become spinal surgeons as well as established spinal specialists should develop the necessary skills to use robotic technology safely and effectively and understand the ethical framework within which the technology is introduced.

Traditional and more recently developed platforms exist to aid skill acquisition and surgical training which are described.

The aim of this narrative review is to describe the role of surgical robotics in spinal surgery, describe measures of proficiency, and present the range of training platforms that institutions can use to ensure they employ confident spine surgeons adequately prepared for the era of robotic spinal surgery.

Cite this article: Bone Joint J 2020;102-B(5):568–572.

Accuracy of augmented reality surgical navigation for minimally invasive pedicle screw insertion in the thoracic and lumbar spine with a new tracking device

BACKGROUND CONTEXT

Minimally invasive approaches are increasingly used in spine surgery. The purpose of navigation systems is to guide the surgeon and to reduce intraoperative x-ray exposure.

PURPOSE

This study aimed to determine the feasibility and clinical accuracy of a navigation technology based on augmented reality surgical navigation (ARSN) for minimally invasive thoracic and lumbar pedicle screw instrumentation compared with standard fluoroscopy-guided minimally invasive technique.

STUDY DESIGN/SETTING

Cadaveric laboratory study.

METHODS

ARSN was installed in a hybrid operating room, consisting of a flat panel detector c-arm with two dimensional/three dimensional imaging capabilities and four integrated cameras in its frame. The surface-referenced navigation device does not require a bony reference but uses video cameras and optical markers applied to the patient's skin for tracking. In four cadavers, a total of 136 pedicle screws were inserted in thoracic and lumbar vertebrae. The accuracy was assessed by three independent raters in postoperative conventional computed tomography.

RESULTS

The overall accuracy of ARSN was 94% compared with an accuracy of 88% for fluoroscopy. The difference was not statistically significant. In the thoracic region, accuracy with ARSN was 92% compared with 83% with fluoroscopy. With fluoroscopy, unsafe screws were observed in three normal cadavers and one with scoliosis. Using ARSN, unsafe screws were only observed in the scoliotic spine. No significant difference in the median of time for K-wire placement was recorded. As no intraoperative fluoroscopy was necessary in ARSN, the performing surgeon was not exposed to radiation.

CONCLUSIONS

In this limited cadaveric study minimally invasive screw placement using ARSN was demonstrated to be feasible and as accurate as fluoroscopy. It did not require any additional navigation time or use of any intraoperative x-ray imaging, thereby potentially permitting surgery in a protective lead garment-free environment. A well-powered clinical study is needed to demonstrate a significant difference in the accuracy between the two methods.

CLINICAL SIGNIFICANCE

ARSN offers real-time imaging of planned insertion paths, instrument tracking, and overlay of three dimensional bony anatomy and surface topography. The referencing procedure, by optical recognition of several skin markers is easy and does not require a solid bony reference as necessary for conventional navigation which saves time. Additionally, ARSN may foster the reduction of intraoperative x-ray exposure to spinal surgeons.

Evolving Navigation, Robotics, and Augmented Reality in Minimally Invasive Spine Surgery

Innovative technology and techniques have revolutionized minimally invasive spine surgery (MIS) within the past decade. The introduction of navigation and image-guided surgery has greatly affected spinal surgery and will continue to make surgery safer and more efficient. Eventually, it is conceivable that fluoroscopy will be completely replaced with image guidance. These advancements, among others such as robotics and virtual and augmented reality technology, will continue to drive the value of 3-dimensional navigation in MIS. In this review, we cover pertinent features of navigation in MIS and explore their evolution over time. Moreover, we aim to discuss the key features germane to surgical advancement, including technique and technology development, accuracy, overall health care costs, operating room time efficiency, and radiation exposure.

Augmented Reality in Superficial Temporal Artery to Middle Cerebral Artery Bypass Surgery: Technical Note

BACKGROUND

Augmented reality (AR) applied to surgery refers to the virtual superimposition of computer-generated anatomical information on the surgical field. AR assistance in extracranial-intracranial (EC-IC) bypass revascularization surgery has been reported to be a helpful technical adjunct.

OBJECTIVE

To describe our experience of using AR in superficial temporal artery to middle cerebral artery (STA-MCA) bypass surgery with the additional implementation of new technical processes to improve the safety and efficacy of the procedure.

METHODS

Data sets from preoperative imaging were loaded and fused in a single 3-dimensional matrix using the neuronavigation system. Anatomical structures of interest (the STA, a selected M4 branch of the MCA, the middle meningeal artery [MMA], and the primary motor cortex [PMC]) were segmented. After the registration of the patient and the operating microscope, the structures of interest were projected into the eyepiece of the microscope and superimposed onto the patient's head, creating the AR surgical field.

RESULTS

AR was shown to be useful in patients undergoing EC-IC bypass revascularization, mostly during the following 4 surgical steps: (1) microsurgical dissection of the donor vessel (STA); (2) tailoring the craniotomy above the recipient vessel (M4 branch of the MCA); (3) tailoring the craniotomy to spare the MMA; and (4) tailoring the craniotomy and the anastomosis to spare the PMC.

CONCLUSION

AR assistance in EC-IC bypass revascularization is a versatile technical adjunct for helping surgeons to ensure the safety and efficacy of the procedure.

Spine Surgery Supported by Augmented Reality

STUDY DESIGN

A prospective, case-based, observational study.

OBJECTIVES

To investigate how microscope-based augmented reality (AR) support can be utilized in various types of spine surgery.

METHODS

In 42 spinal procedures (12 intra- and 8 extradural tumors, 7 other intradural lesions, 11 degenerative cases, 2 infections, and 2 deformities) AR was implemented using operating microscope head-up displays (HUDs). Intraoperative low-dose computed tomography was used for automatic registration. Nonlinear image registration was applied to integrate multimodality preoperative images. Target and risk structures displayed by AR were defined in preoperative images by automatic anatomical mapping and additional manual segmentation.

RESULTS

AR could be successfully applied in all 42 cases. Low-dose protocols ensured a low radiation exposure for registration scanning (effective dose cervical 0.29 ± 0.17 mSv, thoracic 3.40 ± 2.38 mSv, lumbar 3.05 ± 0.89 mSv). A low registration error (0.87 ± 0.28 mm) resulted in a reliable AR representation with a close matching of visualized objects and reality, distinctly supporting anatomical orientation in the surgical field. Flexible AR visualization applying either the microscope HUD or video superimposition, including the ability to selectively activate objects of interest, as well as different display modes allowed a smooth integration in the surgical workflow, without disturbing the actual procedure. On average, 7.1 ± 4.6 objects were displayed visualizing target and risk structures reliably.

CONCLUSIONS

Microscope-based AR can be applied successfully to various kinds of spinal procedures. AR improves anatomical orientation in the surgical field supporting the surgeon, as well as it offers a potential tool for education.

Robotic Spine Surgery and Augmented Reality Systems: A State of the Art

Instrumented spine procedures have been performed for decades to treat a wide variety of spinal disorders. New technologies have been employed to obtain a high degree of precision, to minimize risks of damage to neurovascular structures and to diminish harmful exposure of patients and the operative team to ionizing radiations. Robotic spine surgery comprehends 3 major categories: telesurgical robotic systems, robotic-assisted navigation (RAN) and virtual augmented reality (AR) systems, including AR and virtual reality. Telesurgical systems encompass devices that can be operated from a remote command station, allowing to perform surgery via instruments being manipulated by the robot. On the other hand, RAN technologies are characterized by the robotic guidance of surgeon-operated instruments based on real-time imaging. Virtual AR systems are able to show images directly on special visors and screens allowing the surgeon to visualize information about the patient and the procedure (i.e., anatomical landmarks, screw direction and inclination, distance from neurological and vascular structures etc.). The aim of this review is to focus on the current state of the art of robotics and AR in spine surgery and perspectives of these emerging technologies that hold promises for future applications.

Applicability of augmented reality in orthopedic surgery - A systematic review

BACKGROUND

Computer-assisted solutions are changing surgical practice continuously. One of the most disruptive technologies among the computer-integrated surgical techniques is Augmented Reality (AR). While Augmented Reality is increasingly used in several medical specialties, its potential benefit in orthopedic surgery is not yet clear. The purpose of this article is to provide a systematic review of the current state of knowledge and the applicability of AR in orthopedic surgery.

METHODS

A systematic review of the current literature was performed to find the state of knowledge and applicability of AR in Orthopedic surgery. A systematic search of the following three databases was performed: "PubMed", "Cochrane Library" and "Web of Science". The systematic review followed the Preferred Reporting Items on Systematic Reviews and Meta-analysis (PRISMA) guidelines and it has been published and registered in the international prospective register of systematic reviews (PROSPERO).

RESULTS

31 studies and reports are included and classified into the following categories: Instrument / Implant Placement, Osteotomies, Tumor Surgery, Trauma, and Surgical Training and Education. Quality assessment could be performed in 18 studies. Among the clinical studies, there were six case series with an average score of 90% and one case report, which scored 81% according to the Joanna Briggs Institute Critical Appraisal Checklist (JBI CAC). The 11 cadaveric studies scored 81% according to the QUACS scale (Quality Appraisal for Cadaveric Studies).

CONCLUSION

This manuscript provides 1) a summary of the current state of knowledge and research of Augmented Reality in orthopedic surgery presented in the literature, and 2) a discussion by the authors presenting the key remarks required for seamless integration of Augmented Reality in the future surgical practice.

TRIAL REGISTRATION

PROSPERO registration number: CRD42019128569.

Augmented reality navigation with intraoperative 3D imaging vs fluoroscopy-assisted free-hand surgery for spine fixation surgery: a matched-control study comparing accuracy

This study aimed to compare screw placement accuracy and clinical aspects between Augmented Reality Surgical Navigation (ARSN) and free-hand (FH) technique. Twenty patients underwent spine surgery with screw placement using ARSN and were matched retrospectively to a cohort of 20 FH technique cases for comparison. All ARSN and FH cases were performed by the same surgeon. Matching was based on clinical diagnosis and similar proportions of screws placed in the thoracic and lumbosacral vertebrae in both groups. Accuracy of screw placement was assessed on postoperative scans according to the Gertzbein scale and grades 0 and 1 were considered accurate. Procedure time, blood loss and length of hospital stay, were collected as secondary endpoints. A total of 262 and 288 screws were assessed in the ARSN and FH groups, respectively. The share of clinically accurate screws was significantly higher in the ARSN vs FH group (93.9% vs 89.6%, p < 0.05). The proportion of screws placed without a cortical breach was twice as high in the ARSN group compared to the FH group (63.4% vs 30.6%, p < 0.0001). No statistical difference was observed for the secondary endpoints between both groups. This matched-control study demonstrated that ARSN provided higher screw placement accuracy compared to free-hand.

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery; a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

Objective

Surgical navigation is a well-established tool in endoscopic skull base surgery. However, navigational and endoscopic views are usually displayed on separate monitors, forcing the surgeon to focus on one or the other. Aiming to provide real-time integration of endoscopic and diagnostic imaging information, we present a new navigation technique based on augmented reality with fusion of intraoperative cone beam computed tomography (CBCT) on the endoscopic view. The aim of this study was to evaluate the accuracy of the method.

Material and methods

An augmented reality surgical navigation system (ARSN) with 3D CBCT capability was used. The navigation system incorporates an optical tracking system (OTS) with four video cameras embedded in the flat detector of the motorized C-arm. Intra-operative CBCT images were fused with the view of the surgical field obtained by the endoscope’s camera. Accuracy of CBCT image co-registration was tested using a custom-made grid with incorporated 3D spheres.

Results

Co-registration of the CBCT image on the endoscopic view was performed. Accuracy of the overlay, measured as mean target registration error (TRE), was 0.55 mm with a standard deviation of 0.24 mm and with a median value of 0.51mm and interquartile range of 0.39˗˗0.68 mm.

Conclusion

We present a novel augmented reality surgical navigation system, with fusion of intraoperative CBCT on the endoscopic view. The system shows sub-millimeter accuracy.

Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons

Background

Minimally invasive spine surgery (MISS) and endoscopic spine surgery have continually evolving indications in the cervical, thoracic, and lumbar spine. Endoscopic spine surgery entails treatment of disc disease, stenosis, spondylolisthesis, radiculopathy, and deformity. MISS involves complex motor skills in regions of variable anatomy. Simulator use has been proposed to aid in training and skill retention, preoperative planning, and intraoperative use.

Methods

A systematic review of five databases was performed for publications pertaining to the use of virtual (VR), augmented (AR), and mixed (MR) reality in MISS and spinal endoscopic surgery. Qualitative data analysis was undertaken with focus of study design, quality, and reported outcomes. Study quality was assessed using the Medical Education Research Quality Instrument (MERSQI) score and level of evidence (LoE) by a modified Oxford Centre for Evidence-Based Medicine (OCEBM) level for simulation in medicine.

Results

Thirty-eight studies were retained for data collection. Studies were of intervention-control, clinical application, and pilot or cross-sectional design. Identified articles illustrated use of VR, AR, and MR in all study designs. Procedures included pedicle cannulation and screw insertion, vertebroplasty, kyphoplasty, percutaneous transforaminal endoscopic discectomy (PTED), lumbar puncture and facet injection, transvertebral anterior cervical foraminotomy (TVACF) and posterior cervical laminoforaminotomy. Overall MERSQI score was low-to-medium [M =9.71 (SD =2.60); range, 4.5-13.5], and LoE was predominantly low given the number of purely descriptive articles, or low-quality randomized studies.

Conclusions

The current scope of VR, AR, and MR surgical simulators in MISS and spinal endoscopic surgery was described. Studies demonstrate improvement in technical skill and patient outcomes in short term follow-up. Despite this, overall study quality and levels of evidence remain low. Cohesive study design and reporting with focus on transfer validity in training scenarios, and patient derived outcome measures in clinical studies are required to further advance the field.

Augmented Reality Surgical Navigation in Spine Surgery to Minimize Staff Radiation Exposure

STUDY DESIGN

Prospective observational study.

OBJECTIVE

To assess staff and patient radiation exposure during augmented reality surgical navigation in spine surgery.

SUMMARY OF BACKGROUND DATA

Surgical navigation in combination with intraoperative three-dimensional imaging has been shown to significantly increase the clinical accuracy of pedicle screw placement. Although this technique may increase the total radiation exposure compared with fluoroscopy, the occupational exposure can be minimized, as navigation is radiation free and staff can be positioned behind protective shielding during three-dimensional imaging. The patient radiation exposure during treatment and verification of pedicle screw positions can also be reduced.

METHODS

Twenty patients undergoing spine surgery with pedicle screw placement were included in the study. The staff radiation exposure was measured using real-time active personnel dosimeters and was further compared with measurements using a reference dosimeter attached to the C-arm (i.e., a worst-case staff exposure situation). The patient radiation exposures were recorded, and effective doses (ED) were determined.

RESULTS

The average staff exposure per procedure was 0.21 ± 0.06 μSv. The average staff-to-reference dose ratio per procedure was 0.05% and decreased to less than 0.01% after a few procedures had been performed. The average patient ED was 15.8 ± 1.8 mSv which mainly correlated with the number of vertebrae treated and the number of cone-beam computed tomography acquisitions performed. A low-dose protocol used for the final 10 procedures yielded a 32% ED reduction per spinal level treated.

CONCLUSION

This study demonstrated significantly lower occupational doses compared with values reported in the literature. Real-time active personnel dosimeters contributed to a fast optimization and adoption of protective measures throughout the study. Even though our data include both cone-beam computed tomography for navigation planning and intraoperative screw placement verification, we find low patient radiation exposure levels compared with published data.

LEVEL OF EVIDENCE

3.

Augmented reality in orthopaedics

Aims

Computer-based applications are increasingly being used by orthopaedic surgeons in their clinical practice. With the integration of technology in surgery, augmented reality (AR) may become an important tool for surgeons in the future. By superimposing a digital image on a user’s view of the physical world, this technology shows great promise in orthopaedics. The aim of this review is to investigate the current and potential uses of AR in orthopaedics.

Materials and Methods

A systematic review of the PubMed, MEDLINE, and Embase databases up to January 2019 using the keywords ‘orthopaedic’ OR ‘orthopedic AND augmented reality’ was performed by two independent reviewers.

Results

A total of 41 publications were included after screening. Applications were divided by subspecialty: spine (n = 15), trauma (n = 16), arthroplasty (n = 3), oncology (n = 3), and sports (n = 4). Out of these, 12 were clinical in nature. AR-based technologies have a wide variety of applications, including direct visualization of radiological images by overlaying them on the patient and intraoperative guidance using preoperative plans projected onto real anatomy, enabling hands-free real-time access to operating room resources, and promoting telemedicine and education.

Conclusion

There is an increasing interest in AR among orthopaedic surgeons. Although studies show similar or better outcomes with AR compared with traditional techniques, many challenges need to be addressed before this technology is ready for widespread use. Cite this article: Bone Joint J 2019;101-B:1479–1488

Diffuse reflectance spectroscopy accurately identifies the pre-cortical zone to avoid impending pedicle screw breach in spinal fixation surgery

Pedicle screw placement accuracy during spinal fixation surgery varies greatly and severe misplacement has been reported in 1-6.5% of screws. Diffuse reflectance (DR) spectroscopy has previously been shown to reliably discriminate between tissues in the human body. We postulate that it could be used to discriminate between cancellous and cortical bone. Therefore, the purpose of this study is to validate DR spectroscopy as a warning system to detect impending pedicle screw breach in a cadaveric surgical setting using typical clinical breach scenarios. DR spectroscopy was incorporated at the tip of an integrated pedicle screw and screw driver used for tissue probing during pedicle screw insertions on six cadavers. Measurements were collected in the wavelength range of 400-1600 nm and each insertion was planned to result in a breach. Measurements were labelled as cancellous, cortical or representing a pre-cortical zone (PCZ) in between, based on information from cone beam computed tomographies at corresponding positions. In addition, DR spectroscopy data was recorded after breach. Four typical pedicle breach types were performed, and a total of 45 pedicle breaches were recorded. For each breach direction, the technology was able to detect the transition of the screw tip from the cancellous bone to the PCZ (P < 0.001), to cortical bone (P < 0.001), and to a subsequent breach (P < 0.001). Using support vector machine (SVM) classification, breach could reliably be detected with a sensitivity of 98.3 % [94.3-100 %] and a specificity of 97.7 % [91.0-100 %]. We conclude that DR spectroscopy reliably identifies the area of transition from cancellous to cortical bone in typical breach scenarios and can warn the surgeon of impending pedicle breach, thereby resulting in safer spinal fixation surgeries.

Augmented reality in intradural spinal tumor surgery

BACKGROUND

Microscope-based augmented reality (AR) is commonly used in cranial surgery; however, until recently, this technique was not implemented for spinal surgery. We prospectively investigated, how AR can be applied for intradural spinal tumor surgery.

METHODS

For ten patients with intradural spinal tumors (ependymoma, glioma, hemangioblastoma, meningioma, and metastasis), AR was provided by head-up displays (HUDs) of operating microscopes. User-independent automatic AR registration was established by low-dose intraoperative computed tomography. The objects visualized by AR were segmented in preoperative imaging data; non-linear image registration was applied to consider spine flexibility.

RESULTS

In all cases, AR supported surgery by visualizing the tumor outline and other relevant surrounding structures. The overall AR registration error was 0.72 ± 0.24 mm (mean ± standard deviation), a close matching of visible tumor outline and AR visualization was observed for all cases. Registration scanning resulted in a low effective dose of 0.22 ± 0.16 mSv for cervical and 1.68 ± 0.61 mSv for thoracic lesions. The mean HUD AR usage in relation to microscope time was 51.6 ± 36.7%. The HUD was switched off and turned on again in a range of 2 to 17 times (5.7 ± 4.4 times). Independent of the status of the HUD, the AR visualization was displayed on monitors throughout surgery.

CONCLUSIONS

Microscope-based AR can be reliably applied to intradural spinal tumor surgery. Automatic AR registration ensures high precision and provides an intuitive visualization of the extent of the tumor and surrounding structures. Given this setting, all advanced multi-modality options of cranial AR can also be applied to spinal surgery.

Application of Augmented Reality to Stereotactic Biopsy

Both frame-based stereotaxy and frameless stereotaxy are established surgical procedures. However, they each have their respective disadvantages when used in the biopsy of a deep-seated lesion. To overcome the drawbacks associated with these procedures, we evaluated the feasibility of applying augmented reality (AR) to stereotactic biopsy. We applied our trans-visible navigator (TVN) to frame-based stereotactic biopsy in five cases of deep-seated lesions. This navigation system uses the AR concept, allowing surgeons to view three-dimensional virtual models of anatomical structures superimposed over the surgical field on a tablet personal computer. Using TVN, we could easily confirm a clear trajectory avoiding the important structures as well as the target point’s location in the lesion. Use of the stereotactic apparatus allowed the surgeon to easily advance the biopsy probe to the target point. Consequently, a satisfactory histopathological diagnosis without complication was achieved in all cases. In conclusion, applying AR to stereotactic biopsy is feasible and may improve the safety of the procedure.

The utility of virtual reality and augmented reality in spine surgery

As the number of advances in surgical techniques increases, it becomes increasingly important to assess and research the technology regarding spine surgery techniques in order to increase surgical accuracy, decrease overall length of surgery, and minimize overall radiation exposure. Currently, augmented reality and virtual reality have shown promising results in regard to their applicability beyond their current functions. At present, VR has been generally applied to a teaching and preparatory role, while AR has been utilized in surgical settings. As such, the following review attempts to provide an overview of both virtual reality and augmented reality, followed by a discussion of their current applications and future direction.

A Novel Augmented-Reality-Based Surgical Navigation System for Spine Surgery in a Hybrid Operating Room: Design, Workflow, and Clinical Applications

BACKGROUND

Treatment of several spine disorders requires placement of pedicle screws. Detailed 3-dimensional (3D) anatomic information facilitates this process and improves accuracy.

OBJECTIVE

To present a workflow for a novel augmented-reality-based surgical navigation (ARSN) system installed in a hybrid operating room for anatomy visualization and instrument guidance during pedicle screw placement.

METHODS

The workflow includes surgical exposure, imaging, automatic creation of a 3D model, and pedicle screw path planning for instrument guidance during surgery as well as the actual screw placement, spinal fixation, and wound closure and intraoperative verification of the treatment results. Special focus was given to process integration and minimization of overhead time. Efforts were made to manage staff radiation exposure avoiding the need for lead aprons. Time was kept throughout the procedure and subdivided to reflect key steps. The navigation workflow was validated in a trial with 20 cases requiring pedicle screw placement (13/20 scoliosis).

RESULTS

Navigated interventions were performed with a median total time of 379 min per procedure (range 232-548 min for 4-24 implanted pedicle screws).

The total procedure time was subdivided into surgical exposure (28%), cone beam computed tomography imaging and 3D segmentation (2%), software planning (6%), navigated surgery for screw placement (17%) and non-navigated instrumentation, wound closure, etc (47%).

CONCLUSION

Intraoperative imaging and preparation for surgical navigation totaled 8% of the surgical time. Consequently, ARSN can routinely be used to perform highly accurate surgery potentially decreasing the risk for complications and revision surgery while minimizing radiation exposure to the staff.

The New Frontier: A Review of Augmented Reality and Virtual Reality in Plastic Surgery

Mixed reality, a blending of the physical and digital worlds, can enhance the surgical experience, leading to greater precision, efficiency, and improved outcomes. Various studies across different disciplines have reported encouraging results using mixed reality technologies, such as augmented and virtual reality. To provide a better understanding of the applications and limitations of this technology in plastic surgery, we performed a systematic review of the literature in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The initial query of the National Center for Biotechnology Information database yielded 2544 results, and only 46 articles met our inclusion criteria. The majority of studies were in the field of craniofacial surgery, and uses of mixed reality included preoperative planning, intraoperative guides, and education of surgical trainees. A deeper understanding of mixed reality technologies may promote its integration and also help inspire new and creative applications in healthcare.

Augmented and Virtual Reality Instrument Tracking for Minimally Invasive Spine Surgery: A Feasibility and Accuracy Study

STUDY DESIGN

Cadaveric animal laboratory study.

OBJECTIVE

To evaluate the feasibility and accuracy of pedicle cannulation using an augmented reality surgical navigation (ARSN) system with automatic instrument tracking, yielding feedback of instrument position in relation to deep anatomy.

SUMMARY OF BACKGROUND DATA

Minimally invasive spine surgery (MISS) has the possibility of reducing surgical exposure resulting in shorter hospital stays, lower blood loss and infection rates compared with open surgery but the drawback of limiting visual feedback to the surgeon regarding deep anatomy. MISS is mainly performed using image-guided 2D fluoroscopy, thus exposing the staff to ionizing radiation.

METHODS

A hybrid operating room (OR) equipped with a robotic C-arm with integrated optical cameras for augmented reality instrument navigation was used. In two pig cadavers, cone beam computed tomography (CBCT) scans were performed, a 3D model generated, and pedicle screw insertions were planned. Seventy-eight insertions were performed. Technical accuracy was assessed on post-insertion CBCTs by measuring the distance between the navigated device and the corresponding pre-planned path as well as the angular deviations. Drilling and hammering into the pedicle were also compared. Navigation time was measured. An independent reviewer assessed a simulated clinical accuracy according to Gertzbein.

RESULTS

The technical accuracy was 1.7 ± 1.0 mm at the bone entry point and 2.0 ± 1.3 mm at the device tip. The angular deviation was 1.7 ± 1.7° in the axial and 1.6 ± 1.2° in the sagittal plane. Navigation time per insertion was 195 ± 93 seconds. There was no difference in accuracy between hammering and drilling into the pedicle. The clinical accuracy was 97.4% to 100% depending on the screw size considered for placement. No ionizing radiation was used during navigation.

CONCLUSION

ARSN with instrument tracking for MISS is feasible, accurate, and radiation-free during navigation.

LEVEL OF EVIDENCE

3.

Validation of diffuse reflectance spectroscopy with magnetic resonance imaging for accurate vertebral bone fat fraction quantification

Safe and accurate placement of pedicle screws remains a critical step in open and minimally invasive spine surgery. The diffuse reflectance spectroscopy (DRS) technique may offer the possibility of intra-operative guidance for pedicle screw placement. Currently, Magnetic Resonance Imaging (MRI) is one of the most accurate techniques used to measure fat concentration in tissues. Therefore, the purpose of this study is to compare the accuracy of fat content measured invasively in vertebrae using DRS and validate it against the Proton density fat fraction (PDFF) derived via MRI. Chemical shift-encoding-based water-fat imaging of the spine was first performed on six cadavers. PDFF images were computed and manually segmented. 23 insertions using a custom-made screw probe with integrated optical fibers were then performed under cone beam computer tomography (CBCT). DR spectra were recorded at several positions along the trajectory as the optical screw probe was inserted turn by turn into the vertebral body. Fat fractions determined via DRS and MRI techniques were compared by spatially correlating the optical screw probe position within the vertebrae on CBCT images with respect to the PDFF images. The fat fraction determined by DRS was found to have a high correlation with those determined by MRI, with a Pearson coefficient of 0.950 (P< 0.001) as compared with PDFF measurements calculated from the MRI technique. Additionally, the two techniques were found to be comparable for fat fraction quantification within vertebral bodies (R² = 0.905).

Augmented Reality in Orthopedics: Current State and Future Directions

Augmented reality (AR) comprises special hardware and software, which is used in order to offer computer-processed imaging data to the surgeon in real time, so that real-life objects are combined with computer-generated images. AR technology has recently gained increasing interest in the surgical practice. Preclinical research has provided substantial evidence that AR might be a useful tool for intra-operative guidance and decision-making. AR has been applied to a wide spectrum of orthopedic procedures, such as tumor resection, fracture fixation, arthroscopy, and component's alignment in total joint arthroplasty. The present study aimed to summarize the current state of the application of AR in orthopedics, in preclinical and clinical level, providing future directions and perspectives concerning potential further benefits from this technology.

Workflow Caveats in Augmented Reality-Assisted Pedicle Instrumentation: Cadaver Lab

BACKGROUND

Augmented reality (AR) is gaining popularity in gaming, industrial, military, and medical fields. Neurosurgical applications are currently limited and underdeveloped.

METHODS

The cadaver lab session was prepared with the currently available AR equipment and software. Pedicle instrumentation was performed from thoracic 1 to the pelvis with either fluoroscopy or AR.

RESULTS

A total of 38 screws were placed. There were no major breaches on the fluoroscopy-assisted side. Among the AR screws, 3 had a major medial breach and 4 had a major inferior breach. The cause of a 3 breaches appeared to be related to an error in the starting position, as their overall orientation remained correctly parallel to the original trajectory.

CONCLUSIONS

The article discusses the potential and limitations of AR in its current state and identifies strategies for successful AR application in future surgery.