1
|
Farshad M, Zindel C, Safa NA, Spirig JM, Winkler E. Instrumentation of hypoplastic pedicles with patient-specific guides. Spine Deform 2024; 12:989-1000. [PMID: 38558382 PMCID: PMC11217052 DOI: 10.1007/s43390-024-00852-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Accepted: 02/20/2024] [Indexed: 04/04/2024]
Abstract
PURPOSE Hypoplastic pedicles of the thoracolumbar spine (<5 mm diameter) are often found in syndromic deformities of the spine and pose a challenge in pedicle screw instrumentation. 3D-printed patient-specific guides might help overcome anatomical difficulties when instrumenting pedicles with screws, thereby reducing the necessity for less effective fixation methods such as hooks or sublaminar wires. In this study, the surgical feasibility and clinical outcome of patients with hypoplastic pedicles following pedicle screw instrumentation with 3D-printed patient-specific guides were assessed. METHODS Hypoplastic pedicles were identified on preoperative computed tomography (CT) scans in six patients undergoing posterior spinal fusion surgery between 2017 and 2020. Based on these preoperative CT scans, patient-specific guides were produced to help with screw instrumentation of these thin pedicles. Postoperatively, pedicle-screw-related complications or revisions were analyzed. RESULTS 93/105 (88.6%) pedicle screws placed with patient-specific guides were instrumented. 62/93 (66.7%) of these instrumented pedicles were defined as hypoplastic with a mean width of 3.07 mm (SD ±0.98 mm, 95% CI [2.82-3.32]). Overall, 6 complications in the 62 hypoplastic pedicles (9.7%) were observed and included intraoperatively managed 4 cerebrospinal fluid leaks, 1 pneumothorax and 1 delayed revision due to 2 lumbar screws (2/62, 3.3%) impinging the L3 nerve root causing a painful radiculopathy. The mean follow-up time was 26.7 (SD ±11.7) months. Complications were only noted when the pedicle-width-to-screw-diameter ratio measured less than 0.62. CONCLUSION Patient-specific 3D-printed guides can aid in challenging instrumentation of hypoplastic pedicles in the thoracolumbar spine, especially if the pedicle-width-to-screw-diameter ratio is greater than 0.62.
Collapse
Affiliation(s)
- Mazda Farshad
- Department of Spine Surgery, Balgrist University Hospital Zürich, University of Zürich, Forchstrasse 340, 8008, Zurich, CH, Switzerland
| | - Christoph Zindel
- Department of Spine Surgery, Balgrist University Hospital Zürich, University of Zürich, Forchstrasse 340, 8008, Zurich, CH, Switzerland
| | - Nico Akhavan Safa
- Department of Spine Surgery, Balgrist University Hospital Zürich, University of Zürich, Forchstrasse 340, 8008, Zurich, CH, Switzerland
| | - José Miguel Spirig
- Department of Spine Surgery, Balgrist University Hospital Zürich, University of Zürich, Forchstrasse 340, 8008, Zurich, CH, Switzerland
| | - Elin Winkler
- Department of Spine Surgery, Balgrist University Hospital Zürich, University of Zürich, Forchstrasse 340, 8008, Zurich, CH, Switzerland.
| |
Collapse
|
2
|
Youssef S, McDonnell JM, Wilson KV, Turley L, Cunniffe G, Morris S, Darwish S, Butler JS. Accuracy of augmented reality-assisted pedicle screw placement: a systematic review. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2024; 33:974-984. [PMID: 38177834 DOI: 10.1007/s00586-023-08094-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 12/06/2023] [Accepted: 12/08/2023] [Indexed: 01/06/2024]
Abstract
OBJECTIVE Conventional freehand methods of pedicle screw placement are associated with significant complications due to close proximity to neural and vascular structures. Recent advances in augmented reality surgical navigation (ARSN) have led to its adoption into spine surgery. However, little is known regarding its overall accuracy. The purpose of this study is to delineate the overall accuracy of ARSN pedicle screw placement across various models. METHODS A systematic review was conducted of Medline/PubMed, Cochrane and Embase Library databases according to the PRISMA guidelines. Relevant data extracted included reports of pedicle screw placement accuracy and breaches, as defined by the Gertzbein-Robbins classification, in addition to deviation from pre-planned trajectory and entry point. Accuracy was defined as the summation of grade 0 and grade 1 events per the Gertzbein-Robbins classification. RESULTS Twenty studies reported clinically accurate placed screws. The range of clinically accurate placed screws was 26.3-100%, with 2095 screws (93.1%) being deemed clinically accurate. Furthermore, 5.4% (112/2088) of screws were reported as grade two breaches, 1.6% (33/2088) grade 3 breaches, 3.1% (29/926) medial breaches and 2.3% (21/926) lateral breaches. Mean linear deviation ranged from 1.3 to 5.99 mm, while mean angular/trajectory deviation ranged 1.6°-5.88°. CONCLUSION The results of this study highlight the overall accuracy of ARSN pedicle screw placement. However, further robust prospective studies are needed to accurately compare to conventional methods of pedicle screw placement.
Collapse
Affiliation(s)
- Salma Youssef
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland
| | - Jake M McDonnell
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
- Trinity Biomedical Sciences Institute, Trinity College Dublin, Dublin, Ireland
| | - Kielan V Wilson
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland.
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland.
| | - Luke Turley
- Department of Orthopaedics, Tallaght University Hospital, Tallaght, Dublin, Ireland
| | - Gráinne Cunniffe
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Seamus Morris
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Stacey Darwish
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
- Department of Orthopaedics, St. Vincent's University Hospital, Dublin, Ireland
| | - Joseph S Butler
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| |
Collapse
|
3
|
Adida S, Legarreta AD, Hudson JS, McCarthy D, Andrews E, Shanahan R, Taori S, Lavadi RS, Buell TJ, Hamilton DK, Agarwal N, Gerszten PC. Machine Learning in Spine Surgery: A Narrative Review. Neurosurgery 2024; 94:53-64. [PMID: 37930259 DOI: 10.1227/neu.0000000000002660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 07/06/2023] [Indexed: 11/07/2023] Open
Abstract
Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.
Collapse
Affiliation(s)
- Samuel Adida
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Andrew D Legarreta
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Joseph S Hudson
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - David McCarthy
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Edward Andrews
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Regan Shanahan
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Suchet Taori
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Raj Swaroop Lavadi
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Thomas J Buell
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - D Kojo Hamilton
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Nitin Agarwal
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh , Pennsylvania , USA
| | - Peter C Gerszten
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| |
Collapse
|
4
|
Azad TD, Warman A, Tracz JA, Hughes LP, Judy BF, Witham TF. Augmented reality in spine surgery - past, present, and future. Spine J 2024; 24:1-13. [PMID: 37660893 DOI: 10.1016/j.spinee.2023.08.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 07/27/2023] [Accepted: 08/29/2023] [Indexed: 09/05/2023]
Abstract
BACKGROUND CONTEXT Augmented reality (AR) is increasingly recognized as a valuable tool in spine surgery. Here we provides an overview of the key developments and technological milestones that have laid the foundation for AR applications in this field. We also assess the quality of existing studies on AR systems in spine surgery and explore potential future applications. PURPOSE The purpose of this narrative review is to examine the role of AR in spine surgery. It aims to highlight the evolution of AR technology in this context, evaluate the existing body of research, and outline potential future directions for integrating AR into spine surgery. STUDY DESIGN Narrative review. METHODS We conducted a thorough literature search to identify studies and developments related to AR in spine surgery. Relevant articles, reports, and technological advancements were analyzed to establish the historical context and current state of AR in this field. RESULTS The review identifies significant milestones in the development of AR technology for spine surgery. It discusses the growing body of research and highlights the strengths and weaknesses of existing investigations. Additionally, it presents insights into the potential for AR to enhance spine surgical education and speculates on future applications. CONCLUSIONS Augmented reality has emerged as a promising adjunct in spine surgery, with notable advancements and research efforts. The integration of AR into the spine surgery operating room holds promise, as does its potential to revolutionize surgical education. Future applications of AR in spine surgery may include real-time navigation, enhanced visualization, and improved patient outcomes. Continued development and evaluation of AR technology are essential for its successful implementation in this specialized surgical field.
Collapse
Affiliation(s)
- Tej D Azad
- Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 N. Wolfe St, Meyer 7-109, Baltimore, MD 21287, USA
| | - Anmol Warman
- Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 N. Wolfe St, Meyer 7-109, Baltimore, MD 21287, USA
| | - Jovanna A Tracz
- Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 N. Wolfe St, Meyer 7-109, Baltimore, MD 21287, USA
| | - Liam P Hughes
- Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 N. Wolfe St, Meyer 7-109, Baltimore, MD 21287, USA
| | - Brendan F Judy
- Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 N. Wolfe St, Meyer 7-109, Baltimore, MD 21287, USA
| | - Timothy F Witham
- Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 N. Wolfe St, Meyer 7-109, Baltimore, MD 21287, USA.
| |
Collapse
|
5
|
Leblond L, Godio-Raboutet Y, Tomi F, Glard Y, La Greca R, Clement T, Evin M. Sliding on cortical shell: Biomechanical characterization of the vertebral cannulation for pedicle screw insertion. Clin Biomech (Bristol, Avon) 2023; 110:106102. [PMID: 37769380 DOI: 10.1016/j.clinbiomech.2023.106102] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 09/14/2023] [Accepted: 09/20/2023] [Indexed: 09/30/2023]
Abstract
BACKGROUND Pedicular screws pull-out has been well studied unlike their insertion. A need for characterizing cannulation before pedicle screw implantation is highlighted in literature and offers promising prospects for future intra-operation instrumentation. A reliable cannulation protocol for ex-vivo testing in swine and cadaver vertebrae is presented in this work to predict extra pedicular perforation. METHODS An MTS Acumen 3 A/T electrodynamic device, with a tri-axis 3 kN Kistler load cell mounted on a surgical tool was used to reproduce surgeon's gesture by moving at a constant rotational speed of 10°/mm and performing a three-section test. Perforation of the pedicle's cortical shell was planned through a design of experiment on the surgical tool angle at the entry point. Samples were scanned before and after mechanical tests and reproducibility of the protocol was tested on synthetic foam. Computation of the angle between cannulation tool and pedicle cortical shell was performed as well as cannulation coefficient of each perforation section. FINDINGS A total of 68 pedicles were tested: 19 perforated and 21 non-perforated human pedicles, 17 perforated and 16 non-perforated swine pedicles. The reproducibility of the protocol for cannulation coefficient computation resulted in an intraclass correlation coefficient of 0.979. Cannulation coefficients results presented variability within spinal levels as well as between swine and human model. Correlation between bone density and cannulation coefficient was found significant (p < 0.005). Torque measurement was found to be the best predictor of perforation. Threshold of angle for prediction of perforation was found to be 21.7°. INTERPRETATION Characterizing pedicle cannulation enables to predict extra pedicular perforation. Influence of bone mineral density and patient-specific morphology on pedicle cannulation has been highlighted together with a comparison of swine and cadaver models.
Collapse
Affiliation(s)
| | | | - Florent Tomi
- Aix Marseille Univ. Univ Gustave Eiffel, LBA, Marseille, France
| | - Yann Glard
- Department of Paediatric Orthopaedics, Saint Joseph Hospital, Marseille, France
| | | | - Thomas Clement
- Aix Marseille Univ. Univ Gustave Eiffel, LBA, Marseille, France
| | - Morgane Evin
- Aix Marseille Univ. Univ Gustave Eiffel, LBA, Marseille, France.
| |
Collapse
|
6
|
Pose-Díez-de-la-Lastra A, Ungi T, Morton D, Fichtinger G, Pascau J. Real-time integration between Microsoft HoloLens 2 and 3D Slicer with demonstration in pedicle screw placement planning. Int J Comput Assist Radiol Surg 2023; 18:2023-2032. [PMID: 37310561 PMCID: PMC10589185 DOI: 10.1007/s11548-023-02977-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Accepted: 05/23/2023] [Indexed: 06/14/2023]
Abstract
PURPOSE Up to date, there has been a lack of software infrastructure to connect 3D Slicer to any augmented reality (AR) device. This work describes a novel connection approach using Microsoft HoloLens 2 and OpenIGTLink, with a demonstration in pedicle screw placement planning. METHODS We developed an AR application in Unity that is wirelessly rendered onto Microsoft HoloLens 2 using Holographic Remoting. Simultaneously, Unity connects to 3D Slicer using the OpenIGTLink communication protocol. Geometrical transform and image messages are transferred between both platforms in real time. Through the AR glasses, a user visualizes a patient's computed tomography overlaid onto virtual 3D models showing anatomical structures. We technically evaluated the system by measuring message transference latency between the platforms. Its functionality was assessed in pedicle screw placement planning. Six volunteers planned pedicle screws' position and orientation with the AR system and on a 2D desktop planner. We compared the placement accuracy of each screw with both methods. Finally, we administered a questionnaire to all participants to assess their experience with the AR system. RESULTS The latency in message exchange is sufficiently low to enable real-time communication between the platforms. The AR method was non-inferior to the 2D desktop planner, with a mean error of 2.1 ± 1.4 mm. Moreover, 98% of the screw placements performed with the AR system were successful, according to the Gertzbein-Robbins scale. The average questionnaire outcomes were 4.5/5. CONCLUSIONS Real-time communication between Microsoft HoloLens 2 and 3D Slicer is feasible and supports accurate planning for pedicle screw placement.
Collapse
Affiliation(s)
| | - Tamas Ungi
- Laboratory for Percutaneous Surgery, School of Computing, Queen's University, Kingston, ON, K7M2N8, Canada
| | - David Morton
- Laboratory for Percutaneous Surgery, School of Computing, Queen's University, Kingston, ON, K7M2N8, Canada
| | - Gabor Fichtinger
- Laboratory for Percutaneous Surgery, School of Computing, Queen's University, Kingston, ON, K7M2N8, Canada
| | - Javier Pascau
- Departamento de Bioingeniería, Universidad Carlos III de Madrid, 28911, Leganés, Spain
| |
Collapse
|
7
|
Huang X, Liu X, Zhu B, Hou X, Hai B, Yu D, Zheng W, Li R, Pan J, Yao Y, Dai Z, Zeng H. Augmented Reality Surgical Navigation in Minimally Invasive Spine Surgery: A Preclinical Study. Bioengineering (Basel) 2023; 10:1094. [PMID: 37760196 PMCID: PMC10525156 DOI: 10.3390/bioengineering10091094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 09/12/2023] [Accepted: 09/15/2023] [Indexed: 09/29/2023] Open
Abstract
BACKGROUND In minimally invasive spine surgery (MISS), where the surgeon cannot directly see the patient's internal anatomical structure, the implementation of augmented reality (AR) technology may solve this problem. METHODS We combined AR, artificial intelligence, and optical tracking to enhance the augmented reality minimally invasive spine surgery (AR-MISS) system. The system has three functions: AR radiograph superimposition, AR real-time puncture needle tracking, and AR intraoperative navigation. The three functions of the system were evaluated through beagle animal experiments. RESULTS The AR radiographs were successfully superimposed on the real intraoperative videos. The anteroposterior (AP) and lateral errors of superimposed AR radiographs were 0.74 ± 0.21 mm and 1.13 ± 0.40 mm, respectively. The puncture needles could be tracked by the AR-MISS system in real time. The AP and lateral errors of the real-time AR needle tracking were 1.26 ± 0.20 mm and 1.22 ± 0.25 mm, respectively. With the help of AR radiographs and AR puncture needles, the puncture procedure could be guided visually by the system in real-time. The anteroposterior and lateral errors of AR-guided puncture were 2.47 ± 0.86 mm and 2.85 ± 1.17 mm, respectively. CONCLUSIONS The results indicate that the AR-MISS system is accurate and applicable.
Collapse
Affiliation(s)
- Xin Huang
- Pain Medicine Center, Peking University Third Hospital, Beijing 100191, China;
| | - Xiaoguang Liu
- Pain Medicine Center, Peking University Third Hospital, Beijing 100191, China;
- Department of Orthopedics, Peking University Third Hospital, Beijing 100191, China; (X.H.); (B.H.)
| | - Bin Zhu
- Department of Orthopedics, Beijing Friendship Hospital, Beijing 100052, China;
| | - Xiangyu Hou
- Department of Orthopedics, Peking University Third Hospital, Beijing 100191, China; (X.H.); (B.H.)
| | - Bao Hai
- Department of Orthopedics, Peking University Third Hospital, Beijing 100191, China; (X.H.); (B.H.)
| | - Dongfang Yu
- State Key Laboratory of Virtual Reality Technology and Systems, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; (D.Y.); (R.L.)
| | - Wenhao Zheng
- State Key Laboratory of Virtual Reality Technology and Systems, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; (D.Y.); (R.L.)
| | - Ranyang Li
- State Key Laboratory of Virtual Reality Technology and Systems, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; (D.Y.); (R.L.)
| | - Junjun Pan
- State Key Laboratory of Virtual Reality Technology and Systems, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; (D.Y.); (R.L.)
| | - Youjie Yao
- Smart Learning Institute, Beijing Normal University, Beijing 100875, China
| | - Zailin Dai
- Smart Learning Institute, Beijing Normal University, Beijing 100875, China
| | - Haijun Zeng
- Smart Learning Institute, Beijing Normal University, Beijing 100875, China
| |
Collapse
|
8
|
Cao B, Yuan B, Xu G, Zhao Y, Sun Y, Wang Z, Zhou S, Xu Z, Wang Y, Chen X. A Pilot Human Cadaveric Study on Accuracy of the Augmented Reality Surgical Navigation System for Thoracolumbar Pedicle Screw Insertion Using a New Intraoperative Rapid Registration Method. J Digit Imaging 2023; 36:1919-1929. [PMID: 37131064 PMCID: PMC10406793 DOI: 10.1007/s10278-023-00840-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 04/20/2023] [Accepted: 04/21/2023] [Indexed: 05/04/2023] Open
Abstract
To evaluate the feasibility and accuracy of AR-assisted pedicle screw placement using a new intraoperative rapid registration method of combining preoperative CT scanning and intraoperative C-arm 2D fluoroscopy in cadavers. Five cadavers with intact thoracolumbar spines were employed in this study. Intraoperative registration was performed using anteroposterior and lateral views of preoperative CT scanning and intraoperative 2D fluoroscopic images. Patient-specific targeting guides were used for pedicle screw placement from Th1-L5, totaling 166 screws. Instrumentation for each side was randomized (augmented reality surgical navigation (ARSN) vs. C-arm) with an equal distribution of 83 screws in each group. CT was performed to evaluate the accuracy of both techniques by assessing the screw positions and the deviations between the inserted screws and planned trajectories. Postoperative CT showed that 98.80% (82/83) screws in ARSN group and 72.29% (60/83) screws in C-arm group were within the 2-mm safe zone (p < 0.001). The mean time for instrumentation per level in ARSN group was significantly shorter than that in C-arm group (56.17 ± 3.33 s vs. 99.22 ± 9.03 s, p < 0.001). The overall intraoperative registration time was 17.2 ± 3.5 s per segment. AR-based navigation technology can provide surgeons with accurate guidance of pedicle screw insertion and save the operation time by using the intraoperative rapid registration method of combining preoperative CT scanning and intraoperative C-arm 2D fluoroscopy.
Collapse
Affiliation(s)
- Bing Cao
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Bo Yuan
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Guofeng Xu
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Yin Zhao
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Yanqing Sun
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Zhiwei Wang
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Shengyuan Zhou
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Zheng Xu
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China
| | - Yao Wang
- Linyan Medical Technology Company Limited, 528 Ruiqing Road, Pudong New District, Shanghai, China
| | - Xiongsheng Chen
- Spine Center, Department of Orthopaedics, Shanghai Changzheng Hospital, Second Military Medical University, 415 Fengyang Road, Huangpu District, Shanghai, China.
| |
Collapse
|
9
|
Gsaxner C, Li J, Pepe A, Jin Y, Kleesiek J, Schmalstieg D, Egger J. The HoloLens in medicine: A systematic review and taxonomy. Med Image Anal 2023; 85:102757. [PMID: 36706637 DOI: 10.1016/j.media.2023.102757] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 01/05/2023] [Accepted: 01/18/2023] [Indexed: 01/22/2023]
Abstract
The HoloLens (Microsoft Corp., Redmond, WA), a head-worn, optically see-through augmented reality (AR) display, is the main player in the recent boost in medical AR research. In this systematic review, we provide a comprehensive overview of the usage of the first-generation HoloLens within the medical domain, from its release in March 2016, until the year of 2021. We identified 217 relevant publications through a systematic search of the PubMed, Scopus, IEEE Xplore and SpringerLink databases. We propose a new taxonomy including use case, technical methodology for registration and tracking, data sources, visualization as well as validation and evaluation, and analyze the retrieved publications accordingly. We find that the bulk of research focuses on supporting physicians during interventions, where the HoloLens is promising for procedures usually performed without image guidance. However, the consensus is that accuracy and reliability are still too low to replace conventional guidance systems. Medical students are the second most common target group, where AR-enhanced medical simulators emerge as a promising technology. While concerns about human-computer interactions, usability and perception are frequently mentioned, hardly any concepts to overcome these issues have been proposed. Instead, registration and tracking lie at the core of most reviewed publications, nevertheless only few of them propose innovative concepts in this direction. Finally, we find that the validation of HoloLens applications suffers from a lack of standardized and rigorous evaluation protocols. We hope that this review can advance medical AR research by identifying gaps in the current literature, to pave the way for novel, innovative directions and translation into the medical routine.
Collapse
Affiliation(s)
- Christina Gsaxner
- Institute of Computer Graphics and Vision, Graz University of Technology, 8010 Graz, Austria; BioTechMed, 8010 Graz, Austria.
| | - Jianning Li
- Institute of AI in Medicine, University Medicine Essen, 45131 Essen, Germany; Cancer Research Center Cologne Essen, University Medicine Essen, 45147 Essen, Germany
| | - Antonio Pepe
- Institute of Computer Graphics and Vision, Graz University of Technology, 8010 Graz, Austria; BioTechMed, 8010 Graz, Austria
| | - Yuan Jin
- Institute of Computer Graphics and Vision, Graz University of Technology, 8010 Graz, Austria; Research Center for Connected Healthcare Big Data, Zhejiang Lab, Hangzhou, 311121 Zhejiang, China
| | - Jens Kleesiek
- Institute of AI in Medicine, University Medicine Essen, 45131 Essen, Germany; Cancer Research Center Cologne Essen, University Medicine Essen, 45147 Essen, Germany
| | - Dieter Schmalstieg
- Institute of Computer Graphics and Vision, Graz University of Technology, 8010 Graz, Austria; BioTechMed, 8010 Graz, Austria
| | - Jan Egger
- Institute of Computer Graphics and Vision, Graz University of Technology, 8010 Graz, Austria; Institute of AI in Medicine, University Medicine Essen, 45131 Essen, Germany; BioTechMed, 8010 Graz, Austria; Cancer Research Center Cologne Essen, University Medicine Essen, 45147 Essen, Germany
| |
Collapse
|
10
|
Seibold M, Spirig JM, Esfandiari H, Farshad M, Fürnstahl P. Translation of Medical AR Research into Clinical Practice. J Imaging 2023; 9:jimaging9020044. [PMID: 36826963 PMCID: PMC9961816 DOI: 10.3390/jimaging9020044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Revised: 01/27/2023] [Accepted: 02/03/2023] [Indexed: 02/17/2023] Open
Abstract
Translational research is aimed at turning discoveries from basic science into results that advance patient treatment. The translation of technical solutions into clinical use is a complex, iterative process that involves different stages of design, development, and validation, such as the identification of unmet clinical needs, technical conception, development, verification and validation, regulatory matters, and ethics. For this reason, many promising technical developments at the interface of technology, informatics, and medicine remain research prototypes without finding their way into clinical practice. Augmented reality is a technology that is now making its breakthrough into patient care, even though it has been available for decades. In this work, we explain the translational process for Medical AR devices and present associated challenges and opportunities. To the best knowledge of the authors, this concept paper is the first to present a guideline for the translation of medical AR research into clinical practice.
Collapse
Affiliation(s)
- Matthias Seibold
- Research in Orthopedic Computer Science, Balgrist University Hospital, University of Zurich, CH-8008 Zurich, Switzerland
- Computer Aided Medical Procedures and Augmented Reality, Technical University Munich, DE-85748 Garching, Germany
- Correspondence:
| | - José Miguel Spirig
- Department of Orthopedics, Balgrist University Hospital, University of Zurich, CH-8008 Zurich, Switzerland
| | - Hooman Esfandiari
- Research in Orthopedic Computer Science, Balgrist University Hospital, University of Zurich, CH-8008 Zurich, Switzerland
| | - Mazda Farshad
- Department of Orthopedics, Balgrist University Hospital, University of Zurich, CH-8008 Zurich, Switzerland
| | - Philipp Fürnstahl
- Research in Orthopedic Computer Science, Balgrist University Hospital, University of Zurich, CH-8008 Zurich, Switzerland
| |
Collapse
|
11
|
Doughty M, Ghugre NR, Wright GA. Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery. J Imaging 2022; 8:jimaging8070203. [PMID: 35877647 PMCID: PMC9318659 DOI: 10.3390/jimaging8070203] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2022] [Revised: 07/15/2022] [Accepted: 07/18/2022] [Indexed: 02/01/2023] Open
Abstract
We conducted a systematic review of recent literature to understand the current challenges in the use of optical see-through head-mounted displays (OST-HMDs) for augmented reality (AR) assisted surgery. Using Google Scholar, 57 relevant articles from 1 January 2021 through 18 March 2022 were identified. Selected articles were then categorized based on a taxonomy that described the required components of an effective AR-based navigation system: data, processing, overlay, view, and validation. Our findings indicated a focus on orthopedic (n=20) and maxillofacial surgeries (n=8). For preoperative input data, computed tomography (CT) (n=34), and surface rendered models (n=39) were most commonly used to represent image information. Virtual content was commonly directly superimposed with the target site (n=47); this was achieved by surface tracking of fiducials (n=30), external tracking (n=16), or manual placement (n=11). Microsoft HoloLens devices (n=24 in 2021, n=7 in 2022) were the most frequently used OST-HMDs; gestures and/or voice (n=32) served as the preferred interaction paradigm. Though promising system accuracy in the order of 2–5 mm has been demonstrated in phantom models, several human factors and technical challenges—perception, ease of use, context, interaction, and occlusion—remain to be addressed prior to widespread adoption of OST-HMD led surgical navigation.
Collapse
Affiliation(s)
- Mitchell Doughty
- Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada; (N.R.G.); (G.A.W.)
- Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada
- Correspondence:
| | - Nilesh R. Ghugre
- Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada; (N.R.G.); (G.A.W.)
- Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada
| | - Graham A. Wright
- Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada; (N.R.G.); (G.A.W.)
- Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada
| |
Collapse
|
12
|
Puladi B, Ooms M, Bellgardt M, Cesov M, Lipprandt M, Raith S, Peters F, Möhlhenrich SC, Prescher A, Hölzle F, Kuhlen TW, Modabber A. Augmented Reality-Based Surgery on the Human Cadaver Using a New Generation of Optical Head-Mounted Displays: Development and Feasibility Study. JMIR Serious Games 2022; 10:e34781. [PMID: 35468090 PMCID: PMC9086879 DOI: 10.2196/34781] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 01/04/2022] [Accepted: 03/05/2022] [Indexed: 12/15/2022] Open
Abstract
Background Although nearly one-third of the world’s disease burden requires surgical care, only a small proportion of digital health applications are directly used in the surgical field. In the coming decades, the application of augmented reality (AR) with a new generation of optical-see-through head-mounted displays (OST-HMDs) like the HoloLens (Microsoft Corp) has the potential to bring digital health into the surgical field. However, for the application to be performed on a living person, proof of performance must first be provided due to regulatory requirements. In this regard, cadaver studies could provide initial evidence. Objective The goal of the research was to develop an open-source system for AR-based surgery on human cadavers using freely available technologies. Methods We tested our system using an easy-to-understand scenario in which fractured zygomatic arches of the face had to be repositioned with visual and auditory feedback to the investigators using a HoloLens. Results were verified with postoperative imaging and assessed in a blinded fashion by 2 investigators. The developed system and scenario were qualitatively evaluated by consensus interview and individual questionnaires. Results The development and implementation of our system was feasible and could be realized in the course of a cadaver study. The AR system was found helpful by the investigators for spatial perception in addition to the combination of visual as well as auditory feedback. The surgical end point could be determined metrically as well as by assessment. Conclusions The development and application of an AR-based surgical system using freely available technologies to perform OST-HMD–guided surgical procedures in cadavers is feasible. Cadaver studies are suitable for OST-HMD–guided interventions to measure a surgical end point and provide an initial data foundation for future clinical trials. The availability of free systems for researchers could be helpful for a possible translation process from digital health to AR-based surgery using OST-HMDs in the operating theater via cadaver studies.
Collapse
Affiliation(s)
- Behrus Puladi
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany.,Institute of Medical Informatics, University Hospital RWTH Aachen, Aachen, Germany
| | - Mark Ooms
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | - Martin Bellgardt
- Visual Computing Institute, RWTH Aachen University, Aachen, Germany
| | - Mark Cesov
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany.,Visual Computing Institute, RWTH Aachen University, Aachen, Germany
| | - Myriam Lipprandt
- Institute of Medical Informatics, University Hospital RWTH Aachen, Aachen, Germany
| | - Stefan Raith
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | - Florian Peters
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | - Stephan Christian Möhlhenrich
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany.,Department of Orthodontics, Private University of Witten/Herdecke, Witten, Germany
| | - Andreas Prescher
- Institute of Molecular and Cellular Anatomy, University Hospital RWTH Aachen, Aachen, Germany
| | - Frank Hölzle
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| | | | - Ali Modabber
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Aachen, Germany
| |
Collapse
|
13
|
Feasibility and Accuracy of Thoracolumbar Pedicle Screw Placement Using an Augmented Reality Head Mounted Device. SENSORS 2022; 22:s22020522. [PMID: 35062483 PMCID: PMC8779462 DOI: 10.3390/s22020522] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 12/30/2021] [Accepted: 01/06/2022] [Indexed: 02/06/2023]
Abstract
Background: To investigate the accuracy of augmented reality (AR) navigation using the Magic Leap head mounted device (HMD), pedicle screws were minimally invasively placed in four spine phantoms. Methods: AR navigation provided by a combination of a conventional navigation system integrated with the Magic Leap head mounted device (AR-HMD) was used. Forty-eight screws were planned and inserted into Th11-L4 of the phantoms using the AR-HMD and navigated instruments. Postprocedural CT scans were used to grade the technical (deviation from the plan) and clinical (Gertzbein grade) accuracy of the screws. The time for each screw placement was recorded. Results: The mean deviation between navigation plan and screw position was 1.9 ± 0.7 mm (1.9 [0.3–4.1] mm) at the entry point and 1.4 ± 0.8 mm (1.2 [0.1–3.9] mm) at the screw tip. The angular deviation was 3.0 ± 1.4° (2.7 [0.4–6.2]°) and the mean time for screw placement was 130 ± 55 s (108 [58–437] s). The clinical accuracy was 94% according to the Gertzbein grading scale. Conclusion: The combination of an AR-HMD with a conventional navigation system for accurate minimally invasive screw placement is feasible and can exploit the benefits of AR in the perspective of the surgeon with the reliability of a conventional navigation system.
Collapse
|