A novel augmented reality-based surgical guidance system for total knee arthroplasty

Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room

PURPOSE OF REVIEW

Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development.

RECENT FINDINGS

To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.

A Novel Intraoperative CT Navigation System for Spinal Fusion Surgery in Lumbar Degenerative Disease: Accuracy and Safety of Pedicle Screw Placement

Background: In recent years, intraoperative computed tomography (CT) navigation has become widely used for the insertion of pedicle screws in spinal fusion surgery. However, conventional intraoperative CT navigation may be impaired by infrared interference between the infrared camera and surgical instruments, which can lead to the misplacement of pedicle screws. Recently, a novel intraoperative CT navigation system, NextAR, has been developed. It uses a small infrared camera mounted on surgical instruments within the surgical field. NextAR navigation can minimize the problem of infrared interference and be expected to improve the accuracy of pedicle screw placement. Methods: This study investigated the accuracy of pedicle screw insertion under NextAR navigation in spinal fusion surgery for lumbar degenerative diseases. The accuracy of pedicle screw placement was evaluated in 15 consecutive patients using a CT grading scale. Results: Screw perforation occurred in only 1 of the total 70 screws (1.4%). Specifically, there was one grade 1 perforation within 2 mm, but no perforations larger than 2 mm. There were no reoperations or neurological complications due to screw misplacement. Conclusions: NextAR navigation can provide high accuracy for pedicle screw insertion and help ensure safe spinal fusion surgery for lumbar degenerative diseases.

An Image-Based Augmented Reality System for Achieving Accurate Bone Resection in Total Knee Arthroplasty

Background and objective With the steady advancement of computer-assisted surgical techniques, the importance of assessing and researching technology related to total knee arthroplasty (TKA) procedures has increased. Augmented reality (AR), a recently proposed next-generation technology, is expected to enhance the precision of orthopedic surgery by providing a more efficient and cost-effective approach. However, the accuracy of image-based AR in TKA surgery has not been established. Therefore, this study aimed to determine whether accurate bone resection can be achieved in TKA surgery using image-based AR. Methods In this study, we replaced traditional CT imaging and reconstructions for creating a bone 3D model by direct 3D scanning of the femur and tibia. The preoperative planning involved identifying anatomical landmarks and determining the surgical details. During surgery, markers were employed to create a local coordinate system for an AR-assisted surgical system using a Polaris camera. This approach helped minimize discrepancies between the 3D model and actual positioning, ensuring accurate alignment. Results The AR-assisted surgery using the image method resulted in fewer errors [average error: 0.32 mm; standard deviation (SD): 0.143] between the bone resection depth of the preoperative surgical plan and the bone model test results. Conclusions Our findings demonstrated the accuracy of bone resectioning by using image-based AR-assisted navigation for TKA surgery. Image-based AR-assisted navigation in TKA surgery is a valuable tool not only for enhancing accuracy by using smart glasses and sensors but also for improving the efficiency of the procedure. Therefore, we anticipate that image-based AR-assisted navigation in TKA surgery will gain wide acceptance in practice.

Breamy: An augmented reality mHealth prototype for surgical decision-making in breast cancer

Breast cancer is one of the most prevalent forms of cancer, affecting approximately one in eight women during their lifetime. Deciding on breast cancer treatment, which includes the choice between surgical options, frequently demands prompt decision-making within an 8-week timeframe. However, many women lack the necessary knowledge and preparation for making informed decisions. Anxiety and unsatisfactory outcomes can result from inadequate decision-making processes, leading to decisional regret and revision surgeries. Shared decision-making and personalized decision aids have shown positive effects on patient satisfaction and treatment outcomes. Here, Breamy, a prototype mobile health application that utilizes augmented reality technology to assist breast cancer patients in making more informed decisions is introduced. Breamy provides 3D visualizations of different surgical procedures, aiming to improve confidence in surgical decision-making, reduce decisional regret, and enhance patient well-being after surgery. To determine the perception of the usefulness of Breamy, data was collected from 166 participants through an online survey. The results suggest that Breamy has the potential to reduce patients' anxiety levels and assist them in decision-making.

Single-center experience with Knee+™ augmented reality navigation system in primary total knee arthroplasty

BACKGROUND

Computer-assisted systems obtained an increased interest in orthopaedic surgery over the last years, as they enhance precision compared to conventional hardware. The expansion of computer assistance is evolving with the employment of augmented reality. Yet, the accuracy of augmented reality navigation systems has not been determined.

AIM

To examine the accuracy of component alignment and restoration of the affected limb's mechanical axis in primary total knee arthroplasty (TKA), utilizing an augmented reality navigation system and to assess whether such systems are conspicuously fruitful for an accomplished knee surgeon.

METHODS

From May 2021 to December 2021, 30 patients, 25 women and five men, underwent a primary unilateral TKA. Revision cases were excluded. A preoperative radiographic procedure was performed to evaluate the limb's axial alignment. All patients were operated on by the same team, without a tourniquet, utilizing three distinct prostheses with the assistance of the Knee+™ augmented reality navigation system in every operation. Postoperatively, the same radiographic exam protocol was executed to evaluate the implants' position, orientation and coronal plane alignment. We recorded measurements in 3 stages regarding femoral varus and flexion, tibial varus and posterior slope. Firstly, the expected values from the Augmented Reality system were documented. Then we calculated the same values after each cut and finally, the same measurements were recorded radiologically after the operations. Concerning statistical analysis, Lin's concordance correlation coefficient was estimated, while Wilcoxon Signed Rank Test was performed when needed.

RESULTS

A statistically significant difference was observed regarding mean expected values and radiographic measurements for femoral flexion measurements only (Z score = 2.67, P value = 0.01). Nonetheless, this difference was statistically significantly lower than 1 degree (Z score = -4.21, P value < 0.01). In terms of discrepancies in the calculations of expected values and controlled measurements, a statistically significant difference between tibial varus values was detected (Z score = -2.33, P value = 0.02), which was also statistically significantly lower than 1 degree (Z score = -4.99, P value < 0.01).

CONCLUSION

The results indicate satisfactory postoperative coronal alignment without outliers across all three different implants utilized. Augmented reality navigation systems can bolster orthopaedic surgeons' accuracy in achieving precise axial alignment. However, further research is required to further evaluate their efficacy and potential.

Evaluation of single-stage vision models for pose estimation of surgical instruments

PURPOSE

Multiple applications in open surgical environments may benefit from adoption of markerless computer vision depending on associated speed and accuracy requirements. The current work evaluates vision models for 6-degree of freedom pose estimation of surgical instruments in RGB scenes. Potential use cases are discussed based on observed performance.

METHODS

Convolutional neural nets were developed with simulated training data for 6-degree of freedom pose estimation of a representative surgical instrument in RGB scenes. Trained models were evaluated with simulated and real-world scenes. Real-world scenes were produced by using a robotic manipulator to procedurally generate a wide range of object poses.

RESULTS

CNNs trained in simulation transferred to real-world evaluation scenes with a mild decrease in pose accuracy. Model performance was sensitive to input image resolution and orientation prediction format. The model with highest accuracy demonstrated mean in-plane translation error of 13 mm and mean long axis orientation error of 5[Formula: see text] in simulated evaluation scenes. Similar errors of 29 mm and 8[Formula: see text] were observed in real-world scenes.

CONCLUSION

6-DoF pose estimators can predict object pose in RGB scenes with real-time inference speed. Observed pose accuracy suggests that applications such as coarse-grained guidance, surgical skill evaluation, or instrument tracking for tray optimization may benefit from markerless pose estimation.

Patient specific implants versus conventional implants in primary total knee arthroplasty: No significant difference in patient reported outcomes at 5 years

Background

Patient specific implants (PSI) represent a novel innovation aimed to improve patient satisfaction and function after total knee arthroplasty (TKA); however, longitudinal patient reported outcome measures (PROMs) for PSI are not well described. We sought to primarily evaluate PROMs of patients undergoing TKA with either PSI or off-the-shelf (OTS) implants at mid-term follow-up.

Methods

A retrospective review was performed on a prospectively collected cohort of 43 primary, cruciate-retaining TKAs performed with PSI (n = 23) and OTS implants (n = 20) by a single surgeon. Patient demographics, operative characteristics, range of motion (ROM) return, reoperations, and outcomes [Patient-Reported Outcomes Measurement Information System (PROMIS) T-score, Knee Injury and Osteoarthritis outcome score (KOOS), and Knee Society Score-Function (KSS-F)] were compared. Mean follow-up was 5 years.

Results

TKA performed with either PSI and OTS implants demonstrated no difference in obtaining ROM by 3 months (extension 3° short of full extension vs. 0°, p = 0.16) or flexion (114° vs. 115°, p = 0.99) and final ROM was identical [0° extension to 120° flexion (p = 1)]. Although not significant (p = 0.42), 5 (22%) PSI TKA and 2 (10%) OTS implant patients required manipulation under anesthesia. KSS-F and PROMIS T-scores were higher in the PSI versus OTS TKA patients, respectively (90 vs. 73, p = 0.002; 51.6 vs. 44.5, p = 0.01). However, after multivariable analysis, none of these continuous outcome measures were significantly different (p = 0.28 for KSS and p = 0.45 for PROMIS T-score) between the groups.

Conclusion

In a series of TKAs performed with PSI, no difference existed in postoperative ROM, reoperations, or patient-reported outcomes compared to OTS implants at 5 years. Surgeons may utilize the equivocal midterm results during TKA preoperative patient discussion of implant technologies.

Integration of Square Fiducial Markers in Patient-Specific Instrumentation and Their Applicability in Knee Surgery

Computer technologies play a crucial role in orthopaedic surgery and are essential in personalising different treatments. Recent advances allow the usage of augmented reality (AR) for many orthopaedic procedures, which include different types of knee surgery. AR assigns the interaction between virtual environments and the physical world, allowing both to intermingle (AR superimposes information on real objects in real-time) through an optical device and allows personalising different processes for each patient. This article aims to describe the integration of fiducial markers in planning knee surgeries and to perform a narrative description of the latest publications on AR applications in knee surgery. Augmented reality-assisted knee surgery is an emerging set of techniques that can increase accuracy, efficiency, and safety and decrease the radiation exposure (in some surgical procedures, such as osteotomies) of other conventional methods. Initial clinical experience with AR projection based on ArUco-type artificial marker sensors has shown promising results and received positive operator feedback. Once initial clinical safety and efficacy have been demonstrated, the continued experience should be studied to validate this technology and generate further innovation in this rapidly evolving field.

Prevalence of osteoporosis and osteopenia in elderly patients scheduled for total knee arthroplasty

INTRODUCTION

Osteoporosis is a common comorbidity in elderly patients with osteoarthritis (OA) and may increase perioperative complications in orthopedic surgery (e.g., component migration, periprosthetic fractures). As there is no investigation of bone mineral density (BMD) in elderly patients prior to total knee arthroplasty (TKA) in Europe, we investigated this issue with a particular focus on a potential treatment gap.

MATERIALS AND METHODS

We assessed the BMD by dual-energy X-ray absorptiometry (DXA) in 109 consecutive elderly patients (age ≥ 70 years) scheduled for TKA. In addition to a detailed assessment of osteoporosis and osteopenia, the influence of clinical risk factors and radiological OA severity on BMD was evaluated using group comparisons and linear regression models. In addition, we analyzed differences in BMD between patients scheduled for TKA vs. total hip arthroplasty (THA).

RESULTS

Of the included 109 patients, 19 patients (17.4%) were diagnosed with osteoporosis and 50 (45.9%) with osteopenia. In the osteoporotic patients, a clinically relevant underdiagnosis concomitant with a serious treatment gap was observed in 95.0% of the patients. Body mass index, OA grade, and glucocorticoid use were identified as independent factors associated with BMD. No differences in BMD were found between the patients scheduled for TKA vs. THA.

CONCLUSIONS

Considering the high prevalence of osteoporosis and osteopenia in elderly patients, DXA screening should be recommended for patients ≥ 70 years indicated for TKA.

Augmented reality-aided unicompartmental knee arthroplasty

Purpose

To illustrate a surgical technique for augmented reality (AR)-assisted unicompartmental knee arthroplasty (UKA) and report preliminary data.

Methods

We developed an AR-based navigation system that enables the surgeon to see the tibial mechanical axis superimposed on the patient’s leg in addition to the tibial cutting angle. We measured the tibial resection angle in 11 UKAs using postoperative radiographs and calculated the absolute difference between preoperative target angle and postoperative measured angle. The target angle was determined for each patient: mean values were 0.7° ± 1.0° varus in coronal alignment and 5.3° ± 1.4° posterior slope in sagittal alignment.

Results

The angles measured on postoperative radiographs were 2.6° ± 1.2° varus in the coronal plane and 4.8° ± 2.5° posterior slope in the sagittal plane. The absolute differences between the target and measured angles were 1.9° ± 1.5° in coronal alignment and 2.6° ± 1.2° in sagittal alignment. No patients experienced complications, including surgical site infection and periprosthetic fracture.

Conclusion

The AR-based portable navigation system may provide passable accuracy in terms of proximal tibial resection during UKA.

Level of Evidence

IV

Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI

Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.