Augmented Reality in Arthroplasty: An Overview of Clinical Applications, Benefits, and Limitations

Enhanced Total Hip Arthroplasty Education Using Augmented Reality: A Survey From a Tertiary Center

BACKGROUND

For total hip arthroplasty (THA), a new technology in the evolution of computer-assisted surgery has emerged in the form of augmented reality (AR). We sought to determine the impact of AR on resident and fellow education after implementation at an academic teaching center.

MATERIALS AND METHODS

The senior author's intraoperative technique allows for the orthopedic trainee to use AR to correct the acetabular component's position after an attempt is made with standard instrumentation. One year after the implementation of this AR method, both resident and fellow trainees were issued an anonymous survey regarding their experience and descriptive statistics were calculated for the results.

RESULTS

Sixteen trainees responded to the survey. One hundred percent felt the use of AR improved their understanding of acetabular component placement and improved their intraoperative experience. Sixty-nine percent reported feeling there was a small increase in operative time but 25% reported no increase in operative time when using AR. Seventy-five percent of trainees felt that patients benefited from the technology and would be in favor of AR if they were having a THA. The majority of those surveyed reported a desire to use AR in their practice if it is available.

CONCLUSION

Computer-assisted surgery has demonstrated variable impacts on orthopedic education. After the implementation of AR at an academic teaching center, all trainees reported it improved their intraoperative experience and their understanding of acetabular component placement. Further studies are needed to determine if AR is able to improve a trainee's component placement. [Orthopedics. 2024;47(4):e157-e160.].

Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room

PURPOSE OF REVIEW

Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development.

RECENT FINDINGS

To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.

Assessing the Effect of Augmented Reality on Procedural Outcomes During Ultrasound-Guided Vascular Access

OBJECTIVE

Augmented reality devices are increasingly accepted in health care, though most applications involve education and pre-operative planning. A novel augmented reality ultrasound application, HoloUS, was developed for the Microsoft HoloLens 2 to project real-time ultrasound images directly into the user's field of view. In this work, we assessed the effect of using HoloUS on vascular access procedural outcomes.

METHODS

A single-center user study was completed with participants with (N = 22) and without (N = 12) experience performing ultrasound-guided vascular access. Users completed a venipuncture and aspiration task a total of four times: three times on study day 1, and once on study day 2 between 2 and 4 weeks later. Users were randomized to use conventional ultrasound during either their first or second task and the HoloUS application at all other times. Task completion time, numbers of needle re-directions, head adjustments and needle visualization rates were recorded.

RESULTS

For expert users, task completion time was significantly faster using HoloUS (11.5 s, interquartile range [IQR] = 6.5-23.5 s vs. 18.5 s, IQR = 11.0-36.5 s; p = 0.04). The number of head adjustments was significantly lower using the HoloUS app (1.0, IQR = 0.0-1.0 vs. 3.0, IQR = 1.0-5.0; p < 0.0001). No significant differences were identified in other measured outcomes.

CONCLUSION

This is the first investigation of augmented reality-based ultrasound-guided vascular access using the second-generation HoloLens. It demonstrates equivalent procedural efficiency and accuracy, with favorable usability, ergonomics and user independence when compared with traditional ultrasound techniques.

Study on the postoperative visual function recovery of children with concomitant exotropia based on an augmented reality plasticity model

Objective

This study aimed to investigate the clinical application effect of an augmented reality (AR) plasticity model on the postoperative visual function recovery of children with concomitant exotropia.

Methods

Between September 2019 and October 2021, 28 patients with concomitant exotropia who visited Shenzhen Children's Hospital (9 male and 19 female) were enrolled in this study. The average age of the patients was 6.4 ± 1.8 years. Postoperative rehabilitation training was conducted using a personalized AR binocular visual perception plasticity model developed based on the patient's examination results. After 1 month, 3 months, and 6 months of training, the patients returned to the hospital for examinations of perceptual eye position, static zero-order stereopsis, dynamic first-order fine stereopsis, and dynamic second-order coarse stereopsis to compare the changes in eye position control and stereovision function.

Results

After 6 months of eye position training, the horizontal perception eye position of the 28 patients was significantly lower than that before training. The difference in eye position at the first and third months compared with that before training was not statistically significant (1st month: z = -2.255, p = 0.024 > 0.017; 3rd month: z = -2.277, p = 0.023 > 0.017; 6th month: z = -3.051, p = 0.002 < 0.017). The difference in vertical perceptual eye position after training compared with that before training was not statistically significant (1st month: z = -0.252, p = 0.801 > 0.017; 3rd month: z = -1.189, p = 0.234 > 0.017; 6th month: z = -2.225, p = 0.026 > 0.017). The difference in 0.8-m static zero-order stereopsis before and after training was not statistically significant (1st month: z = -2.111, p = 0.035 > 0.017; 3rd month: z = -1.097, p = 0.273 > 0.017; 6th month: z = -1.653, p = 0.098 > 0.017). The 1.5-m static zero-order stereopsis was improved after 1 month, 3 months, and 6 months of training compared with that before training (1st month: z = -3.134, p = 0.002 < 0.017; 3rd month: z = -2.835, p = 0.005 < 0.017; 6th month: z = -3.096, p = 0.002 < 0.017). Dynamic first-order fine stereopsis and dynamic second-order coarse stereopsis were measured in the 28 patients before and after training. Patients 1 and 18 had no dynamic first-order fine stereopsis before training, but both regained dynamic stereopsis after 1 month, 3 months, and 6 months of training. Patient 16 had no dynamic first-order fine stereopsis or dynamic second-order coarse stereopsis before training, but first-order and second-order stereopsis had been reconstructed after 1 month, 3 months, and 6 months of training.

Conclusion

Concomitant exotropia surgery improved the basic problem of eye position at the ocular muscle level, but the patient's perceptual eye position and visual function defects at the brain visual level remained. This might partly explain the poor postoperative clinical effect. The AR plasticity model can improve patients' horizontal perceptual eye position and multi-dimensional stereoscopic function, and its clinical effect warrants further study.

Accuracy of augmented reality with computed tomography-based navigation in total hip arthroplasty

BACKGROUND

Augmented reality (AR) provides the surgeon with direct visualization of radiological images by overlaying them on the patient. This study aimed to evaluate the accuracy of cup placement using a computed tomography (CT)-based AR navigation system.

METHODS

Sixty-five prospectively enrolled patients underwent primary cementless total hip arthroplasty (THA) in a supine position using this novel AR navigation system, and changes in pelvic flexion angle (PFA) were evaluated. Absolute navigation errors were defined as the absolute differences between angles in the intraoperative navigation record and those measured on postoperative CT. Factors affecting the absolute navigation error in cup alignment were determined.

RESULTS

Mean absolute change in PFA between preoperative CT and reduction was 2.1° ± 1.6°. Mean absolute navigation errors were 2.5° ± 1.7° in radiographic inclination (RI) and 2.5° ± 2.2° in radiographic anteversion (RA). While no factors significantly affecting absolute navigation error were found for RI, absolute change in PFA between preoperative CT and reduction correlated significantly with the absolute navigation error for RA.

CONCLUSION

This CT-based navigation system with AR enabled surgeons to place the cup more accurately than was possible by freehand placement during THA in a supine position.

Comparison of the Accuracy of 2D and 3D Templating for Revision Total Hip Replacement

Introduction: Revision hip arthroplasty is a challenging surgical procedure, especially in cases of advanced acetabular bone loss. Accurate preoperative planning can prevent complications such as periprosthetic fractures or aseptic loosening. To date, the accuracy of three-dimensional (3D) versus two-dimensional (2D) templating has been evaluated only in primary hip and knee arthroplasty. Methods: We retrospectively investigated the accuracy of 3D personalized planning of reinforcement cages (Burch Schneider) in 27 patients who underwent revision hip arthroplasty. Personalized 3D modeling and positioning of the reinforcement cages were performed using computed tomography (CT) of the pelvis of each patient and 3D templates of the implant. To evaluate accuracy, the sizes of the reinforcement cages planned in 2D and 3D were compared with the sizes of the finally implanted cages. Factors that may potentially influence planning accuracy such as gender and body mass index (BMI) were analyzed. Results: There was a significant difference (p = 0.003) in the accuracy of correct size prediction between personalized 3D templating and 2D templating. Personalized 3D templating predicted the exact size of the reinforcement cage in 96.3% of the patients, while the exact size was predicted in only 55.6% by 2D templating. Regarding gender and BMI, no statistically significant differences in planning accuracy either for 2D or 3D templating were observed. Conclusion: Personalized 3D planning of revision hip arthroplasty using Burch Schneider reinforcement cages leads to greater accuracy in the prediction of the required size of implants than conventional 2D templating.

Alignment options and robotics in total knee arthroplasty

Total knee arthroplasty is one of the most widely performed surgical procedures today. Its widespread popularity has helped drive innovation and improvement in the field. Different schools of thought have developed regarding the best way to perform this operation. Specifically, there are controversaries regarding the best alignment philosophy for the femoral and tibial components to optimize implant stability and longevity. Traditionally, neutral mechanical alignment has been the preferred alignment target. More recently, some surgeons advocate for alignment matching the patient's pre-arthritic anatomic alignment ("physiologic" varus or valgus), which has been described as kinematic alignment. Functional alignment is a hybrid technique that focuses on the coronal plane minimizing soft tissue releases. To date, there is no evidence demonstrating superiority of one method over another. There is growing popularity of robotic surgical techniques to improve accuracy of implant position and alignment. The choice of alignment philosophy is an important aspect of robotic assisted TKA surgery and has the potential to clarify the optimal alignment technique.

The decisive early phase of bone regeneration

Bone has a remarkable endogenous regenerative capacity that enables scarless healing and restoration of its prior mechanical function, even under challenging conditions such as advanced age and metabolic or immunological degenerative diseases. However - despite much progress - a high number of bone injuries still heal with unsatisfactory outcomes. The mechanisms leading to impaired healing are heterogeneous, and involve exuberant and non-resolving immune reactions or overstrained mechanical conditions that affect the delicate regulation of the early initiation of scar-free healing. Every healing process begins phylogenetically with an inflammatory reaction, but its spatial and temporal intensity must be tightly controlled. Dysregulation of this inflammatory cascade directly affects the subsequent healing phases and hinders the healing progression. This Review discusses the complex processes underlying bone regeneration, focusing on the early healing phase and its highly dynamic environment, where vibrant changes in cellular and tissue composition alter the mechanical environment and thus affect the signalling pathways that orchestrate the healing process. Essential to scar-free healing is the interplay of various dynamic cascades that control timely resolution of local inflammation and tissue self-organization, while also providing sufficient local stability to initiate endogenous restoration. Various immunotherapy and mechanobiology-based therapy options are under investigation for promoting bone regeneration.

Reduced Calibration Strategy Using a Basketball for RGB-D Cameras

RGB-D cameras produce depth and color information commonly used in the 3D reconstruction and vision computer areas. Different cameras with the same model usually produce images with different calibration errors. The color and depth layer usually requires calibration to minimize alignment errors, adjust precision, and improve data quality in general. Standard calibration protocols for RGB-D cameras require a controlled environment to allow operators to take many RGB and depth pair images as an input for calibration frameworks making the calibration protocol challenging to implement without ideal conditions and the operator experience. In this work, we proposed a novel strategy that simplifies the calibration protocol by requiring fewer images than other methods. Our strategy uses an ordinary object, a know-size basketball, as a ground truth sphere geometry during the calibration. Our experiments show comparable results requiring fewer images and non-ideal scene conditions than a reference method to align color and depth image layers.