Smartglass augmented reality-assisted targeted prostate biopsy using cognitive point-of-care fusion technology

Performance Comparison of Augmented Reality Versus Ultrasound Guidance for Puncture: A Phantom Study

PURPOSE

Augmented reality (AR) is an innovative approach that could assist percutaneous procedures; by directly seeing "through" a phantom, targeting a lesion might be more intuitive than using ultrasound (US). The objective of this study was to compare the performance of experienced interventional radiologists and operators untrained in soft tissue lesion puncture using AR guidance and standard US guidance.

MATERIAL AND METHODS

Three trained interventional radiologists with 5-10 years of experience and three untrained operators performed punctures of five targets in an abdominal phantom, with US guidance and AR guidance. Correct targeting, accuracy (defined as the Euclidean distance between the tip and the center of the target), planning time, and puncture time were documented.

RESULTS

Accuracy was higher for the trained group than the untrained group using US guidance (1 mm versus 4 mm, p = 0.001), but not when using AR guidance (4 mm vs. 4 mm, p = 0.76). All operators combined, no significant difference was found concerning accuracy between US and AR guidance (2 mm vs. 4 mm, p = 0.09), but planning time and puncture time were significantly shorter using AR (respectively, 15.1 s vs. 74 s, p < 0.001; 16.1 s vs. 59 s; p < 0.001).

CONCLUSION

Untrained and trained operators obtained comparable accuracy in percutaneous punctures when using AR guidance whereas US performance was better in the experienced group. All operators together, accuracy was similar between US and AR guidance, but shorter planning time, puncture time were found for AR guidance.

Targeted augmented reality-guided transperineal prostate biopsies study: initial experience

Background

Transperineal biopsy of magnetic resonance imaging (MRI)-detected prostate lesions is now the established technique used in prostate cancer (CaP) diagnostics. Virtual Surgery Intelligence (VSI) Holomedicine by Apoqlar (Hamburg, Germany) is a mixed reality (MR)/augmented reality (AR) software platform that runs on the HoloLens II system (Microsoft, Redford, USA). Multiparametric prostate MRI images were converted into 3D holograms and added into a MR space, enabling visualization of a 3D hologram and image-assisted prostate biopsy.

Objective

The Targeted Augmented Reality-GuidEd Transperineal (TARGET) study investigated the feasibility of performing AR-guided prostate biopsies in a MR framework, using the VSI platform in patients with MRI-detected prostate lesions.

Methods

Ten patients with a clinical suspicion of CaP on MRI (Prostate Imaging-Reporting and Data System, PI-RADS 4/5) were uploaded to the VSI HoloLens system. Two MR/AR-guided prostate biopsies were then acquired using the PrecisionPoint Freehand transperineal biopsy system. Cognitive fusion biopsies were performed as standard of care following the MR/AR-guided prostate biopsies.

Results

All 10 patients successfully underwent MR/AR-guided prostate biopsy after 3D MR images were overlaid on the patient's body. Prostatic tissue was obtained in all MR/AR-guided specimens. Seven patients (70%) had matching histology in both the standard and MR/AR-guided biopsies. The remaining three had ISUP (International Society of Urological Pathology) Grade 2 CaP. There were no immediate complications.

Conclusion

We believe this is a world first. The initial feasibility data from the TARGET study demonstrated that an MR/AR-guided prostate biopsy utilizing the VSI Holomedicine system is a viable option in CaP diagnostics. The next stage in development is to combine AR images with real-time needle insertion and to provide further data to formally appraise the sensitivity and specificity of the technique.

Evaluation of augmented reality technology in global urologic surgery

BACKGROUND

The COVID-19 pandemic drastically reduced opportunities for surgical skill sharing between high-income and low to middle-income countries. Augmented reality (AR) technology allows mentors in one country to virtually train a mentee in another country during surgical cases without international travel. We hypothesize that AR technology is an effective live surgical training and mentorship modality.

METHODS

Three senior urologic surgeons in the US and UK worked with four urologic surgeon trainees across the continent of Africa using AR systems. Trainers and trainees individually completed post-operative questionnaires evaluating their experience.

RESULTS

Trainees rated the quality of virtual training as equivalent to in-person training in 83% of cases (N = 5 of 6 responses). Trainers reported the technology's visual quality as "acceptable" in 67% of cases (N = 12 of 18 responses). The audiovisual capabilities of the technology had a "high" impact in the majority of the cases.

CONCLUSION

AR technology can effectively facilitate surgical training when in-person training is limited or unavailable.

The design and validation of a low-cost trans perineal (TP) prostate biopsy simulator for training: improving trainees' confidence and cognitive targeting skills

PURPOSE

The aim of this research was to create a novel and low-cost TP prostate biopsy simulator that has face, content and construct validity with high educational value.

METHODS

This research developed a trans perineal prostate (TP) biopsy simulator using 3D-printed moulds and tissue-mimicking materials. Important regions (anterior, mid, and posterior zones) were coded with different colours. Ultrasound visible abnormal lesions were embedded in the prostate phantom. Expert and novice participants in TP biopsies were recruited. Essential skills were identified through the consensus of six experts. These skills were assessed through tasks performed by participants. This included the accuracy and timing of systematic and target biopsies. Immediate feedback was determined by the colour of the biopsy cores taken. A survey was distributed to evaluate its realism and educational value.

RESULTS

The material cost of one simulator was £7.50. This simulator was proven to have face, content, and construct validity. There was a significant difference (p = 0.02) in the accuracy of systematic biopsies between both experts and novices. Significant difference was also observed (p = 0.01), in accurately identifying target lesion on ultrasound between both groups. Participants rated the overall realism of the simulator 4.57/5 (range 3-5). 100% of the experts agreed that introducing this simulator to training will be beneficial. 85.7% of the participants strongly agree that the simulator improved their confidence in TP biopsies.

CONCLUSION

There is value in integrating this proof-of-concept TP prostate biopsy simulator into training. It has highly rated educational value and has face, content, and construct validity.

The use of advanced imaging in guiding the further investigation and treatment of primary prostate cancer

In the era of precision medicine, oncological imaging techniques are advancing at a rapid pace, particularly molecular imaging with promising new targets for prostate cancer (PC) such as gastrin releasing peptide receptors (GRPR) along the established and indispensable prostate specific membrane antigen (PSMA). As PC is characterized by heterogenous tumor biology ranging from indolent to aggressive disease, distinguishing clinically significant tumors from indolent disease is critical. Multiparametric MRI- and PET-targeted prostate biopsies mitigate the shortcomings and risks of standard systematic template biopsy by identifying more significant cancers.Focal treatment for localized disease is a minimally invasive approach that targets the index tumor - the lesion of the highest grade - while sparing the surrounding healthy tissue. Real-time MRI-guidance and thermal control with MR-thermometry, improves treatment accuracy and results in lower rates of functional side effects. PET imaging could be an useful tool to assess response to treatment compared to invasive prostate biopsies.In this comprehensive review, we focus on the image-guided detection and treatment of localized primary prostate cancer, its current status and future perspectives.

Assessment of a novel smartglass-based point-of-care fusion approach for mixed reality-assisted targeted prostate biopsy: A pilot proof-of-concept study

Purpose

While several biopsy techniques and platforms for magnetic resonance imaging (MRI)-guided targeted biopsy of the prostate have been established, none of them has proven definite superiority. Augmented and virtual reality (mixed reality) smartglasses have emerged as an innovative technology to support image-guidance and optimize accuracy during medical interventions. We aimed to investigate the benefits of smartglasses for MRI-guided mixed reality-assisted cognitive targeted biopsy of the prostate.

Methods

For prospectively collected patients with suspect prostate PIRADS lesions, multiparametric MRI was uploaded to a smartglass (Microsoft® Hololens I), and smartglass-assisted targeted biopsy (SMART TB) of the prostate was executed by generation of a cognitive fusion technology at the point-of-care. Detection rates of prostate cancer (PCA) were compared between SMART TB and 12-core systematic biopsy. Assessment of SMART-TB was executed by the two performing surgeons based on 10 domains on a 10-point scale ranging from bad (1) to excellent (10).

Results

SMART TB and systematic biopsy of the prostate were performed for 10 patients with a total of 17 suspect PIRADS lesions (PIRADS 3, n = 6; PIRADS 4, n = 6; PIRADS 5, n = 5). PCA detection rate per core was significant (p < 0.05) higher for SMART TB (47%) than for systematic biopsy (19%). Likelihood for PCA according to each core of a PIRADS lesion (17%, PIRADS 3; 58%, PIRADS 4; 67%, PIRADS 5) demonstrated convenient accuracy. Feasibility scores for SMART TB were high for practicality (10), multitasking (10), execution speed (9), comfort (8), improvement of surgery (8) and image quality (8), medium for physical stress (6) and device handling (6) and low for device weight (5) and battery autonomy (4).

Conclusion

SMART TB has the potential to increase accuracy for PCA detection and might enhance cognitive MRI-guided targeted prostate biopsy in the future.