Augmented reality for interventional oncology: proof-of-concept study of a novel high-end guidance system platform

Mixed reality in interventional radiology: a focus on first clinical use of XR90 augmented reality-based visualization and navigation platform

INTRODUCTION

Augmented reality (AR) and virtual reality (VR) are emerging tools in interventional radiology (IR), enhancing IR education, preprocedural planning, and intraprocedural guidance.

AREAS COVERED

This review identifies current applications of AR/VR in IR, with a focus on studies that assess the clinical impact of AR/VR. We outline the relevant technology and assess current limitations and future directions in this space. We found that the use of AR in IR lags other surgical fields, and the majority of the data exists in case series or small-scale studies. Educational use of AR/VR improves learning anatomy, procedure steps, and procedural learning curves. Preprocedural use of AR/VR decreases procedure times, especially in complex procedures. Intraprocedural AR for live tracking is accurate within 5 mm live patients and has up to 0.75 mm in phantoms, offering decreased procedure time and radiation exposure. Challenges include cost, ergonomics, rapid segmentation, and organ motion.

EXPERT OPINION

The use of AR/VR in interventional radiology may lead to safer and more efficient procedures. However, more data from larger studies is needed to better understand where AR/VR is confers the most benefit in interventional radiology clinical practice.

US & MR/CT Image Fusion with Markerless Skin Registration: A Proof of Concept

This paper presents an innovative automatic fusion imaging system that combines 3D CT/MR images with real-time ultrasound acquisition. The system eliminates the need for external physical markers and complex training, making image fusion feasible for physicians with different experience levels. The integrated system involves a portable 3D camera for patient-specific surface acquisition, an electromagnetic tracking system, and US components. The fusion algorithm comprises two main parts: skin segmentation and rigid co-registration, both integrated into the US machine. The co-registration aligns the surface extracted from CT/MR images with the 3D surface acquired by the camera, facilitating rapid and effective fusion. Experimental tests in different settings, validate the system's accuracy, computational efficiency, noise robustness, and operator independence.

US-Guided Interventional Procedures for Total Hip Arthroplasty

In patients with total hip arthroplasty (THA) with recurrent pain, symptoms may be caused by several conditions involving not just the joint, but also the surrounding soft tissues including tendons, muscles, bursae, and peripheral nerves. US and US-guided interventional procedures are important tools in the diagnostic work-up of patients with painful THA given that it is possible to reach a prompt diagnosis both directly identifying the pathological changes of periprosthetic structures and indirectly evaluating the response and pain relief to local injection of anesthetics under US monitoring. Then, US guidance can be used for the aspiration of fluid from the joint or periarticular collections, or alternatively to follow the biopsy needle to collect samples for culture analysis in the suspicion of prosthetic joint infection. Furthermore, US-guided percutaneous interventions may be used to treat several conditions with well-established minimally invasive procedures that involve injections of corticosteroid, local anesthetics, and platelet-rich plasma or other autologous products. In this review, we will discuss the clinical and technical applications of US-guided percutaneous interventional procedures in painful THA that can be used in routine daily practice for diagnostic and therapeutic purposes.

Tablet-based Augmented reality and 3D printed templates in fully guided Microtia Reconstruction: a clinical workflow

BACKGROUND

Microtia is a congenital malformation of the auricle that affects approximately 4 of every 10,000 live newborns. Radiographic film paper is traditionally employed to bidimensionally trace the structures of the contralateral healthy ear in a quasi-artistic manner. Anatomical points provide linear and angular measurements. However, this technique proves time-consuming, subjectivity-rich, and greatly dependent on surgeon expertise. Hence, it's susceptible to shape errors and misplacement.

METHODS

We present an innovative clinical workflow that combines 3D printing and augmented reality (AR) to increase objectivity and reproducibility of these procedures. Specifically, we introduce patient-specific 3D cutting templates and remodeling molds to carve and construct the cartilaginous framework that will conform the new ear. Moreover, we developed an in-house AR application compatible with any commercial Android tablet. It precisely guides the positioning of the new ear during surgery, ensuring symmetrical alignment with the healthy one and avoiding time-consuming intraoperative linear or angular measurements. Our solution was evaluated in one case, first with controlled experiments in a simulation scenario and finally during surgery.

RESULTS

Overall, the ears placed in the simulation scenario had a mean absolute deviation of 2.2 ± 1.7 mm with respect to the reference plan. During the surgical intervention, the reconstructed ear was 3.1 mm longer and 1.3 mm wider with respect to the ideal plan and had a positioning error of 2.7 ± 2.4 mm relative to the contralateral side. Note that in this case, additional morphometric variations were induced from inflammation and other issues intended to be addressed in a subsequent stage of surgery, which are independent of our proposed solution.

CONCLUSIONS

In this work we propose an innovative workflow that combines 3D printing and AR to improve ear reconstruction and positioning in microtia correction procedures. Our implementation in the surgical workflow showed good accuracy, empowering surgeons to attain consistent and objective outcomes.

Smart goggles augmented reality CT-US fusion compared to conventional fusion navigation for percutaneous needle insertion

PURPOSE

Targeting accuracy determines outcomes for percutaneous needle interventions. Augmented reality (AR) in IR may improve procedural guidance and facilitate access to complex locations. This study aimed to evaluate percutaneous needle placement accuracy using a goggle-based AR system compared to an ultrasound (US)-based fusion navigation system.

METHODS

Six interventional radiologists performed 24 independent needle placements in an anthropomorphic phantom (CIRS 057A) in four needle guidance cohorts (n = 6 each): (1) US-based fusion, (2) goggle-based AR with stereoscopically projected anatomy (AR-overlay), (3) goggle AR without the projection (AR-plain), and (4) CT-guided freehand. US-based fusion included US/CT registration with electromagnetic (EM) needle, transducer, and patient tracking. For AR-overlay, US, EM-tracked needle, stereoscopic anatomical structures and targets were superimposed over the phantom. Needle placement accuracy (distance from needle tip to target center), placement time (from skin puncture to final position), and procedure time (time to completion) were measured.

RESULTS

Mean needle placement accuracy using US-based fusion, AR-overlay, AR-plain, and freehand was 4.5 ± 1.7 mm, 7.0 ± 4.7 mm, 4.7 ± 1.7 mm, and 9.2 ± 5.8 mm, respectively. AR-plain demonstrated comparable accuracy to US-based fusion (p = 0.7) and AR-overlay (p = 0.06). Excluding two outliers, AR-overlay accuracy became 5.9 ± 2.6 mm. US-based fusion had the highest mean placement time (44.3 ± 27.7 s) compared to all navigation cohorts (p < 0.001). Longest procedure times were recorded with AR-overlay (34 ± 10.2 min) compared to AR-plain (22.7 ± 8.6 min, p = 0.09), US-based fusion (19.5 ± 5.6 min, p = 0.02), and freehand (14.8 ± 1.6 min, p = 0.002).

CONCLUSION

Goggle-based AR showed no difference in needle placement accuracy compared to the commercially available US-based fusion navigation platform. Differences in accuracy and procedure times were apparent with different display modes (with/without stereoscopic projections). The AR-based projection of the US and needle trajectory over the body may be a helpful tool to enhance visuospatial orientation. Thus, this study refines the potential role of AR for needle placements, which may serve as a catalyst for informed implementation of AR techniques in IR.

Smartphone Augmented Reality Outperforms Conventional CT Guidance for Composite Ablation Margins in Phantom Models

PURPOSE

To develop and evaluate a smartphone augmented reality (AR) system for a large 50-mm liver tumor ablation with treatment planning for composite overlapping ablation zones.

MATERIALS AND METHODS

A smartphone AR application was developed to display tumor, probe, projected probe paths, ablated zones, and real-time percentage of the ablated target tumor volume. Fiducial markers were attached to phantoms and an ablation probe hub for tracking. The system was evaluated with tissue-mimicking thermochromic phantoms and gel phantoms. Four interventional radiologists performed 2 trials each of 3 probe insertions per trial using AR guidance versus computed tomography (CT) guidance approaches in 2 gel phantoms. Insertion points and optimal probe paths were predetermined. On Gel Phantom 2, serial ablated zones were saved and continuously displayed after each probe placement/adjustment, enabling feedback and iterative planning. The percentages of tumor ablated for AR guidance versus CT guidance, and with versus without display of recorded ablated zones, were compared among interventional radiologists with pairwise t-tests.

RESULTS

The means of percentages of tumor ablated for CT freehand and AR guidance were 36% ± 7 and 47% ± 4 (P = .004), respectively. The mean composite percentages of tumor ablated for AR guidance were 43% ± 1 (without) and 50% ± 2 (with display of ablation zone) (P = .033). There was no strong correlation between AR-guided percentage of ablation and years of experience (r < 0.5), whereas there was a strong correlation between CT-guided percentage of ablation and years of experience (r > 0.9).

CONCLUSIONS

A smartphone AR guidance system for dynamic iterative large liver tumor ablation was accurate, performed better than conventional CT guidance, especially for less experienced interventional radiologists, and enhanced more standardized performance across experience levels for ablation of a 50-mm tumor.

Ultracompact polarization multiplexing meta-combiner for augmented reality display

Augmented reality (AR) display, as a next-generation innovative technology, is revolutionizing the ways of perceiving and communicating by overlaying virtual images onto real-world scenes. However, the current AR devices are often bulky and cumbersome, posing challenges for long-term wearability. Metasurfaces have flexible capabilities of manipulating light waves at subwavelength scales, making them as ideal candidates for replacing traditional optical elements in AR display devices. In this work, we propose and fabricate what we believe is a novel reflective polarization multiplexing gradient metasurface based on propagation phase principle to replace the optical combiner element in traditional AR display devices. Our designed metasurface exhibits different polarization modulations for reflected and transmitted light, enabling efficient deflection of reflected light while minimizing the impact on transmitted light. This work reveals the significant potential of metasurfaces in next-generation optical display systems and provides a reliable theoretical foundation for future integrated waveguide schemes, driving the development of next-generation optical display products towards lightweight and comfortable.

Navigation and Robotics in Interventional Oncology: Current Status and Future Roadmap

Interventional oncology (IO) is the field of Interventional Radiology that provides minimally invasive procedures under imaging guidance for the diagnosis and treatment of malignant tumors. Sophisticated devices can be utilized to increase standardization, accuracy, outcomes, and "repeatability" in performing percutaneous Interventional Oncology techniques. These technologies can reduce variability, reduce human error, and outperform human hand-to-eye coordination and spatial relations, thus potentially normalizing an otherwise broad diversity of IO techniques, impacting simulation, training, navigation, outcomes, and performance, as well as verification of desired minimum ablation margin or other measures of successful procedures. Stereotactic navigation and robotic systems may yield specific advantages, such as the potential to reduce procedure duration and ionizing radiation exposure during the procedure and, at the same time, increase accuracy. Enhanced accuracy, in turn, is linked to improved outcomes in many clinical scenarios. The present review focuses on the current role of percutaneous navigation systems and robotics in diagnostic and therapeutic Interventional Oncology procedures. The currently available alternatives are presented, including their potential impact on clinical practice as reflected in the peer-reviewed medical literature. A review of such data may inform wiser investment of time and resources toward the most impactful IR/IO applications of robotics and navigation to both standardize and address unmet clinical needs.

Virtual and Augmented Reality in Interventional Radiology: Current Applications, Challenges, and Future Directions

Virtual reality (VR) and augmented Reality (AR) are emerging technologies with the potential to revolutionize Interventional radiology (IR). These innovations offer advantages in patient care, interventional planning, and educational training by improving the visualization and navigation of medical images. Despite progress, several challenges hinder their widespread adoption, including limitations in navigation systems, cost, clinical acceptance, and technical constraints of AR/VR equipment. However, ongoing research holds promise with recent advancements such as shape-sensing needles and improved organ deformation modeling. The development of deep learning techniques, particularly for medical imaging segmentation, presents a promising avenue to address existing accuracy and precision issues. Future applications of AR/VR in IR include simulation-based training, preprocedural planning, intraprocedural guidance, and increased patient engagement. As these technologies advance, they are expected to facilitate telemedicine, enhance operational efficiency, and improve patient outcomes, marking a new frontier in interventional radiology.

Bone biopsies guided by augmented reality: a pilot study

PURPOSE

To test the technical feasibility of an augmented reality (AR) navigation system to guide bone biopsies.

METHODS

We enrolled patients subjected to percutaneous computed tomography (CT)-guided bone biopsy using a novel AR navigation system. Data from prospectively enrolled patients (AR group) were compared with data obtained retrospectively from previous standard CT-guided bone biopsies (control group). We evaluated the following: procedure duration, number of CT passes, patient's radiation dose (dose-length product), complications, and specimen adequacy. Technical success was defined as the ability to complete the procedure as planned, reaching the target center. Technical efficacy was assessed evaluating specimen adequacy.

RESULTS

Eight patients (4 males) aged 58 ± 24 years (mean ± standard deviation) were enrolled in the AR group and compared with 8 controls (4 males) aged 60 ± 15 years. No complications were observed. Procedure duration, number of CT passes, and radiation dose were 22 ± 5 min, 4 (median) [4, 6 interquartile range] and 1,034 ± 672 mGy*cm for the AR group and 23 ± 5 min, 9 [7.75, 11.25], and 1,954 ± 993 mGy*cm for controls, respectively. No significant differences were observed for procedure duration (p = 0.878). Conversely, number of CT passes and radiation doses were significantly lower for the AR group (p < 0.001 and p = 0.021, respectively). Technical success and technical efficacy were 100% for both groups.

CONCLUSIONS

This AR navigation system is safe, feasible, and effective; it can decrease radiation exposure and number of CT passes during bone biopsies without increasing duration time.

RELEVANCE STATEMENT

This augmented reality (AR) navigation system is a safe and feasible guidance for bone biopsies; it may ensure a decrease in the number of CT passes and patient's radiation dose.

KEY POINTS

• This AR navigation system is a safe guidance for bone biopsies. • It ensures decrease of number of CT passes and patient's radiation exposure. • Procedure duration was similar to that of standard CT-guided biopsy. • Technical success was 100% as in all patients the target was reached. • Technical efficacy was 100% as the specimen was adequate in all patients.

Artificial Intelligence, Augmented Reality, and Virtual Reality Advances and Applications in Interventional Radiology

Artificial intelligence (AI) uses computer algorithms to process and interpret data as well as perform tasks, while continuously redefining itself. Machine learning, a subset of AI, is based on reverse training in which evaluation and extraction of data occur from exposure to labeled examples. AI is capable of using neural networks to extract more complex, high-level data, even from unlabeled data sets, and better emulate, or even exceed, the human brain. Advances in AI have and will continue to revolutionize medicine, especially the field of radiology. Compared to the field of interventional radiology, AI innovations in the field of diagnostic radiology are more widely understood and used, although still with significant potential and growth on the horizon. Additionally, AI is closely related and often incorporated into the technology and programming of augmented reality, virtual reality, and radiogenomic innovations which have the potential to enhance the efficiency and accuracy of radiological diagnoses and treatment planning. There are many barriers that limit the applications of artificial intelligence applications into the clinical practice and dynamic procedures of interventional radiology. Despite these barriers to implementation, artificial intelligence in IR continues to advance and the continued development of machine learning and deep learning places interventional radiology in a unique position for exponential growth. This review describes the current and possible future applications of artificial intelligence, radiogenomics, and augmented and virtual reality in interventional radiology while also describing the challenges and limitations that must be addressed before these applications can be fully implemented into common clinical practice.

HoloLens 1 vs. HoloLens 2: Improvements in the New Model for Orthopedic Oncological Interventions

This work analyzed the use of Microsoft HoloLens 2 in orthopedic oncological surgeries and compares it to its predecessor (Microsoft HoloLens 1). Specifically, we developed two equivalent applications, one for each device, and evaluated the augmented reality (AR) projection accuracy in an experimental scenario using phantoms based on two patients. We achieved automatic registration between virtual and real worlds using patient-specific surgical guides on each phantom. They contained a small adaptor for a 3D-printed AR marker, the characteristic patterns of which were easily recognized using both Microsoft HoloLens devices. The newest model improved the AR projection accuracy by almost 25%, and both of them yielded an RMSE below 3 mm. After ascertaining the enhancement of the second model in this aspect, we went a step further with Microsoft HoloLens 2 and tested it during the surgical intervention of one of the patients. During this experience, we collected the surgeons’ feedback in terms of comfortability, usability, and ergonomics. Our goal was to estimate whether the improved technical features of the newest model facilitate its implementation in actual surgical scenarios. All of the results point to Microsoft HoloLens 2 being better in all the aspects affecting surgical interventions and support its use in future experiences.

Update on Percutaneous Local Ablative Procedures for the Treatment of Hepatocellular Carcinoma

BACKGROUND

 Hepatocellular carcinoma (HCC) is the fifth most common tumor worldwide. Because many hepatocellular carcinomas are already unresectable at the time of initial diagnosis, percutaneous tumor ablation has become established in recent decades as a curative therapeutic approach for very early (BCLC 0) and early (BCLC A) HCC. The aim of this paper is to provide a concise overview of the percutaneous local ablative procedures currently in use, based on their technical characteristics as well as clinical relevance, taking into account the current body of studies.

MATERIALS AND METHODS

 The literature search included all original papers, reviews, and meta-analyses available via MEDLINE and Pubmed on the respective percutaneous ablation procedures; the primary focus was on randomized controlled trials and publications from the last 10 years.

RESULTS AND CONCLUSIONS

 Radiofrequency ablation (RFA) and microwave ablation (MWA) are well-established procedures that are considered equal to surgical resection in the treatment of stage BCLC 0 and A HCC with a diameter up to 3 cm due to their strong evidence in international and national guidelines. For tumors with a diameter between 3 and 5 cm, the current S3 guidelines recommend a combination of transarterial chemoembolization (TACE) and thermal ablation using RFA or MWA as combination therapy is superior to thermal ablation alone in tumors of this size and shows comparable results to surgical resection in terms of overall survival. Alternative, less frequently employed thermal procedures include cryotherapy (CT) and laser ablation (LA). Non-thermal procedures include irreversible electroporation (IRE), interstitial brachytherapy (IBT), and most recently, electrochemotherapy (ECT). Due to insufficient evidence, these have only been used in individual cases and within the framework of studies. However, the nonthermal methods are a reasonable alternative for ablation of tumors adjacent to large blood vessels and bile ducts because they cause significantly less damage to these structures than thermal ablation methods. With advances in the technology of the respective procedures, increasingly good evidence, and advancements in supportive techniques such as navigation devices and fusion imaging, percutaneous ablation procedures may expand their indications for the treatment of larger and more advanced tumors in the coming years.

KEY POINTS

· RFA and MWA are considered equal to surgical resection as a first-line therapy for the curative treatment of stage BCLC 0 and A HCCs with a diameter of up to 3 cm.. · For HCCs with a diameter between 3 and 5 cm, a combination of TACE and RFA or MWA is recommended. This combination therapy yields results comparable to those of surgical resection in terms of overall survival.. · Due to insufficient evidence, alternative ablation methods have only been used in individual cases and within the framework of studies. However, nonthermal methods, such as IRE, IBT, and, most recently, ECT, are a reasonable alternative for ablation of HCCs adjacent to large blood vessels and bile ducts because they cause significantly less damage to these structures than thermal ablation methods..

CITATION FORMAT

· Luerken L, Haimerl M, Doppler M et al. Update on Percutaneous Local Ablative Procedures for the Treatment of Hepatocellular Carcinoma. Fortschr Röntgenstr 2022; DOI: 10.1055/a-1768-0954.

Thermal Ablation of Liver Tumors Guided by Augmented Reality: An Initial Clinical Experience

Background: Over the last two decades, augmented reality (AR) has been used as a visualization tool in many medical fields in order to increase precision, limit the radiation dose, and decrease the variability among operators. Here, we report the first in vivo study of a novel AR system for the guidance of percutaneous interventional oncology procedures. Methods: Eight patients with 15 liver tumors (0.7−3.0 cm, mean 1.56 + 0.55) underwent percutaneous thermal ablations using AR guidance (i.e., the Endosight system). Prior to the intervention, the patients were evaluated with US and CT. The targeted nodules were segmented and three-dimensionally (3D) reconstructed from CT images, and the probe trajectory to the target was defined. The procedures were guided solely by AR, with the position of the probe tip was subsequently confirmed by conventional imaging. The primary endpoints were the targeting accuracy, the system setup time, and targeting time (i.e., from the target visualization to the correct needle insertion). The technical success was also evaluated and validated by co-registration software. Upon completion, the operators were assessed for cybersickness or other symptoms related to the use of AR. Results: Rapid system setup and procedural targeting times were noted (mean 14.3 min; 12.0−17.2 min; 4.3 min, 3.2−5.7 min, mean, respectively). The high targeting accuracy (3.4 mm; 2.6−4.2 mm, mean) was accompanied by technical success in all 15 lesions (i.e., the complete ablation of the tumor and 13/15 lesions with a >90% 5-mm periablational margin). No intra/periprocedural complications or operator cybersickness were observed. Conclusions: AR guidance is highly accurate, and allows for the confident performance of percutaneous thermal ablations.

Percutaneous Therapies for Hepatocellular Carcinoma: Evolution of Liver Directed Therapies

Percutaneous ablation is a mainstay of treatment for early stage, unresectable hepatocellular carcinoma (HCC). Recent advances in technology have created multiple ablative modalities for treatment of this common malignancy. The purpose of this review is to familiarize readers with the technical and clinical aspects of both existing and emerging percutaneous treatment options for HCC.

Augmented reality technology in image-guided therapy: State-of-the-art review

Image-guided therapies have been on the rise in recent years as they can achieve higher accuracy and are less invasive than traditional methods. By combining augmented reality technology with image-guided therapy, more organs, and tissues can be observed by surgeons to improve surgical accuracy. In this review, 233 publications (dated from 2015 to 2020) on the design and application of augmented reality-based systems for image-guided therapy, including both research prototypes and commercial products, were considered for review. Based on their functions and applications. Sixteen studies were selected. The engineering specifications and applications were analyzed and summarized for each study. Finally, future directions and existing challenges in the field were summarized and discussed.

Comparison of Smartphone Augmented Reality, Smartglasses Augmented Reality, and 3D CBCT-guided Fluoroscopy Navigation for Percutaneous Needle Insertion: A Phantom Study

PURPOSE

To compare needle placement performance using an augmented reality (AR) navigation platform implemented on smartphone or smartglasses devices to that of CBCT-guided fluoroscopy in a phantom.

MATERIALS AND METHODS

An AR application was developed to display a planned percutaneous needle trajectory on the smartphone (iPhone7) and smartglasses (HoloLens1) devices in real time. Two AR-guided needle placement systems and CBCT-guided fluoroscopy with navigation software (XperGuide, Philips) were compared using an anthropomorphic phantom (CIRS, Norfolk, VA). Six interventional radiologists each performed 18 independent needle placements using smartphone (n = 6), smartglasses (n = 6), and XperGuide (n = 6) guidance. Placement error was defined as the distance from the needle tip to the target center. Placement time was recorded. For XperGuide, dose-area product (DAP, mGy*cm²) and fluoroscopy time (sec) were recorded. Statistical comparisons were made using a two-way repeated measures ANOVA.

RESULTS

The placement error using the smartphone, smartglasses, or XperGuide was similar (3.98 ± 1.68 mm, 5.18 ± 3.84 mm, 4.13 ± 2.38 mm, respectively, p = 0.11). Compared to CBCT-guided fluoroscopy, the smartphone and smartglasses reduced placement time by 38% (p = 0.02) and 55% (p = 0.001), respectively. The DAP for insertion using XperGuide was 3086 ± 2920 mGy*cm², and no intra-procedural radiation was required for augmented reality.

CONCLUSIONS

Smartphone- and smartglasses-based augmented reality reduced needle placement time and radiation exposure while maintaining placement accuracy compared to a clinically validated needle navigation platform.

Augmented reality improves procedural efficiency and reduces radiation dose for CT-guided lesion targeting: a phantom study using HoloLens 2

Out-of-plane lesions pose challenges for CT-guided interventions. Augmented reality (AR) headsets are capable to provide holographic 3D guidance to assist CT-guided targeting. A prospective trial was performed assessing CT-guided lesion targeting on an abdominal phantom with and without AR guidance using HoloLens 2. Eight operators performed a cumulative total of 86 needle passes. Total needle redirections, radiation dose, procedure time, and puncture rates of nontargeted lesions were compared with and without AR. Mean number of needle passes to reach the target reduced from 7.4 passes without AR to 3.4 passes with AR (p = 0.011). Mean CT dose index decreased from 28.7 mGy without AR to 16.9 mGy with AR (p = 0.009). Mean procedure time reduced from 8.93 min without AR to 4.42 min with AR (p = 0.027). Puncture rate of a nontargeted lesion decreased from 11.9% without AR (7/59 passes) to 0% with AR (0/27 passes). First needle passes were closer to the ideal target trajectory with AR versus without AR (4.6° vs 8.0° offset, respectively, p = 0.018). AR reduced variability and elevated the performance of all operators to the same level irrespective of prior clinical experience. AR guidance can provide significant improvements in procedural efficiency and radiation dose savings for targeting out-of-plane lesions.

The evolution of interventional oncology in the 21st century

Interventional oncology (IO) has proven to be highly efficient in the local therapy of numerous malignant tumors in addition to surgery, chemotherapy, and radiotherapy. Due to the advent of immune-oncology with the possibility of tumor control at the molecular and cellular levels, a system change is currently emerging. This will significantly rule oncology in the coming decades. Therefore, one cannot think about IO in the 21st century without considering immunology. For IO, this means paying much more attention to the immunomodulatory effects of the interventional techniques, which have so far been neglected, and to explore the synergistic possibilities with immuno-oncology. It can be expected that the combined use of IO and immuno-oncology will help to overcome the limitations of the latter, such as limited local effects and a high rate of side-effects. To do this, however, sectoral boundaries must be removed and interdisciplinary research efforts must be strengthened. In case of success, IO will face an exciting future.

Virtual and augmented reality: potential applications in radiology

The modern-day radiologist must be adept at image interpretation, and the one who most successfully leverages new technologies may provide the highest value to patients, clinicians, and trainees. Applications of virtual reality (VR) and augmented reality (AR) have the potential to revolutionize how imaging information is applied in clinical practice and how radiologists practice. This review provides an overview of VR and AR, highlights current applications, future developments, and limitations hindering adoption.

Smartphone- versus smartglasses-based augmented reality (AR) for percutaneous needle interventions: system accuracy and feasibility study

PURPOSE

To compare the system accuracy and needle placement performance of smartphone- and smartglasses-based augmented reality (AR) for percutaneous needle interventions.

METHODS

An AR platform was developed to enable the superimposition of annotated anatomy and a planned needle trajectory onto a patient in real time. The system accuracy of the AR display on smartphone (iPhone7) and smartglasses (HoloLens1) devices was evaluated on a 3D-printed phantom. The target overlay error was measured as the distance between actual and virtual targets (n = 336) on the AR display, derived from preprocedural CT. The needle overlay angle was measured as the angular difference between actual and virtual needles (n = 12) on the AR display. Three operators each used the iPhone (n = 8), HoloLens (n = 8) and CT-guided freehand (n = 8) to guide needles into targets in a phantom. Needle placement error was measured with post-placement CT. Needle placement time was recorded from needle puncture to navigation completion.

RESULTS

The target overlay error of the iPhone was comparable to the HoloLens (1.75 ± 0.59 mm, 1.74 ± 0.86 mm, respectively, p = 0.9). The needle overlay angle of the iPhone and HoloLens was similar (0.28 ± 0.32°, 0.41 ± 0.23°, respectively, p = 0.26). The iPhone-guided needle placements showed reduced error compared to the HoloLens (2.58 ± 1.04 mm, 3.61 ± 2.25 mm, respectively, p = 0.05) and increased time (87 ± 17 s, 71 ± 27 s, respectively, p = 0.02). Both AR devices reduced placement error compared to CT-guided freehand (15.92 ± 8.06 mm, both p < 0.001).

CONCLUSION

An augmented reality platform employed on smartphone and smartglasses devices may provide accurate display and navigation guidance for percutaneous needle-based interventions.

Augmented and Mixed Reality: Technologies for Enhancing the Future of IR

Augmented and mixed reality are emerging interactive and display technologies. These technologies are able to merge virtual objects, in either 2 or 3 dimensions, with the real world. Image guidance is the cornerstone of interventional radiology. With augmented or mixed reality, medical imaging can be more readily accessible or displayed in actual 3-dimensional space during procedures to enhance guidance, at times when this information is most needed. In this review, the current state of these technologies is addressed followed by a fundamental overview of their inner workings and challenges with 3-dimensional visualization. Finally, current and potential future applications in interventional radiology are highlighted.

Ultrasound-guided interventions with augmented reality in situ visualisation: a proof-of-mechanism phantom study

Background

Ultrasound (US) images are currently displayed on monitors, and their understanding needs good orientation skills. Direct overlay of US images onto the according anatomy is possible with augmented reality (AR) technologies. Our purpose was to explore the performance of US-guided needle placement with and without AR in situ US viewing.

Methods

Three untrained operators and two experienced radiologists performed 200 US-guided punctures: 100 with and 100 without AR in situ US. The punctures were performed in two different phantoms, a leg phantom with soft tissue lesions and a vessel phantom. Time to puncture and number of needle passes were recorded for each puncture. Data are reported as median [range] according to their non-normal distribution.

Results

AR in situ US resulted in reduced time (median [range], 13 s [3–101] versus 14 s [3–220]) and number of needle passes (median [range], 1 [1–4] versus 1 [1–8]) compared to the conventional technique. The initial gap in performance of untrained versus experienced operators with the conventional US (time, 21.5 s [3–220] versus 10.5 s [3–94] and needle passes 1 [1–8] versus 1 [1, 2]) was reduced to 12.5 s [3–101] versus 13 s [3–100] and 1 [1–4] versus 1 [1–4] when using AR in situ US, respectively.

Conclusion

AR in situ US could be a potential breakthrough in US applications by simplifying operator’s spatial orientation and reducing experience-based differences in performance of US-guided interventions. Further studies are needed to confirm these preliminary phantom results.

Augmented reality and mixed reality for healthcare education beyond surgery: an integrative review

OBJECTIVES

This study aimed to review and synthesize the current research and state of augmented reality (AR), mixed reality (MR) and the applications developed for healthcare education beyond surgery.

METHODS

An integrative review was conducted on all relevant material, drawing on different data sources, including the databases of PubMed, PsycINFO, and ERIC from January 2013 till September 2018. Inductive content analysis and qualitative synthesis were performed. Additionally, the quality of the studies was assessed with different structured tools.

RESULTS

Twenty-six studies were included. Studies based on both AR and MR involved established applications in 27% of all cases (n=6), the rest being prototypes. The most frequently studied subjects were related to anatomy and anesthesia (n=13). All studies showed several healthcare educational benefits of AR and MR, significantly outperforming traditional learning approaches in 11 studies examining various outcomes. Studies had a low-to-medium quality overall with a MERSQI mean of 12.26 (SD=2.63), while the single qualitative study had high quality.

CONCLUSIONS

This review suggests the progress of learning approaches based on AR and MR for various medical subjects while moving the research base away from feasibility studies on prototypes. Yet, lacking validity of study conclusions, heterogeneity of research designs and widely varied reporting challenges transferability of the findings in the studies included in the review. Future studies should examine suitable research designs and instructional objectives achievable by AR and MR-based applications to strengthen the evidence base, making it relevant for medical educators and institutions to apply the technologies.

Artificial Intelligence in Interventional Radiology: A Literature Review and Future Perspectives

The term “artificial intelligence” (AI) includes computational algorithms that can perform tasks considered typical of human intelligence, with partial to complete autonomy, to produce new beneficial outputs from specific inputs. The development of AI is largely based on the introduction of artificial neural networks (ANN) that allowed the introduction of the concepts of “computational learning models,” machine learning (ML) and deep learning (DL). AI applications appear promising for radiology scenarios potentially improving lesion detection, segmentation, and interpretation with a recent application also for interventional radiology (IR) practice, including the ability of AI to offer prognostic information to both patients and physicians about interventional oncology procedures. This article integrates evidence-reported literature and experience-based perceptions to assist not only residents and fellows who are training in interventional radiology but also practicing colleagues who are approaching to locoregional mini-invasive treatments.

Real-time control of respiratory motion: Beyond radiation therapy

Motion management in radiation oncology is an important aspect of modern treatment planning and delivery. Special attention has been paid to control respiratory motion in recent years. However, other medical procedures related to both diagnosis and treatment are likely to benefit from the explicit control of breathing motion. Quantitative imaging - including increasingly important tools in radiology and nuclear medicine - is among the fields where a rapid development of motion control is most likely, due to the need for quantification accuracy. Emerging treatment modalities like focussed-ultrasound tumor ablation are also likely to benefit from a significant evolution of motion control in the near future. In the present article an overview of available respiratory motion systems along with ongoing research in this area is provided. Furthermore, an attempt is made to envision some of the most expected developments in this field in the near future.