Assessment of pulmonary vascular anatomy: comparing augmented reality by holograms versus standard CT images/reconstructions using surgical findings as reference standard

BACKGROUND

We compared computed tomography (CT) images and holograms (HG) to assess the number of arteries of the lung lobes undergoing lobectomy and assessed easiness in interpretation by radiologists and thoracic surgeons with both techniques.

METHODS

Patients scheduled for lobectomy for lung cancer were prospectively included and underwent CT for staging. A patient-specific three-dimensional model was generated and visualized in an augmented reality setting. One radiologist and one thoracic surgeon evaluated CT images and holograms to count lobar arteries, having as reference standard the number of arteries recorded at surgery. The easiness of vessel identification was graded according to a Likert scale. Wilcoxon signed-rank test and κ statistics were used.

RESULTS

Fifty-two patients were prospectively included. The two doctors detected the same number of arteries in 44/52 images (85%) and in 51/52 holograms (98%). The mean difference between the number of artery branches detected by surgery and CT images was 0.31 ± 0.98, whereas it was 0.09 ± 0.37 between surgery and HGs (p = 0.433). In particular, the mean difference in the number of arteries detected in the upper lobes was 0.67 ± 1.08 between surgery and CT images and 0.17 ± 0.46 between surgery and holograms (p = 0.029). Both radiologist and surgeon showed a higher agreement for holograms (κ = 0.99) than for CT (κ = 0.81) and found holograms easier to evaluate than CTs (p < 0.001).

CONCLUSIONS

Augmented reality by holograms is an effective tool for preoperative vascular anatomy assessment of lungs, especially when evaluating the upper lobes, more prone to anatomical variations.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04227444 RELEVANCE STATEMENT: Preoperative evaluation of the lung lobe arteries through augmented reality may help the thoracic surgeons to carefully plan a lobectomy, thus contributing to optimize patients' outcomes.

KEY POINTS

• Preoperative assessment of the lung arteries may help surgical planning. • Lung artery detection by augmented reality was more accurate than that by CT images, particularly for the upper lobes. • The assessment of the lung arterial vessels was easier by using holograms than CT images.

A platform for real-3d visualization and planning of left atrial appendage occlusion through mixed reality

Funding Acknowledgements

Type of funding sources: None.

Background

In left atrial appendage occlusion (LAAO), pre-procedural computed tomography (CT) is pivotal to describe the complex and highly variable LAA anatomy and to guide the operator in accurate planning of the intervention. Multiplanar reconstruction and 3D rendering are used for the navigation and analysis of the 3D datasets but they share some limitations that are due to the use of 2D screens; Mixed Reality (MxR) technology aims at overcoming such limitations by allowing for real-3D visualizations with holographic replicas of anatomical models while preserving a sense of presence within the true physical environment by the operator.

Purpose

To develop and test a MxR platform that provides a more intuitive and informative tool for the morphological analysis during the planning phase of LAAO.

Methods

Patients (n = 4) were randomly selected among those referred for a CT scan prior to transcatheter aortic valve replacement, each one characterized by a specific LAA morphology (cauliflower, bilobular, chicken wing, wind-sock). CT scans were performed in diastole at 75% of the R-R interval on a 64-slice scanner, with in-plane resolution 0.38-0.64 mm and slice thickness 0.62 mm. Firstly, the acquisition was cropped to contain the left atrium, the circumflex artery, the left upper pulmonary ridge. Subsequently, an isosurface with high coincidence between the blood cavity border and the endocardium was identified by the user and processed using a marching cube algorithm to obtain the 3D model. Finally, the 3D model was optimized for a MxR platform that allows for moving, zooming and cutting the model, measuring the main LAA linear dimensions and simulating the implant of a virtual replica of a transcatheter occluder.

Results

 

The workflow was successfully applied for all the patients independently from the morphology. All the models were successfully uploaded in the MxR platform (Fig 1.a) and for all the patients the morphological analysis was performed (Fig 1.b) in less than 10 minutes.

The four different morphologies of the LAA were correctly identified allowing a very detailed holographic modeling of the structure, including the neck, the landing zone, the curvature and the position and size of lobes.

For both the identified ostium and landing planes, using a dedicated measuring tool (Fig. 1.c), the operator measured the minimum and maximum diameters, which were later used to define the size of the occluder device to be used in the virtual implant simulation (Fig. 1.d).

Conclusions

The tested MxR platform suggested the potential to overcome the limits of the standard technologies in planning of LAAO thanks to the real-3D perception, potentially leading to a more accurate and faster planning phase. Furthermore, the use of MxR technology may enhance the ability to predict the optimal device size and position within the anatomy to obtain LAA complete sealing.

Abstract Figure.