Accuracy of instrument tip position using fiber optic shape sensing for navigated bronchoscopy

The purpose of this study was to evaluate the accuracy of a method for estimating the tip position of a fiber optic shape-sensing (FOSS) integrated instrument being inserted through a bronchoscope. A modified guidewire with a multicore optical fiber was inserted into the working channel of a custom-made catheter with three electromagnetic (EM) sensors. The displacement between the instruments was manually set, and a point-based method was applied to match the position of the EM sensors to corresponding points on the shape. The accuracy was evaluated in a realistic bronchial model. An additional EM sensor was used to sample the tip of the guidewire, and the absolute deviation between this position and the estimated tip position was calculated. For small displacements between the tip of the FOSS integrated tool and the catheter, the median deviation in estimated tip position was ≤5 mm. For larger displacements, deviations exceeding 10 mm were observed. The deviations increased when the shape sensor had sharp curvatures relative to more straight shapes. The method works well for clinically relevant displacements of a biopsy tool from the bronchoscope tip, and when the path to the lesion has limited curvatures. However, improvements must be made to our configuration before pursuing further clinical testing.

Peripheral tumour targeting using open-source virtual bronchoscopy with electromagnetic tracking: a multi-user pre-clinical study

Objectives: The goal was to demonstrate the utility of open-source tracking and visualisation tools in the targeting of lung cancer.Material and methods: The study demonstrates the first deployment of the Anser electromagnetic (EM) tracking system with the CustusX image-guided interventional research platform to navigate using an endobronchial catheter to injected tumour targets. Live animal investigations validated the deployment and targeting of peripheral tumour models using an innovative tumour marking routine.Results: Novel tumour model deployment was successfully achieved at all eight target sites across two live animal investigations without pneumothorax. Virtual bronchoscopy with tracking successfully guided the tracked catheter to 2-12 mm from the target tumour site. Deployment of a novel marker was achieved at all eight sites providing a reliable measure of targeting accuracy. Targeting accuracy within 10 mm was achieved in 7/8 sites and in all cases, the virtual target distance at marker deployment was within the range subsequently measured with x-ray.Conclusions: Endobronchial targeting of peripheral airway targets is feasible using existing open-source technology. Notwithstanding the shortcomings of current commercial platforms, technological improvements in EM tracking and registration accuracy fostered by open-source technology may provide the impetus for widespread clinical uptake of electromagnetic navigation in bronchoscopy.

Pulmonologist evaluation on new CT visualization for guidance to lung lesions during bronchoscopy

OBJECTIVE

Endoluminal visualization in virtual and video bronchoscopy lacks information about the surrounding structures, and the traditional 2 D axial, coronal and sagittal CT views can be difficult to interpret. To address this challenge, we previously introduced a novel visualization technique, Anchored to Centerline Curved Surface, for navigated bronchoscopy. The current study compares the ACCuSurf to the standard ACS CT views as planning and guiding tools in a phantom study.

MATERIAL AND METHODS

Bronchoscope operators navigated in physical phantom guided by virtual realistic image data constructed by fusion of CT dataset of phantom and anonymized patient CT data. We marked four different target positions within the virtual image data and gave 12 pulmonologists the task to navigate, with either ACCuSurf or ACS as guidance, to the corresponding targets in the physical phantom.

RESULTS

Using ACCuSurf reduced the planning time and increased the grade of successful navigation significantly compared to ACS.

CONCLUSION

The phantom setup with virtual patient image data proved realistic according to the pulmonologists. ACCuSurf proved superior to ACS regarding planning time and navigation success grading. Improvements on visualisation or display techniques may consequently improve both planning and navigated bronchoscopy and thus contribute to more precise lung diagnostics.

Navigated retrograde endoscopic myotomy (REM) for the treatment of therapy-resistant achalasia

BACKGROUND

In achalasia, muscle spasm may involve the proximal esophagus. When the muscle spasm is located in the proximal esophagus, conventional per oral endoscopic myotomy (POEM) may not be sufficient to relieve symptoms. In this paper, we describe retrograde endoscopic myotomy (REM) as a novel approach to perform myotomy of the proximal esophagus, with the application of a navigation tool for anatomical guidance during REM. We aim to evaluate the feasibility and safety of REM and usefulness of the navigation during REM.

METHOD

A 42-year-old male with type III achalasia who was treated with laparoscopic myotomy with fundoplication, multiple pneumatic balloon dilations, Botox injections and anterior POEM of the middle and distal esophagus without symptomatic effect. Repeated high-resolution- manometry (HRM) revealed occluding contractions of high amplitude around and above the aortic arch. A probe-based real-time electromagnetic navigation platform was used to facilitate real-time anatomical orientation and to evaluate myotomy position and length during REM.

RESULTS

The navigation system aided in identifying the major structures of the mediastinum, and position and length of the myotomy. Twelve weeks after REM, the Eckardt score fell from seven at baseline seven to two. We also observed improvement with reduction of the pressure at the level of previous spasms in the proximal esophagus from 124 mmHg to 8 mmHg on HRM.

CONCLUSION

REM makes the proximal esophagus accessible for endoscopic myotomy. Potential indication for REM is motility disorders in the proximal esophagus and therapy failure after POEM.

A new visualization method for navigated bronchoscopy

OBJECTIVE

In flexible endoscopy techniques, such as bronchoscopy, there is often a challenge visualizing the path from start to target based on preoperative data and accessing these during the procedure. An example of this is visualizing only the inside of central airways in bronchoscopy. Virtual bronchoscopy (VB) does not meet the pulmonologist's need to detect, define and sample the frequent targets outside the bronchial wall. Our aim was to develop and study a new visualization technique for navigated bronchoscopy.

MATERIAL AND METHODS

We extracted the shortest possible path from the top of the trachea to the target along the airway centerline and a corresponding auxiliary route in the opposite lung. A surface structure between the centerlines was developed and displayed. The new technique was tested on non-selective CT data from eight patients using artificial lung targets.

RESULTS

The new display technique anchored to centerline curved surface (ACCuSurf) made it easy to detect and interpret anatomical features, targets and neighboring anatomy outside the airways, in all eight patients.

CONCLUSIONS

ACCuSurf can simplify planning and performing navigated bronchoscopy, meets the challenge of improving orientation and register the direction of the moving endoscope, thus creating an optimal visualization for navigated bronchoscopy.

A multimodal image guiding system for Navigated Ultrasound Bronchoscopy (EBUS): A human feasibility study

BACKGROUND

Endobronchial ultrasound transbronchial needle aspiration (EBUS-TBNA) is the endoscopic method of choice for confirming lung cancer metastasis to mediastinal lymph nodes. Precision is crucial for correct staging and clinical decision-making. Navigation and multimodal imaging can potentially improve EBUS-TBNA efficiency.

AIMS

To demonstrate the feasibility of a multimodal image guiding system using electromagnetic navigation for ultrasound bronchoschopy in humans.

METHODS

Four patients referred for lung cancer diagnosis and staging with EBUS-TBNA were enrolled in the study. Target lymph nodes were predefined from the preoperative computed tomography (CT) images. A prototype convex probe ultrasound bronchoscope with an attached sensor for position tracking was used for EBUS-TBNA. Electromagnetic tracking of the ultrasound bronchoscope and ultrasound images allowed fusion of preoperative CT and intraoperative ultrasound in the navigation software. Navigated EBUS-TBNA was used to guide target lymph node localization and sampling. Navigation system accuracy was calculated, measured by the deviation between lymph node position in ultrasound and CT in three planes. Procedure time, diagnostic yield and adverse events were recorded.

RESULTS

Preoperative CT and real-time ultrasound images were successfully fused and displayed in the navigation software during the procedures. Overall navigation accuracy (11 measurements) was 10.0 ± 3.8 mm, maximum 17.6 mm, minimum 4.5 mm. An adequate sample was obtained in 6/6 (100%) of targeted lymph nodes. No adverse events were registered.

CONCLUSIONS

Electromagnetic navigated EBUS-TBNA was feasible, safe and easy in this human pilot study. The clinical usefulness was clearly demonstrated. Fusion of real-time ultrasound, preoperative CT and electromagnetic navigational bronchoscopy provided a controlled guiding to level of target, intraoperative overview and procedure documentation.

Airway Segmentation and Centerline Extraction from Thoracic CT - Comparison of a New Method to State of the Art Commercialized Methods

INTRODUCTION

Our motivation is increased bronchoscopic diagnostic yield and optimized preparation, for navigated bronchoscopy. In navigated bronchoscopy, virtual 3D airway visualization is often used to guide a bronchoscopic tool to peripheral lesions, synchronized with the real time video bronchoscopy. Visualization during navigated bronchoscopy, the segmentation time and methods, differs. Time consumption and logistics are two essential aspects that need to be optimized when integrating such technologies in the interventional room. We compared three different approaches to obtain airway centerlines and surface.

METHOD

CT lung dataset of 17 patients were processed in Mimics (Materialize, Leuven, Belgium), which provides a Basic module and a Pulmonology module (beta version) (MPM), OsiriX (Pixmeo, Geneva, Switzerland) and our Tube Segmentation Framework (TSF) method. Both MPM and TSF were evaluated with reference segmentation. Automatic and manual settings allowed us to segment the airways and obtain 3D models as well as the centrelines in all datasets. We compared the different procedures by user interactions such as number of clicks needed to process the data and quantitative measures concerning the quality of the segmentation and centrelines such as total length of the branches, number of branches, number of generations, and volume of the 3D model.

RESULTS

The TSF method was the most automatic, while the Mimics Pulmonology Module (MPM) and the Mimics Basic Module (MBM) resulted in the highest number of branches. MPM is the software which demands the least number of clicks to process the data. We found that the freely available OsiriX was less accurate compared to the other methods regarding segmentation results. However, the TSF method provided results fastest regarding number of clicks. The MPM was able to find the highest number of branches and generations. On the other hand, the TSF is fully automatic and it provides the user with both segmentation of the airways and the centerlines. Reference segmentation comparison averages and standard deviations for MPM and TSF correspond to literature.

CONCLUSION

The TSF is able to segment the airways and extract the centerlines in one single step. The number of branches found is lower for the TSF method than in Mimics. OsiriX demands the highest number of clicks to process the data, the segmentation is often sparse and extracting the centerline requires the use of another software system. Two of the software systems performed satisfactory with respect to be used in preprocessing CT images for navigated bronchoscopy, i.e. the TSF method and the MPM. According to reference segmentation both TSF and MPM are comparable with other segmentation methods. The level of automaticity and the resulting high number of branches plus the fact that both centerline and the surface of the airways were extracted, are requirements we considered particularly important. The in house method has the advantage of being an integrated part of a navigation platform for bronchoscopy, whilst the other methods can be considered preprocessing tools to a navigation system.

A novel platform for electromagnetic navigated ultrasound bronchoscopy (EBUS)

Purpose

Endobronchial ultrasound transbronchial needle aspiration (EBUS-TBNA) of mediastinal lymph nodes is essential for lung cancer staging and distinction between curative and palliative treatment. Precise sampling is crucial. Navigation and multimodal imaging may improve the efficiency of EBUS-TBNA. We demonstrate a novel EBUS-TBNA navigation system in a dedicated airway phantom.

Methods

Using a convex probe EBUS bronchoscope (CP-EBUS) with an integrated sensor for electromagnetic (EM) position tracking, we performed navigated CP-EBUS in a phantom. Preoperative computed tomography (CT) and real-time ultrasound (US) images were integrated into a navigation platform for EM navigated bronchoscopy. The coordinates of targets in CT and US volumes were registered in the navigation system, and the position deviation was calculated.

Results

The system visualized all tumor models and displayed their fused CT and US images in correct positions in the navigation system. Navigating the EBUS bronchoscope was fast and easy. Mean error observed between US and CT positions for 11 target lesions (37 measurements) was \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.8\pm 1.0$$\end{document}2.8±1.0 mm, maximum error was 5.9 mm.

Conclusion

The feasibility of our novel navigated CP-EBUS system was successfully demonstrated. An EBUS navigation system is needed to meet future requirements of precise mediastinal lymph node mapping, and provides new opportunities for procedure documentation in EBUS-TBNA.

CustusX: an open-source research platform for image-guided therapy

Purpose

CustusX is an image-guided therapy (IGT) research platform dedicated to intraoperative navigation and ultrasound imaging. In this paper, we present CustusX as a robust, accurate, and extensible platform with full access to data and algorithms and show examples of application in technological and clinical IGT research.

Methods

CustusX has been developed continuously for more than 15 years based on requirements from clinical and technological researchers within the framework of a well-defined software quality process. The platform was designed as a layered architecture with plugins based on the CTK/OSGi framework, a superbuild that manages dependencies and features supporting the IGT workflow. We describe the use of the system in several different clinical settings and characterize major aspects of the system such as accuracy, frame rate, and latency.

Results

The validation experiments show a navigation system accuracy of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$<$$\end{document}<1.1 mm, a frame rate of 20 fps, and latency of 285 ms for a typical setup. The current platform is extensible, user-friendly and has a streamlined architecture and quality process. CustusX has successfully been used for IGT research in neurosurgery, laparoscopic surgery, vascular surgery, and bronchoscopy.

Conclusions

CustusX is now a mature research platform for intraoperative navigation and ultrasound imaging and is ready for use by the IGT research community. CustusX is open-source and freely available at http://www.custusx.org.

Liver deformation in an animal model due to pneumoperitoneum assessed by a vessel-based deformable registration

PURPOSE

Surgical navigation based on preoperative images partly overcomes some of the drawbacks of minimally invasive interventions - reduction of free sight, lack of dexterity and tactile feedback. The usefulness of preoperative images is limited in laparoscopic liver surgery, as the liver shifts due to respiration, induction of pneumoperitoneum and surgical manipulation. In this study, we evaluated the shift and deformation in an animal liver caused by respiration and pneumopertioneum using intraoperative cone beam CT.

MATERIAL AND METHODS

3D cone beam CT scans were acquired with arterial contrast. The centerlines of the segmented vessels were extracted from the images taken at different respiration and pressure settings. A non-rigid registration method was used to measure the shift and deformation. The mean Euclidean distance between the annotated landmarks was used for evaluation.

RESULTS

A shift and deformation of 44.6 mm on average was introduced due to the combined effect of respiration and pneumoperitoneum. On average 91% of the deformations caused by the respiration and pneumoperitoneum were recovered.

CONCLUSION

The results can contribute to the use of intraoperative imaging to correct for anatomic shift so that preoperative data can be used with greater confidence and accuracy during guidance of laparoscopic liver procedures.