Real-time bronchoscope three-dimensional motion estimation using multiple sensor-driven alignment of CT images and electromagnetic measurements

Endobronchial Ultrasound Image Simulation for Image-Guided Bronchoscopy

BACKGROUND/OBJECTIVE

Accurate disease diagnosis and staging are essential for patients suspected of having lung cancer. The state-of-the-art minimally invasive tools used by physicians to perform these operations are bronchoscopy, for navigating the lung airways, and endobronchial ultrasound (EBUS), for localizing suspect extraluminal cancer lesions. While new image-guided systems enable accurate bronchoscope navigation close to a lesion, no means exists for guiding the final EBUS localization of an extraluminal lesion. We propose an EBUS simulation method to assist with EBUS localization.

METHODS

The method draws on a patient's chest computed-tomography (CT) scan to model the ultrasound signal propagation through the tissue media. The method, which is suitable for simulating EBUS images for both radial-probe and convex-probe EBUS devices, entails three steps: 1) image preprocessing, which generates a 2D CT equivalent of the EBUS scan plane; 2) EBUS scan-line computation, which models ultrasound transmission to map the CT plane into a preliminary simulated EBUS image; and 3) image post-processing, which increases realism by introducing simulated EBUS imaging effects and artifacts.

RESULTS

Results show that the method produces simulated EBUS images that strongly resemble images generated live by a real device and compares favorably to an existing ultrasound simulation method. It also produces images at a rate greater than real time (i.e., 53 frames/sec). We also demonstrate a successful integration of the method into an image-guided EBUS bronchoscopy system.

CONCLUSION/SIGNIFICANCE

The method is effective and practical for procedure planning/preview and follow-on live guidance of EBUS bronchoscopy.

Efficient procedure planning for comprehensive lymph node staging bronchoscopy

Purpose: For a patient at risk of having lung cancer, accurate disease staging is vital as it dictates disease prognosis and treatment. Accurate staging requires a comprehensive sampling of lymph nodes within the chest via bronchoscopy. Unfortunately, physicians are generally unable to plan and perform sufficiently comprehensive procedures to ensure accurate disease staging. We propose a method for planning comprehensive lymph node staging procedures. Approach: Drawing on a patient's chest CT scan, the method derives a multi-destination tour for efficient navigation to a set of lymph nodes. We formulate the planning task as a traveling salesman problem. To solve the problem, we apply the concept of ant colony optimization (ACO) to derive an efficient airway tour connecting the target nodes. The method has three main steps: (1) CT preprocessing, to define important chest anatomy; (2) graph and staging zone construction, to set up the necessary data structures and clinical constraints; and (3) tour computation, to derive the staging plan. The plan conforms to the world standard International Association for the Study of Lung Cancer (IASLC) lymph node map and recommended clinical staging guidelines. Results: Tests with a patient database indicate that the method derives optimal or near-optimal tours in under a few seconds, regardless of the number of target lymph nodes (mean tour length = 1.4% longer than the optimum). A brute force optimal search, on the other hand, generally cannot reach a solution in under 10 min. for patients exhibiting > 16 nodes, and other methods provide poor solutions. We also demonstrate the method's utility in an image-guided bronchoscopy system. Conclusions: The method provides an efficient computational approach for planning a comprehensive lymph node staging bronchoscopy. In addition, the method shows promise for driving an image-guided bronchoscopy system or robotics-assisted bronchoscopy system tailored to lymph node staging.

Advanced Endoscopic Navigation: Surgical Big Data, Methodology, and Applications

Interventional endoscopy (e.g., bronchoscopy, colonoscopy, laparoscopy, cystoscopy) is a widely performed procedure that involves either diagnosis of suspicious lesions or guidance for minimally invasive surgery in a variety of organs within the body cavity. Endoscopy may also be used to guide the introduction of certain items (e.g., stents) into the body. Endoscopic navigation systems seek to integrate big data with multimodal information (e.g., computed tomography, magnetic resonance images, endoscopic video sequences, ultrasound images, external trackers) relative to the patient's anatomy, control the movement of medical endoscopes and surgical tools, and guide the surgeon's actions during endoscopic interventions. Nevertheless, it remains challenging to realize the next generation of context-aware navigated endoscopy. This review presents a broad survey of various aspects of endoscopic navigation, particularly with respect to the development of endoscopic navigation techniques. First, we investigate big data with multimodal information involved in endoscopic navigation. Next, we focus on numerous methodologies used for endoscopic navigation. We then review different endoscopic procedures in clinical applications. Finally, we discuss novel techniques and promising directions for the development of endoscopic navigation.