Automatic definition of the central-chest lymph-node stations

Efficient procedure planning for comprehensive lymph node staging bronchoscopy

Purpose: For a patient at risk of having lung cancer, accurate disease staging is vital as it dictates disease prognosis and treatment. Accurate staging requires a comprehensive sampling of lymph nodes within the chest via bronchoscopy. Unfortunately, physicians are generally unable to plan and perform sufficiently comprehensive procedures to ensure accurate disease staging. We propose a method for planning comprehensive lymph node staging procedures. Approach: Drawing on a patient's chest CT scan, the method derives a multi-destination tour for efficient navigation to a set of lymph nodes. We formulate the planning task as a traveling salesman problem. To solve the problem, we apply the concept of ant colony optimization (ACO) to derive an efficient airway tour connecting the target nodes. The method has three main steps: (1) CT preprocessing, to define important chest anatomy; (2) graph and staging zone construction, to set up the necessary data structures and clinical constraints; and (3) tour computation, to derive the staging plan. The plan conforms to the world standard International Association for the Study of Lung Cancer (IASLC) lymph node map and recommended clinical staging guidelines. Results: Tests with a patient database indicate that the method derives optimal or near-optimal tours in under a few seconds, regardless of the number of target lymph nodes (mean tour length = 1.4% longer than the optimum). A brute force optimal search, on the other hand, generally cannot reach a solution in under 10 min. for patients exhibiting > 16 nodes, and other methods provide poor solutions. We also demonstrate the method's utility in an image-guided bronchoscopy system. Conclusions: The method provides an efficient computational approach for planning a comprehensive lymph node staging bronchoscopy. In addition, the method shows promise for driving an image-guided bronchoscopy system or robotics-assisted bronchoscopy system tailored to lymph node staging.

Multimodal Registration for Image-Guided EBUS Bronchoscopy

The state-of-the-art procedure for examining the lymph nodes in a lung cancer patient involves using an endobronchial ultrasound (EBUS) bronchoscope. The EBUS bronchoscope integrates two modalities into one device: (1) videobronchoscopy, which gives video images of the airway walls; and (2) convex-probe EBUS, which gives 2D fan-shaped views of extraluminal structures situated outside the airways. During the procedure, the physician first employs videobronchoscopy to navigate the device through the airways. Next, upon reaching a given node’s approximate vicinity, the physician probes the airway walls using EBUS to localize the node. Due to the fact that lymph nodes lie beyond the airways, EBUS is essential for confirming a node’s location. Unfortunately, it is well-documented that EBUS is difficult to use. In addition, while new image-guided bronchoscopy systems provide effective guidance for videobronchoscopic navigation, they offer no assistance for guiding EBUS localization. We propose a method for registering a patient’s chest CT scan to live surgical EBUS views, thereby facilitating accurate image-guided EBUS bronchoscopy. The method entails an optimization process that registers CT-based virtual EBUS views to live EBUS probe views. Results using lung cancer patient data show that the method correctly registered 28/28 (100%) lymph nodes scanned by EBUS, with a mean registration time of 3.4 s. In addition, the mean position and direction errors of registered sites were 2.2 mm and 11.8∘, respectively. In addition, sensitivity studies show the method’s robustness to parameter variations. Lastly, we demonstrate the method’s use in an image-guided system designed for guiding both phases of EBUS bronchoscopy.

Automated mapping and N-Staging of thoracic lymph nodes in contrast-enhanced CT scans of the chest using a fully convolutional neural network

PURPOSE

To develop a deep-learning (DL)-based approach for thoracic lymph node (LN) mapping based on their anatomical location.

METHOD

The training-and validation-dataset included 89 contrast-enhanced computed tomography (CT) scans of the chest. 4201 LNs were semi-automatically segmented and then assigned to LN levels according to their anatomical location. The LN level classification task was addressed by a multi-class segmentation procedure using a fully convolutional neural network. Mapping was performed by firstly determining potential level affiliation for each voxel and then performing majority voting over all voxels belonging to each LN. Mean classification accuracies on the validation data were calculated separately for each level and overall Top-1, Top-2 and Top-3 scores were determined, where a Top-X score describes how often the annotated class was within the top-X predictions. To demonstrate the clinical applicability of our model, we tested its N-staging capabilities in a simulated clinical use case scenario assuming a patient diseased with lung cancer.

RESULTS

The artificial intelligence(AI)-based assignment revealed mean classification accuracies of 86.36 % (Top-1), 94.48 % (Top-2) and 96.10 % (Top-3). Best accuracies were achieved for LNs in the subcarinal level 7 (98.31 %) and axillary region (98.74 %). The highest misclassification rates were observed among LNs in adjacent levels. The proof-of-principle application in a simulated clinical use case scenario for automated tumor N-staging showed a mean classification accuracy of up to 96.14 % (Top-1).

CONCLUSIONS

The proposed AI approach for automatic classification of LN levels in chest CT as well as the proof-of-principle-experiment for automatic N-staging, revealed promising results, warranting large-scale validation for clinical application.

Mediastinal lymph node detection and station mapping on chest CT using spatial priors and random forest

PURPOSE

To develop an automated system for mediastinal lymph node detection and station mapping for chest CT.

METHODS

The contextual organs, trachea, lungs, and spine are first automatically identified to locate the region of interest (ROI) (mediastinum). The authors employ shape features derived from Hessian analysis, local object scale, and circular transformation that are computed per voxel in the ROI. Eight more anatomical structures are simultaneously segmented by multiatlas label fusion. Spatial priors are defined as the relative multidimensional distance vectors corresponding to each structure. Intensity, shape, and spatial prior features are integrated and parsed by a random forest classifier for lymph node detection. The detected candidates are then segmented by the following curve evolution process. Texture features are computed on the segmented lymph nodes and a support vector machine committee is used for final classification. For lymph node station labeling, based on the segmentation results of the above anatomical structures, the textual definitions of mediastinal lymph node map according to the International Association for the Study of Lung Cancer are converted into patient-specific color-coded CT image, where the lymph node station can be automatically assigned for each detected node.

RESULTS

The chest CT volumes from 70 patients with 316 enlarged mediastinal lymph nodes are used for validation. For lymph node detection, their system achieves 88% sensitivity at eight false positives per patient. For lymph node station labeling, 84.5% of lymph nodes are correctly assigned to their stations.

CONCLUSIONS

Multiple-channel shape, intensity, and spatial prior features aggregated by a random forest classifier improve mediastinal lymph node detection on chest CT. Using the location information of segmented anatomic structures from the multiatlas formulation enables accurate identification of lymph node stations.

Thoracic cavity definition for 3D PET/CT analysis and visualization

X-ray computed tomography (CT) and positron emission tomography (PET) serve as the standard imaging modalities for lung-cancer management. CT gives anatomical details on diagnostic regions of interest (ROIs), while PET gives highly specific functional information. During the lung-cancer management process, a patient receives a co-registered whole-body PET/CT scan pair and a dedicated high-resolution chest CT scan. With these data, multimodal PET/CT ROI information can be gleaned to facilitate disease management. Effective image segmentation of the thoracic cavity, however, is needed to focus attention on the central chest. We present an automatic method for thoracic cavity segmentation from 3D CT scans. We then demonstrate how the method facilitates 3D ROI localization and visualization in patient multimodal imaging studies. Our segmentation method draws upon digital topological and morphological operations, active-contour analysis, and key organ landmarks. Using a large patient database, the method showed high agreement to ground-truth regions, with a mean coverage=99.2% and leakage=0.52%. Furthermore, it enabled extremely fast computation. For PET/CT lesion analysis, the segmentation method reduced ROI search space by 97.7% for a whole-body scan, or nearly 3 times greater than that achieved by a lung mask. Despite this reduction, we achieved 100% true-positive ROI detection, while also reducing the false-positive (FP) detection rate by >5 times over that achieved with a lung mask. Finally, the method greatly improved PET/CT visualization by eliminating false PET-avid obscurations arising from the heart, bones, and liver. In particular, PET MIP views and fused PET/CT renderings depicted unprecedented clarity of the lesions and neighboring anatomical structures truly relevant to lung-cancer assessment.

Text mining and medicine: usefulness in respiratory diseases

It is increasingly common to have medical information in electronic format. This includes scientific articles as well as clinical management reviews, and even records from health institutions with patient data. However, traditional instruments, both individual and institutional, are of little use for selecting the most appropriate information in each case, either in the clinical or research field. So-called text or data «mining» enables this huge amount of information to be managed, extracting it from various sources using processing systems (filtration and curation), integrating it and permitting the generation of new knowledge. This review aims to provide an overview of text and data mining, and of the potential usefulness of this bioinformatic technique in the exercise of care in respiratory medicine and in research in the same field.

Optimal procedure planning and guidance system for peripheral bronchoscopy

With the development of multidetector computed-tomography (MDCT) scanners and ultrathin bronchoscopes, the use of bronchoscopy for diagnosing peripheral lung-cancer nodules is becoming a viable option. The work flow for assessing lung cancer consists of two phases: 1) 3-D MDCT analysis and 2) live bronchoscopy. Unfortunately, the yield rates for peripheral bronchoscopy have been reported to be as low as 14%, and bronchoscopy performance varies considerably between physicians. Recently, proposed image-guided systems have shown promise for assisting with peripheral bronchoscopy. Yet, MDCT-based route planning to target sites has relied on tedious error-prone techniques. In addition, route planning tends not to incorporate known anatomical, device, and procedural constraints that impact a feasible route. Finally, existing systems do not effectively integrate MDCT-derived route information into the live guidance process. We propose a system that incorporates an automatic optimal route-planning method, which integrates known route constraints. Furthermore, our system offers a natural translation of the MDCT-based route plan into the live guidance strategy via MDCT/video data fusion. An image-based study demonstrates the route-planning method's functionality. Next, we present a prospective lung-cancer patient study in which our system achieved a successful navigation rate of 91% to target sites. Furthermore, when compared to a competing commercial system, our system enabled bronchoscopy over two airways deeper into the airway-tree periphery with a sample time that was nearly 2 min shorter on average. Finally, our system's ability to almost perfectly predict the depth of a bronchoscope's navigable route in advance represents a substantial benefit of optimal route planning.

A robust semi-automatic approach for ROI segmentation in 3D CT images

In CT-based clinical applications, segmentation of regions of interest (ROIs) is a preliminary but vital step. The task is, however, quite challenging, especially for 3D objects, because suspicious ROIs are usually soft-tissue structures, which include a various organs and anatomical objects while sharing a small intensity dynamic range in CT images. Furthermore, the ROIs usually vary significantly in size, shape, and boundary conditions. Among considerable efforts contributed to addressing the problem, live wire, also known as intelligent scissors, has been recognized as an efficient and robust tool for dealing with a wide range of 2D ROIs. Such an approach provides full user control during the process while minimizing human interaction to optimally counterbalance automatic and manual approaches. In this work, we improve our previous live-wire-based segmentation of 3D objects and the experiment results show its efficiency and robustness.

Segmentation of the central-chest lymph nodes in 3D MDCT images

Central-chest lymph nodes play a vital role in lung-cancer staging. The definition of lymph nodes from three-dimensional (3D) multidetector computed-tomography (MDCT) images, however, remains an open problem. We propose two methods for computer-based segmentation of the central-chest lymph nodes from a 3D MDCT scan: the single-section live wire and the single-click live wire. For the single-section live wire, the user first applies the standard live wire to a single two-dimensional (2D) section after which automated analysis completes the segmentation process. The single-click live wire is similar but is almost completely automatic. Ground-truth studies involving human 3D MDCT scans demonstrate the robustness, efficiency, and intra-observer and inter-observer reproducibility of the methods.