Segmentation and analysis of the human airway tree from three-dimensional X-ray CT images

Detail-sensitive 3D-UNet for pulmonary airway segmentation from CT images

The segmentation of airway from computed tomography (CT) images plays a vital role in pulmonary disease diagnosis, evaluation, surgical planning, and treatment. Nevertheless, it is still challenging for current methods to handle distal thin and low-contrast airways, leading to mis-segmentation issues. This paper proposes a detail-sensitive 3D-UNet (DS-3D-UNet) that incorporates two new modules into 3D-UNet to segment airways accurately from CT images. The feature recalibration module is designed to give more attention to the foreground airway features through a new attention mechanism. The detail extractor module aims to restore multi-scale detailed features by fusion of features at different levels. Extensive experiments were conducted on the ATM'22 challenge dataset composed of 300 CT scans with airway annotations to evaluate its performance. Quantitative comparisons prove that the proposed model achieves the best performance in terms of Dice similarity coefficient (92.6%) and Intersection over Union (86.3%), outperforming other state-of-the-art methods. Qualitative comparisons further exhibit the superior performance of our method in segmenting thin and confused distal bronchi. The proposed model could provide important references for the diagnosis and treatment of pulmonary diseases, holding promising prospects in the field of digital medicine. Codes are available at https://github.com/nighlevil/DS-3D-UNet/tree/master .

Hunting imaging biomarkers in pulmonary fibrosis: Benchmarks of the AIIB23 challenge

Airway-related quantitative imaging biomarkers are crucial for examination, diagnosis, and prognosis in pulmonary diseases. However, the manual delineation of airway structures remains prohibitively time-consuming. While significant efforts have been made towards enhancing automatic airway modelling, current public-available datasets predominantly concentrate on lung diseases with moderate morphological variations. The intricate honeycombing patterns present in the lung tissues of fibrotic lung disease patients exacerbate the challenges, often leading to various prediction errors. To address this issue, the 'Airway-Informed Quantitative CT Imaging Biomarker for Fibrotic Lung Disease 2023' (AIIB23) competition was organized in conjunction with the official 2023 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI). The airway structures were meticulously annotated by three experienced radiologists. Competitors were encouraged to develop automatic airway segmentation models with high robustness and generalization abilities, followed by exploring the most correlated QIB of mortality prediction. A training set of 120 high-resolution computerised tomography (HRCT) scans were publicly released with expert annotations and mortality status. The online validation set incorporated 52 HRCT scans from patients with fibrotic lung disease and the offline test set included 140 cases from fibrosis and COVID-19 patients. The results have shown that the capacity of extracting airway trees from patients with fibrotic lung disease could be enhanced by introducing voxel-wise weighted general union loss and continuity loss. In addition to the competitive image biomarkers for mortality prediction, a strong airway-derived biomarker (Hazard ratio>1.5, p < 0.0001) was revealed for survival prognostication compared with existing clinical measurements, clinician assessment and AI-based biomarkers.

A Precise Pulmonary Airway Tree Segmentation Method Using Quasi-Spherical Region Constraint and Tracheal Wall Gap Sealing

Accurate segmentation of the pulmonary airway tree is crucial for diagnosing lung diseases. To tackle the issues of low segmentation accuracy and frequent leaks in existing methods, this paper proposes a precise segmentation method using quasi-spherical region-constrained wavefront propagation with tracheal wall gap sealing. Based on the characteristic that the surface formed by seed points approximates the airway cross-section, the width of the unsegmented airway is calculated, determining the initial quasi-spherical constraint region. Using the wavefront propagation method, seed points are continuously propagated and segmented along the tracheal wall within the quasi-spherical constraint region, thus overcoming the need to determine complex segmentation directions. To seal tracheal wall gaps, a morphological closing operation is utilized to extract the characteristics of small holes and locate low-brightness tracheal wall gaps. By filling the CT values at these gaps, the method seals the tracheal wall gaps. Extensive experiments on the EXACT09 dataset demonstrate that our algorithm ranks third in segmentation completeness. Moreover, its performance in preventing airway leaks is significantly better than the top-two algorithms, effectively preventing large-scale leak-induced spread.

Fuzzy Attention Neural Network to Tackle Discontinuity in Airway Segmentation

Airway segmentation is crucial for the examination, diagnosis, and prognosis of lung diseases, while its manual delineation is unduly burdensome. To alleviate this time-consuming and potentially subjective manual procedure, researchers have proposed methods to automatically segment airways from computerized tomography (CT) images. However, some small-sized airway branches (e.g., bronchus and terminal bronchioles) significantly aggravate the difficulty of automatic segmentation by machine learning models. In particular, the variance of voxel values and the severe data imbalance in airway branches make the computational module prone to discontinuous and false-negative predictions, especially for cohorts with different lung diseases. The attention mechanism has shown the capacity to segment complex structures, while fuzzy logic can reduce the uncertainty in feature representations. Therefore, the integration of deep attention networks and fuzzy theory, given by the fuzzy attention layer, should be an escalated solution for better generalization and robustness. This article presents an efficient method for airway segmentation, comprising a novel fuzzy attention neural network (FANN) and a comprehensive loss function to enhance the spatial continuity of airway segmentation. The deep fuzzy set is formulated by a set of voxels in the feature map and a learnable Gaussian membership function. Different from the existing attention mechanism, the proposed channel-specific fuzzy attention addresses the issue of heterogeneous features in different channels. Furthermore, a novel evaluation metric is proposed to assess both the continuity and completeness of airway structures. The efficiency, generalization, and robustness of the proposed method have been proved by training on normal lung disease while testing on datasets of lung cancer, COVID-19, and pulmonary fibrosis.

An end-to-end multi-scale airway segmentation framework based on pulmonary CT image

Objective. Automatic and accurate airway segmentation is necessary for lung disease diagnosis. The complex tree-like structures leads to gaps in the different generations of the airway tree, and thus airway segmentation is also considered to be a multi-scale problem. In recent years, convolutional neural networks have facilitated the development of medical image segmentation. In particular, 2D CNNs and 3D CNNs can extract different scale features. Hence, we propose a two-stage and 2D + 3D framework for multi-scale airway tree segmentation.Approach. In stage 1, we use a 2D full airway SegNet(2D FA-SegNet) to segment the complete airway tree. Multi-scale atros spatial pyramid and Atros Residual Skip connection modules are inserted to extract different scales feature. We designed a hard sample selection strategy to increase the proportion of intrapulmonary airway samples in stage 2. 3D airway RefineNet (3D ARNet) as stage 2 takes the results of stage 1 asa prioriinformation. Spatial information extracted by 3D convolutional kernel compensates for the loss of in 2D FA-SegNet. Furthermore, we added false positive losses and false negative losses to improve the segmentation performance of airway branches within the lungs.Main results. We performed data enhancement on the publicly available dataset of ISICDM 2020 Challenge 3, and on which evaluated our method. Comprehensive experiments show that the proposed method has the highest dice similarity coefficient (DSC) of 0.931, and IoU of 0.871 for the whole airway tree and DSC of 0.699, and IoU of 0.543 for the intrapulmonary bronchi tree. In addition, 3D ARNet proposed in this paper cascaded with other state-of-the-art methods to increase detected tree length rate by up to 46.33% and detected tree branch rate by up to 42.97%.Significance. The quantitative and qualitative evaluation results show that our proposed method performs well in segmenting the airway at different scales.

Multi-site, Multi-domain Airway Tree Modeling

Open international challenges are becoming the de facto standard for assessing computer vision and image analysis algorithms. In recent years, new methods have extended the reach of pulmonary airway segmentation that is closer to the limit of image resolution. Since EXACT'09 pulmonary airway segmentation, limited effort has been directed to the quantitative comparison of newly emerged algorithms driven by the maturity of deep learning based approaches and extensive clinical efforts for resolving finer details of distal airways for early intervention of pulmonary diseases. Thus far, public annotated datasets are extremely limited, hindering the development of data-driven methods and detailed performance evaluation of new algorithms. To provide a benchmark for the medical imaging community, we organized the Multi-site, Multi-domain Airway Tree Modeling (ATM'22), which was held as an official challenge event during the MICCAI 2022 conference. ATM'22 provides large-scale CT scans with detailed pulmonary airway annotation, including 500 CT scans (300 for training, 50 for validation, and 150 for testing). The dataset was collected from different sites and it further included a portion of noisy COVID-19 CTs with ground-glass opacity and consolidation. Twenty-three teams participated in the entire phase of the challenge and the algorithms for the top ten teams are reviewed in this paper. Both quantitative and qualitative results revealed that deep learning models embedded with the topological continuity enhancement achieved superior performance in general. ATM'22 challenge holds as an open-call design, the training data and the gold standard evaluation are available upon successful registration via its homepage (https://atm22.grand-challenge.org/).

A Survey on Artificial Intelligence in Pulmonary Imaging

Over the last decade, deep learning (DL) has contributed a paradigm shift in computer vision and image recognition creating widespread opportunities of using artificial intelligence in research as well as industrial applications. DL has been extensively studied in medical imaging applications, including those related to pulmonary diseases. Chronic obstructive pulmonary disease, asthma, lung cancer, pneumonia, and, more recently, COVID-19 are common lung diseases affecting nearly 7.4% of world population. Pulmonary imaging has been widely investigated toward improving our understanding of disease etiologies and early diagnosis and assessment of disease progression and clinical outcomes. DL has been broadly applied to solve various pulmonary image processing challenges including classification, recognition, registration, and segmentation. This paper presents a survey of pulmonary diseases, roles of imaging in translational and clinical pulmonary research, and applications of different DL architectures and methods in pulmonary imaging with emphasis on DL-based segmentation of major pulmonary anatomies such as lung volumes, lung lobes, pulmonary vessels, and airways as well as thoracic musculoskeletal anatomies related to pulmonary diseases.

Adversarial Transformer for Repairing Human Airway Segmentation

Automated airway segmentation models often suffer from discontinuities in peripheral bronchioles, which limits their clinical applicability. Furthermore, data heterogeneity across different centres and pathological abnormalities pose significant challenges to achieving accurate and robust segmentation in distal small airways. Accurate segmentation of airway structures is essential for the diagnosis and prognosis of lung diseases. To address these issues, we propose a patch-scale adversarial-based refinement network that takes in preliminary segmentation and original CT images and outputs a refined mask of the airway structure. Our method is validated on three datasets, including healthy cases, pulmonary fibrosis, and COVID-19 cases, and quantitatively evaluated using seven metrics. Our method achieves more than a 15% increase in the detected length ratio and detected branch ratio compared to previously proposed models, demonstrating its promising performance. The visual results show that our refinement approach, guided by a patch-scale discriminator and centreline objective functions, effectively detects discontinuities and missing bronchioles. We also demonstrate the generalizability of our refinement pipeline on three previous models, significantly improving their segmentation completeness. Our method provides a robust and accurate airway segmentation tool that can help improve diagnosis and treatment planning for lung diseases.

Two-stage contextual transformer-based convolutional neural network for airway extraction from CT images

Accurate airway segmentation from computed tomography (CT) images is critical for planning navigation bronchoscopy and realizing a quantitative assessment of airway-related chronic obstructive pulmonary disease (COPD). Existing methods face difficulty in airway segmentation, particularly for the small branches of the airway. These difficulties arise due to the constraints of limited labeling and failure to meet clinical use requirements in COPD. We propose a two-stage framework with a novel 3D contextual transformer for segmenting the overall airway and small airway branches using CT images. The method consists of two training stages sharing the same modified 3D U-Net network. The novel 3D contextual transformer block is integrated into both the encoder and decoder path of the network to effectively capture contextual and long-range information. In the first training stage, the proposed network segments the overall airway with the overall airway mask. To improve the performance of the segmentation result, we generate the intrapulmonary airway branch label, and train the network to focus on producing small airway branches in the second training stage. Extensive experiments were performed on in-house and multiple public datasets. Quantitative and qualitative analyses demonstrate that our proposed method extracts significantly more branches and longer lengths of the airway tree while accomplishing state-of-the-art airway segmentation performance. The code is available at https://github.com/zhaozsq/airway_segmentation.

A Deep Attention-based U-Net for Airways Segmentation in Computed Tomography Images

BACKGROUND

Airway segmentation is a way to quantify the diagnosis of pulmonary diseases, including chronic obstructive problems and bronchiectasis. Manual analysis by radiologists is a challenging task due to the complex airway structure. Additionally, tree-like patterns, varied shapes, sizes, and intensity make the manual airway segmentation task more complex. Deeper airways are even more difficult to segment as their intensity starts matching the lung parenchyma as the diameter of the airway cross-section gets reduced.

OBJECTIVE

Many earlier works have proposed different deep learning networks for airway segmentation but were unable to achieve the desired performance; hence the task of airway segmentation still possesses challenges in this field.

METHODS

This work proposes a convolutional neural network based on deep U-Net architecture and employs an attention block technique for airway segmentation. The attention mechanism aids in the extraction of the complicated and multi-sized airways found in the lung region, hence increasing the efficiency of the U-Net architecture.

RESULTS

The model has been validated using VESSEL12 and EXACT09 datasets, individually and combined, with and without trachea images. The best DSC scores on EXACT09 and VESSEL12 datasets are 95.21% and 95.80%, respectively. The performance on both datasets combined gave a DSC score of 94.1%, showing that the overall performance of the proposed methodology is quite satisfactory. The generalizability of the model is also confirmed using k-fold cross-validation. The comparison of the proposed model to existing research on airway segmentation found competitive results.

CONCLUSION

The use of an attention unit in the proposed model highlights the relevant information and reduces the irrelevant features, which helps to improve the performance and saves time.

Human treelike tubular structure segmentation: A comprehensive review and future perspectives

Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales. Examples of such structures are intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large collections of 2D and 3D images have been made available by medical imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), Optical coherence tomography (OCT) and ultrasound in which the spatial arrangement can be observed. Segmentation of these structures in medical imaging is of great importance since the analysis of the structure provides insights into disease diagnosis, treatment planning, and prognosis. Manually labelling extensive data by radiologists is often time-consuming and error-prone. As a result, automated or semi-automated computational models have become a popular research field of medical imaging in the past two decades, and many have been developed to date. In this survey, we aim to provide a comprehensive review of currently publicly available datasets, segmentation algorithms, and evaluation metrics. In addition, current challenges and future research directions are discussed.

Artificial Intelligence in Lung Imaging

Recently, interest and advances in artificial intelligence (AI) including deep learning for medical images have surged. As imaging plays a major role in the assessment of pulmonary diseases, various AI algorithms have been developed for chest imaging. Some of these have been approved by governments and are now commercially available in the marketplace. In the field of chest radiology, there are various tasks and purposes that are suitable for AI: initial evaluation/triage of certain diseases, detection and diagnosis, quantitative assessment of disease severity and monitoring, and prediction for decision support. While AI is a powerful technology that can be applied to medical imaging and is expected to improve our current clinical practice, some obstacles must be addressed for the successful implementation of AI in workflows. Understanding and becoming familiar with the current status and potential clinical applications of AI in chest imaging, as well as remaining challenges, would be essential for radiologists and clinicians in the era of AI. This review introduces the potential clinical applications of AI in chest imaging and also discusses the challenges for the implementation of AI in daily clinical practice and future directions in chest imaging.

Towards understanding respiratory particle transport and deposition in the human respiratory system: Effects of physiological conditions and particle properties

Fly ash is a common solid residue of incineration plants and poses a great environmental concern because of its toxicity upon inhalation exposure. The inhalation health impacts of fly ash is closely related to its transport and deposition in the human respiratory system which warrants significant research for health guideline setting and inhalation exposure protection. In this study, a series of fly ash transport and deposition experiments have been carried out in a bifurcation airway model by optical aerosol sampling analysis. Three types of fly ash samples of different morphologies were tested and their respiratory deposition and transport processes were compared. The deposition efficiencies were calculated and relevant transport dynamics mechanisms were discussed. The influences of physiological conditions such as breathing rate, duration, and fly ash physical properties (size, morphology, and specific surface area) were investigated. The deposition characteristics of respiratory particles containing SARS-CoV-2 has also been analyzed, which could further provide some guidance on COVID-19 prevention. The results could potentially serve as a basis for setting health guidelines and recommending personal respiratory protective equipment for fly ash handlers and people who are in the high exposure risk environment for COVID-19 transmission.

LTSP: long-term slice propagation for accurate airway segmentation

Purpose:

Bronchoscopic intervention is a widely used clinical technique for pulmonary diseases, which requires an accurate and topological complete airway map for its localization and guidance. The airway map could be extracted from chest computed tomography (CT) scans automatically by airway segmentation methods. Due to the complex tree-like structure of the airway, preserving its topology completeness while maintaining the segmentation accuracy is a challenging task.

Methods:

In this paper, a long-term slice propagation (LTSP) method is proposed for accurate airway segmentation from pathological CT scans. We also design a two-stage end-to-end segmentation framework utilizing the LTSP method in the decoding process. Stage 1 is used to generate a coarse feature map by an encoder–decoder architecture. Stage 2 is to adopt the proposed LTSP method for exploiting the continuity information and enhancing the weak airway features in the coarse feature map. The final segmentation result is predicted from the refined feature map.

Results:

Extensive experiments were conducted to evaluate the performance of the proposed method on 70 clinical CT scans. The results demonstrate the considerable improvements of the proposed method compared to some state-of-the-art methods as most breakages are eliminated and more tiny bronchi are detected. The ablation studies further confirm the effectiveness of the constituents of the proposed method and the efficacy of the framework design.

Conclusion:

Slice continuity information is beneficial to accurate airway segmentation. Furthermore, by propagating the long-term slice feature, the airway topology connectivity is preserved with overall segmentation accuracy maintained.

Effect of patient inhalation profile and airway structure on drug deposition in image-based models with particle-particle interactions

For many of the one billion sufferers of respiratory diseases worldwide, managing their disease with inhalers improves their ability to breathe. Poor disease management and rising pollution can trigger exacerbations that require urgent relief. Higher drug deposition in the throat instead of the lungs limits the impact on patient symptoms. To optimise delivery to the lung, patient-specific computational studies of aerosol inhalation can be used. However in many studies, inhalation modelling does not represent situations when the breathing is impaired, such as in recovery from an exacerbation, where the patient's inhalation is much faster and shorter. Here we compare differences in deposition of inhaler particles (10, 4 μm) in the airways of three patients. We aimed to evaluate deposition differences between healthy and impaired breathing with image-based healthy and diseased patient models. We found that the ratio of drug in the lower to upper lobes was 35% larger with a healthy inhalation. For smaller particles the upper airway deposition was similar in all patients, but local deposition hotspots differed in size, location and intensity. Our results identify that image-based airways must be used in respiratory modelling. Various inhalation profiles should be tested for optimal prediction of inhaler deposition.

Quantitative computed tomography imaging-based classification of cement dust-exposed subjects with an artificial neural network technique

BACKGROUND AND OBJECTIVE

Cement dust exposure is likely to affect the structural and functional alterations in segmental airways and parenchymal lungs. This study develops an artificial neural network (ANN) model for identifying cement dust-exposed (CDE) subjects using quantitative computed tomography-based airway structural and functional features.

METHODS

We obtained the airway features in five central and five sub-grouped segmental regions and the lung features in five lobar regions and one total lung region from 311 CDE and 298 non-CDE (NCDE) subjects. The five-fold cross-validation method was adopted to train the following classification models:ANN, support vector machine (SVM), logistic regression (LR), and decision tree (DT). For all the classification models, linear discriminant analysis (LDA) and genetic algorithm (GA) were applied for dimensional reduction and hyperparameterization, respectively. The ANN model without LDA was also optimized by the GA method to observe the effect of the dimensional reduction.

RESULTS

The genetically optimized ANN model without the LDA method was the best in terms of the classification accuracy. The accuracy, sensitivity, and specificity of the GA-ANN model with four layers were greater than those of the other classification models (i.e., ANN, SVM, LR, and DT using LDA and GA methods) in the five-fold cross-validation. The average values of accuracy, sensitivity, and specificity for the five-fold cross-validation were 97.0%, 98.7%, and 98.6%, respectively.

CONCLUSIONS

We demonstrated herein that a quantitative computed tomography-based ANN model could more effectively detect CDE subjects when compared to their counterpart models. By employing the model, the CDE subjects may be identified early for therapeutic intervention.

High-quality chest CT segmentation to assess the impact of COVID-19 disease

Purpose

COVID-19 has spread rapidly worldwide since its initial appearance, creating the need for faster diagnostic methods and tools. Due to the high rate of false-negative RT-PCR tests, the role of chest CT examination has been investigated as an auxiliary procedure. The main goal of this work is to establish a well-defined strategy for 3D segmentation of the airways and lungs of COVID-19 positive patients from CT scans, including detected abnormalities. Their identification and the volumetric quantification could allow an easier classification in terms of gravity, extent and progression of the infection. Moreover, these 3D reconstructions can provide a high-impact tool to enhance awareness of the severity of COVID-19 pneumonia.

Methods

Segmentation process was performed utilizing a proprietary software, starting from six different stacks of chest CT images of subjects with and without COVID-19. In this context, a comparison between manual and automatic segmentation methods of the respiratory system was conducted, to assess the potential value of both techniques, in terms of time consumption, required anatomical knowledge and branch detection, in healthy and pathological conditions.

Results

High-quality 3D models were obtained. They can be utilized to assess the impact of the pathology, by volumetrically quantifying the extension of the affected areas. Indeed, based on the obtained reconstructions, an attempted classification for each patient in terms of the severity of the COVID-19 infection has been outlined.

Conclusions

Automatic algorithms allowed for a substantial reduction in segmentation time. However, a great effort was required for the manual identification of COVID-19 CT manifestations. The developed automated procedure succeeded in obtaining sufficiently accurate models of the airways and the lungs of both healthy patients and subjects with confirmed COVID-19, in a reasonable time.

Development of length standard phantom for length measurement correction in x-ray image

Specific tissue lengths or volumes in x-ray images are measured for diagnostic and therapeutic purposes. Measurements are used to make clinical decisions; however, the accuracy of these measurements has not been studied. In this study, based on the sources of uncertainty, an SI-traceable length standard phantom and an x-ray imaging system calibration method are proposed. The uncertainty in the length of the fabricated standard phantom is determined using a toolmaker's microscope. The sources of uncertainty in an x-ray imaging system, such as magnification, pixel-to-millimeter unit conversion, and penumbra effect, are considered, and the lengths of the phantom before and after imaging system calibration were compared. The maximum deviation of length measurements with and without calibration is (-0.11 ± 0.10) and (-3.37 ± 0.15) mm (k = 2, 95% level of confidence), respectively. The proposed phantom and calibration method can be used for calibrating x-ray images and obtaining their length correction values. Furthermore, length correction values are expected to be useful for diagnosis and treatment planning, where precise length measurements are essential.

Demarcation of arteriopulmonary segments: a novel and effective method for the identification of pulmonary segments

Objective

Each pulmonary segment is an anatomical and functional unit. However, it is fundamentally difficult to precisely distinguish every pulmonary segment using the conventional pulmonary intersegmental planes from computed tomography images. Building arteriopulmonary segments is likely to be an effective way to identify pulmonary segments.

Methods

The thoracic computed tomography images of 40 patients were collected. The anatomic structures of interest were extracted in the transverse, sagittal, and coronal planes using the semi-automated segmentation tools provided by Amira software. The intrapulmonary vessels were subsequently segmented and reconstructed. The distributions of the pulmonary arteries, veins, and bronchi were observed. In patients with pulmonary masses, the mass was also reconstructed.

Results

The three-dimensional reconstructed images showed the branches of the pulmonary artery ramified up to their eighth order covering the entire lung as well as evident intersegmental gaps without pulmonary arteries. The segmental artery was closely accompanied by the segmental bronchi in 486 pulmonary segments (90% of total number of segments). The size and spatial location of the pulmonary mass within a pulmonary segment were also clearly visible.

Conclusions

Demarcation of arteriopulmonary segments can be used to precisely distinguish every pulmonary segment and provide its detailed anatomical structure before pulmonary segmentectomy.

Backward Planning for a Multi-Stage Steerable Needle Lung Robot

Lung cancer is one of the deadliest types of cancer, and early diagnosis is crucial for successful treatment. Definitively diagnosing lung cancer typically requires biopsy, but current approaches either carry a high procedural risk for the patient or are incapable of reaching many sites of clinical interest in the lung. We present a new sampling-based planning method for a steerable needle lung robot that has the potential to accurately reach targets in most regions of the lung. The robot comprises three stages: a transorally deployed bronchoscope, a sharpened piercing tube (to pierce into the lung parenchyma from the airways), and a steerable needle able to navigate to the target. Planning for the sequential deployment of all three stages under health safety concerns is a challenging task, as each stage depends on the previous one. We introduce a new backward planning approach that starts at the target and advances backwards toward the airways with the goal of finding a piercing site reachable by the bronchoscope. This new strategy enables faster performance by iteratively building a single search tree during the entire computation period, whereas previous forward approaches have relied on repeating this expensive tree construction process many times. Additionally, our method further reduces runtime by employing biased sampling and sample rejection based on geometric constraints. We evaluate this approach using simulation-based studies in anatomical lung models. We demonstrate in comparison with existing techniques that the new approach (i) is more likely to find a path to a target, (ii) is more efficient by reaching targets more than 5 times faster on average, and (iii) arrives at lower-risk paths in shorter time.

Automatic airway tree segmentation based on multi-scale context information

PURPOSE

Airway tree segmentation plays a pivotal role in chest computed tomography (CT) analysis tasks such as lesion localization, surgical planning, and intra-operative guidance. The remaining challenge is to identify small bronchi correctly, which facilitates further segmentation of the pulmonary anatomies.

METHODS

A three-dimensional (3D) multi-scale feature aggregation network (MFA-Net) is proposed against the scale difference of substructures in airway tree segmentation. In this model, the multi-scale feature aggregation (MFA) block is used to capture the multi-scale context information, which improves the sensitivity of the small bronchi segmentation and addresses the local discontinuities. Meanwhile, the concept of airway tree partition is introduced to evaluate the segmentation performance at a more granular level.

RESULTS

Experiments were conducted on a dataset of 250 CT scans, which were annotated by experienced clinical radiologists. Through the airway partition, we evaluated the segmentation results of the small bronchi compared with the state-of-the-art methods. Experiments show that MFA-Net achieves the best performance in the Dice similarity coefficient (DSC) in the intra-lobar airway and improves the true positive rate (TPR) by 7.59% on average. Besides, in the entire airway, the proposed method achieves the best results in DSC and TPR scores of 86.18% and 79.31%, respectively, with the consequence of higher false positives.

CONCLUSION

The MFA-Net is competitive with the state-of-the-art methods. The experiment results indicate that the MFA block improves the performance of the network by utilizing multi-scale context information. More accurate segmentation results will be more helpful in further clinical analysis.

Artificial intelligence in radiology

The interest in artificial intelligence (AI) has ballooned within radiology in the past few years primarily due to notable successes of deep learning. With the advances brought by deep learning, AI has the potential to recognize and localize complex patterns from different radiological imaging modalities, many of which even achieve comparable performance to human decision-making in recent applications. In this chapter, we review several AI applications in radiology for different anatomies: chest, abdomen, pelvis, as well as general lesion detection/identification that is not limited to specific anatomies. For each anatomy site, we focus on introducing the tasks of detection, segmentation, and classification with an emphasis on describing the technology development pathway with the aim of providing the reader with an understanding of what AI can do in radiology and what still needs to be done for AI to better fit in radiology. Combining with our own research experience of AI in medicine, we elaborate how AI can enrich knowledge discovery, understanding, and decision-making in radiology, rather than replacing the radiologist.

A CT-Based Automated Algorithm for Airway Segmentation Using Freeze-and-Grow Propagation and Deep Learning

Chronic obstructive pulmonary disease (COPD) is a common lung disease, and quantitative CT-based bronchial phenotypes are of increasing interest as a means of exploring COPD sub-phenotypes, establishing disease progression, and evaluating intervention outcomes. Reliable, fully automated, and accurate segmentation of pulmonary airway trees is critical to such exploration. We present a novel approach of multi-parametric freeze-and-grow (FG) propagation which starts with a conservative segmentation parameter and captures finer details through iterative parameter relaxation. First, a CT intensity-based FG algorithm is developed and applied for airway tree segmentation. A more efficient version is produced using deep learning methods generating airway lumen likelihood maps from CT images, which are input to the FG algorithm. Both CT intensity- and deep learning-based algorithms are fully automated, and their performance, in terms of repeat scan reproducibility, accuracy, and leakages, is evaluated and compared with results from several state-of-the-art methods including an industry-standard one, where segmentation results were manually reviewed and corrected. Both new algorithms show a reproducibility of 95% or higher for total lung capacity (TLC) repeat CT scans. Experiments on TLC CT scans from different imaging sites at standard and low radiation dosages show that both new algorithms outperform the other methods in terms of leakages and branch-level accuracy. Considering the performance and execution times, the deep learning-based FG algorithm is a fully automated option for large multi-site studies.

Hybrid Airway Segmentation Using Multi-Scale Tubular Structure Filters and Texture Analysis on 3D Chest CT Scans

Airway diseases are frequently related to morphological changes that may influence lung physiology. Accurate airway region segmentation may be useful for quantitative evaluation of disease prognosis and therapy efficacy. The information can also be applied to understand the fundamental mechanisms of various lung diseases. We present a hybrid method to automatically segment the airway regions on 3D volume chest computed tomography (CT) scans. This method uses multi-scale filtering and support vector machine (SVM) classification. The proposed scheme is comprised of two hybrid steps. First, a tubular structure-based multi-scale filter is applied to find the initial candidate airway regions. Second, for identifying candidate airway regions using the fuzzy connectedness technique, the small and disconnected branches of airway regions are detected using SVM classification trained to differentiate between airway and non-airway regions through texture analysis of user-defined landmark points. For development and evaluation of the method, two datasets were incorporated: (1) 55 lung-CT volumes from the Korean Obstructive Lung Disease (KOLD) Cohort Study and (2) 20 cases from the publicly open database (EXACT'09). The average tree-length detection rates of EXACT'09 and KOLD were 56.9 ± 11.0 and 70.5 ± 8.98, respectively. Comparison of the results for the EXACT'09 data set between the presented method and other methods revealed that our approach was a high performer. The method limitations were higher false-positive rates than those of the other methods and risk of leakage. In future studies, application of a convolutional neural network will help overcome these shortcomings.

Region growing algorithm combined with morphology and skeleton analysis for segmenting airway tree in CT images

BACKGROUND

Automatic segmentation of pulmonary airway tree is a challenging task in many clinical applications, including developing computer-aided detection and diagnosis schemes of lung diseases.

OBJECTIVE

To segment the pulmonary airway tree from the computed tomography (CT) chest images using a novel automatic method proposed in this study.

METHODS

This method combines a two-pass region growing algorithm with gray-scale morphological reconstruction and leakage elimination. The first-pass region growing is implemented to obtain a rough airway tree. The second-pass region growing and gray-scale morphological reconstruction are used to detect the distal airways. Finally, leakage detection is performed to remove leakage and refine the airway tree.

RESULTS

Our methods were compared with the gold standards. Forty-five clinical CT lung image scan cases were used in the experiments. Statistics on tree division order, branch number, and airway length were adopted for evaluation. The proposed method detected up to 12 generations of bronchi. On average, 148.85 branches were extracted with a false positive rate of 0.75%.

CONCLUSIONS

The results show that our method is accurate for pulmonary airway tree segmentation. The strategy of separating the leakage detection from the segmenting process is feasible and promising for ensuring a high branch detected rate with a low leakage volume.

Assessing pulmonary hypertension in COPD. Is there a role for computed tomography?

Pulmonary hypertension (PH) is a common complication of chronic obstructive pulmonary disease (COPD) and is associated with increased morbidity and mortality. Reference standard method to diagnose PH is right heart catheterization. Several non-invasive imaging techniques have been employed in the detection of PH. Among them, computed tomography (CT) is the most commonly used for phenotyping and detecting complications of COPD. Several CT findings have also been described in patients with severe PH. Nevertheless, CT analysis is currently based on visual findings which can lead to reproducibility failure. Therefore, there is a need for quantification in order to assess objective criteria. In this review, progresses in automated analyses of CT parameters and their values in predicting PH and COPD outcomes are presented.

Safe Motion Planning for Steerable Needles Using Cost Maps Automatically Extracted from Pulmonary Images

Lung cancer is the deadliest form of cancer, and early diagnosis is critical to favorable survival rates. Definitive diagnosis of lung cancer typically requires needle biopsy. Common lung nodule biopsy approaches either carry significant risk or are incapable of accessing large regions of the lung, such as in the periphery. Deploying a steerable needle from a bronchoscope and steering through the lung allows for safe biopsy while improving the accessibility of lung nodules in the lung periphery. In this work, we present a method for extracting a cost map automatically from pulmonary CT images, and utilizing the cost map to efficiently plan safe motions for a steerable needle through the lung. The cost map encodes obstacles that should be avoided, such as the lung pleura, bronchial tubes, and large blood vessels, and additionally formulates a cost for the rest of the lung which corresponds to an approximate likelihood that a blood vessel exists at each location in the anatomy. We then present a motion planning approach that utilizes the cost map to generate paths that minimize accumulated cost while safely reaching a goal location in the lung.

Small airway segmentation in thoracic computed tomography scans: a machine learning approach

Small airway obstruction is a main cause for chronic obstructive pulmonary disease (COPD). We propose a novel method based on machine learning to extract the airway system from a thoracic computed tomography (CT) scan. The emphasis of the proposed method is on including the smallest airways that are still visible on CT. We used an optimized sampling procedure to extract airway and non-airway voxel samples from a large set of scans for which a semi-automatically constructed reference standard was available. We created a set of features which represent tubular and texture properties that are characteristic for small airway voxels. A random forest classifier was used to determine for each voxel if it belongs to the airway class. Our method was validated on a set of 20 clinical thoracic CT scans from the COPDGene study. Experiments show that our method is effective in extracting the full airway system and in detecting a large number of small airways that were missed by the semi-automatically constructed reference standard.

The Direct Oblique Method: A New Gold Standard for Bronchoscopic Navigation That is Superior to Automatic Methods

BACKGROUND

The purpose of this study was to identify bronchi on computed tomographic (CT) images, manual analysis is more accurate than automatic methods. Nonetheless, manual bronchoscopic navigation is not preferred as it involves mentally reconstructing a route to a bronchial target by interpreting 2-dimensional CT images. Here, we established the direct oblique method (DOM), a form of manual bronchoscopic navigation that does not necessitate mental reconstruction, and compared it with automatic virtual bronchoscopic navigation (VBN).

METHODS

Routes were calculated to 47 identical targets using 2 automatic VBNs (LungPoint and VINCENT-BFsim) and the DOM, using 3 general application CT viewers (Aquarius, Synapse Vincent, and OsiriX). Results of all analyses were compared.

RESULTS

The DOM drew routes to more targets than the VBNs [94% (the DOM on any viewer) vs. 49% (LungPoint) vs. 62% (VINCENT-BFsim), P<0.0001]. For the 44 targets with the CT-bronchus or CT-artery signs, 100% of the DOM routes led to targets. In the bronchoscopic simulation phase, the DOM covered 100% of the bifurcations identified on CT, whereas some bifurcations were skipped and some bronchial walls appeared partially transparent in the VBNs. Manual analysis identified more bronchi near the targets than the VBNs [32.1±3.4 (manual analysis) vs.18.9±2.1 (LungPoint) vs. 22.9±2.7 (VINCENT-BFsim), mean±SEM, P<0.0001]. The DOM took around 5 minutes on average.

CONCLUSION

On the basis of precise manual CT analysis using general application CT viewers, the DOM drew routes leading to more targets and provided better bronchoscopic simulation than the automatic route calculation of the VBNs.

Comparison of Manual and Automated Measurements of Tracheobronchial Airway Geometry in Three Balb/c Mice

Mammalian lungs are comprised of large numbers of tracheobronchial airways that transition from the trachea to alveoli. Studies as wide ranging as pollutant deposition and lung development rely on accurate characterization of these airways. Advancements in CT imaging and the value of computational approaches in eliminating the burden of manual measurement are providing increased efficiency in obtaining this geometric data. In this study, we compare an automated method to a manual one for the first six generations of three Balb/c mouse lungs. We find good agreement between manual and automated methods and that much of the disagreement can be attributed to method precision. Using the automated method, we then provide anatomical data for the entire tracheobronchial airway tree from three Balb/C mice. Anat Rec, 2017. © 2017 Wiley Periodicals, Inc. Anat Rec, 300:2046-2057, 2017. © 2017 Wiley Periodicals, Inc.

Anatomy-based algorithm for automatic segmentation of human diaphragm in noncontrast computed tomography images

In-depth understanding of the diaphragm's anatomy and physiology has been of great interest to the medical community, as it is the most important muscle of the respiratory system. While noncontrast four-dimensional (4-D) computed tomography (CT) imaging provides an interesting opportunity for effective acquisition of anatomical and/or functional information from a single modality, segmenting the diaphragm in such images is very challenging not only because of the diaphragm's lack of image contrast with its surrounding organs but also because of respiration-induced motion artifacts in 4-D CT images. To account for such limitations, we present an automatic segmentation algorithm, which is based on a priori knowledge of diaphragm anatomy. The novelty of the algorithm lies in using the diaphragm's easy-to-segment contacting organs-including the lungs, heart, aorta, and ribcage-to guide the diaphragm's segmentation. Obtained results indicate that average mean distance to the closest point between diaphragms segmented using the proposed technique and corresponding manual segmentation is [Formula: see text], which is favorable. An important feature of the proposed technique is that it is the first algorithm to delineate the entire diaphragm. Such delineation facilitates applications, where the diaphragm boundary conditions are required such as biomechanical modeling for in-depth understanding of the diaphragm physiology.

Automatic multiorgan segmentation in CT images of the male pelvis using region-specific hierarchical appearance cluster models

PURPOSE

Accurate segmentation of pelvic organs in CT images is of great importance in external beam radiotherapy for prostate cancer. The aim of this studying is to develop a novel method for automatic, multiorgan segmentation of the male pelvis.

METHODS

The authors' segmentation method consists of several stages. First, a pretreatment includes parameterization, principal component analysis (PCA), and an established process of region-specific hierarchical appearance cluster (RSHAC) model which was executed on the training dataset. After the preprocessing, online automatic segmentation of new CT images is achieved by combining the RSHAC model with the PCA-based point distribution model. Fifty pelvic CT from eight prostate cancer patients were used as the training dataset. From another 20 prostate cancer patients, 210 CT images were used for independent validation of the segmentation method.

RESULTS

In the training dataset, 15 PCA modes were needed to represent 95% of shape variations of pelvic organs. When tested on the validation dataset, the authors' segmentation method had an average Dice similarity coefficient and mean absolute distance of 0.751 and 0.371 cm, 0.783 and 0.303 cm, 0.573 and 0.604 cm for prostate, bladder, and rectum, respectively. The automated segmentation process took on average 5 min on a personal computer equipped with Core 2 Duo CPU of 2.8 GHz and 8 GB RAM.

CONCLUSIONS

The authors have developed an efficient and reliable method for automatic segmentation of multiple organs in the male pelvis. This method should be useful for treatment planning and adaptive replanning for prostate cancer radiotherapy. With this method, the physicist can improve the work efficiency and stability.

Automatic determination of lung features of CF patients in CT scans

This paper describes a prototype of an automatic system for the detection and evaluation of Cystic fibrosis features (CF) in High resolution computed tomography (HRCT) Scans. The aim of this study lies in presenting this system as a decision support tool for radiologists in future. The CF features that have been detected and evaluated are Bronchiectasis and Mucus Plugging. This system recognizes Bronchiectasis as the presence of enlarged airways in pulmonary CF-CT slices whereas, Mucus Plugging has been recognized as clusters of high attenuation pixels. The dataset of this study consists of HRCT Scans of five CF patients of varying disease stages. Mean percentages of these CF features that were computed for each intercostal space, starting from the first to the fifth, fairly accurately match the different stages of the disease.

Developmental model of an automatic production of the human bronchial tree based on L-system

BACKGROUND AND OBJECTIVE

The human lungs exchange air with the external environment via the conducting airways. The application of an anatomically accurate model of the conducting airways can be helpful for simulating gas exchange and fluid distribution throughout the bronchial tree in the lung.

METHODS

In the current study, Lindenmayer system (L-system) has been formulated to generate the bronchial tree structure in a human lung. It has been considered that the structure of the bronchial tree is divided into two main segments: 1) The central airways (from the trachea to segmental bronchi) and 2) the dichotomous structure (from segmental bronchi to terminal bronchioles). Two sets of parametric rewriting rules which can be used to develop central and peripheral airways have been proposed; the first set used to develop central airways consists of seven rules, while the second rule set contains four rules.

RESULTS

The proposed model is capable of generating bronchial tree inside the volume of the host lung; and comparison of the resulting model with those reported in the literature shows that the morphometric characteristics of L-system structure are in good agreement with their corresponding experimental data.

CONCLUSION

The resulting model can be used to obtain a mathematical model required for the study of transport phenomena occurring in the lung during respiration.

Computer-aided pulmonary image analysis in small animal models

PURPOSE

To develop an automated pulmonary image analysis framework for infectious lung diseases in small animal models.

METHODS

The authors describe a novel pathological lung and airway segmentation method for small animals. The proposed framework includes identification of abnormal imaging patterns pertaining to infectious lung diseases. First, the authors' system estimates an expected lung volume by utilizing a regression function between total lung capacity and approximated rib cage volume. A significant difference between the expected lung volume and the initial lung segmentation indicates the presence of severe pathology, and invokes a machine learning based abnormal imaging pattern detection system next. The final stage of the proposed framework is the automatic extraction of airway tree for which new affinity relationships within the fuzzy connectedness image segmentation framework are proposed by combining Hessian and gray-scale morphological reconstruction filters.

RESULTS

133 CT scans were collected from four different studies encompassing a wide spectrum of pulmonary abnormalities pertaining to two commonly used small animal models (ferret and rabbit). Sensitivity and specificity were greater than 90% for pathological lung segmentation (average dice similarity coefficient > 0.9). While qualitative visual assessments of airway tree extraction were performed by the participating expert radiologists, for quantitative evaluation the authors validated the proposed airway extraction method by using publicly available EXACT'09 data set.

CONCLUSIONS

The authors developed a comprehensive computer-aided pulmonary image analysis framework for preclinical research applications. The proposed framework consists of automatic pathological lung segmentation and accurate airway tree extraction. The framework has high sensitivity and specificity; therefore, it can contribute advances in preclinical research in pulmonary diseases.

Airway Segmentation and Centerline Extraction from Thoracic CT - Comparison of a New Method to State of the Art Commercialized Methods

INTRODUCTION

Our motivation is increased bronchoscopic diagnostic yield and optimized preparation, for navigated bronchoscopy. In navigated bronchoscopy, virtual 3D airway visualization is often used to guide a bronchoscopic tool to peripheral lesions, synchronized with the real time video bronchoscopy. Visualization during navigated bronchoscopy, the segmentation time and methods, differs. Time consumption and logistics are two essential aspects that need to be optimized when integrating such technologies in the interventional room. We compared three different approaches to obtain airway centerlines and surface.

METHOD

CT lung dataset of 17 patients were processed in Mimics (Materialize, Leuven, Belgium), which provides a Basic module and a Pulmonology module (beta version) (MPM), OsiriX (Pixmeo, Geneva, Switzerland) and our Tube Segmentation Framework (TSF) method. Both MPM and TSF were evaluated with reference segmentation. Automatic and manual settings allowed us to segment the airways and obtain 3D models as well as the centrelines in all datasets. We compared the different procedures by user interactions such as number of clicks needed to process the data and quantitative measures concerning the quality of the segmentation and centrelines such as total length of the branches, number of branches, number of generations, and volume of the 3D model.

RESULTS

The TSF method was the most automatic, while the Mimics Pulmonology Module (MPM) and the Mimics Basic Module (MBM) resulted in the highest number of branches. MPM is the software which demands the least number of clicks to process the data. We found that the freely available OsiriX was less accurate compared to the other methods regarding segmentation results. However, the TSF method provided results fastest regarding number of clicks. The MPM was able to find the highest number of branches and generations. On the other hand, the TSF is fully automatic and it provides the user with both segmentation of the airways and the centerlines. Reference segmentation comparison averages and standard deviations for MPM and TSF correspond to literature.

CONCLUSION

The TSF is able to segment the airways and extract the centerlines in one single step. The number of branches found is lower for the TSF method than in Mimics. OsiriX demands the highest number of clicks to process the data, the segmentation is often sparse and extracting the centerline requires the use of another software system. Two of the software systems performed satisfactory with respect to be used in preprocessing CT images for navigated bronchoscopy, i.e. the TSF method and the MPM. According to reference segmentation both TSF and MPM are comparable with other segmentation methods. The level of automaticity and the resulting high number of branches plus the fact that both centerline and the surface of the airways were extracted, are requirements we considered particularly important. The in house method has the advantage of being an integrated part of a navigation platform for bronchoscopy, whilst the other methods can be considered preprocessing tools to a navigation system.

Automated continuous quantitative measurement of proximal airways on dynamic ventilation CT: initial experience using an ex vivo porcine lung phantom

Background

The purpose of this study was to evaluate the feasibility of continuous quantitative measurement of the proximal airways, using dynamic ventilation computed tomography (CT) and our research software.

Methods

A porcine lung that was removed during meat processing was ventilated inside a chest phantom by a negative pressure cylinder (eight times per minute). This chest phantom with imitated respiratory movement was scanned by a 320-row area-detector CT scanner for approximately 9 seconds as dynamic ventilatory scanning. Obtained volume data were reconstructed every 0.35 seconds (total 8.4 seconds with 24 frames) as three-dimensional images and stored in our research software. The software automatically traced a designated airway point in all frames and measured the cross-sectional luminal area and wall area percent (WA%). The cross-sectional luminal area and WA% of the trachea and right main bronchus (RMB) were measured for this study. Two radiologists evaluated the traceability of all measurable airway points of the trachea and RMB using a three-point scale.

Results

It was judged that the software satisfactorily traced airway points throughout the dynamic ventilation CT (mean score, 2.64 at the trachea and 2.84 at the RMB). From the maximum inspiratory frame to the maximum expiratory frame, the cross-sectional luminal area of the trachea decreased 17.7% and that of the RMB 29.0%, whereas the WA% of the trachea increased 6.6% and that of the RMB 11.1%.

Conclusion

It is feasible to measure airway dimensions automatically at designated points on dynamic ventilation CT using research software. This technique can be applied to various airway and obstructive diseases.

Automatic Pharynx Segmentation from MRI Data for Analysis of Sleep Related Disorders

In our project, we analyse throat structures using magnetic resonance imaging (MRI) to associate anatomic risk factors with sleep related disorders. Pharynx segmentation is the first step in the three-dimensional analysis of throat tissues.

We present a pipeline for automatic pharynx segmentation. The automatic part of the approach consists of three steps: smoothing, thresholding, 2D and 3D connected component analysis. Whereas two first steps are rather common, the third step provides a set of general rules for the automatic extraction of the pharyngeal component. Our method requires less than one minute to extract the pharyngeal structures. The approach is evaluated quantitatively on 30 data sets using region-based and edge-based measures.

A "loop" shape descriptor and its application to automated segmentation of airways from CT scans

PURPOSE

A novel shape descriptor is presented to aid an automated identification of the airways depicted on computed tomography (CT) images.

METHODS

Instead of simplifying the tubular characteristic of the airways as an ideal mathematical cylindrical or circular shape, the proposed "loop" shape descriptor exploits the fact that the cross sections of any tubular structure (regardless of its regularity) always appear as a loop. In implementation, the authors first reconstruct the anatomical structures in volumetric CT as a three-dimensional surface model using the classical marching cubes algorithm. Then, the loop descriptor is applied to locate the airways with a concave loop cross section. To deal with the variation of the airway walls in density as depicted on CT images, a multiple threshold strategy is proposed. A publicly available chest CT database consisting of 20 CT scans, which was designed specifically for evaluating an airway segmentation algorithm, was used for quantitative performance assessment. Measures, including length, branch count, and generations, were computed under the aid of a skeletonization operation.

RESULTS

For the test dataset, the airway length ranged from 64.6 to 429.8 cm, the generation ranged from 7 to 11, and the branch number ranged from 48 to 312. These results were comparable to the performance of the state-of-the-art algorithms validated on the same dataset.

CONCLUSIONS

The authors' quantitative experiment demonstrated the feasibility and reliability of the developed shape descriptor in identifying lung airways.

A hybrid method for airway segmentation and automated measurement of bronchial wall thickness on CT

Inflammatory and infectious lung diseases commonly involve bronchial airway structures and morphology, and these abnormalities are often analyzed non-invasively through high resolution computed tomography (CT) scans. Assessing airway wall surfaces and the lumen are of great importance for diagnosing pulmonary diseases. However, obtaining high accuracy from a complete 3-D airway tree structure can be quite challenging. The airway tree structure has spiculated shapes with multiple branches and bifurcation points as opposed to solid single organ or tumor segmentation tasks in other applications, hence, it is complex for manual segmentation as compared with other tasks. For computerized methods, a fundamental challenge in airway tree segmentation is the highly variable intensity levels in the lumen area, which often causes a segmentation method to leak into adjacent lung parenchyma through blurred airway walls or soft boundaries. Moreover, outer wall definition can be difficult due to similar intensities of the airway walls and nearby structures such as vessels. In this paper, we propose a computational framework to accurately quantify airways through (i) a novel hybrid approach for precise segmentation of the lumen, and (ii) two novel methods (a spatially constrained Markov random walk method (pseudo 3-D) and a relative fuzzy connectedness method (3-D)) to estimate the airway wall thickness. We evaluate the performance of our proposed methods in comparison with mostly used algorithms using human chest CT images. Our results demonstrate that, on publicly available data sets and using standard evaluation criteria, the proposed airway segmentation method is accurate and efficient as compared with the state-of-the-art methods, and the airway wall estimation algorithms identified the inner and outer airway surfaces more accurately than the most widely applied methods, namely full width at half maximum and phase congruency.

Graph-Based Airway Tree Reconstruction From Chest CT Scans: Evaluation of Different Features on Five Cohorts

We present a graph-based framework for airway tree reconstruction from computerized tomography (CT) scans and evaluate the performance of different feature categories and their combinations on five lung cohorts. The approach consists of two main processing steps. First, potential airway branch and connection candidates are identified and represented by a graph structure with weighted nodes and edges, respectively. Second, an optimization algorithm is utilized for generating an airway detection result by selecting a subset of airway branches and connections based on graph weights derived from image features. The performance of the algorithm with different feature categories and their combinations was assessed on a set of 50 lung CT scans from five different cohorts, including normal and diseased lungs. Results show trade-offs between feature categories/combinations in terms of correctly (true positive) and incorrectly (false positive) identified airways. Also, the performance of features in dependence of lung cohort was analyzed. Across all cohorts, a good trade-off with high true positive rate (TPR) and low false positive rate (FPR) was achieved by a combination of gray-value, local shape, and structural features. This combination enabled extracting 91.80% of reference airways (TPR) in combination with a low FPR of 1.00%. In addition, this variant was evaluated on the public EXACT'09 test set, and a comparison with other airway detection approaches is provided. One of the main advantages of the presented method is that it is robust against local disturbances/artifacts or other ambiguities that are frequently occurring in lung CT scans.

Review of automatic pulmonary lobe segmentation methods from CT

The computational detection of pulmonary lobes from CT images is a challenging segmentation problem with important respiratory health care applications, including surgical planning and regional image analysis. Several authors have proposed automated algorithms and we present a methodological review. These algorithms share a number of common stages and we consider each stage in turn, comparing the methods applied by each author and discussing their relative strengths. No standard method has yet emerged and none of the published methods have been demonstrated across a full range of clinical pathologies and imaging protocols. We discuss how improved methods could be developed by combining different approaches, and we use this to propose a workflow for the development of new algorithms.

Automatic segmentation of anatomical structures from CT scans of thorax for RTP

Modern radiotherapy techniques are vulnerable to delineation inaccuracies owing to the steep dose gradient around the target. In this aspect, accurate contouring comprises an indispensable part of optimal radiation treatment planning (RTP). We suggest a fully automated method to segment the lungs, trachea/main bronchi, and spinal canal accurately from computed tomography (CT) scans of patients with lung cancer to use for RTP. For this purpose, we developed a new algorithm for inclusion of excluded pathological areas into the segmented lungs and a modified version of the fuzzy segmentation by morphological reconstruction for spinal canal segmentation and implemented some image processing algorithms along with them. To assess the accuracy, we performed two comparisons between the automatically obtained results and the results obtained manually by an expert. The average volume overlap ratio values range between 94.30 ± 3.93% and 99.11 ± 0.26% on the two different datasets. We obtained the average symmetric surface distance values between the ranges of 0.28 ± 0.21 mm and 0.89 ± 0.32 mm by using the same datasets. Our method provides favorable results in the segmentation of CT scans of patients with lung cancer and can avoid heavy computational load and might offer expedited segmentation that can be used in RTP.

Computer-aided detection and quantification of cavitary tuberculosis from CT scans

PURPOSE

To present a computer-aided detection tool for identifying, quantifying, and evaluating tuberculosis (TB) cavities in the infected lungs from computed tomography (CT) scans.

METHODS

The authors' proposed method is based on a novel shape-based automated detection algorithm on CT scans followed by a fuzzy connectedness (FC) delineation procedure. In order to assess interaction between cavities and airways, the authors first roughly identified air-filled structures (airway, cavities, esophagus, etc.) by thresholding over Hounsfield unit of CT image. Then, airway and cavity structure detection was conducted within the support vector machine classification algorithm. Once airway and cavities were detected automatically, the authors extracted airway tree using a hybrid multiscale approach based on novel affinity relations within the FC framework and segmented cavities using intensity-based FC algorithm. At final step, the authors refined airway structures within the local regions of FC with finer control. Cavity segmentation results were compared to the reference truths provided by expert radiologists and cavity formation was tracked longitudinally from serial CT scans through shape and volume information automatically determined through the authors' proposed system. Morphological evolution of the cavitary TB were analyzed accordingly with this process. Finally, the authors computed the minimum distance between cavity surface and nearby airway structures by using the linear time distance transform algorithm to explore potential role of airways in cavity formation and morphological evolution.

RESULTS

The proposed methodology was qualitatively and quantitatively evaluated on pulmonary CT images of rabbits experimentally infected with TB, and multiple markers such as cavity volume, cavity surface area, minimum distance from cavity surface to the nearest bronchial-tree, and longitudinal change of these markers (namely, morphological evolution of cavities) were determined precisely. While accuracy of the authors' cavity detection algorithm was 94.61%, airway detection part of the proposed methodology showed even higher performance by 99.8%. Dice similarity coefficients for cavitary segmentation experiments were found to be approximately 99.0% with respect to the reference truths provided by two expert radiologists (blinded to their evaluations). Moreover, the authors noted that volume derived from the authors' segmentation method was highly correlated with those provided by the expert radiologists (R(2) = 0.99757 and R(2) = 0.99496, p < 0.001, with respect to the observer 1 and observer 2) with an interobserver agreement of 98%. The authors quantitatively confirmed that cavity formation was positioned by the nearby bronchial-tree after exploring the respective spatial positions based on the minimum distance measurement. In terms of efficiency, the core algorithms take less than 2 min on a linux machine with 3.47 GHz CPU and 24 GB memory.

CONCLUSION

The authors presented a fully automatic method for cavitary TB detection, quantification, and evaluation. The performance of every step of the algorithm was qualitatively and quantitatively assessed. With the proposed method, airways and cavities were automatically detected and subsequently delineated in high accuracy with heightened efficiency. Furthermore, not only morphological information of cavities were obtained through the authors' proposed framework, but their spatial relation to airways, and longitudinal analysis was also provided to get further insight on cavity formation in tuberculosis disease. To the authors' best of knowledge, this is the first study in computerized analysis of cavitary tuberculosis from CT scans.

A hybrid approach to segmentation of diseased lung lobes

Complete segmentation of diseased lung lobes by automatically identifying fissure surfaces is a nontrivial task, due to incomplete, disrupted, and deformed fissures. In this paper, we present a novel algorithm employing a hybrid two-dimensional/three-dimensional approach for segmenting diseased lung lobes. Our approach models complete fissure surfaces from partial fissures found in individual computed tomography (CT) images. Evaluated using 24 patients' lungs with a variety of different diseases, our algorithm produced root-mean square errors of 2.21 ± 1.21, 2.51 ± 1.36, and 2.38 ± 1.27 mm for segmenting the left oblique fissure (LOF), right oblique fissure (ROF) and right horizontal fissure (RHF), respectively. The average accuracies for segmenting the LOF, ROF, and RHF are 86.59%, 84.80%, and 82.62%, using our ±3-mm percentile measure. These results indicate the feasibility of developing an automatic algorithm for complete segmentation of diseased lung lobes.

Spatially constrained random walk approach for accurate estimation of airway wall surfaces

Assessing airway wall surfaces and the lumen from high resolution computed tomography (CT) scans are of great importance for diagnosing pulmonary diseases. However, accurately determining inner and outer airway wall surfaces of a complete 3-D tree structure can be quite challenging because of its complex nature. In this paper, we introduce a computational framework to accurately quantify airways through (i) a precise segmentation of the lumen, and (ii) a spatially constrained Markov random walk method to estimate the airway walls. Our results demonstrate that the proposed airway analysis platform identified the inner and outer airway surfaces better than methods commonly used in clinics, such as full width at half maximum and phase congruency.

Automated segmentation of pulmonary structures in thoracic computed tomography scans: a review

Computed tomography (CT) is the modality of choice for imaging the lungs in vivo. Sub-millimeter isotropic images of the lungs can be obtained within seconds, allowing the detection of small lesions and detailed analysis of disease processes. The high resolution of thoracic CT and the high prevalence of lung diseases require a high degree of automation in the analysis pipeline. The automated segmentation of pulmonary structures in thoracic CT has been an important research topic for over a decade now. This systematic review provides an overview of current literature. We discuss segmentation methods for the lungs, the pulmonary vasculature, the airways, including airway tree construction and airway wall segmentation, the fissures, the lobes and the pulmonary segments. For each topic, the current state of the art is summarized, and topics for future research are identified.