1
|
Guo J, Fu R, Pan L, Zheng S, Huang L, Zheng B, He B. Coarse-to-fine airway segmentation using multi information fusion network and CNN-based region growing. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 215:106610. [PMID: 35077902 DOI: 10.1016/j.cmpb.2021.106610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 12/03/2021] [Accepted: 12/26/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVES Automatic airway segmentation from chest computed tomography (CT) scans plays an important role in pulmonary disease diagnosis and computer-assisted therapy. However, low contrast at peripheral branches and complex tree-like structures remain as two mainly challenges for airway segmentation. Recent research has illustrated that deep learning methods perform well in segmentation tasks. Motivated by these works, a coarse-to-fine segmentation framework is proposed to obtain a complete airway tree. METHODS Our framework segments the overall airway and small branches via the multi-information fusion convolution neural network (Mif-CNN) and the CNN-based region growing, respectively. In Mif-CNN, atrous spatial pyramid pooling (ASPP) is integrated into a u-shaped network, and it can expend the receptive field and capture multi-scale information. Meanwhile, boundary and location information are incorporated into semantic information. These information are fused to help Mif-CNN utilize additional context knowledge and useful features. To improve the performance of the segmentation result, the CNN-based region growing method is designed to focus on obtaining small branches. A voxel classification network (VCN), which can entirely capture the rich information around each voxel, is applied to classify the voxels into airway and non-airway. In addition, a shape reconstruction method is used to refine the airway tree. RESULTS We evaluate our method on a private dataset and a public dataset from EXACT09. Compared with the segmentation results from other methods, our method demonstrated promising accuracy in complete airway tree segmentation. In the private dataset, the Dice similarity coefficient (DSC), Intersection over Union (IoU), false positive rate (FPR), and sensitivity are 93.5%, 87.8%, 0.015%, and 90.8%, respectively. In the public dataset, the DSC, IoU, FPR, and sensitivity are 95.8%, 91.9%, 0.053% and 96.6%, respectively. CONCLUSION The proposed Mif-CNN and CNN-based region growing method segment the airway tree accurately and efficiently in CT scans. Experimental results also demonstrate that the framework is ready for application in computer-aided diagnosis systems for lung disease and other related works.
Collapse
Affiliation(s)
- Jinquan Guo
- School of Mechanical engineering and Automation, Fuzhou University, Fuzhou 350108, China
| | - Rongda Fu
- School of Mechanical engineering and Automation, Fuzhou University, Fuzhou 350108, China
| | - Lin Pan
- School of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, China
| | - Shaohua Zheng
- School of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, China
| | - Liqin Huang
- School of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, China
| | - Bin Zheng
- Thoracic Department, Fujian Medical University Union Hospital, China.
| | - Bingwei He
- School of Mechanical engineering and Automation, Fuzhou University, Fuzhou 350108, China.
| |
Collapse
|
2
|
Bertolini M, Brambilla A, Dallasta S, Colombo G. High-quality chest CT segmentation to assess the impact of COVID-19 disease. Int J Comput Assist Radiol Surg 2021; 16:1737-1747. [PMID: 34357524 PMCID: PMC8343216 DOI: 10.1007/s11548-021-02466-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 07/15/2021] [Indexed: 12/24/2022]
Abstract
Purpose COVID-19 has spread rapidly worldwide since its initial appearance, creating the need for faster diagnostic methods and tools. Due to the high rate of false-negative RT-PCR tests, the role of chest CT examination has been investigated as an auxiliary procedure. The main goal of this work is to establish a well-defined strategy for 3D segmentation of the airways and lungs of COVID-19 positive patients from CT scans, including detected abnormalities. Their identification and the volumetric quantification could allow an easier classification in terms of gravity, extent and progression of the infection. Moreover, these 3D reconstructions can provide a high-impact tool to enhance awareness of the severity of COVID-19 pneumonia. Methods Segmentation process was performed utilizing a proprietary software, starting from six different stacks of chest CT images of subjects with and without COVID-19. In this context, a comparison between manual and automatic segmentation methods of the respiratory system was conducted, to assess the potential value of both techniques, in terms of time consumption, required anatomical knowledge and branch detection, in healthy and pathological conditions. Results High-quality 3D models were obtained. They can be utilized to assess the impact of the pathology, by volumetrically quantifying the extension of the affected areas. Indeed, based on the obtained reconstructions, an attempted classification for each patient in terms of the severity of the COVID-19 infection has been outlined. Conclusions Automatic algorithms allowed for a substantial reduction in segmentation time. However, a great effort was required for the manual identification of COVID-19 CT manifestations. The developed automated procedure succeeded in obtaining sufficiently accurate models of the airways and the lungs of both healthy patients and subjects with confirmed COVID-19, in a reasonable time.
Collapse
Affiliation(s)
- Michele Bertolini
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy.
| | - Alma Brambilla
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy
| | - Samanta Dallasta
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy
| | - Giorgio Colombo
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy
| |
Collapse
|
3
|
Wollatz L, Johnston SJ, Lackie PM, Cox SJ. 3D Histopathology-a Lung Tissue Segmentation Workflow for Microfocus X-ray-Computed Tomography Scans. J Digit Imaging 2018; 30:772-781. [PMID: 28342044 PMCID: PMC5681467 DOI: 10.1007/s10278-017-9966-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Lung histopathology is currently based on the analysis of 2D sections of tissue samples. The use of microfocus X-ray-computed tomography imaging of unstained soft tissue can provide high-resolution 3D image datasets in the range of 2-10 μm without affecting the current diagnostic workflow. Important details of structural features such as the tubular networks of airways and blood vessels are contained in these datasets but are difficult and time-consuming to identify by manual image segmentation. Providing 3D structures permits a better understanding of tissue functions and structural interrelationships. It also provides a more complete picture of heterogeneous samples. In addition, 3D analysis of tissue structure provides the potential for an entirely new level of quantitative measurements of this structure that have previously been based only on extrapolation from 2D sections. In this paper, a workflow for segmenting such 3D images semi-automatically has been created using and extending the ImageJ open-source software and key steps of the workflow have been integrated into a new ImageJ plug-in called LungJ. Results indicate an improved workflow with a modular organization of steps facilitating the optimization for different sample and scan properties with expert input as required. This allows for incremental and independent optimization of algorithms leading to faster segmentation. Representation of the tubular networks in samples of human lung, building on those segmentations, has been demonstrated using this approach.
Collapse
Affiliation(s)
- Lasse Wollatz
- Faculty of Engineering and the Environment, University of Southampton, Southampton, SO17 1BJ, UK.
| | - Steven J Johnston
- Faculty of Engineering and the Environment, University of Southampton, Southampton, SO17 1BJ, UK
| | - Peter M Lackie
- Faculty of Medicine, University of Southampton, Southampton, SO17 1BJ, UK
| | - Simon J Cox
- Faculty of Engineering and the Environment, University of Southampton, Southampton, SO17 1BJ, UK
| |
Collapse
|
4
|
Davoodi A, Boozarjomehry RB. Developmental model of an automatic production of the human bronchial tree based on L-system. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 132:1-10. [PMID: 27282222 DOI: 10.1016/j.cmpb.2016.04.021] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/10/2015] [Revised: 03/16/2016] [Accepted: 04/19/2016] [Indexed: 06/06/2023]
Abstract
BACKGROUND AND OBJECTIVE The human lungs exchange air with the external environment via the conducting airways. The application of an anatomically accurate model of the conducting airways can be helpful for simulating gas exchange and fluid distribution throughout the bronchial tree in the lung. METHODS In the current study, Lindenmayer system (L-system) has been formulated to generate the bronchial tree structure in a human lung. It has been considered that the structure of the bronchial tree is divided into two main segments: 1) The central airways (from the trachea to segmental bronchi) and 2) the dichotomous structure (from segmental bronchi to terminal bronchioles). Two sets of parametric rewriting rules which can be used to develop central and peripheral airways have been proposed; the first set used to develop central airways consists of seven rules, while the second rule set contains four rules. RESULTS The proposed model is capable of generating bronchial tree inside the volume of the host lung; and comparison of the resulting model with those reported in the literature shows that the morphometric characteristics of L-system structure are in good agreement with their corresponding experimental data. CONCLUSION The resulting model can be used to obtain a mathematical model required for the study of transport phenomena occurring in the lung during respiration.
Collapse
Affiliation(s)
- Amirabbas Davoodi
- Chemical and Petroleum Engineering Department, Sharif University of Technology, Azadi Av., Tehran, Iran
| | | |
Collapse
|
5
|
Reynisson PJ, Scali M, Smistad E, Hofstad EF, Leira HO, Lindseth F, Nagelhus Hernes TA, Amundsen T, Sorger H, Langø T. Airway Segmentation and Centerline Extraction from Thoracic CT - Comparison of a New Method to State of the Art Commercialized Methods. PLoS One 2015; 10:e0144282. [PMID: 26657513 PMCID: PMC4676651 DOI: 10.1371/journal.pone.0144282] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2015] [Accepted: 11/15/2015] [Indexed: 12/18/2022] Open
Abstract
INTRODUCTION Our motivation is increased bronchoscopic diagnostic yield and optimized preparation, for navigated bronchoscopy. In navigated bronchoscopy, virtual 3D airway visualization is often used to guide a bronchoscopic tool to peripheral lesions, synchronized with the real time video bronchoscopy. Visualization during navigated bronchoscopy, the segmentation time and methods, differs. Time consumption and logistics are two essential aspects that need to be optimized when integrating such technologies in the interventional room. We compared three different approaches to obtain airway centerlines and surface. METHOD CT lung dataset of 17 patients were processed in Mimics (Materialize, Leuven, Belgium), which provides a Basic module and a Pulmonology module (beta version) (MPM), OsiriX (Pixmeo, Geneva, Switzerland) and our Tube Segmentation Framework (TSF) method. Both MPM and TSF were evaluated with reference segmentation. Automatic and manual settings allowed us to segment the airways and obtain 3D models as well as the centrelines in all datasets. We compared the different procedures by user interactions such as number of clicks needed to process the data and quantitative measures concerning the quality of the segmentation and centrelines such as total length of the branches, number of branches, number of generations, and volume of the 3D model. RESULTS The TSF method was the most automatic, while the Mimics Pulmonology Module (MPM) and the Mimics Basic Module (MBM) resulted in the highest number of branches. MPM is the software which demands the least number of clicks to process the data. We found that the freely available OsiriX was less accurate compared to the other methods regarding segmentation results. However, the TSF method provided results fastest regarding number of clicks. The MPM was able to find the highest number of branches and generations. On the other hand, the TSF is fully automatic and it provides the user with both segmentation of the airways and the centerlines. Reference segmentation comparison averages and standard deviations for MPM and TSF correspond to literature. CONCLUSION The TSF is able to segment the airways and extract the centerlines in one single step. The number of branches found is lower for the TSF method than in Mimics. OsiriX demands the highest number of clicks to process the data, the segmentation is often sparse and extracting the centerline requires the use of another software system. Two of the software systems performed satisfactory with respect to be used in preprocessing CT images for navigated bronchoscopy, i.e. the TSF method and the MPM. According to reference segmentation both TSF and MPM are comparable with other segmentation methods. The level of automaticity and the resulting high number of branches plus the fact that both centerline and the surface of the airways were extracted, are requirements we considered particularly important. The in house method has the advantage of being an integrated part of a navigation platform for bronchoscopy, whilst the other methods can be considered preprocessing tools to a navigation system.
Collapse
Affiliation(s)
- Pall Jens Reynisson
- Dept. Circulation and medical imaging, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | - Marta Scali
- Bio-Mechanical Engineering, Faculty of Mechanical Engineering, Delft University of Technology, Delft, Netherlands
| | - Erik Smistad
- Dept. Computer and Information Science, NTNU, Trondheim, Norway
| | | | - Håkon Olav Leira
- Dept. Circulation and medical imaging, Norwegian University of Science and Technology (NTNU), Trondheim, Norway.,Dept. Thoracic Medicine, St. Olavs Hospital, Trondheim, Norway
| | - Frank Lindseth
- Dept. Computer and Information Science, NTNU, Trondheim, Norway.,Dept. Medical Technology, SINTEF, Trondheim, Norway
| | - Toril Anita Nagelhus Hernes
- Dept. Circulation and medical imaging, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | - Tore Amundsen
- Dept. Circulation and medical imaging, Norwegian University of Science and Technology (NTNU), Trondheim, Norway.,Dept. Thoracic Medicine, St. Olavs Hospital, Trondheim, Norway
| | - Hanne Sorger
- Dept. Circulation and medical imaging, Norwegian University of Science and Technology (NTNU), Trondheim, Norway.,Dept. Thoracic Medicine, St. Olavs Hospital, Trondheim, Norway
| | - Thomas Langø
- Dept. Medical Technology, SINTEF, Trondheim, Norway
| |
Collapse
|
6
|
Pu J, Jin C, Yu N, Qian Y, Wang X, Meng X, Guo Y. A "loop" shape descriptor and its application to automated segmentation of airways from CT scans. Med Phys 2015; 42:3076-84. [PMID: 26127059 DOI: 10.1118/1.4921139] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
PURPOSE A novel shape descriptor is presented to aid an automated identification of the airways depicted on computed tomography (CT) images. METHODS Instead of simplifying the tubular characteristic of the airways as an ideal mathematical cylindrical or circular shape, the proposed "loop" shape descriptor exploits the fact that the cross sections of any tubular structure (regardless of its regularity) always appear as a loop. In implementation, the authors first reconstruct the anatomical structures in volumetric CT as a three-dimensional surface model using the classical marching cubes algorithm. Then, the loop descriptor is applied to locate the airways with a concave loop cross section. To deal with the variation of the airway walls in density as depicted on CT images, a multiple threshold strategy is proposed. A publicly available chest CT database consisting of 20 CT scans, which was designed specifically for evaluating an airway segmentation algorithm, was used for quantitative performance assessment. Measures, including length, branch count, and generations, were computed under the aid of a skeletonization operation. RESULTS For the test dataset, the airway length ranged from 64.6 to 429.8 cm, the generation ranged from 7 to 11, and the branch number ranged from 48 to 312. These results were comparable to the performance of the state-of-the-art algorithms validated on the same dataset. CONCLUSIONS The authors' quantitative experiment demonstrated the feasibility and reliability of the developed shape descriptor in identifying lung airways.
Collapse
Affiliation(s)
- Jiantao Pu
- Department of Radiology, First Affiliated Hospital of Medical College, Xi'an Jiaotong University, Shaanxi 710061, People's Republic of China, and Departments of Radiology and Bioengineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15213
| | - Chenwang Jin
- Department of Radiology, First Affiliated Hospital of Medical College, Xi'an Jiaotong University, Shaanxi 710061, People's Republic of China
| | - Nan Yu
- Department of Radiology, First Affiliated Hospital of Medical College, Xi'an Jiaotong University, Shaanxi 710061, People's Republic of China
| | - Yongqiang Qian
- Department of Radiology, First Affiliated Hospital of Medical College, Xi'an Jiaotong University, Shaanxi 710061, People's Republic of China
| | - Xiaohua Wang
- Third Affiliated Hospital, Peking University, Beijing, People's Republic of China, 100029
| | - Xin Meng
- Department of Radiology, University of Pittsburgh, Pittsburgh, Pennsylvania 15213
| | - Youmin Guo
- Department of Radiology, First Affiliated Hospital of Medical College, Xi'an Jiaotong University, Shaanxi 710061, People's Republic of China
| |
Collapse
|
7
|
Rosell J, Cabras P. A three-stage method for the 3D reconstruction of the tracheobronchial tree from CT scans. Comput Med Imaging Graph 2013; 37:430-7. [PMID: 23981684 DOI: 10.1016/j.compmedimag.2013.07.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2013] [Revised: 07/23/2013] [Accepted: 07/25/2013] [Indexed: 11/24/2022]
Abstract
This paper proposes a method for segmenting the airways from CT scans of the chest to obtain a 3D model that can be used in the virtual bronchoscopy for the exploration and the planning of paths to the lesions. The method is composed of 3 stages: a gross segmentation that reconstructs the main airway tree using adaptive region growing, a finer segmentation that identifies any potential airway region based on a 2D process that enhances bronchi walls using local information, and a final process to connect any isolated bronchus to the main airways using a morphologic reconstruction process and a path planning technique. The paper includes two examples for the evaluation and discussion of the proposal.
Collapse
Affiliation(s)
- Jan Rosell
- Institute of Industrial and Control Engineering (IOC), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain.
| | | |
Collapse
|
8
|
Mesanovic N, Huseinagic H, Mujagic S. 3D TRACHEOBRONCHIAL AIRWAY TREE SEGMENTATION FROM THORAX CT IMAGES. BIOMEDICAL ENGINEERING-APPLICATIONS BASIS COMMUNICATIONS 2013. [DOI: 10.4015/s1016237213500154] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Segmentation of the lung structures is an important operation in the medical analysis. This paper is proposing a region growing algorithm for airway segmentation. The proposed method for the airway tree segmentation works fully in 3D and performs the measurements in the original gray-scale volume for increased accuracy and efficiency. This algorithm uses region growing and morphological operators. The airway segmentation algorithm is intended to serve qualitative and quantitative purposes, and additional three descriptors are being used for evaluation of the airway segmentation. The proposed method was evaluated using the database of 15 patients who underwent lung CT scans, with varying image quality and anatomical changes. Overlap measure is used to show the difference between measured volumes from the established gold standard and the proposed method. The student t-test and Pearson test showed high correlation of the results with the gold standard. Overall, the test results were satisfactory since accurate segmentation was achieved in 95% of the patients.
Collapse
Affiliation(s)
- Nihad Mesanovic
- IT Sector, University Clinical Centre, Trnovac bb, 75000 Tuzla, Bosnia and Herzegovina
| | - Haris Huseinagic
- Department of Radiology and Nuclear Medicine, University Clinical Centre, Trnovac bb, 75000 Tuzla, Bosnia and Herzegovina
| | - Svjetlana Mujagic
- Department of Radiology and Nuclear Medicine, University Clinical Centre, Trnovac bb, 75000 Tuzla, Bosnia and Herzegovina
| |
Collapse
|
9
|
Liu X, Chen DZ, Tawhai MH, Wu X, Hoffman EA, Sonka M. Optimal graph search based segmentation of airway tree double surfaces across bifurcations. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:493-510. [PMID: 23070299 PMCID: PMC4086865 DOI: 10.1109/tmi.2012.2223760] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Identification of both the luminal and the wall areas of the bronchial tree structure from volumetric X-ray computed tomography (CT) data sets is of critical importance in distinguishing important phenotypes within numerous major lung diseases including chronic obstructive pulmonary diseases (COPD) and asthma. However, accurate assessment of the inner and outer airway wall surfaces of a complete 3-D tree structure is difficult due to their complex nature, particularly around the branch areas. In this paper, we extend a graph search based technique (LOGISMOS) to simultaneously identify multiple inter-related surfaces of branching airway trees. We first perform a presegmentation of the input 3-D image to obtain basic information about the tree topology. The presegmented image is resampled along judiciously determined paths to produce a set of vectors of voxels (called voxel columns). The resampling process utilizes medial axes to ensure that voxel columns of appropriate lengths and directions are used to capture the object surfaces without interference. A geometric graph is constructed whose edges connect voxels in the resampled voxel columns and enforce validity of the smoothness and separation constraints on the sought surfaces. Cost functions with directional information are employed to distinguish inner and outer walls. The assessment of wall thickness measurement on a CT-scanned double-wall physical phantom (patterned after an in vivo imaged human airway tree) achieved highly accurate results on the entire 3-D tree. The observed mean signed error of wall thickness ranged from -0.09 ±0.24 mm to 0.07 ±0.23 mm in bifurcating/nonbifurcating areas. The mean unsigned errors were 0.16±0.12 mm to 0.20±0.11 mm. When the airway wall surface was partitioned into meaningful subregions, the airway wall thickness accuracy was the same in most tested bifurcation/nonbifurcation and carina/noncarina regions (p=NS). Once validated on phantoms, our method was applied to human in vivo volumetric CT data to demonstrate relationships of airway wall thickness as a function of luminal dimension and airway tree generation. Wall thickness differences between the bifurcation/nonbifurcation regions were statistically significant (p < 0.05) for tree generations 6, 7, 8, and 9. In carina/noncarina regions, the wall thickness was statistically different in generations 1, 4, 5, 6, 7, and 8.
Collapse
Affiliation(s)
- Xiaomin Liu
- Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, IN 46556, USA.
| | | | | | | | | | | |
Collapse
|
10
|
Gu S, Fuhrman C, Meng X, Siegfried JM, Gur D, Leader JK, Sciurba FC, Pu J. Computerized identification of airway wall in CT examinations using a 3D active surface evolution approach. Med Image Anal 2012; 17:283-96. [PMID: 23260997 DOI: 10.1016/j.media.2012.11.003] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2012] [Revised: 11/06/2012] [Accepted: 11/14/2012] [Indexed: 11/18/2022]
Abstract
Airway diseases (e.g., asthma, emphysema, and chronic bronchitis) are extremely common worldwide. Any morphological variations (abnormalities) of airways may physically change airflow and ultimately affect the ability of the lungs in gas exchange. In this study, we describe a novel algorithm aimed to automatically identify airway walls depicted on CT images. The underlying idea is to place a three-dimensional (3D) surface model within airway regions and thereafter allow this model to evolve (deform) under predefined external and internal forces automatically to the location where these forces reach a state of balance. By taking advantage of the geometric and the density characteristics of airway walls, the evolution procedure is performed in a distance gradient field and ultimately stops at regions with the highest contrast. The performance of this scheme was quantitatively evaluated from several perspectives. First, we assessed the accuracy of the developed scheme using a dedicated lung phantom in airway wall estimation and compared it with the traditional full-width at half maximum (FWHM) method. The phantom study shows that the developed scheme has an error ranging from 0.04 mm to 0.36 mm, which is much smaller than the FWHM method with an error ranging from 0.16 mm to 0.84 mm. Second, we compared the results obtained by the developed scheme with those manually delineated by an experienced (>30 years) radiologist on clinical chest CT examinations, showing a mean difference of 0.084 mm. In particular, the sensitivity of the scheme to different reconstruction kernels was evaluated on real chest CT examinations. For the 'lung', 'bone' and 'standard' kernels, the average airway wall thicknesses computed by the developed scheme were 1.302 mm, 1.333 mm and 1.339 mm, respectively. Our preliminary experiments showed that the scheme had a reasonable accuracy in airway wall estimation. For a clinical chest CT examination, it took around 4 min for this scheme to identify the inner and outer airway walls on a modern PC.
Collapse
Affiliation(s)
- Suicheng Gu
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | | | | | | | | | | | | | | |
Collapse
|
11
|
Pu J, Gu S, Liu S, Zhu S, Wilson D, Siegfried JM, Gur D. CT based computerized identification and analysis of human airways: a review. Med Phys 2012; 39:2603-16. [PMID: 22559631 DOI: 10.1118/1.4703901] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
As one of the most prevalent chronic disorders, airway disease is a major cause of morbidity and mortality worldwide. In order to understand its underlying mechanisms and to enable assessment of therapeutic efficacy of a variety of possible interventions, noninvasive investigation of the airways in a large number of subjects is of great research interest. Due to its high resolution in temporal and spatial domains, computed tomography (CT) has been widely used in clinical practices for studying the normal and abnormal manifestations of lung diseases, albeit there is a need to clearly demonstrate the benefits in light of the cost and radiation dose associated with CT examinations performed for the purpose of airway analysis. Whereas a single CT examination consists of a large number of images, manually identifying airway morphological characteristics and computing features to enable thorough investigations of airway and other lung diseases is very time-consuming and susceptible to errors. Hence, automated and semiautomated computerized analysis of human airways is becoming an important research area in medical imaging. A number of computerized techniques have been developed to date for the analysis of lung airways. In this review, we present a summary of the primary methods developed for computerized analysis of human airways, including airway segmentation, airway labeling, and airway morphometry, as well as a number of computer-aided clinical applications, such as virtual bronchoscopy. Both successes and underlying limitations of these approaches are discussed, while highlighting areas that may require additional work.
Collapse
Affiliation(s)
- Jiantao Pu
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | | | | | | | | | | | | |
Collapse
|
12
|
Janaszewski M, Postolski M, Babout L. Robust algorithm for tunnel closing in 3D volumetric objects based on topological characteristics of points. Pattern Recognit Lett 2011. [DOI: 10.1016/j.patrec.2011.06.013] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
13
|
Salito C, Barazzetti L, Woods JC, Aliverti A. 3D Airway Tree Reconstruction in Healthy Subjects and Emphysema. Lung 2011; 189:287-93. [DOI: 10.1007/s00408-011-9305-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2011] [Accepted: 05/20/2011] [Indexed: 10/18/2022]
|
14
|
Pu J, Fuhrman C, Good WF, Sciurba FC, Gur D. A differential geometric approach to automated segmentation of human airway tree. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:266-78. [PMID: 20851792 PMCID: PMC3271357 DOI: 10.1109/tmi.2010.2076300] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
Airway diseases are frequently associated with morphological changes that may affect the physiology of the lungs. Accurate characterization of airways may be useful for quantitatively assessing prognosis and for monitoring therapeutic efficacy. The information gained may also provide insight into the underlying mechanisms of various lung diseases. We developed a computerized scheme to automatically segment the 3-D human airway tree depicted on computed tomography (CT) images. The method takes advantage of both principal curvatures and principal directions in differentiating airways from other tissues in geometric space. A "puzzle game" procedure is used to identify false negative regions and reduce false positive regions that do not meet the shape analysis criteria. The negative impact of partial volume effects on small airway detection is partially alleviated by repeating the developed differential geometric analysis on lung anatomical structures modeled at multiple iso-values (thresholds). In addition to having advantages, such as full automation, easy implementation and relative insensitivity to image noise and/or artifacts, this scheme has virtually no leakage issues and can be easily extended to the extraction or the segmentation of other tubular type structures (e.g., vascular tree). The performance of this scheme was assessed quantitatively using 75 chest CT examinations acquired on 45 subjects with different slice thicknesses and using 20 publicly available test cases that were originally designed for evaluating the performance of different airway tree segmentation algorithms.
Collapse
Affiliation(s)
- Jiantao Pu
- Imaging Research Division, Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | | | | | | | | |
Collapse
|
15
|
Wang X, Fang C, Xia Y, Feng D. Airway segmentation for low-contrast CT images from combined PET/CT scanners based on airway modelling and seed prediction. Biomed Signal Process Control 2011. [DOI: 10.1016/j.bspc.2010.05.002] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
16
|
Pu J, Paik DS, Meng X, Roos JE, Rubin GD. Shape "break-and-repair" strategy and its application to automated medical image segmentation. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2011; 17:115-24. [PMID: 21071791 PMCID: PMC3099140 DOI: 10.1109/tvcg.2010.56] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
In three-dimensional medical imaging, segmentation of specific anatomy structure is often a preprocessing step for computer-aided detection/diagnosis (CAD) purposes, and its performance has a significant impact on diagnosis of diseases as well as objective quantitative assessment of therapeutic efficacy. However, the existence of various diseases, image noise or artifacts, and individual anatomical variety generally impose a challenge for accurate segmentation of specific structures. To address these problems, a shape analysis strategy termed "break-and-repair" is presented in this study to facilitate automated medical image segmentation. Similar to surface approximation using a limited number of control points, the basic idea is to remove problematic regions and then estimate a smooth and complete surface shape by representing the remaining regions with high fidelity as an implicit function. The innovation of this shape analysis strategy is the capability of solving challenging medical image segmentation problems in a unified framework, regardless of the variability of anatomical structures in question. In our implementation, principal curvature analysis is used to identify and remove the problematic regions and radial basis function (RBF) based implicit surface fitting is used to achieve a closed (or complete) surface boundary. The feasibility and performance of this strategy are demonstrated by applying it to automated segmentation of two completely different anatomical structures depicted on CT examinations, namely human lungs and pulmonary nodules. Our quantitative experiments on a large number of clinical CT examinations collected from different sources demonstrate the accuracy, robustness, and generality of the shape "break-and-repair" strategy in medical image segmentation.
Collapse
Affiliation(s)
- Jiantao Pu
- Department of Radiology and Department of Bioengineering, University of Pittsburgh, 3362 Fifth Ave, Pittsburgh, PA 15213
| | - David S. Paik
- Department of Radiology, Stanford University, 300 Pasteur Dr., Stanford, CA 94305
| | - Xin Meng
- Department of Structural Biology, University of Pittsburgh, 3501 Fifth Ave, Pittsburgh, PA 15260
| | - Justus E. Roos
- Department of Radiology, Stanford University, 300 Pasteur Dr., Stanford, CA 94305
| | - Geoffrey D. Rubin
- Department of Radiology, Stanford University, 300 Pasteur Dr., Stanford, CA 94305
| |
Collapse
|
17
|
Graham MW, Gibbs JD, Cornish DC, Higgins WE. Robust 3-D airway tree segmentation for image-guided peripheral bronchoscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2010; 29:982-997. [PMID: 20335095 DOI: 10.1109/tmi.2009.2035813] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
A vital task in the planning of peripheral bronchoscopy is the segmentation of the airway tree from a 3-D multidetector computed tomography chest scan. Unfortunately, existing methods typically do not sufficiently extract the necessary peripheral airways needed to plan a procedure. We present a robust method that draws upon both local and global information. The method begins with a conservative segmentation of the major airways. Follow-on stages then exhaustively search for additional candidate airway locations. Finally, a graph-based optimization method counterbalances both the benefit and cost of retaining candidate airway locations for the final segmentation. Results demonstrate that the proposed method typically extracts 2-3 more generations of airways than several other methods, and that the extracted airway trees enable image-guided bronchoscopy deeper into the human lung periphery than past studies.
Collapse
|
18
|
Pu J, Zheng B, Leader JK, Fuhrman C, Knollmann F, Klym A, Gur D. Pulmonary lobe segmentation in CT examinations using implicit surface fitting. IEEE TRANSACTIONS ON MEDICAL IMAGING 2009; 28:1986-96. [PMID: 19628453 PMCID: PMC2839920 DOI: 10.1109/tmi.2009.2027117] [Citation(s) in RCA: 55] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Lobe identification in computed tomography (CT) examinations is often an important consideration during the diagnostic process as well as during treatment planning because of their relative independence of each other in terms of anatomy and function. In this paper, we present a new automated scheme for segmenting lung lobes depicted on 3-D CT examinations. The unique characteristic of this scheme is the representation of fissures in the form of implicit functions using Radial Basis Functions (RBFs), capable of seamlessly interpolating "holes" in the detected fissures and smoothly extrapolating the fissure surfaces to the lung boundaries resulting in a "natural" segmentation of lung lobes. A previously developed statistically based approach is used to detect pulmonary fissures and the constraint points for implicit surface fitting are selected from detected fissure surfaces in a greedy manner to improve fitting efficiency. In a preliminary assessment study, lobe segmentation results of 65 chest CT examinations, five of which were reconstructed with three section thicknesses of 0.625 mm, 1.25 mm, and 2.5 mm, were subjectively and independently evaluated by two experienced chest radiologists using a five category rating scale (i.e., excellent, good, fair, poor, and unacceptable). Thirty-three of 65 examinations (50.8%) with a section thickness of 0.625 mm were rated as either "excellent" or "good" by both radiologists and only one case (1.5%) was rated by both radiologists as "poor" or "unacceptable." Comparable performance was obtained with a slice thickness of 1.25 mm, but substantial performance deterioration occurred in examinations with a section thickness of 2.5 mm. The advantages of this scheme are its full automation, relative insensitivity to fissure completeness, and ease of implementation.
Collapse
Affiliation(s)
- Jiantao Pu
- Imaging Research Division, Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | | | | | | | | | | | | |
Collapse
|
19
|
Two-pass region growing algorithm for segmenting airway tree from MDCT chest scans. Comput Med Imaging Graph 2009; 33:537-46. [DOI: 10.1016/j.compmedimag.2009.04.012] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2008] [Revised: 02/28/2009] [Accepted: 04/22/2009] [Indexed: 11/19/2022]
|
20
|
Pu J, Leader JK, Zheng B, Knollmann F, Fuhrman C, Sciurba FC, Gur D. A Computational geometry approach to automated pulmonary fissure segmentation in CT examinations. IEEE TRANSACTIONS ON MEDICAL IMAGING 2009; 28:710-9. [PMID: 19272987 PMCID: PMC2839918 DOI: 10.1109/tmi.2008.2010441] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
Identification of pulmonary fissures, which form the boundaries between the lobes in the lungs, may be useful during clinical interpretation of computed tomography (CT) examinations to assess the early presence and characterization of manifestation of several lung diseases. Motivated by the unique nature of the surface shape of pulmonary fissures in 3-D space, we developed a new automated scheme using computational geometry methods to detect and segment fissures depicted on CT images. After a geometric modeling of the lung volume using the marching cubes algorithm, Laplacian smoothing is applied iteratively to enhance pulmonary fissures by depressing nonfissure structures while smoothing the surfaces of lung fissures. Next, an extended Gaussian image based procedure is used to locate the fissures in a statistical manner that approximates the fissures using a set of plane "patches." This approach has several advantages such as independence of anatomic knowledge of the lung structure except the surface shape of fissures, limited sensitivity to other lung structures, and ease of implementation. The scheme performance was evaluated by two experienced thoracic radiologists using a set of 100 images (slices) randomly selected from 10 screening CT examinations. In this preliminary evaluation 98.7% and 94.9% of scheme segmented fissure voxels are within 2 mm of the fissures marked independently by two radiologists in the testing image dataset. Using the scheme detected fissures as reference, 89.4% and 90.1% of manually marked fissure points have distance </= 2 mm to the reference suggesting a possible under-segmentation of the scheme. The case-based root mean square (rms) distances ("errors") between our scheme and the radiologist ranged from 1.48 +/-0.92 to 2.04 +/-3.88 mm. The discrepancy of fissure detection results between the automated scheme and either radiologist is smaller in this dataset than the interreader variability.
Collapse
Affiliation(s)
- Jiantao Pu
- Imaging Research Division, Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | | | | | | | | | | | | |
Collapse
|
21
|
Megalooikonomou V, Barnathan M, Kontos D, Bakic PR, Maidment ADA. A representation and classification scheme for tree-like structures in medical images: analyzing the branching pattern of ductal trees in X-ray galactograms. IEEE TRANSACTIONS ON MEDICAL IMAGING 2009; 28:487-93. [PMID: 19272984 PMCID: PMC3390200 DOI: 10.1109/tmi.2008.929102] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
We propose a multistep approach for representing and classifying tree-like structures in medical images. Tree-like structures are frequently encountered in biomedical contexts; examples are the bronchial system, the vascular topology, and the breast ductal network. We use tree encoding techniques, such as the depth-first string encoding and the PrUfer encoding, to obtain a symbolic string representation of the tree's branching topology; the problem of classifying trees is then reduced to string classification. We use the tf-idf text mining technique to assign a weight of significance to each string term (i.e., tree node label). Similarity searches and k-nearest neighbor classification of the trees is performed using the tf-idf weight vectors and the cosine similarity metric. We applied our approach to characterize the ductal tree-like parenchymal structure in X-ray galactograms, in order to distinguish among different radiological findings. Experimental results demonstrate the effectiveness of the proposed approach with classification accuracy reaching up to 86%, and also indicate that our method can potentially aid in providing insight to the relationship between branching patterns and function or pathology.
Collapse
|
22
|
Nakamura M, Wada S, Miki T, Shimada Y, Suda Y, Tamura G. Automated segmentation and morphometric analysis of the human airway tree from multidetector CT images. J Physiol Sci 2008; 58:493-8. [PMID: 19055856 DOI: 10.2170/physiolsci.rp007408] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2008] [Accepted: 12/03/2008] [Indexed: 11/05/2022]
Abstract
Remarkable advances in computed tomography (CT) technology geared our research toward investigating the integrative function of the lung and the development of a database of the airway tree incorporating anatomical and functional data with computational models. As part of this project, we are developing the algorithm to construct an anatomically realistic geometric model of airways from CT images. The basic concept of the algorithm is to segment as many airway trees as possible from CT images and later correct quantified parameters based on CT values. CT images are acquired with a 64-channel multidetector CT, and the airway is then extracted from them by the region-growing method while maintaining connectivity. Using this method, we extracted 428 airways up to the 14th branching generation. Although the airway diameters up to the 4th generation showed good agreement with those reported in an autopsy study, those in later generations were all greater than the reported values because of the limited resolution of the CT images. We corrected the errors in diameters by assessing the relationship between the diameter and median value of Hounsfield unit (HU) intensity of each airway; consequently, the diameters up to generation 8 agreed well with the reported values. Based on these results, we conclude that the use of HU-based correction algorithm combined with rough segmentation can be another way to improve data accuracy in the morphometric analysis of airways from CTs.
Collapse
Affiliation(s)
- Masanori Nakamura
- The Center for Advanced Medical Engineering and Informatics, Osaka University, Toyonaka 560-8531, Japan.
| | | | | | | | | | | |
Collapse
|
23
|
Tsuda A, Filipovic N, Haberthür D, Dickie R, Matsui Y, Stampanoni M, Schittny JC. Finite element 3D reconstruction of the pulmonary acinus imaged by synchrotron X-ray tomography. J Appl Physiol (1985) 2008; 105:964-76. [PMID: 18583378 PMCID: PMC2536812 DOI: 10.1152/japplphysiol.90546.2008] [Citation(s) in RCA: 71] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2008] [Accepted: 06/16/2008] [Indexed: 11/22/2022] Open
Abstract
The alveolated structure of the pulmonary acinus plays a vital role in gas exchange function. Three-dimensional (3D) analysis of the parenchymal region is fundamental to understanding this structure-function relationship, but only a limited number of attempts have been conducted in the past because of technical limitations. In this study, we developed a new image processing methodology based on finite element (FE) analysis for accurate 3D structural reconstruction of the gas exchange regions of the lung. Stereologically well characterized rat lung samples (Pediatr Res 53: 72-80, 2003) were imaged using high-resolution synchrotron radiation-based X-ray tomographic microscopy. A stack of 1,024 images (each slice: 1024 x 1024 pixels) with resolution of 1.4 mum(3) per voxel were generated. For the development of FE algorithm, regions of interest (ROI), containing approximately 7.5 million voxels, were further extracted as a working subunit. 3D FEs were created overlaying the voxel map using a grid-based hexahedral algorithm. A proper threshold value for appropriate segmentation was iteratively determined to match the calculated volume density of tissue to the stereologically determined value (Pediatr Res 53: 72-80, 2003). The resulting 3D FEs are ready to be used for 3D structural analysis as well as for subsequent FE computational analyses like fluid dynamics and skeletonization.
Collapse
Affiliation(s)
- A Tsuda
- Molecular and Integrative Physiological Sciences, Harvard School of Public Health, 665 Huntington Ave., Boston, MA 02115, USA.
| | | | | | | | | | | | | |
Collapse
|
24
|
Pu J, Roos J, Yi CA, Napel S, Rubin GD, Paik DS. Adaptive border marching algorithm: automatic lung segmentation on chest CT images. Comput Med Imaging Graph 2008; 32:452-62. [PMID: 18515044 DOI: 10.1016/j.compmedimag.2008.04.005] [Citation(s) in RCA: 79] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2007] [Revised: 04/17/2008] [Accepted: 04/21/2008] [Indexed: 11/17/2022]
Abstract
Segmentation of the lungs in chest-computed tomography (CT) is often performed as a preprocessing step in lung imaging. This task is complicated especially in presence of disease. This paper presents a lung segmentation algorithm called adaptive border marching (ABM). Its novelty lies in the fact that it smoothes the lung border in a geometric way and can be used to reliably include juxtapleural nodules while minimizing oversegmentation of adjacent regions such as the abdomen and mediastinum. Our experiments using 20 datasets demonstrate that this computational geometry algorithm can re-include all juxtapleural nodules and achieve an average oversegmentation ratio of 0.43% and an average under-segmentation ratio of 1.63% relative to an expert determined reference standard. The segmentation time of a typical case is under 1min on a typical PC. As compared to other available methods, ABM is more robust, more efficient and more straightforward to implement, and once the chest CT images are input, there is no further interaction needed from users. The clinical impact of this method is in potentially avoiding false negative CAD findings due to juxtapleural nodules and improving volumetry and doubling time accuracy.
Collapse
Affiliation(s)
- Jiantao Pu
- Department of Radiology, Stanford University, United States
| | | | | | | | | | | |
Collapse
|
25
|
Silveira M, Nascimento J, Marques J. Automatic segmentation of the lungs using robust level sets. ACTA ACUST UNITED AC 2008; 2007:4414-7. [PMID: 18002983 DOI: 10.1109/iembs.2007.4353317] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper presents a method for the automatic segmentation of the lungs in X-ray computed tomography (CT) images. The proposed technique is based on the use of a robust geometric active contour that is initialized around the lungs, automatically splits in two, and performs outlier rejection during the curve evolution. The technique starts by grey-level thresholding of the images followed by edge detection. Then the edge connected points are organized into strokes and classified as valid or invalid. A confidence degree (weight) is assigned to each stroke and updated during the evolution process with the valid strokes receiving a high confidence degree and the confidence degrees of the outlier strokes tending to zero. These weights depend on the distance between the stroke points and the curve and also on the stroke size. Initialization of the curve is fully automatic. Experimental results show the effectiveness of the proposed technique.
Collapse
Affiliation(s)
- Margarida Silveira
- Instituto Superior Técnico - Instituto de Sistemas e Robótica, Av. Rovisco Pais, 1049-001, Lisboa, Portugal
| | | | | |
Collapse
|
26
|
Ellingson BM, Ulmer JL, Schmit BD. Gray and white matter delineation in the human spinal cord using diffusion tensor imaging and fuzzy logic. Acad Radiol 2007; 14:847-58. [PMID: 17574135 DOI: 10.1016/j.acra.2007.04.006] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2006] [Revised: 04/09/2007] [Accepted: 04/09/2007] [Indexed: 02/02/2023]
Abstract
RATIONALE AND OBJECTIVES Diffusion tensor imaging (DTI) has been used extensively in determining morphology and connectivity of the brain; however, similar analysis in the spinal cord has proven difficult. The objective of this study was to improve the delineation of gray and white matter in the spinal cord by applying signal processing techniques to the eigenvalues of the diffusion tensor. Our approach involved creating anisotropy indices based on the difference between eigenvalues and mean diffusivity then using a fuzzy inference system (FIS) to delineate between gray and white matter in the human cervical spinal cord. MATERIALS AND METHODS DTI was performed on the cervical spinal cord in five neurologically intact subjects. Distributions were extracted for regions of gray and white matter through the use of a digitized histologic template. Fuzzy membership functions were created based on these distributions. Detectability index and receiver operating characteristic (ROC) analysis was performed on traditional DTI indices and FIS classified regions. RESULTS A significantly higher contrast between gray and white matter was observed using fuzzy classification compared with traditionally used DTI indices based on the detectability index (P < .001) and trends in the ROC analysis. Reconstructed images from the FIS qualitatively showed a better anatomical representation of the spinal cord compared with traditionally used DTI indices. CONCLUSIONS Diffusion tensor imaging using an FIS for tissue classification provides high contrast between spinal gray and white matter compared with traditional DTI indices and may provide a noninvasive technique to quantify the integrity and morphology of the human spinal cord following injury.
Collapse
Affiliation(s)
- Benjamin M Ellingson
- Department of Biomedical Engineering, Marquette University, Milwaukee, WI 53201-1881, USA
| | | | | |
Collapse
|
27
|
Ochs RA, Goldin JG, Abtin F, Kim HJ, Brown K, Batra P, Roback D, McNitt-Gray MF, Brown MS. Automated classification of lung bronchovascular anatomy in CT using AdaBoost. Med Image Anal 2007; 11:315-24. [PMID: 17482500 PMCID: PMC2041873 DOI: 10.1016/j.media.2007.03.004] [Citation(s) in RCA: 61] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2006] [Revised: 01/10/2007] [Accepted: 03/21/2007] [Indexed: 11/27/2022]
Abstract
Lung CAD systems require the ability to classify a variety of pulmonary structures as part of the diagnostic process. The purpose of this work was to develop a methodology for fully automated voxel-by-voxel classification of airways, fissures, nodules, and vessels from chest CT images using a single feature set and classification method. Twenty-nine thin section CT scans were obtained from the Lung Image Database Consortium (LIDC). Multiple radiologists labeled voxels corresponding to the following structures: airways (trachea to 6th generation), major and minor lobar fissures, nodules, and vessels (hilum to peripheral), and normal lung parenchyma. The labeled data was used in conjunction with a supervised machine learning approach (AdaBoost) to train a set of ensemble classifiers. Each ensemble classifier was trained to detect voxels part of a specific structure (either airway, fissure, nodule, vessel, or parenchyma). The feature set consisted of voxel attenuation and a small number of features based on the eigenvalues of the Hessian matrix (used to differentiate structures by shape). When each ensemble classifier was composed of 20 weak classifiers, the AUC values for the airway, fissure, nodule, vessel, and parenchyma classifiers were 0.984+/-0.011, 0.949+/-0.009, 0.945+/-0.018, 0.953+/-0.016, and 0.931+/-0.015, respectively. The strong results suggest that this could be an effective input to higher-level anatomical based segmentation models with the potential to improve CAD performance.
Collapse
Affiliation(s)
- Robert A Ochs
- Department of Biomedical Physics, University of California Los Angeles, CA 90095, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|
28
|
Venkatraman R, Raman R, Raman B, Moss RB, Rubin GD, Mathers LH, Robinson TE. Fully automated system for three-dimensional bronchial morphology analysis using volumetric multidetector computed tomography of the chest. J Digit Imaging 2006; 19:132-9. [PMID: 16341571 PMCID: PMC3045191 DOI: 10.1007/s10278-005-9240-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022] Open
Abstract
Recent advancements in computed tomography (CT) have enabled quantitative assessment of severity and progression of large airway damage in chronic pulmonary disease. The advent of fast multidetector computed tomography scanning has allowed the acquisition of rapid, low-dose 3D volumetric pulmonary scans that depict the bronchial tree in great detail. Volumetric CT allows quantitative indices of bronchial airway morphology to be calculated, including airway diameters, wall thicknesses, wall area, airway segment lengths, airway taper indices, and airway branching patterns. However, the complexity and size of the bronchial tree render manual measurement methods impractical and inaccurate. We have developed an integrated software package utilizing a new measurement algorithm termed mirror-image Gaussian fit that enables the user to perform automated bronchial segmentation, measurement, and database archiving of the bronchial morphology in high resolution and volumetric CT scans and also allows 3D localization, visualization, and registration.
Collapse
Affiliation(s)
- Raman Venkatraman
- Department of Pediatric Pulmonology, Stanford University School of Medicine, Stanford, CA 94305 USA
| | - Raghav Raman
- Department of Radiology, Stanford University School of Medicine, Stanford, CA 94305 USA
| | - Bhargav Raman
- Department of Radiology, Stanford University School of Medicine, Stanford, CA 94305 USA
| | - Richard B. Moss
- Department of Pediatric Pulmonology, Stanford University School of Medicine, Stanford, CA 94305 USA
| | - Geoffrey D. Rubin
- Department of Radiology, Stanford University School of Medicine, Stanford, CA 94305 USA
| | - Lawrence H. Mathers
- Department of Pediatric Pulmonology, Stanford University School of Medicine, Stanford, CA 94305 USA
| | - Terry E. Robinson
- Department of Pediatric Pulmonology, Stanford University School of Medicine, Stanford, CA 94305 USA
| |
Collapse
|
29
|
Cai H, Xu X, Lu J, Lichtman JW, Yung SP, Wong STC. Repulsive force based snake model to segment and track neuronal axons in 3D microscopy image stacks. Neuroimage 2006; 32:1608-20. [PMID: 16861006 DOI: 10.1016/j.neuroimage.2006.05.036] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2005] [Revised: 05/03/2006] [Accepted: 05/10/2006] [Indexed: 10/24/2022] Open
Abstract
The branching patterns of axons and dendrites are fundamental structural properties that affect the synaptic connectivity of axons. Although today three-dimensional images of fluorescently labeled processes can be obtained to study axonal branching, there are no robust methods of tracing individual axons. This paper describes a repulsive force based snake model to segment and track axonal profiles in 3D images. This new method segments all the axonal profiles in a 2D image and then uses the results obtained from that image as prior information to help segment the adjacent 2D image. In this way, the segmentation successfully connects axonal profiles over hundreds of images in a 3D image stack. Individual axons can then be extracted based on the segmentation results. The utility and performance of the method are demonstrated using 3D axonal images obtained from transgenic mice that express fluorescent protein.
Collapse
Affiliation(s)
- Hongmin Cai
- Center for Bioinformatics, Harvard Center for Neurodegeneration and Repair, and Department of Radiology, Brigham and Women's Hospital, Boston, MA 02114, USA
| | | | | | | | | | | |
Collapse
|
30
|
Tschirren J, Hoffman EA, McLennan G, Sonka M. Segmentation and quantitative analysis of intrathoracic airway trees from computed tomography images. Ann Am Thorac Soc 2006; 2:484-7, 503-4. [PMID: 16352753 PMCID: PMC2713337 DOI: 10.1513/pats.200507-078ds] [Citation(s) in RCA: 61] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
The segmentation of the human airway tree from volumetric multidetector-row computed tomography images is an important prerequisite for many clinical applications and physiologic studies. We present a new airway segmentation method based on fuzzy connectivity. Small adaptive regions of interest are used that follow the airway branches as they are segmented. This method works on various types of scans (low dose and regular dose, normal subjects and diseased subjects) without the need for the user to manually adjust any parameters. Comparison with a commonly used region-growing segmentation algorithm shows that this method retrieves a significantly higher count of airway branches. In an additional processing step, this method provides accurate cross-sectional airway measurements that are conducted in the original gray-level volume. Validation on a phantom shows that subvoxel accuracy is achieved for all airway sizes and airway orientations. The utility of the reported method is demonstrated in a comparative analysis of normal and cystic fibrosis airway trees.
Collapse
Affiliation(s)
- Juerg Tschirren
- Department of Electrical and Computer Engineering, 4016 SC, University of Iowa, Iowa City, IA 52242, USA
| | | | | | | |
Collapse
|
31
|
Sluimer I, Schilham A, Prokop M, van Ginneken B. Computer analysis of computed tomography scans of the lung: a survey. IEEE TRANSACTIONS ON MEDICAL IMAGING 2006; 25:385-405. [PMID: 16608056 DOI: 10.1109/tmi.2005.862753] [Citation(s) in RCA: 209] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Current computed tomography (CT) technology allows for near isotropic, submillimeter resolution acquisition of the complete chest in a single breath hold. These thin-slice chest scans have become indispensable in thoracic radiology, but have also substantially increased the data load for radiologists. Automating the analysis of such data is, therefore, a necessity and this has created a rapidly developing research area in medical imaging. This paper presents a review of the literature on computer analysis of the lungs in CT scans and addresses segmentation of various pulmonary structures, registration of chest scans, and applications aimed at detection, classification and quantification of chest abnormalities. In addition, research trends and challenges are identified and directions for future research are discussed.
Collapse
Affiliation(s)
- Ingrid Sluimer
- Image Sciences Institute, University Medical Center Utrecht, 3584 CX Utrecht, The Netherlands.
| | | | | | | |
Collapse
|
32
|
Zhang L, Hoffman EA, Reinhardt JM. Atlas-driven lung lobe segmentation in volumetric X-ray CT images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2006; 25:1-16. [PMID: 16398410 DOI: 10.1109/tmi.2005.859209] [Citation(s) in RCA: 96] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
High-resolution X-ray computed tomography (CT) imaging is routinely used for clinical pulmonary applications. Since lung function varies regionally and because pulmonary disease is usually not uniformly distributed in the lungs, it is useful to study the lungs on a lobe-by-lobe basis. Thus, it is important to segment not only the lungs, but the lobar fissures as well. In this paper, we demonstrate the use of an anatomic pulmonary atlas, encoded with a priori information on the pulmonary anatomy, to automatically segment the oblique lobar fissures. Sixteen volumetric CT scans from 16 subjects are used to construct the pulmonary atlas. A ridgeness measure is applied to the original CT images to enhance the fissure contrast. Fissure detection is accomplished in two stages: an initial fissure search and a final fissure search. A fuzzy reasoning system is used in the fissure search to analyze information from three sources: the image intensity, an anatomic smoothness constraint, and the atlas-based search initialization. Our method has been tested on 22 volumetric thin-slice CT scans from 12 subjects, and the results are compared to manual tracings. Averaged across all 22 data sets, the RMS error between the automatically segmented and manually segmented fissures is 1.96 +/- 0.71 mm and the mean of the similarity indices between the manually defined and computer-defined lobe regions is 0.988. The results indicate a strong agreement between the automatic and manual lobe segmentations.
Collapse
Affiliation(s)
- Li Zhang
- University of Iowa, Iowa City, IA 52242, USA
| | | | | |
Collapse
|
33
|
Silveira M, Marques J. Automatic segmentation of the lungs using multiple active contours and outlier model. CONFERENCE PROCEEDINGS : ... ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL CONFERENCE 2006; 2006:3122-3125. [PMID: 17946549 DOI: 10.1109/iembs.2006.260185] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
This paper presents a method for the automatic segmentation of the lungs in X-ray computed tomography (CT) images. The proposed technique is based on the use of multiple active contour models (ACMs) for the simultaneous segmentation of both lungs and outlier detection. The technique starts by grey-level thresholding of the images followed by edge detection. Then the edge points are organized in strokes and a set of weights summing to one is assigned to each stroke. These weights represent the soft assignment of the stroke to each of the ACMs and depend on the distance between the stroke points and the ACM units, on gradient direction information and also on the stroke size. Both the weights and the ACMs energy minimization are computed using the generalized expectation-maximization (EM) algorithm. Initialization of the ACM's is fully automatic. Experimental results show the effectiveness of the proposed technique.
Collapse
|
34
|
Tschirren J, Hoffman EA, McLennan G, Sonka M. Intrathoracic airway trees: segmentation and airway morphology analysis from low-dose CT scans. IEEE TRANSACTIONS ON MEDICAL IMAGING 2005; 24:1529-39. [PMID: 16353370 PMCID: PMC1851666 DOI: 10.1109/tmi.2005.857654] [Citation(s) in RCA: 153] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
The segmentation of the human airway tree from volumetric computed tomography (CT) images builds an important step for many clinical applications and for physiological studies. Previously proposed algorithms suffer from one or several problems: leaking into the surrounding lung parenchyma, the need for the user to manually adjust parameters, excessive runtime. Low-dose CT scans are increasingly utilized in lung screening studies, but segmenting them with traditional airway segmentation algorithms often yields less than satisfying results. In this paper, a new airway segmentation method based on fuzzy connectivity is presented. Small adaptive regions of interest are used that follow the airway branches as they are segmented. This has several advantages. It makes it possible to detect leaks early and avoid them, the segmentation algorithm can automatically adapt to changing image parameters, and the computing time is kept within moderate values. The new method is robust in the sense that it works on various types of scans (low-dose and regular dose, normal subjects and diseased subjects) without the need for the user to manually adjust any parameters. Comparison with a commonly used region-grow segmentation algorithm shows that the newly proposed method retrieves a significantly higher count of airway branches. A method that conducts accurate cross-sectional airway measurements on airways is presented as an additional processing step. Measurements are conducted in the original gray-level volume. Validation on a phantom shows that subvoxel accuracy is achieved for all airway sizes and airway orientations.
Collapse
Affiliation(s)
- Juerg Tschirren
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA 52240, USA.
| | | | | | | |
Collapse
|
35
|
Fetita CI, Prêteux F, Beigelman-Aubry C, Grenier P. Pulmonary airways: 3-D reconstruction from multislice CT and clinical investigation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2004; 23:1353-64. [PMID: 15554124 DOI: 10.1109/tmi.2004.826945] [Citation(s) in RCA: 48] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
In the framework of computer-aided diagnosis, this paper proposes a novel functionality for the computerized tomography (CT)-based investigation of the pulmonary airways. It relies on an energy-based three-dimensional (3-D) reconstruction of the bronchial tree from multislice CT acquisitions, up to the sixth- to seventh-order subdivisions. Global and local analysis of the reconstructed airways is possible by means of specific visualization modalities, respectively, the CT bronchography and the virtual bronchoscopy. The originality of the 3-D reconstruction approach consists in combining axial and radial propagation potentials to control the growth of a subset of low-order airways extracted from the CT volume by means of a robust mathematical morphology operator-the selective marking and depth constrained (SMDC) connection cost. The proposed approach proved to be robust with respect to a large spectrum of airway pathologies, including even severe stenosis (bronchial lumen obstruction/collapse). Validated by expert radiologists, examples of airway 3-D reconstructions are presented and discussed for both normal and pathological cases. They highlight the interest in considering CT bronchography and virtual bronchoscopy as complementary tools for clinical diagnosis and follow-up of airway diseases.
Collapse
Affiliation(s)
- Catalin I Fetita
- ARTEMIS Project Unit, Institut National des Télécommunications, 9 rue Charles Fourier, 91011 Evry Cedex, France.
| | | | | | | |
Collapse
|
36
|
Wang B, Saha PK, Udupa JK, Ferrante MA, Baumgardner J, Roberts DA, Rizi RR. 3D airway segmentation via hyperpolarized 3He gas MRI by using scale-based fuzzy connectedness. Comput Med Imaging Graph 2004; 28:77-86. [PMID: 15127752 DOI: 10.1016/j.compmedimag.2003.06.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Computerized segmentation of 3D tracheobronchial tree is a necessary first step for subsequent registration and analysis of pulmonary airway and vascular magnetic resonance (MR) images obtained by using hyperpolarized 3Helium gas and Gadolinium. The scientific and clinical implications of acquiring these data on the tracheobronchial tree (for studying ventilation, V) and on the coinciding pulmonary arterioles (for studying perfusion, Q), is the next frontier for static and dynamic pulmonary MRI. In this paper, we report an airway segmentation method from 3He MR images based on the scale-based fuzzy connectedness approach. Incorporated in this method are the pre-processing steps of inhomogeneity correction and intensity standardization. The basic sequential steps in the proposed airway segmentation method are: (1) image acquisition, (2) radio frequency field inhomogeneity correction, (3) standardization of MR image intensity scale, (4) seed specification, (5) scale-based fuzzy connected segmentation of airways, and (6) thresholding and binarization. The majority of these steps are automatically executed; others allow interaction through a graphical interface provided in the 3DVIEWNIX software system, in which the algorithms are implemented. The method achieves an overall precision of about 98% in terms of the extent of overlap in repeated segmentations. Its level of accuracy can be described by a true positive volume fraction of about 98% (considering manual delineation as the surrogate of true delineation), and a false negative and positive volume fraction of about 1%. The total operator and computational time required per study are on the average 2 and 20 min.
Collapse
Affiliation(s)
- Binquan Wang
- BI, Stellar-Chance Laboratories, Metabolic Magnetic Resonance Research and Computing Center, Department of Radiology, Hospital of the University of Pennsylvania, 422 Curie Boulevard, Philadelphia, PA 19104, USA
| | | | | | | | | | | | | |
Collapse
|
37
|
Mayer D, Bartz D, Fischer J, Ley S, del Río A, Thust S, Kauczor HU, Heussel CP. Hybrid segmentation and virtual bronchoscopy based on CT images. Acad Radiol 2004; 11:551-65. [PMID: 15147620 DOI: 10.1016/j.acra.2004.01.012] [Citation(s) in RCA: 43] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2003] [Revised: 12/22/2003] [Accepted: 01/23/2004] [Indexed: 11/18/2022]
Abstract
RATIONALE AND OBJECTIVES Introduction of combination of the segmentation tool SegoMeTex and the virtual endoscopy system VIVENDI to perform virtual endoscopic inspections of the human lung. This virtual bronchoscopy system enables visualization of the tracheobronchial tree down to seventh generation. Furthermore, the modified virtual system visualizes hidden structures such as segmented vascular system or tumors. MATERIALS AND METHODS The segmentation is based on image data acquired by a multislice computed tomography scanner. SegoMeTex is used to segment the tracheobronchial tree by a hybrid system with minimal user action. Similarly, the complementary pulmonary arterial can be segmented, whereas additional structures such as tumors are marked manually. On this dataset, subsequently, data structures of the inner surface for virtual endoscopy are generated. Finally, the dataset can be explored by a virtual bronchoscopy procedure using the VIVENDI system. RESULTS The segmentation method was successfully tested on 22 patients. The hybrid segmentation system identified bronchi up to the sixth generation with a sensitivity of more than 58%, and a positive predictive value of more than 90%. After the segmentation, the datasets are explored interactively (>30 fps on a standard personal computer platform in real-time rendering) using the virtual endoscopy software. The exploration exposed a high-quality reconstruction, even of small structures throughout the dataset. CONCLUSION Virtual bronchoscopy in combining with a highly sensitive segmentation is a valuable tool for the localization and measurement of stenosis for resection planning.
Collapse
Affiliation(s)
- Dirk Mayer
- Department of Radiology, Johannes-Gutenberg-University, Mainz D-55131, Germany.
| | | | | | | | | | | | | | | |
Collapse
|
38
|
Yin TK, Chiu NT. A computer-aided diagnosis for locating abnormalities in bone scintigraphy by a fuzzy system with a three-step minimization approach. IEEE TRANSACTIONS ON MEDICAL IMAGING 2004; 23:639-654. [PMID: 15147016 DOI: 10.1109/tmi.2004.826355] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Bone scintigraphy is an effective method to diagnose bone diseases such as bone tumors. In the scintigraphic images, bone abnormalities are widely scattered on the whole body. Conventionally, radiologists visually check the whole-body images and find the distributed abnormalities based on their expertise. This manual process is time-consuming and it is not unusual to miss some abnormalities. In this paper, a computer-aided diagnosis (CAD) system is proposed to assist radiologists in the diagnosis of bone scintigraphy. The system will provide warning marks and abnormal scores on some locations of the images to direct radiologists' attention toward these locations. A fuzzy system called characteristic-point-based fuzzy inference system (CPFIS) is employed to implement the diagnosis system and three minimizations are used to systematically train the CPFIS. Asymmetry and brightness are chosen as the two inputs to the CPFIS according to radiologists' knowledge. The resulting CAD system is of a small-sized rule base such that the resulting fuzzy rules can be not only easily understood by radiologists, but also matched to and compared with their expert knowledge. The prototype CAD system was tested on 82 abnormal images and 27 normal images. We employed free-response receiver operating characteristics method with the mean number of false positives (FPs) and the sensitivity as performance indexes to evaluate the proposed system. The sensitivity is 91.5% (227 of 248) and the mean number of FPs is 37.3 per image. The high sensitivity and moderate numbers of FP marks per image shows that the proposed method can provide an effective second-reader information to radiologists in the diagnosis of bone scintigraphy.
Collapse
Affiliation(s)
- Tang-Kai Yin
- Department of Management Information Science, Chia-Nan University of Pharmacy and Science, Tainan, Taiwan, ROC.
| | | |
Collapse
|
39
|
Leader JK, Zheng B, Rogers RM, Sciurba FC, Perez A, Chapman BE, Patel S, Fuhrman CR, Gur D. Automated lung segmentation in X-ray computed tomography: development and evaluation of a heuristic threshold-based scheme. Acad Radiol 2004; 10:1224-36. [PMID: 14626297 DOI: 10.1016/s1076-6332(03)00380-5] [Citation(s) in RCA: 103] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
RATIONALE AND OBJECTIVES To develop and evaluate a reliable, fully-automated lung segmentation scheme for application in X-ray computed tomography. MATERIALS AND METHODS The automated scheme was heuristically developed using a slice-based, pixel-value threshold and two sets of classification rules. Features used in the rules include size, circularity, and location. The segmentation scheme operates slice-by-slice and performs three key operations: (1) image preprocessing to remove background pixels, (2) computation and application of a pixel-value threshold to identify lung tissue, and (3) refinement of the initial segmented regions to prune incorrectly detected airways and separate fused right and left lungs. RESULTS The performance of the automated segmentation scheme was evaluated using 101 computed tomography cases (91 thick slice, 10 thin slice scans). The 91 thick cases were pre- and post-surgery from 50 patients and were not independent. The automated scheme successfully segmented 94.0% of the 2,969 thick slice images and 97.6% of the 1,161 thin slice images. The mean difference of the total lung volumes calculated by the automated scheme and functional residual capacity plus 60% inspiratory capacity was -24.7 +/- 508.1 mL. The mean differences of the total lung volumes calculated by the automated scheme and an established, commonly used semi-automated scheme were 95.2 +/- 52.5 mL and -27.7 +/- 66.9 mL for the thick and thin slice cases, respectively. CONCLUSION This simple, fully-automated lung segmentation scheme provides an objective tool to facilitate lung segmentation from computed tomography scans.
Collapse
Affiliation(s)
- Joseph K Leader
- Department of Radiology, University of Pittsburgh, Imaging Research Division, 300 Halket St, Suite 4200, Pittsburgh, PA 15213, USA
| | | | | | | | | | | | | | | | | |
Collapse
|
40
|
Saba OI, Hoffman EA, Reinhardt JM. Maximizing quantitative accuracy of lung airway lumen and wall measures obtained from X-ray CT imaging. J Appl Physiol (1985) 2003; 95:1063-75. [PMID: 12754180 DOI: 10.1152/japplphysiol.00962.2002] [Citation(s) in RCA: 84] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
To objectively quantify airway geometry from three-dimensional computed tomographic (CT) images, an idealized (circular cross section) airway model is parameterized by airway luminal caliber, wall thickness, and tilt angle. Using a two-dimensional CT slice, an initial guess for the airway center, and the full-width-half-maximum principle, we form an estimate of inner and outer airway wall locations. We then fit ellipses to the inner and outer airway walls via a direct least squares fit and use the major and minor axes of the ellipses to estimate the tilt and in-plane rotation angles. Convolving the airway model, initialized with these estimates, with the three-dimensional scanner point-spread function forms the predicted image. The difference between predicted and actual images is minimized by refining the model parameter estimates via a multidimensional, unconstrained, nonlinear minimization routine. When optimization converges, airway model parameters estimate the airway inner and outer radii and tilt angle. Results using a Plexiglas phantom show that tilt angle is estimated to within +/-4 degrees and both inner and outer radii to within one-half pixel when a "standard" CT reconstruction kernel is used. By opening up the ability to measure airways that are not oriented perpendicular to the scanning plane, this method allows evaluation of a greater sampling of airways in a two-dimensional CT slice than previously possible. In addition, by combining the tilt-angle compensation with the deconvolution method, we provide significant improvement over the previous full-width-half-maximum method for assessing location of the luminal edge but not the outer edge of the airway wall.
Collapse
Affiliation(s)
- Osama I Saba
- Department of Biomedical Engineering, University of Iowa, Iowa City, IA 52242, USA
| | | | | |
Collapse
|
41
|
Aykac D, Hoffman EA, McLennan G, Reinhardt JM. Segmentation and analysis of the human airway tree from three-dimensional X-ray CT images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2003; 22:940-950. [PMID: 12906248 DOI: 10.1109/tmi.2003.815905] [Citation(s) in RCA: 109] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
The lungs exchange air with the external environment via the pulmonary airways. Computed tomography (CT) scanning can be used to obtain detailed images of the pulmonary anatomy, including the airways. These images have been used to measure airway geometry, study airway reactivity, and guide surgical interventions. Prior to these applications, airway segmentation can be used to identify the airway lumen in the CT images. Airway tree segmentation can be performed manually by an image analyst, but the complexity of the tree makes manual segmentation tedious and extremely time-consuming. We describe a fully automatic technique for segmenting the airway tree in three-dimensional (3-D) CT images of the thorax. We use grayscale morphological reconstruction to identify candidate airways on CT slices and then reconstruct a connected 3-D airway tree. After segmentation, we estimate airway branchpoints based on connectivity changes in the reconstructed tree. Compared to manual analysis on 3-mm-thick electron-beam CT images, the automatic approach has an overall airway branch detection sensitivity of approximately 73%.
Collapse
Affiliation(s)
- Deniz Aykac
- Department of Biomedical Engineering, University of Iowa, Iowa City, IA 52242, USA
| | | | | | | |
Collapse
|
42
|
Low DA, Nystrom M, Kalinin E, Parikh P, Dempsey JF, Bradley JD, Mutic S, Wahab SH, Islam T, Christensen G, Politte DG, Whiting BR. A method for the reconstruction of four-dimensional synchronized CT scans acquired during free breathing. Med Phys 2003; 30:1254-63. [PMID: 12852551 DOI: 10.1118/1.1576230] [Citation(s) in RCA: 329] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Breathing motion is a significant source of error in radiotherapy treatment planning for the thorax and upper abdomen. Accounting for breathing motion has a profound effect on the size of conformal radiation portals employed in these sites. Breathing motion also causes artifacts and distortions in treatment planning computed tomography (CT) scans acquired during free breathing and also causes a breakdown of the assumption of the superposition of radiation portals in intensity-modulated radiation therapy, possibly leading to significant dose delivery errors. Proposed voluntary and involuntary breath-hold techniques have the potential for reducing or eliminating the effects of breathing motion, however, they are limited in practice, by the fact that many lung cancer patients cannot tolerate holding their breath. We present an alternative solution to accounting for breathing motion in radiotherapy treatment planning, where multislice CT scans are collected simultaneously with digital spirometry over many free breathing cycles to create a four-dimensional (4-D) image set, where tidal lung volume is the additional dimension. An analysis of this 4-D data leads to methods for digital-spirometry, based elimination or accounting of breathing motion artifacts in radiotherapy treatment planning for free breathing patients. The 4-D image set is generated by sorting free-breathing multislice CT scans according to user-defined tidal-volume bins. A multislice CT scanner is operated in the ciné mode, acquiring 15 scans per couch position, while the patient undergoes simultaneous digital-spirometry measurements. The spirometry is used to retrospectively sort the CT scans by their correlated tidal lung volume within the patient's normal breathing cycle. This method has been prototyped using data from three lung cancer patients. The actual tidal lung volumes agreed with the specified bin volumes within standard deviations ranging between 22 and 33 cm3. An analysis of sagittal and coronal images demonstrated relatively small (<1 cm) motion artifacts along the diaphragm, even for tidal volumes where the rate of breathing motion is greatest. While still under development, this technology has the potential for revolutionizing the radiotherapy treatment planning for the thorax and upper abdomen.
Collapse
Affiliation(s)
- Daniel A Low
- Department of Radiation Oncology, Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, Missouri 63110, USA.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
43
|
Li B, Christensen GE, Hoffman EA, McLennan G, Reinhardt JM. Establishing a normative atlas of the human lung: intersubject warping and registration of volumetric CT images. Acad Radiol 2003; 10:255-65. [PMID: 12643552 DOI: 10.1016/s1076-6332(03)80099-5] [Citation(s) in RCA: 93] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
RATIONALE AND OBJECTIVES To establish the range of normal values for quantitative CT-based measures of lung structure and function, the authors developed a method for matching pulmonary structures across individuals and creating a normative human lung atlas. MATERIALS AND METHODS A computerized human lung atlas was synthesized from computed tomographic (CT) images from six subjects by means of three-dimensional image registration. The authors identified a set of reproducible feature points for each CT image and used these points to establish correspondences across subjects, used a landmark- and intensity-based consistent image registration algorithm to register a template image volume from the population to the rest of the pulmonary CT volumes in the population, averaged these transformations, and constructed an atlas by deforming the template with the average transformation. RESULTS The effectiveness of the authors' method was evaluated and visualized by means of both gray-level and segmented CT images. The method reduced the average landmark registration error from 10.5 mm to 0.4 mm and the average relative volume overlap error from 0.7 to 0.11 for the six data sets studied. CONCLUSION The method, and the computerized human lung atlas constructed and visualized by the authors with this method, provides a basis for establishing regional ranges of normative values for structural and functional measures of the human lung.
Collapse
Affiliation(s)
- Baojun Li
- Department of Biomedical Engineering, University of Iowa, 1402 SC, Iowa City, IA 52242, USA
| | | | | | | | | |
Collapse
|
44
|
Liu J, Udupa JK, Odhnera D, McDonough JM, Arens R. System for upper airway segmentation and measurement with MR imaging and fuzzy connectedness. Acad Radiol 2003; 10:13-24. [PMID: 12529024 DOI: 10.1016/s1076-6332(03)80783-3] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
RATIONALE AND OBJECTIVES The purpose of this study was to evaluate whether a computerized system developed to help delineate the upper airway and surrounding structures with magnetic resonance (MR) imaging was effective for aiding in the diagnosis of upper airway disorders in children. MATERIALS AND METHODS The authors performed axial T2-weighted MR imaging to gather information about different aspects of the airway and its surrounding soft-tissue structures, including the adenoid and palatine tonsils, tongue, and soft palate. Images were processed and segmented to compute the architectural parameters of the airway (eg, surface description, volume, central [medial] line, and cross-sectional areas at planes perpendicular to the central line). The authors built a software package for the visualization, segmentation, registration, prefiltering, interpolation, standardization, and quantitative analysis of the airway and tonsils. RESULTS The system was tested with 40 patient studies. For every study, the system segmented and displayed a smooth three-dimensional rendition of the airway and its central line and a plot of the cross-sectional area of the airway orthogonal to the central line as a function of the distance from one end of the central line. The precision and accuracy for segmentation was 97%. The mean time taken per study was about 4 minutes and included the operator interaction time and processing time. CONCLUSION This method provides a robust and fast means of assessing the airway size, shape, and level of restriction, as well as a structural data set suitable for use in modeling studies of airflow and mechanics.
Collapse
Affiliation(s)
- Jianguo Liu
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 4th Floor, Blockley Hall, 423 Guardian Dr, Philadelphia, PA 19104-6021, USA
| | | | | | | | | |
Collapse
|
45
|
Kiraly AP, Higgins WE, McLennan G, Hoffman EA, Reinhardt JM. Three-dimensional human airway segmentation methods for clinical virtual bronchoscopy. Acad Radiol 2002; 9:1153-68. [PMID: 12385510 DOI: 10.1016/s1076-6332(03)80517-2] [Citation(s) in RCA: 77] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
RATIONALE AND OBJECTIVES The segmentation of airways from CT images is a critical first step for numerous virtual bronchoscopic (VB) applications. Automatic or semiautomatic methods are necessary, since manual segmentation is prohibitively time consuming. The methods must be robust and operate within a reasonable time frame to be useful for clinical VB use. The authors developed an integrated airway segmentation system and demonstrated its effectiveness on a series of human images. MATERIALS AND METHODS The authors' airway segmentation system draws on two segmentation algorithms: (a) an adaptive region-growing algorithm and (b) a new hybrid algorithm that uses both region growing and mathematical morphology. Images from an ongoing VB study were segmented by means of both the adaptive region-growing and the new hybrid methods. The segmentation volume, branch number estimate, and segmentation quality were determined for each case. RESULTS The results demonstrate the need for an integrated segmentation system, since no single method is superior for all clinically relevant cases. The region-growing algorithm is the fastest and provides acceptable segmentations for most VB applications, but the hybrid method provides superior airway edge localization, making it better suited for quantitative applications. In addition, the authors show that prefiltering the image data before airway segmentation increases the robustness of both region-growing and hybrid methods. CONCLUSION The combination of these two algorithms with the prefiltering options allowed the successful segmentation of all test images. The times required for all segmentations were acceptable, and the results were suitable for the authors' VB application needs.
Collapse
Affiliation(s)
- Atilla P Kiraly
- Department of Computer Science and Engineering, Penn State University, PA, USA
| | | | | | | | | |
Collapse
|
46
|
|
47
|
Abstract
Computer-aided methods are now being developed for the detection and characterization of pulmonary nodules found in CT images, based on techniques from computer vision, image processing, and pattern classification. With the increasing resolution of modern CT scanners, computer methods provide continually improving accuracy, reproducibility, and utility in analyzing the larger numbers of images acquired in a lung screening exam or diagnostic study. This article describes the fundamental tools and issues involved in computer-aided nodule detection and characterization, as we move from two-dimensional toward three-dimensional automated methods. In particular, we focus on the new domain of "small" pulmonary nodules.
Collapse
Affiliation(s)
- A P Reeves
- School of Electrical Engineering, Cornell University, Ithaca, NY 14853, USA
| | | |
Collapse
|
48
|
Yoshida K, Tadokoro H, Shimada K, Endo M, Satoh K, Kitsukawa S, Takami A, Masuda Y, Kusakabe M, Sasaki Y. Cone-beam CT angiography of the thorax: an experimental study. JAPANESE CIRCULATION JOURNAL 1999; 63:789-93. [PMID: 10553922 DOI: 10.1253/jcj.63.789] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The authors recently developed a cone-beam computed tomography (CT) scanner and this report presents their evaluation of its potential for thoracic vascular imaging. An X-ray tube and a video-fluoroscopic system were rotated around the objects and 360 projected images were collected in a 12-s scan. Each image was digitized and a 3 dimensional (D) image (256x256x256 voxel volume with a voxel dimension of 0.9x0.9x0.9 mm) was reconstructed. Two different 3D-CT angiographies were investigated in 2 pigs: right atriography and thoracic aortography. Each pig was anesthetized, mechanically ventilated and positioned within the scanner. Contrast agent was infused through the right atrium or the aortic root at a rate of 3 ml/s during the scan. The right atriography scan clearly delineated the anatomy of the pulmonary artery, heart chambers and thoracic aorta. The thoracic aortography scan also clearly delineated the aortic anatomy including the internal thoracic and intercostal arteries. In conclusion, cone-beam CT angiography is potentially useful for thoracic vascular imaging.
Collapse
Affiliation(s)
- K Yoshida
- Third Department of Internal Medicine, Chiba University School of Medicine, Japan
| | | | | | | | | | | | | | | | | | | |
Collapse
|