1
|
Jerónimo A, Valenzuela O, Rojas I. Statistical Analysis of nnU-Net Models for Lung Nodule Segmentation. J Pers Med 2024; 14:1016. [PMID: 39452524 PMCID: PMC11508652 DOI: 10.3390/jpm14101016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Revised: 09/05/2024] [Accepted: 09/19/2024] [Indexed: 10/26/2024] Open
Abstract
This paper aims to conduct a statistical analysis of different components of nnU-Net models to build an optimal pipeline for lung nodule segmentation in computed tomography images (CT scan). This study focuses on semantic segmentation of lung nodules, using the UniToChest dataset. Our approach is based on the nnU-Net framework and is designed to configure a whole segmentation pipeline, thereby avoiding many complex design choices, such as data properties and architecture configuration. Although these framework results provide a good starting point, many configurations in this problem can be optimized. In this study, we tested two U-Net-based architectures, using different preprocessing techniques, and we modified the existing hyperparameters provided by nnU-Net. To study the impact of different settings on model segmentation accuracy, we conducted an analysis of variance (ANOVA) statistical analysis. The factors studied included the datasets according to nodule diameter size, model, preprocessing, polynomial learning rate scheduler, and number of epochs. The results of the ANOVA analysis revealed significant differences in the datasets, models, and preprocessing.
Collapse
Affiliation(s)
- Alejandro Jerónimo
- Computer Engineering, Automatics and Robotics Department, University of Granada, 18071 Granada, Spain;
| | - Olga Valenzuela
- Department of Applied Mathematics, University of Granada, 18071 Granada, Spain;
| | - Ignacio Rojas
- Computer Engineering, Automatics and Robotics Department, University of Granada, 18071 Granada, Spain;
| |
Collapse
|
2
|
Sun L, Zhang M, Lu Y, Zhu W, Yi Y, Yan F. Nodule-CLIP: Lung nodule classification based on multi-modal contrastive learning. Comput Biol Med 2024; 175:108505. [PMID: 38688129 DOI: 10.1016/j.compbiomed.2024.108505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 02/28/2024] [Accepted: 04/21/2024] [Indexed: 05/02/2024]
Abstract
The latest developments in deep learning have demonstrated the importance of CT medical imaging for the classification of pulmonary nodules. However, challenges remain in fully leveraging the relevant medical annotations of pulmonary nodules and distinguishing between the benign and malignant labels of adjacent nodules. Therefore, this paper proposes the Nodule-CLIP model, which deeply mines the potential relationship between CT images, complex attributes of lung nodules, and benign and malignant attributes of lung nodules through a comparative learning method, and optimizes the model in the image feature extraction network by using its similarities and differences to improve its ability to distinguish similar lung nodules. Firstly, we segment the 3D lung nodule information by U-Net to reduce the interference caused by the background of lung nodules and focus on the lung nodule images. Secondly, the image features, class features, and complex attribute features are aligned by contrastive learning and loss function in Nodule-CLIP to achieve lung nodule image optimization and improve classification ability. A series of testing and ablation experiments were conducted on the public dataset LIDC-IDRI, and the final benign and malignant classification rate was 90.6%, and the recall rate was 92.81%. The experimental results show the advantages of this method in terms of lung nodule classification as well as interpretability.
Collapse
Affiliation(s)
- Lijing Sun
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Mengyi Zhang
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China.
| | - Yu Lu
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Wenjun Zhu
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Yang Yi
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Fei Yan
- Jiangsu Institute of Cancer Research & The Affiliated Cancer Hospital of Nanjing Medical University, Jiangsu Cancer Hospital, Nanjing, 210009, Jiangsu, China
| |
Collapse
|
3
|
Bbosa R, Gui H, Luo F, Liu F, Efio-Akolly K, Chen YPP. MRUNet-3D: A multi-stride residual 3D UNet for lung nodule segmentation. Methods 2024; 226:89-101. [PMID: 38642628 DOI: 10.1016/j.ymeth.2024.04.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Revised: 02/02/2024] [Accepted: 04/07/2024] [Indexed: 04/22/2024] Open
Abstract
Obtaining an accurate segmentation of the pulmonary nodules in computed tomography (CT) images is challenging. This is due to: (1) the heterogeneous nature of the lung nodules; (2) comparable visual characteristics between the nodules and their surroundings. A robust multi-scale feature extraction mechanism that can effectively obtain multi-scale representations at a granular level can improve segmentation accuracy. As the most commonly used network in lung nodule segmentation, UNet, its variants, and other image segmentation methods lack this robust feature extraction mechanism. In this study, we propose a multi-stride residual 3D UNet (MRUNet-3D) to improve the segmentation accuracy of lung nodules in CT images. It incorporates a multi-slide Res2Net block (MSR), which replaces the simple sequence of convolution layers in each encoder stage to effectively extract multi-scale features at a granular level from different receptive fields and resolutions while conserving the strengths of 3D UNet. The proposed method has been extensively evaluated on the publicly available LUNA16 dataset. Experimental results show that it achieves competitive segmentation performance with an average dice similarity coefficient of 83.47 % and an average surface distance of 0.35 mm on the dataset. More notably, our method has proven to be robust to the heterogeneity of lung nodules. It has also proven to perform better at segmenting small lung nodules. Ablation studies have shown that the proposed MSR and RFIA modules are fundamental to improving the performance of the proposed model.
Collapse
Affiliation(s)
- Ronald Bbosa
- School of Computer Science, Wuhan University, Wuhan, China.
| | - Hao Gui
- School of Computer Science, Wuhan University, Wuhan, China
| | - Fei Luo
- School of Computer Science, Wuhan University, Wuhan, China
| | - Feng Liu
- School of Computer Science, Wuhan University, Wuhan, China
| | | | - Yi-Ping Phoebe Chen
- Department of Computer Science and Information Technology, La Trobe University, Melbourne, Australia
| |
Collapse
|
4
|
Yang L, Shao D, Huang Z, Geng M, Zhang N, Chen L, Wang X, Liang D, Pang ZF, Hu Z. Few-shot segmentation framework for lung nodules via an optimized active contour model. Med Phys 2024; 51:2788-2805. [PMID: 38189528 DOI: 10.1002/mp.16933] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 11/07/2023] [Accepted: 12/15/2023] [Indexed: 01/09/2024] Open
Abstract
BACKGROUND Accurate segmentation of lung nodules is crucial for the early diagnosis and treatment of lung cancer in clinical practice. However, the similarity between lung nodules and surrounding tissues has made their segmentation a longstanding challenge. PURPOSE Existing deep learning and active contour models each have their limitations. This paper aims to integrate the strengths of both approaches while mitigating their respective shortcomings. METHODS In this paper, we propose a few-shot segmentation framework that combines a deep neural network with an active contour model. We introduce heat kernel convolutions and high-order total variation into the active contour model and solve the challenging nonsmooth optimization problem using the alternating direction method of multipliers. Additionally, we use the presegmentation results obtained from training a deep neural network on a small sample set as the initial contours for our optimized active contour model, addressing the difficulty of manually setting the initial contours. RESULTS We compared our proposed method with state-of-the-art methods for segmentation effectiveness using clinical computed tomography (CT) images acquired from two different hospitals and the publicly available LIDC dataset. The results demonstrate that our proposed method achieved outstanding segmentation performance according to both visual and quantitative indicators. CONCLUSION Our approach utilizes the output of few-shot network training as prior information, avoiding the need to select the initial contour in the active contour model. Additionally, it provides mathematical interpretability to the deep learning, reducing its dependency on the quantity of training samples.
Collapse
Affiliation(s)
- Lin Yang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- College of Mathematics and Statistics, Henan University, Kaifeng, China
| | - Dan Shao
- Department of Nuclear Medicine, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Zhenxing Huang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Mengxiao Geng
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- College of Mathematics and Statistics, Henan University, Kaifeng, China
| | - Na Zhang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China
| | - Long Chen
- Department of PET/CT Center and the Department of Thoracic Cancer I, Cancer Center of Yunnan Province, Yunnan Cancer Hospital, The Third Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Xi Wang
- Department of PET/CT Center and the Department of Thoracic Cancer I, Cancer Center of Yunnan Province, Yunnan Cancer Hospital, The Third Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Dong Liang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China
| | - Zhi-Feng Pang
- College of Mathematics and Statistics, Henan University, Kaifeng, China
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China
| |
Collapse
|
5
|
Rikhari H, Baidya Kayal E, Ganguly S, Sasi A, Sharma S, Dheeksha DS, Saini M, Rangarajan K, Bakhshi S, Kandasamy D, Mehndiratta A. Fully automatic deep learning-based lung parenchyma segmentation and boundary correction in thoracic CT scans. Int J Comput Assist Radiol Surg 2024; 19:261-272. [PMID: 37594684 DOI: 10.1007/s11548-023-03010-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Accepted: 07/25/2023] [Indexed: 08/19/2023]
Abstract
PURPOSE The proposed work aims to develop an algorithm to precisely segment the lung parenchyma in thoracic CT scans. To achieve this goal, the proposed technique utilized a combination of deep learning and traditional image processing algorithms. The initial step utilized a trained convolutional neural network (CNN) to generate preliminary lung masks, followed by the proposed post-processing algorithm for lung boundary correction. METHODS First, the proposed method trained an improved 2D U-Net CNN model with Inception-ResNet-v2 as its backbone. The model was trained on 32 CT scans from two different sources: one from the VESSEL12 grand challenge and the other from AIIMS Delhi. Further, the model's performance was evaluated on a test dataset of 16 CT scans with juxta-pleural nodules obtained from AIIMS Delhi and the LUNA16 challenge. The model's performance was assessed using evaluation metrics such as average volumetric dice coefficient (DSCavg), average IoU score (IoUavg), and average F1 score (F1avg). Finally, the proposed post-processing algorithm was implemented to eliminate false positives from the model's prediction and to include juxta-pleural nodules in the final lung masks. RESULTS The trained model reported a DSCavg of 0.9791 ± 0.008, IoUavg of 0.9624 ± 0.007, and F1avg of 0.9792 ± 0.004 on the test dataset. Applying the post-processing algorithm to the predicted lung masks obtained a DSCavg of 0.9713 ± 0.007, IoUavg of 0.9486 ± 0.007, and F1avg of 0.9701 ± 0.008. The post-processing algorithm successfully included juxta-pleural nodules in the final lung mask. CONCLUSIONS Using a CNN model, the proposed method for lung parenchyma segmentation produced precise segmentation results. Furthermore, the post-processing algorithm addressed false positives and negatives in the model's predictions. Overall, the proposed approach demonstrated promising results for lung parenchyma segmentation. The method has the potential to be valuable in the advancement of computer-aided diagnosis (CAD) systems for automatic nodule detection.
Collapse
Affiliation(s)
- Himanshu Rikhari
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Esha Baidya Kayal
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Shuvadeep Ganguly
- All India Institute of Medical Sciences New Delhi, Medical Oncology, Dr. B.R.A. IRCH, New Delhi, India
| | - Archana Sasi
- All India Institute of Medical Sciences New Delhi, Medical Oncology, Dr. B.R.A. IRCH, New Delhi, India
| | - Swetambri Sharma
- All India Institute of Medical Sciences New Delhi, Medical Oncology, Dr. B.R.A. IRCH, New Delhi, India
| | - D S Dheeksha
- Radiodiagnosis, All India Institute of Medical Sciences New Delhi, New Delhi, India
| | - Manish Saini
- Radiodiagnosis, All India Institute of Medical Sciences New Delhi, New Delhi, India
| | - Krithika Rangarajan
- Radiodiagnosis, All India Institute of Medical Sciences New Delhi, Dr. B.R.A. IRCH, New Delhi, India
| | - Sameer Bakhshi
- All India Institute of Medical Sciences New Delhi, Medical Oncology, Dr. B.R.A. IRCH, New Delhi, India
| | | | - Amit Mehndiratta
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India.
- Department of Biomedical Engineering, All India Institute of Medical Sciences New Delhi, New Delhi, India.
| |
Collapse
|
6
|
Siddiqui EA, Chaurasia V, Shandilya M. Classification of lung cancer computed tomography images using a 3-dimensional deep convolutional neural network with multi-layer filter. J Cancer Res Clin Oncol 2023; 149:11279-11294. [PMID: 37368121 DOI: 10.1007/s00432-023-04992-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 06/15/2023] [Indexed: 06/28/2023]
Abstract
Lung cancer creates pulmonary nodules in the patient's lung, which may be diagnosed early on using computer-aided diagnostics. A novel automated pulmonary nodule diagnosis technique using three-dimensional deep convolutional neural networks and multi-layered filter has been presented in this paper. For the suggested automated diagnosis of lung nodule, volumetric computed tomographic images are employed. The proposed approach generates three-dimensional feature layers, which retain the temporal links between adjacent slices of computed tomographic images. The use of several activation functions at different levels of the proposed network results in increased feature extraction and efficient classification. The suggested approach divides lung volumetric computed tomography pictures into malignant and benign categories. The suggested technique's performance is evaluated using three commonly used datasets in the domain: LUNA 16, LIDC-IDRI, and TCIA. The proposed method outperforms the state-of-the-art in terms of accuracy, sensitivity, specificity, F-1 score, false-positive rate, false-negative rate, and error rate.
Collapse
Affiliation(s)
| | | | - Madhu Shandilya
- Maulana Azad National Institute of Technology, Bhopal, 462003, India
| |
Collapse
|
7
|
Mridha MF, Prodeep AR, Hoque ASMM, Islam MR, Lima AA, Kabir MM, Hamid MA, Watanobe Y. A Comprehensive Survey on the Progress, Process, and Challenges of Lung Cancer Detection and Classification. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5905230. [PMID: 36569180 PMCID: PMC9788902 DOI: 10.1155/2022/5905230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 10/17/2022] [Accepted: 11/09/2022] [Indexed: 12/23/2022]
Abstract
Lung cancer is the primary reason of cancer deaths worldwide, and the percentage of death rate is increasing step by step. There are chances of recovering from lung cancer by detecting it early. In any case, because the number of radiologists is limited and they have been working overtime, the increase in image data makes it hard for them to evaluate the images accurately. As a result, many researchers have come up with automated ways to predict the growth of cancer cells using medical imaging methods in a quick and accurate way. Previously, a lot of work was done on computer-aided detection (CADe) and computer-aided diagnosis (CADx) in computed tomography (CT) scan, magnetic resonance imaging (MRI), and X-ray with the goal of effective detection and segmentation of pulmonary nodule, as well as classifying nodules as malignant or benign. But still, no complete comprehensive review that includes all aspects of lung cancer has been done. In this paper, every aspect of lung cancer is discussed in detail, including datasets, image preprocessing, segmentation methods, optimal feature extraction and selection methods, evaluation measurement matrices, and classifiers. Finally, the study looks into several lung cancer-related issues with possible solutions.
Collapse
Affiliation(s)
- M. F. Mridha
- Department of Computer Science and Engineering, American International University Bangladesh, Dhaka 1229, Bangladesh
| | - Akibur Rahman Prodeep
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh
| | - A. S. M. Morshedul Hoque
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh
| | - Md. Rashedul Islam
- Department of Computer Science and Engineering, University of Asia Pacific, Dhaka 1216, Bangladesh
| | - Aklima Akter Lima
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh
| | - Muhammad Mohsin Kabir
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh
| | - Md. Abdul Hamid
- Department of Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Yutaka Watanobe
- Department of Computer Science and Engineering, University of Aizu, Aizuwakamatsu 965-8580, Japan
| |
Collapse
|
8
|
Tang T, Li F, Jiang M, Xia X, Zhang R, Lin K. Improved Complementary Pulmonary Nodule Segmentation Model Based on Multi-Feature Fusion. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1755. [PMID: 36554161 PMCID: PMC9778431 DOI: 10.3390/e24121755] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 11/23/2022] [Accepted: 11/28/2022] [Indexed: 06/17/2023]
Abstract
Accurate segmentation of lung nodules from pulmonary computed tomography (CT) slices plays a vital role in the analysis and diagnosis of lung cancer. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in the automatic segmentation of lung nodules. However, they are still challenged by the large diversity of segmentation targets, and the small inter-class variances between the nodule and its surrounding tissues. To tackle this issue, we propose a features complementary network according to the process of clinical diagnosis, which made full use of the complementarity and facilitation among lung nodule location information, global coarse area, and edge information. Specifically, we first consider the importance of global features of nodules in segmentation and propose a cross-scale weighted high-level feature decoder module. Then, we develop a low-level feature decoder module for edge feature refinement. Finally, we construct a complementary module to make information complement and promote each other. Furthermore, we weight pixels located at the nodule edge on the loss function and add an edge supervision to the deep supervision, both of which emphasize the importance of edges in segmentation. The experimental results demonstrate that our model achieves robust pulmonary nodule segmentation and more accurate edge segmentation.
Collapse
Affiliation(s)
- Tiequn Tang
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
- Key Laboratory of Optical Technology and Instrument for Medicine, Ministry of Education, University of Shanghai for Science and Technology, Shanghai 200093, China
- School of Physics and Electronic Engineering, Fuyang Normal University, Fuyang 236037, China
| | - Feng Li
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
- Key Laboratory of Optical Technology and Instrument for Medicine, Ministry of Education, University of Shanghai for Science and Technology, Shanghai 200093, China
| | - Minshan Jiang
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
- Key Laboratory of Optical Technology and Instrument for Medicine, Ministry of Education, University of Shanghai for Science and Technology, Shanghai 200093, China
- Department of Biomedical Engineering, Florida International University, Miami, FL 33174, USA
| | - Xunpeng Xia
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
- Key Laboratory of Optical Technology and Instrument for Medicine, Ministry of Education, University of Shanghai for Science and Technology, Shanghai 200093, China
| | - Rongfu Zhang
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
- Key Laboratory of Optical Technology and Instrument for Medicine, Ministry of Education, University of Shanghai for Science and Technology, Shanghai 200093, China
| | - Kailin Lin
- Fudan University Shanghai Cancer Center, Shanghai 200032, China
| |
Collapse
|
9
|
An Automatic Random Walker Algorithm for Segmentation of Ground Glass Opacity Pulmonary Nodules. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:6727957. [PMID: 36212245 PMCID: PMC9537033 DOI: 10.1155/2022/6727957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Revised: 07/02/2021] [Accepted: 01/06/2022] [Indexed: 11/24/2022]
Abstract
Automatic and accurate segmentation of ground glass opacity (GGO) nodules still remains challenging due to inhomogeneous interiors, irregular shapes, and blurred boundaries from different patients. Despite successful applications in the image processing domains, the random walk has some limitations for segmentation of GGO pulmonary nodules. In this paper, an improved random walker method is proposed for the segmentation of GGO nodules. To calculate a new affinity matrix, intensity, spatial, and texture features are incorporated. It strengthens discriminative power between two adjacent nodes on the graph. To address the problem of robustness in seed acquisition, the geodesic distance is introduced and a novel local search strategy is presented to automatically acquire reliable seeds. For segmentation, a label constraint term is introduced to the energy function of original random walker, which alleviates the accumulation of errors caused by the initial seeds acquisition. Massive experiments conducted on Lung Images Dataset Consortium (LIDC) demonstrate that the proposed method achieves visually satisfactory results without user interactions. Both qualitative and quantitative evaluations also demonstrate that the proposed method obtains better performance compared with conventional random walker method and state-of-the-art segmentation methods in terms of the overlap score and F-measure.
Collapse
|
10
|
Fahmy D, Kandil H, Khelifi A, Yaghi M, Ghazal M, Sharafeldeen A, Mahmoud A, El-Baz A. How AI Can Help in the Diagnostic Dilemma of Pulmonary Nodules. Cancers (Basel) 2022; 14:cancers14071840. [PMID: 35406614 PMCID: PMC8997734 DOI: 10.3390/cancers14071840] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 03/29/2022] [Accepted: 03/30/2022] [Indexed: 02/04/2023] Open
Abstract
Simple Summary Pulmonary nodules are considered a sign of bronchogenic carcinoma, detecting them early will reduce their progression and can save lives. Lung cancer is the second most common type of cancer in both men and women. This manuscript discusses the current applications of artificial intelligence (AI) in lung segmentation as well as pulmonary nodule segmentation and classification using computed tomography (CT) scans, published in the last two decades, in addition to the limitations and future prospects in the field of AI. Abstract Pulmonary nodules are the precursors of bronchogenic carcinoma, its early detection facilitates early treatment which save a lot of lives. Unfortunately, pulmonary nodule detection and classification are liable to subjective variations with high rate of missing small cancerous lesions which opens the way for implementation of artificial intelligence (AI) and computer aided diagnosis (CAD) systems. The field of deep learning and neural networks is expanding every day with new models designed to overcome diagnostic problems and provide more applicable and simply used models. We aim in this review to briefly discuss the current applications of AI in lung segmentation, pulmonary nodule detection and classification.
Collapse
Affiliation(s)
- Dalia Fahmy
- Diagnostic Radiology Department, Mansoura University Hospital, Mansoura 35516, Egypt;
| | - Heba Kandil
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
- Information Technology Department, Faculty of Computers and Informatics, Mansoura University, Mansoura 35516, Egypt
| | - Adel Khelifi
- Computer Science and Information Technology Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates;
| | - Maha Yaghi
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (M.Y.); (M.G.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (M.Y.); (M.G.)
| | - Ahmed Sharafeldeen
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
| | - Ali Mahmoud
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
- Correspondence:
| |
Collapse
|
11
|
Kido S, Kidera S, Hirano Y, Mabu S, Kamiya T, Tanaka N, Suzuki Y, Yanagawa M, Tomiyama N. Segmentation of Lung Nodules on CT Images Using a Nested Three-Dimensional Fully Connected Convolutional Network. Front Artif Intell 2022; 5:782225. [PMID: 35252849 PMCID: PMC8892185 DOI: 10.3389/frai.2022.782225] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 01/17/2022] [Indexed: 11/16/2022] Open
Abstract
In computer-aided diagnosis systems for lung cancer, segmentation of lung nodules is important for analyzing image features of lung nodules on computed tomography (CT) images and distinguishing malignant nodules from benign ones. However, it is difficult to accurately and robustly segment lung nodules attached to the chest wall or with ground-glass opacities using conventional image processing methods. Therefore, this study aimed to develop a method for robust and accurate three-dimensional (3D) segmentation of lung nodule regions using deep learning. In this study, a nested 3D fully connected convolutional network with residual unit structures was proposed, and designed a new loss function. Compared with annotated images obtained under the guidance of a radiologist, the Dice similarity coefficient (DS) and intersection over union (IoU) were 0.845 ± 0.008 and 0.738 ± 0.011, respectively, for 332 lung nodules (lung adenocarcinoma) obtained from 332 patients. On the other hand, for 3D U-Net and 3D SegNet, the DS was 0.822 ± 0.009 and 0.786 ± 0.011, respectively, and the IoU was 0.711 ± 0.011 and 0.660 ± 0.012, respectively. These results indicate that the proposed method is significantly superior to well-known deep learning models. Moreover, we compared the results obtained from the proposed method with those obtained from conventional image processing methods, watersheds, and graph cuts. The DS and IoU results for the watershed method were 0.628 ± 0.027 and 0.494 ± 0.025, respectively, and those for the graph cut method were 0.566 ± 0.025 and 0.414 ± 0.021, respectively. These results indicate that the proposed method is significantly superior to conventional image processing methods. The proposed method may be useful for accurate and robust segmentation of lung nodules to assist radiologists in the diagnosis of lung nodules such as lung adenocarcinoma on CT images.
Collapse
Affiliation(s)
- Shoji Kido
- Department of Artificial Intelligence Diagnostic Radiology, Osaka University Graduate School of Medicine, Suita, Japan
| | - Shunske Kidera
- Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Ube, Japan
| | - Yasushi Hirano
- Medical Informatics and Decision Sciences, Yamaguchi University Hospital, Ube, Japan
| | - Shingo Mabu
- Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Ube, Japan
| | - Tohru Kamiya
- Department of Mechanical and Control Engineering, Faculty of Engineering Kyushu Institute of Technology, Kitakyushu, Japan
| | - Nobuyuki Tanaka
- Department of Radiology, National Hospital Organization, Yamaguchi-Ube Medical Center, Ube, Japan
| | - Yuki Suzuki
- Department of Artificial Intelligence Diagnostic Radiology, Osaka University Graduate School of Medicine, Suita, Japan
| | - Masahiro Yanagawa
- Department of Radiology, Osaka University Graduate School of Medicine, Suita, Japan
| | - Noriyuki Tomiyama
- Department of Radiology, Osaka University Graduate School of Medicine, Suita, Japan
| |
Collapse
|
12
|
Zhang X, Liu X, Zhang B, Dong J, Zhang B, Zhao S, Li S. Accurate segmentation for different types of lung nodules on CT images using improved U-Net convolutional network. Medicine (Baltimore) 2021; 100:e27491. [PMID: 34622882 PMCID: PMC8500581 DOI: 10.1097/md.0000000000027491] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Revised: 09/02/2021] [Accepted: 09/23/2021] [Indexed: 01/05/2023] Open
Abstract
ABSTRACT Since lung nodules on computed tomography images can have different shapes, contours, textures or locations and may be attached to neighboring blood vessels or pleural surfaces, accurate segmentation is still challenging. In this study, we propose an accurate segmentation method based on an improved U-Net convolutional network for different types of lung nodules on computed tomography images.The first phase is to segment lung parenchyma and correct the lung contour by applying α-hull algorithm. The second phase is to extract image pairs of patches containing lung nodules in the center and the corresponding ground truth and build an improved U-Net network with introduction of batch normalization.A large number of experiments manifest that segmentation performance of Dice loss has superior results than mean square error and Binary_crossentropy loss. The α-hull algorithm and batch normalization can improve the segmentation performance effectively. Our best result for Dice similar coefficient (0.8623) is also more competitive than other state-of-the-art segmentation algorithms.In order to segment different types of lung nodules accurately, we propose an improved U-Net network, which can improve the segmentation accuracy effectively. Moreover, this work also has practical value in helping radiologists segment lung nodules and diagnose lung cancer.
Collapse
|
13
|
Lung Nodule Detection from Feature Engineering to Deep Learning in Thoracic CT Images: a Comprehensive Review. J Digit Imaging 2021; 33:655-677. [PMID: 31997045 DOI: 10.1007/s10278-020-00320-6] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
This paper presents a systematic review of the literature focused on the lung nodule detection in chest computed tomography (CT) images. Manual detection of lung nodules by the radiologist is a sequential and time-consuming process. The detection is subjective and depends on the radiologist's experiences. Owing to the variation in shapes and appearances of a lung nodule, it is very difficult to identify the proper location of the nodule from a huge number of slices generated by the CT scanner. Small nodules (< 10 mm in diameter) may be missed by this manual detection process. Therefore, computer-aided diagnosis (CAD) system acts as a "second opinion" for the radiologists, by making final decision quickly with higher accuracy and greater confidence. The goal of this survey work is to present the current state of the artworks and their progress towards lung nodule detection to the researchers and readers in this domain. This review paper has covered the published works from 2009 to April 2018. Different nodule detection approaches are described elaborately in this work. Recently, it is observed that deep learning (DL)-based approaches are applied extensively for nodule detection and characterization. Therefore, emphasis has been given to convolutional neural network (CNN)-based DL approaches by describing different CNN-based networks.
Collapse
|
14
|
Singadkar G, Mahajan A, Thakur M, Talbar S. Deep Deconvolutional Residual Network Based Automatic Lung Nodule Segmentation. J Digit Imaging 2021; 33:678-684. [PMID: 32026218 DOI: 10.1007/s10278-019-00301-4] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023] Open
Abstract
Accurate and automatic lung nodule segmentation is of prime importance for the lung cancer analysis and its fundamental step in computer-aided diagnosis (CAD) systems. However, various types of nodule and visual similarity with its surrounding chest region make it challenging to develop lung nodule segmentation algorithm. In this paper, we proposed the Deep Deconvolutional Residual Network (DDRN) based approach for the lung nodule segmentation from the CT images. Our approach is based on two key insights. Proposed deep deconvolutional residual network trained end to end and captures the diverse variety of the nodules from the 2D set of the CT images. Summation-based long skip connection from convolutional to deconvolutional part of the network preserves the spatial information lost during the pooling operation and captures the full resolution features. The proposed method is evaluated on the publicly available Lung Image Database Consortium and Image Database Resource Initiative (LIDC/IDRI) dataset. Results indicate that our proposed method can successfully segment nodules and achieve the average Dice scores of 94.97%, and Jaccard index of 88.68%.
Collapse
Affiliation(s)
- Ganesh Singadkar
- Department of Electronics & Telecommunication Engineering, Shri Guru Gobind Singhji Institute of Engineering and Technology, Nanded, Maharashtra, India.
| | - Abhishek Mahajan
- Department of Radio-diagnosis, Tata Memorial Hospital, Mumbai, India
| | - Meenakshi Thakur
- Department of Radio-diagnosis, Tata Memorial Hospital, Mumbai, India
| | - Sanjay Talbar
- Department of Electronics & Telecommunication Engineering, Shri Guru Gobind Singhji Institute of Engineering and Technology, Nanded, Maharashtra, India
| |
Collapse
|
15
|
Abstract
A typical growth of cells inside tissue is normally known as a nodular entity. Lung nodule segmentation from computed tomography (CT) images becomes crucial for early lung cancer diagnosis. An issue that pertains to the segmentation of lung nodules is homogenous modular variants. The resemblance among nodules as well as among neighboring regions is very challenging to deal with. Here, we propose an end-to-end U-Net-based segmentation framework named DA-Net for efficient lung nodule segmentation. This method extracts rich features by integrating compactly and densely linked rich convolutional blocks merged with Atrous convolutions blocks to broaden the view of filters without dropping loss and coverage data. We first extract the lung’s ROI images from the whole CT scan slices using standard image processing operations and k-means clustering. This reduces the search space of the model to only lungs where the nodules are present instead of the whole CT scan slice. The evaluation of the suggested model was performed through utilizing the LIDC-IDRI dataset. According to the results, we found that DA-Net showed good performance, achieving an 81% Dice score value and 71.6% IOU score.
Collapse
|
16
|
LNCDS: A 2D-3D cascaded CNN approach for lung nodule classification, detection and segmentation. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102527] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
17
|
Lung Nodule Segmentation with a Region-Based Fast Marching Method. SENSORS 2021; 21:s21051908. [PMID: 33803297 PMCID: PMC7967233 DOI: 10.3390/s21051908] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 02/27/2021] [Accepted: 03/02/2021] [Indexed: 11/16/2022]
Abstract
When dealing with computed tomography volume data, the accurate segmentation of lung nodules is of great importance to lung cancer analysis and diagnosis, being a vital part of computer-aided diagnosis systems. However, due to the variety of lung nodules and the similarity of visual characteristics for nodules and their surroundings, robust segmentation of nodules becomes a challenging problem. A segmentation algorithm based on the fast marching method is proposed that separates the image into regions with similar features, which are then merged by combining regions growing with k-means. An evaluation was performed with two distinct methods (objective and subjective) that were applied on two different datasets, containing simulation data generated for this study and real patient data, respectively. The objective experimental results show that the proposed technique can accurately segment nodules, especially in solid cases, given the mean Dice scores of 0.933 and 0.901 for round and irregular nodules. For non-solid and cavitary nodules the performance dropped—0.799 and 0.614 mean Dice scores, respectively. The proposed method was compared to active contour models and to two modern deep learning networks. It reached better overall accuracy than active contour models, having comparable results to DBResNet but lesser accuracy than 3D-UNet. The results show promise for the proposed method in computer-aided diagnosis applications.
Collapse
|
18
|
Cao W, Liang Z, Gao Y, Pomeroy MJ, Han F, Abbasi A, Pickhardt PJ. A dynamic lesion model for differentiation of malignant and benign pathologies. Sci Rep 2021; 11:3485. [PMID: 33568762 PMCID: PMC7875978 DOI: 10.1038/s41598-021-83095-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Accepted: 01/20/2021] [Indexed: 11/21/2022] Open
Abstract
Malignant lesions have a high tendency to invade their surrounding environment compared to benign ones. This paper proposes a dynamic lesion model and explores the 2nd order derivatives at each image voxel, which reflect the rate of change of image intensity, as a quantitative measure of the tendency. The 2nd order derivatives at each image voxel are usually represented by the Hessian matrix, but it is difficult to quantify a matrix field (or image) through the lesion space as a measure of the tendency. We conjecture that the three eigenvalues contain important information of the Hessian matrix and are chosen as the surrogate representation of the Hessian matrix. By treating the three eigenvalues as a vector, called Hessian vector, which is defined in a local coordinate formed by three orthogonal Hessian eigenvectors and further adapting the gray level occurrence computing method to extract the vector texture descriptors (or measures) from the Hessian vector, a quantitative presentation for the dynamic lesion model is completed. The vector texture descriptors were applied to differentiate malignant from benign lesions from two pathologically proven datasets: colon polyps and lung nodules. The classification results not only outperform four state-of-the-art methods but also three radiologist experts.
Collapse
Affiliation(s)
- Weiguo Cao
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY, USA
| | - Zhengrong Liang
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY, USA.
- Department of Biomedical Engineering, State University of New York at Stony Brook, Stony Brook, NY, USA.
| | - Yongfeng Gao
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY, USA
| | - Marc J Pomeroy
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY, USA
- Department of Biomedical Engineering, State University of New York at Stony Brook, Stony Brook, NY, USA
| | - Fangfang Han
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, Guangdong, People's Republic of China
| | - Almas Abbasi
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY, USA
| | - Perry J Pickhardt
- Department of Radiology, School of Medicine, University of Wisconsin, Madison, WI, USA
| |
Collapse
|
19
|
Henschke CI, Yip R, Shaham D, Zulueta JJ, Aguayo SM, Reeves AP, Jirapatnakul A, Avila R, Moghanaki D, Yankelevitz DF. The Regimen of Computed Tomography Screening for Lung Cancer: Lessons Learned Over 25 Years From the International Early Lung Cancer Action Program. J Thorac Imaging 2021; 36:6-23. [PMID: 32520848 PMCID: PMC7771636 DOI: 10.1097/rti.0000000000000538] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
We learned many unanticipated and valuable lessons since we started planning our study of low-dose computed tomography (CT) screening for lung cancer in 1991. The publication of the baseline results of the Early Lung Cancer Action Project (ELCAP) in Lancet 1999 showed that CT screening could identify a high proportion of early, curable lung cancers. This stimulated large national screening studies to be quickly started. The ELCAP design, which provided evidence about screening in the context of a clinical program, was able to rapidly expand to a 12-institution study in New York State (NY-ELCAP) and to many international institutions (International-ELCAP), ultimately working with 82 institutions, all using the common I-ELCAP protocol. This expansion was possible because the investigators had developed the ELCAP Management System for screening, capturing data and CT images, and providing for quality assurance. This advanced registry and its rapid accumulation of data and images allowed continual assessment and updating of the regimen of screening as advances in knowledge and new technology emerged. For example, in the initial ELCAP study, introduction of helical CT scanners had allowed imaging of the entire lungs in a single breath, but the images were obtained in 10 mm increments resulting in about 30 images per person. Today, images are obtained in submillimeter slice thickness, resulting in around 700 images per person, which are viewed on high-resolution monitors. The regimen provides the imaging acquisition parameters, imaging interpretation, definition of positive result, and the recommendations for further workup, which now include identification of emphysema and coronary artery calcifications. Continual updating is critical to maximize the benefit of screening and to minimize potential harms. Insights were gained about the natural history of lung cancers, identification and management of nodule subtypes, increased understanding of nodule imaging and pathologic features, and measurement variability inherent in CT scanners. The registry also provides the foundation for assessment of new statistical techniques, including artificial intelligence, and integration of effective genomic and blood-based biomarkers, as they are developed.
Collapse
Affiliation(s)
- Claudia I. Henschke
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York
- Phoenix Veterans Affairs Health Care System, Phoenix, AZ
| | - Rowena Yip
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York
| | - Dorith Shaham
- Department of Medical Imaging, Hadassah Medical Center, Jerusalem, Israel
| | - Javier J. Zulueta
- Clinica Universidad de Navarra, University of Navarra School of Medicine, Pamplona, Spain
| | | | - Anthony P. Reeves
- Department of Electrical and Computer Engineering, Cornell University, Ithaca
| | - Artit Jirapatnakul
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York
| | | | - Drew Moghanaki
- Department of Radiation Oncology, Atlanta VA Medical Center, Decatur, GA
| | | |
Collapse
|
20
|
Siddique M, Yip R, Henschke CI, Yankelevitz DF. PET standardized uptake values of primary lung cancer for comparison with tumor volume doubling times. Clin Imaging 2020; 73:146-150. [PMID: 33418311 DOI: 10.1016/j.clinimag.2020.11.048] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 11/23/2020] [Accepted: 11/30/2020] [Indexed: 01/15/2023]
Abstract
OBJECTIVE To determine the relationship between two documented indicators of tumor aggressiveness, SUV and volume doubling time (VDT) for stage I non-small cell lung cancer (NSCLC). METHODS 116 pathology proven solid NSCLC patients with 2 pretreatment CT and 1 PET/CT scan were retrospectively identified. The 2 CT scans were at least 85 days apart. SUV values were collected from PET/CT reports and CT derived VDT's were calculated assuming an exponential growth rate. Corrected SUV values were also obtained for all cases. Median VDT, SUV and corrected SUV values were reported according to cancer histology. Relationships between VDT, SUV and corrected SUV were examined. RESULTS 91 Adenocarcinomas and 25 squamous-cell carcinomas had median VDT values of 150.6 and 110.0 days respectively. Median SUV values were 5.1 and 12.3 for adenocarcinoma and squamous-cell carcinoma, respectively (p = 0.0003); median corrected SUV values were 16.8 and 31.7 respectively (p = 0.003). A statistically significant monotonic relationship was observed between increased SUV uptake and faster VDT (p = 0.05) and corrected SUV and VDT (P = 0.0002). When stratified by cancer histology, the relationship between VDT and either SUV or corrected SUV was statistically significant for adenocarcinomas (p = 0.02 and p = 0.0001, respectively), but not for squamous-cell carcinoma (p = 0.85 and p = 0.37, respectively). CONCLUSION We demonstrated an overall significant relationship between VDT, SUV and corrected SUV. The relationship, however, was stronger for adenocarcinomas than for squamous-cell carcinomas. This implies that the primary determinant for these relationships is histology and within each cell type, there are other factors that have strong influences.
Collapse
Affiliation(s)
- Maham Siddique
- Department of Radiology, Columbia University Medical Center, New York Presbyterian Hospital, 622 West 168th Street, PB-1-301, New York, NY 10032, United States of America.
| | - Rowena Yip
- Department of Radiology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, United States of America.
| | - Claudia I Henschke
- Department of Radiology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, United States of America.
| | - David F Yankelevitz
- Department of Radiology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, United States of America.
| |
Collapse
|
21
|
Zhang S, Chen X, Zhu Z, Feng B, Chen Y, Long W. Segmentation of small ground glass opacity pulmonary nodules based on Markov random field energy and Bayesian probability difference. Biomed Eng Online 2020; 19:51. [PMID: 32552724 PMCID: PMC7302391 DOI: 10.1186/s12938-020-00793-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Accepted: 06/08/2020] [Indexed: 12/18/2022] Open
Abstract
BACKGROUND Image segmentation is an important part of computer-aided diagnosis (CAD), the segmentation of small ground glass opacity (GGO) pulmonary nodules is beneficial for the early detection of lung cancer. For the segmentation of small GGO pulmonary nodules, an integrated active contour model based on Markov random field energy and Bayesian probability difference (IACM_MRFEBPD) is proposed in this paper. METHODS First, the Markov random field (MRF) is constructed on the computed tomography (CT) images, then the MRF energy is calculated. The MRF energy is used to construct the region term. It can not only enhance the contrast between pulmonary nodule and the background region, but also solve the problem of intensity inhomogeneity using local spatial correlation information between neighboring pixels in the image. Second, the Gaussian mixture model is used to establish the probability model of the image, and the model parameters are estimated by the expectation maximization (EM) algorithm. So the Bayesian posterior probability difference of each pixel can be calculated. The probability difference is used to construct the boundary detection term, which is 0 at the boundary. Therefore, the blurred boundary problem can be solved. Finally, under the framework of the level set, the integrated active contour model is constructed. RESULTS To verify the effectiveness of the proposed method, the public data of the lung image database consortium and image database resource initiative (LIDC-IDRI) and the clinical data of the Affiliated Jiangmen Hospital of Sun Yat-sen University are used to perform experiments, and the intersection over union (IOU) score is used to evaluate the segmentation methods. Compared with other methods, the proposed method achieves the best results with the highest average IOU of 0.7444, 0.7503, and 0.7450 for LIDC-IDRI test set, clinical test set, and all test sets, respectively. CONCLUSIONS The experiment results show that the proposed method can segment various small GGO pulmonary nodules more accurately and robustly, which is helpful for the accurate evaluation of medical imaging.
Collapse
Affiliation(s)
- Shaorong Zhang
- School of Electronic Engineering and Automation, Guilin University of Electronic Technology, Guilin, 541004, China.,School of Electronic Information and Automation, Guilin University of Aerospace Technology, Guilin, 541004, China
| | - Xiangmeng Chen
- The Department of Radiology, The Affiliated Jiangmen Hospital of Sun Yat-sen University, Jiangmen, 529000, China
| | - Zhibin Zhu
- School of Mathematics and Computational Science, Guilin University of Electronic Technology, Guilin, 541004, China.
| | - Bao Feng
- School of Electronic Information and Automation, Guilin University of Aerospace Technology, Guilin, 541004, China.,The Department of Radiology, The Affiliated Jiangmen Hospital of Sun Yat-sen University, Jiangmen, 529000, China
| | - Yehang Chen
- School of Electronic Engineering and Automation, Guilin University of Electronic Technology, Guilin, 541004, China
| | - Wansheng Long
- The Department of Radiology, The Affiliated Jiangmen Hospital of Sun Yat-sen University, Jiangmen, 529000, China
| |
Collapse
|
22
|
Reddy UJ, Ramana Reddy BV, Reddy BE. Categorization & Recognition of Lung Tumor Using Machine Learning Representations. Curr Med Imaging 2020; 15:405-413. [PMID: 31989910 DOI: 10.2174/1573405614666180212162727] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2017] [Revised: 12/19/2017] [Accepted: 02/02/2018] [Indexed: 02/05/2023]
Abstract
BACKGROUND Lung Cancer is the disease spreading around the world nowadays. Early recognition of lung disease is a difficult task as the cells which cause tumor will grow quickly and the majority of these cells are enclosed with each other. From the beginning of the treatment, tumor detection handling systems which are generally utilized for the diagnosis of lung cancer, recognizable proof of hereditary and ecological elements is imperative in creating a novel technique for lung tumor detection. In different cancers, for example, lung cancer, the time calculated is imperative to find the anomaly issue in target images. METHODS In this proposed framework, GLCM (Gray Level Co-event Matrix) is utilized for preprocessing of images and to feature extraction procedures to check the condition of the patient whether it is ordinary or irregular. Surface-based elements, for example, GLCM (Gray Level Co-event Matrix) features assume a vital part of remedial image examination which is utilized for the identification of Lung cancer. In the event that lung cancer is effectively distinguished and anticipated in its initial stages, it lessens numerous treatment choices and furthermore, decreases the danger of intrusive surgery and increment survival rate. RESULTS & CONCLUSION The proposed method will efficiently identify the position of the tumor in lungs using the probability framework. This will offer a promising outcome for recognition and diagnosis of lung cancer. In this manuscript, GLCM features are used for the prediction of lung tumor and tests are performed for performance analysis in comparison with the histogram and GLCM features, in which GLCM features are accurate in predicting lung tumor even if it takes more time than histogram features. In this manner, early discovery and probability of lung cancer should assume a crucial task in finding a procedure and furthermore, an increment in the survival rate of the patient. This exploration investigates machine learning systems which consider quality articulation, to perceive cancer or to identify lung cancer.
Collapse
Affiliation(s)
- Ummadi Janardhan Reddy
- Department of Computer Science and Engineering, Jawaharlal Nehru Technological University Anantapur, Ananthapuramu, Andhra Pradesh, India
| | | | - Boddi Eswara Reddy
- Department of Computer Science & Engineering, JNTUA College of Engineering, Kalikiri, Chittoor, India
| |
Collapse
|
23
|
Wu W, Gao L, Duan H, Huang G, Ye X, Nie S. Segmentation of pulmonary nodules in CT images based on 3D-UNET combined with three-dimensional conditional random field optimization. Med Phys 2020; 47:4054-4063. [PMID: 32428969 DOI: 10.1002/mp.14248] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 05/10/2020] [Accepted: 05/13/2020] [Indexed: 12/19/2022] Open
Abstract
PURPOSE Pulmonary nodules are a potential manifestation of lung cancer. In computer-aided diagnosis (CAD) of lung cancer, it is of great significance to extract the complete boundary of the pulmonary nodules in the computed tomography (CT) scans accurately. It can provide doctors with important information such as tumor size and density, which assist doctors in subsequent diagnosis and treatment. In addition to this, in the molecular subtype and radiomics of lung cancer, segmentation of lung nodules also plays a pivotal role. Existing methods are difficult to use only one model to simultaneously treat the boundaries of multiple types of lung nodules in CT images. METHOD In order to solve the problem, this paper proposed a three-dimensional (3D)-UNET network model optimized by a 3D conditional random field (3D-CRF) to segment pulmonary nodules. On the basis of 3D-UNET, the 3D-CRF is used to optimize the sample output of the training set, so as to update the network weights in training process, reduce the model training time, and reduce the loss rate of the model. We selected 936 sets of pulmonary nodule data for the lung image database consortium and image database resource initiative (LIDC-IDRI)1 database to train and test the model. What's more, we used clinical data from partner hospitals for additional validation. RESULTS AND CONCLUSIONS The results show that our method is accurate and effective. Particularly, it shows more significance for the optimization of the segmentation of adhesive pulmonary nodules (the juxta-pleural and juxta-vascular nodules) and ground glass pulmonary nodules (GGNs).
Collapse
Affiliation(s)
- Wenhao Wu
- School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, People's Republic of China
| | - Lei Gao
- School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, People's Republic of China
| | - Huihong Duan
- School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, People's Republic of China
| | - Gang Huang
- Shanghai University of Medicine & Health Science, Shanghai, 201318, People's Republic of China
| | - Xiaodan Ye
- Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, 200030, People's Republic of China
| | - Shengdong Nie
- School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, People's Republic of China
| |
Collapse
|
24
|
Han F, Yan L, Chen J, Teng Y, Chen S, Qi S, Qian W, Yang J, Moore W, Zhang S, Liang Z. Predicting Unnecessary Nodule Biopsies from a Small, Unbalanced, and Pathologically Proven Dataset by Transfer Learning. J Digit Imaging 2020; 33:685-696. [PMID: 32144499 PMCID: PMC7256141 DOI: 10.1007/s10278-019-00306-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
This study explores an automatic diagnosis method to predict unnecessary nodule biopsy from a small, unbalanced, and pathologically proven database. The automatic diagnosis method is based on a convolutional neural network (CNN) model. Because of the small and unbalanced samples, the presented method aims to improve the transfer learning capability via the VGG16 architecture and optimize the related transfer learning parameters. For comparison purpose, a traditional machine learning method is implemented, which extracts the texture features and classifies the features by support vector machine (SVM). The database includes 68 biopsied nodules, 16 are pathologically proven benign and the remaining 52 are malignant. To consider the volumetric data by the CNN model, each image slice from each nodule volume is selected randomly until all image slices of each nodule are utilized. The leave-one-out and 10-folder cross validations are applied to train and test the randomly selected 68 image slices (one image slice from one nodule) in each experiment, respectively. The averages over all the experimental outcomes are the final results. The experiments revealed that the features from both the medical and the natural images share the similarity of focusing on simpler and less-abstract objects, leading to the conclusion that not the more the transfer convolutional layers, the better the classification results. Transfer learning from other larger datasets can supply additional information to small and unbalanced datasets to improve the classification performance. The presented method has shown the potential to adapt CNN architecture to improve the prediction of unnecessary nodule biopsy from small, unbalanced, and pathologically proven volumetric dataset.
Collapse
Affiliation(s)
- Fangfang Han
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515 People’s Republic of China
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, Liaoning, 110169 People’s Republic of China
| | - Linkai Yan
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, Liaoning, 110169 People’s Republic of China
| | - Junxin Chen
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, Liaoning, 110169 People’s Republic of China
| | - Yueyang Teng
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, Liaoning, 110169 People’s Republic of China
| | - Shuo Chen
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, Liaoning, 110169 People’s Republic of China
| | - Shouliang Qi
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, Liaoning, 110169 People’s Republic of China
| | - Wei Qian
- College of Engineering, University of Texas at El Paso, El Paso, TX 79968 USA
| | - Jie Yang
- Department of Family, Population and Preventive Medicine, Stony Brook University, Stony Brook, NY 11794 USA
| | - William Moore
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA
| | - Shu Zhang
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA
| | - Zhengrong Liang
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA
| |
Collapse
|
25
|
Cao H, Liu H, Song E, Hung CC, Ma G, Xu X, Jin R, Lu J. Dual-branch residual network for lung nodule segmentation. Appl Soft Comput 2020. [DOI: 10.1016/j.asoc.2019.105934] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
26
|
Liu H, Cao H, Song E, Ma G, Xu X, Jin R, Jin Y, Hung CC. A cascaded dual-pathway residual network for lung nodule segmentation in CT images. Phys Med 2019; 63:112-121. [PMID: 31221402 DOI: 10.1016/j.ejmp.2019.06.003] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/29/2018] [Revised: 06/04/2019] [Accepted: 06/07/2019] [Indexed: 11/30/2022] Open
Abstract
It is difficult to obtain an accurate segmentation due to the variety of lung nodules in computed tomography (CT) images. In this study, we propose a data-driven model, called the Cascaded Dual-Pathway Residual Network (CDP-ResNet) to improve the segmentation of lung nodules in the CT images. Our approach incorporates the multi-view and multi-scale features of different nodules from CT images. The proposed residual block based dual-path network extracts local features and rich contextual information of lung nodules. In addition, we designed an improved weighted sampling strategy to select training samples based on the edge. The proposed method was extensively evaluated on an LIDC dataset, which contains 986 nodules. Experimental results show that the CDP-ResNet achieves superior segmentation performance with an average DICE score (standard deviation) of 81.58% (11.05) on the LIDC dataset. Moreover, we compared our results with those of four radiologists on the same dataset. The comparison shows that the CDP-ResNet is slightly better than human experts in terms of segmentation accuracy. Meanwhile, the proposed segmentation method outperforms existing methods.
Collapse
Affiliation(s)
- Hong Liu
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| | - Haichao Cao
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| | - Enmin Song
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China.
| | - Guangzhi Ma
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| | - Xiangyang Xu
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| | - Renchao Jin
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| | - Yong Jin
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| | - Chih-Cheng Hung
- Huazhong University of Science and Technology, School of Computer Science & Technology, Wuhan 430074, China
| |
Collapse
|
27
|
Han J, Xiang H, Ridley WE, Ridley LJ. Pleural tail sign: pleural tags. J Med Imaging Radiat Oncol 2018; 62 Suppl 1:37. [DOI: 10.1111/1754-9485.24_12785] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Affiliation(s)
- Jason Han
- Department of Radiology, Concord Repatriation General Hospital, Concord, New South Wales, Australia
| | - Hao Xiang
- Department of Radiology, Concord Repatriation General Hospital, Concord, New South Wales, Australia
| | | | - Lloyd J Ridley
- Department of Radiology, Concord Repatriation General Hospital, Concord, New South Wales, Australia
- Medical Imaging, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
28
|
3-D segmentation of lung nodules using hybrid level sets. Comput Biol Med 2018; 96:214-226. [PMID: 29631230 DOI: 10.1016/j.compbiomed.2018.03.015] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2017] [Revised: 03/22/2018] [Accepted: 03/22/2018] [Indexed: 11/20/2022]
Abstract
Lung nodule segmentation in CT images and its subsequent volume analysis can help determine the malignancy status of a lung nodule. While several efficient segmentation schemes have been proposed, only a few studies evaluated the segmentation's performance for large nodules. In this research, we contribute a semi-automatic system which is capable of performing robust 3-D segmentations on both small and large nodules with good accuracy. The target CT volume is de-noised with an anisotropic diffusion filter and a region of interest is selected around the target nodule on a reference slice. The proposed model performs nodule segmentation by incorporating a mean intensity based threshold in Geodesic Active Contour model in level sets. We also devise an adaptive technique using image intensity histogram to estimate the desired mean intensity of the nodule. The proposed system is validated on both lung nodules and phantoms collected from publicly available diverse databases. Quantitative and visual comparative analysis of the proposed work with the Chan-Vese algorithm and statistic active contour model of 3D Slicer platform is also presented. The resulting mean spatial overlap between segmented nodules and reference nodules is 0.855, the mean volume bias is 0.10±0.2 ml and the algorithm repeatability is 0.060 ml. The achieved results suggest that the proposed method can be used for volume estimations of small as well as large-sized nodules.
Collapse
|
29
|
Milanese G, Eberhard M, Martini K, Vittoria De Martini I, Frauenfelder T. Vessel suppressed chest Computed Tomography for semi-automated volumetric measurements of solid pulmonary nodules. Eur J Radiol 2018; 101:97-102. [PMID: 29571809 DOI: 10.1016/j.ejrad.2018.02.020] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 02/09/2018] [Accepted: 02/14/2018] [Indexed: 10/18/2022]
Abstract
OBJECTIVE To evaluate whether vessel-suppressed computed tomography (VSCT) can be reliably used for semi-automated volumetric measurements of solid pulmonary nodules, as compared to standard CT (SCT) MATERIAL AND METHODS: Ninety-three SCT were elaborated by dedicated software (ClearRead CT, Riverain Technologies, Miamisburg, OH, USA), that allows subtracting vessels from lung parenchyma. Semi-automated volumetric measurements of 65 solid nodules were compared between SCT and VSCT. The measurements were repeated by two readers. For each solid nodule, volume measured on SCT by Reader 1 and Reader 2 was averaged and the average volume between readers acted as standard of reference value. Concordance between measurements was assessed using Lin's Concordance Correlation Coefficient (CCC). Limits of agreement (LoA) between readers and CT datasets were evaluated. RESULTS Standard of reference nodule volume ranged from 13 to 366 mm3. The mean overestimation between readers was 3 mm3 and 2.9 mm3 on SCT and VSCT, respectively. Semi-automated volumetric measurements on VSCT showed substantial agreement with the standard of reference (Lin's CCC = 0.990 for Reader 1; 0.985 for Reader 2). The upper and lower LoA between readers' measurements were (16.3, -22.4 mm3) and (15.5, -21.4 mm3) for SCT and VSCT, respectively. CONCLUSIONS VSCT datasets are feasible for the measurements of solid nodules, showing an almost perfect concordance between readers and with measurements on SCT.
Collapse
Affiliation(s)
- Gianluca Milanese
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Ramistrasse 100, 8091 Zurich, Switzerland.
| | - Matthias Eberhard
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Ramistrasse 100, 8091 Zurich, Switzerland.
| | - Katharina Martini
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Ramistrasse 100, 8091 Zurich, Switzerland.
| | - Ilaria Vittoria De Martini
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Ramistrasse 100, 8091 Zurich, Switzerland.
| | - Thomas Frauenfelder
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Ramistrasse 100, 8091 Zurich, Switzerland.
| |
Collapse
|
30
|
Gupta A, Saar T, Martens O, Moullec YL. Automatic detection of multisize pulmonary nodules in CT images: Large-scale validation of the false-positive reduction step. Med Phys 2018; 45:1135-1149. [DOI: 10.1002/mp.12746] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 11/07/2017] [Accepted: 12/14/2017] [Indexed: 11/08/2022] Open
Affiliation(s)
- Anindya Gupta
- Thomas Johann Seebeck Department of Electronics; Tallinn University of Technology; Tallinn 19086 Estonia
| | - Tonis Saar
- Eliko Tehnoloogia Arenduskeskus OÜ; Tallinn 12618 and OÜ Tallinn 10143 Estonia
| | - Olev Martens
- Thomas Johann Seebeck Department of Electronics; Tallinn University of Technology; Tallinn 19086 Estonia
| | - Yannick Le Moullec
- Thomas Johann Seebeck Department of Electronics; Tallinn University of Technology; Tallinn 19086 Estonia
| |
Collapse
|
31
|
Arulmurugan R, Anandakumar H. Early Detection of Lung Cancer Using Wavelet Feature Descriptor and Feed Forward Back Propagation Neural Networks Classifier. COMPUTATIONAL VISION AND BIO INSPIRED COMPUTING 2018. [DOI: 10.1007/978-3-319-71767-8_9] [Citation(s) in RCA: 134] [Impact Index Per Article: 22.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
32
|
Cha J, Farhangi MM, Dunlap N, Amini AA. Segmentation and tracking of lung nodules via graph-cuts incorporating shape prior and motion from 4D CT. Med Phys 2017; 45:297-306. [DOI: 10.1002/mp.12690] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2017] [Revised: 08/24/2017] [Accepted: 10/26/2017] [Indexed: 11/12/2022] Open
Affiliation(s)
- Jungwon Cha
- Medical Imaging Laboratory; University of Louisville; Louisville KY 40292 USA
| | | | - Neal Dunlap
- Department of Radiation Oncology; Brown Cancer Center; University of Louisville; Louisville KY 40202 USA
| | - Amir A. Amini
- Medical Imaging Laboratory; University of Louisville; Louisville KY 40292 USA
| |
Collapse
|
33
|
Wang S, Zhou M, Liu Z, Liu Z, Gu D, Zang Y, Dong D, Gevaert O, Tian J. Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation. Med Image Anal 2017; 40:172-183. [PMID: 28688283 PMCID: PMC5661888 DOI: 10.1016/j.media.2017.06.014] [Citation(s) in RCA: 206] [Impact Index Per Article: 29.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2017] [Revised: 06/29/2017] [Accepted: 06/29/2017] [Indexed: 11/23/2022]
Abstract
Accurate lung nodule segmentation from computed tomography (CT) images is of great importance for image-driven lung cancer analysis. However, the heterogeneity of lung nodules and the presence of similar visual characteristics between nodules and their surroundings make it difficult for robust nodule segmentation. In this study, we propose a data-driven model, termed the Central Focused Convolutional Neural Networks (CF-CNN), to segment lung nodules from heterogeneous CT images. Our approach combines two key insights: 1) the proposed model captures a diverse set of nodule-sensitive features from both 3-D and 2-D CT images simultaneously; 2) when classifying an image voxel, the effects of its neighbor voxels can vary according to their spatial locations. We describe this phenomenon by proposing a novel central pooling layer retaining much information on voxel patch center, followed by a multi-scale patch learning strategy. Moreover, we design a weighted sampling to facilitate the model training, where training samples are selected according to their degree of segmentation difficulty. The proposed method has been extensively evaluated on the public LIDC dataset including 893 nodules and an independent dataset with 74 nodules from Guangdong General Hospital (GDGH). We showed that CF-CNN achieved superior segmentation performance with average dice scores of 82.15% and 80.02% for the two datasets respectively. Moreover, we compared our results with the inter-radiologists consistency on LIDC dataset, showing a difference in average dice score of only 1.98%.
Collapse
Affiliation(s)
- Shuo Wang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Mu Zhou
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, CA 94305, USA
| | - Zaiyi Liu
- Guangdong General Hospital, Guangzhou, Guangdong 510080, China
| | - Zhenyu Liu
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Dongsheng Gu
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yali Zang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Di Dong
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Olivier Gevaert
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, CA 94305, USA.
| | - Jie Tian
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences, Beijing 100049, China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, China.
| |
Collapse
|
34
|
Farag AA, Ali A, Elshazly S, Farag AA. Feature fusion for lung nodule classification. Int J Comput Assist Radiol Surg 2017. [PMID: 28623478 DOI: 10.1007/s11548-017-1626-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
PURPOSE This article examines feature-based nodule description for the purpose of nodule classification in chest computed tomography scanning. METHODS Three features based on (i) Gabor filter, (ii) multi-resolution local binary pattern (LBP) texture features and (iii) signed distance fused with LBP which generates a combinational shape and texture feature are utilized to provide feature descriptors of malignant and benign nodules and non-nodule regions of interest. Support vector machines (SVMs) and k-nearest neighbor (kNN) classifiers in serial and two-tier cascade frameworks are optimized and analyzed for optimal classification results of nodules. RESULTS A total of 1191 nodule and non-nodule samples from the Lung Image Data Consortium database is used for analysis. Classification using SVM and kNN classifiers is examined. The classification results from the two-tier cascade SVM using Gabor features showed overall better results for identifying non-nodules, malignant and benign nodules with average area under the receiver operating characteristics (AUC-ROC) curves of 0.99 and average f1-score of 0.975 over the two tiers. CONCLUSION In the results, higher overall AUCs and f1-scores were obtained for the non-nodules cases using any of the three features, showing the greatest distinguishability over nodules (benign/malignant). SVM and kNN classifiers were used for benign, malignant and non-nodule classification, where Gabor proved to be the most effective of the features for classification. The cascaded framework showed the greatest distinguishability between benign and malignant nodules.
Collapse
Affiliation(s)
- Amal A Farag
- Kentucky Imaging Technologies, LLC., Louisville, KY, USA.
| | - Asem Ali
- Computer Vision and Image Processing Laboratory (CVIP Lab), University of Louisville, Louisville, KY, 40292, USA
| | - Salwa Elshazly
- Kentucky Imaging Technologies, LLC., Louisville, KY, USA
| | - Aly A Farag
- Computer Vision and Image Processing Laboratory (CVIP Lab), University of Louisville, Louisville, KY, 40292, USA
| |
Collapse
|
35
|
Shaukat F, Raja G, Gooya A, Frangi AF. Fully automatic detection of lung nodules in CT images using a hybrid feature set. Med Phys 2017; 44:3615-3629. [DOI: 10.1002/mp.12273] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2016] [Revised: 02/15/2017] [Accepted: 03/28/2017] [Indexed: 11/06/2022] Open
Affiliation(s)
- Furqan Shaukat
- Department of Electrical Engineering, University of Engineering & Technology, Taxila, 47080, Pakistan
| | - Gulistan Raja
- Department of Electrical Engineering, University of Engineering & Technology, Taxila, 47080, Pakistan
| | - Ali Gooya
- Department of Electronic and Electrical Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK
| | - Alejandro F Frangi
- Department of Electronic and Electrical Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK
| |
Collapse
|
36
|
Reeves AP, Xie Y, Liu S. Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation. J Med Imaging (Bellingham) 2017; 4:024505. [PMID: 28612037 PMCID: PMC5462336 DOI: 10.1117/1.jmi.4.2.024505] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2016] [Accepted: 05/16/2017] [Indexed: 12/17/2022] Open
Abstract
With the advent of fully automated image analysis and modern machine learning methods, there is a need for very large image datasets having documented segmentations for both computer algorithm training and evaluation. This paper presents a method and implementation for facilitating such datasets that addresses the critical issue of size scaling for algorithm validation and evaluation; current evaluation methods that are usually used in academic studies do not scale to large datasets. This method includes protocols for the documentation of many regions in very large image datasets; the documentation may be incrementally updated by new image data and by improved algorithm outcomes. This method has been used for 5 years in the context of chest health biomarkers from low-dose chest CT images that are now being used with increasing frequency in lung cancer screening practice. The lung scans are segmented into over 100 different anatomical regions, and the method has been applied to a dataset of over 20,000 chest CT images. Using this framework, the computer algorithms have been developed to achieve over 90% acceptable image segmentation on the complete dataset.
Collapse
Affiliation(s)
- Anthony P Reeves
- Cornell University, School of Electrical and Computer Engineering, Ithaca, New York, United States
| | - Yiting Xie
- Cornell University, School of Electrical and Computer Engineering, Ithaca, New York, United States
| | - Shuang Liu
- Cornell University, School of Electrical and Computer Engineering, Ithaca, New York, United States
| |
Collapse
|
37
|
Abstract
Accurate segmentation of pulmonary nodules is a prerequisite for acceptable performance of computer-aided detection (CAD) system designed for diagnosis of lung cancer from lung CT images. Accurate segmentation helps to improve the quality of machine level features which could improve the performance of the CAD system. The well-circumscribed solid nodules can be segmented using thresholding, but segmentation becomes difficult for part-solid, non-solid, and solid nodules attached with pleura or vessels. We proposed a segmentation framework for all types of pulmonary nodules based on internal texture (solid/part-solid and non-solid) and external attachment (juxta-pleural and juxta-vascular). In the proposed framework, first pulmonary nodules are categorized into solid/part-solid and non-solid category by analyzing intensity distribution in the core of the nodule. Two separate segmentation methods are developed for solid/part-solid and non-solid nodules, respectively. After determining the category of nodule, the particular algorithm is set to remove attached pleural surface and vessels from the nodule body. The result of segmentation is evaluated in terms of four contour-based metrics and six region-based metrics for 891 pulmonary nodules from Lung Image Database Consortium and Image Database Resource Initiative (LIDC/IDRI) public database. The experimental result shows that the proposed segmentation framework is reliable for segmentation of various types of pulmonary nodules with improved accuracy compared to existing segmentation methods.
Collapse
|
38
|
Hwang EJ, Goo JM, Kim J, Park SJ, Ahn S, Park CM, Shin YG. Development and validation of a prediction model for measurement variability of lung nodule volumetry in patients with pulmonary metastases. Eur Radiol 2017; 27:3257-3265. [PMID: 28050697 DOI: 10.1007/s00330-016-4713-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2016] [Revised: 10/20/2016] [Accepted: 12/15/2016] [Indexed: 11/26/2022]
Abstract
OBJECTIVES To develop a prediction model for the variability range of lung nodule volumetry and validate the model in detecting nodule growth. MATERIALS AND METHODS For model development, 50 patients with metastatic nodules were prospectively included. Two consecutive CT scans were performed to assess volumetry for 1,586 nodules. Nodule volume, surface voxel proportion (SVP), attachment proportion (AP) and absolute percentage error (APE) were calculated for each nodule and quantile regression analyses were performed to model the 95% percentile of APE. For validation, 41 patients who underwent metastasectomy were included. After volumetry of resected nodules, sensitivity and specificity for diagnosis of metastatic nodules were compared between two different thresholds of nodule growth determination: uniform 25% volume change threshold and individualized threshold calculated from the model (estimated 95% percentile APE). RESULTS SVP and AP were included in the final model: Estimated 95% percentile APE = 37.82 · SVP + 48.60 · AP-10.87. In the validation session, the individualized threshold showed significantly higher sensitivity for diagnosis of metastatic nodules than the uniform 25% threshold (75.0% vs. 66.0%, P = 0.004) CONCLUSION: Estimated 95% percentile APE as an individualized threshold of nodule growth showed greater sensitivity in diagnosing metastatic nodules than a global 25% threshold. KEY POINTS • The 95 % percentile APE of a particular nodule can be predicted. • Estimated 95 % percentile APE can be utilized as an individualized threshold. • More sensitive diagnosis of metastasis can be made with an individualized threshold. • Tailored nodule management can be provided during nodule growth follow-up.
Collapse
Affiliation(s)
- Eui Jin Hwang
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea
- Deparment of Radiology, Armed Forces Seoul Hospital, Seoul, Korea
| | - Jin Mo Goo
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea.
- Cancer Research Institute, Seoul National University, Seoul, Korea.
| | - Jihye Kim
- School of Computer Science and Engineering, Seoul National University, Seoul, Korea
| | - Sang Joon Park
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea
- Cancer Research Institute, Seoul National University, Seoul, Korea
| | - Soyeon Ahn
- Medical Research Collaborating Center, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea
| | - Chang Min Park
- Department of Radiology, Seoul National University College of Medicine, and Institute of Radiation Medicine, Seoul National University Medical Research, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea
- Cancer Research Institute, Seoul National University, Seoul, Korea
| | - Yeong-Gil Shin
- School of Computer Science and Engineering, Seoul National University, Seoul, Korea
| |
Collapse
|
39
|
Krishnamurthy S, Narasimhan G, Rengasamy U. An Automatic Computerized Model for Cancerous Lung Nodule Detection from Computed Tomography Images with Reduced False Positives. COMMUNICATIONS IN COMPUTER AND INFORMATION SCIENCE 2017. [DOI: 10.1007/978-981-10-4859-3_31] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
40
|
Echegaray S, Nair V, Kadoch M, Leung A, Rubin D, Gevaert O, Napel S. A Rapid Segmentation-Insensitive "Digital Biopsy" Method for Radiomic Feature Extraction: Method and Pilot Study Using CT Images of Non-Small Cell Lung Cancer. ACTA ACUST UNITED AC 2016; 2:283-294. [PMID: 28612050 PMCID: PMC5466872 DOI: 10.18383/j.tom.2016.00163] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Quantitative imaging approaches compute features within images' regions of interest. Segmentation is rarely completely automatic, requiring time-consuming editing by experts. We propose a new paradigm, called “digital biopsy,” that allows for the collection of intensity- and texture-based features from these regions at least 1 order of magnitude faster than the current manual or semiautomated methods. A radiologist reviewed automated segmentations of lung nodules from 100 preoperative volume computed tomography scans of patients with non–small cell lung cancer, and manually adjusted the nodule boundaries in each section, to be used as a reference standard, requiring up to 45 minutes per nodule. We also asked a different expert to generate a digital biopsy for each patient using a paintbrush tool to paint a contiguous region of each tumor over multiple cross-sections, a procedure that required an average of <3 minutes per nodule. We simulated additional digital biopsies using morphological procedures. Finally, we compared the features extracted from these digital biopsies with our reference standard using intraclass correlation coefficient (ICC) to characterize robustness. Comparing the reference standard segmentations to our digital biopsies, we found that 84/94 features had an ICC >0.7; comparing erosions and dilations, using a sphere of 1.5-mm radius, of our digital biopsies to the reference standard segmentations resulted in 41/94 and 53/94 features, respectively, with ICCs >0.7. We conclude that many intensity- and texture-based features remain consistent between the reference standard and our method while substantially reducing the amount of operator time required.
Collapse
Affiliation(s)
- Sebastian Echegaray
- Department of Electrical Engineering, Stanford University, Stanford, California
| | - Viswam Nair
- Department of Radiology, Stanford University School of Medicine, Stanford, California.,Department of Medicine, Stanford University School of Medicine, Stanford, California.,Canary Center for Cancer Early Detection, Stanford University, Stanford, California
| | - Michael Kadoch
- Department of Radiology, Stanford University School of Medicine, Stanford, California
| | - Ann Leung
- Department of Radiology, Stanford University School of Medicine, Stanford, California
| | - Daniel Rubin
- Department of Radiology, Stanford University School of Medicine, Stanford, California.,Department of Medicine, Stanford University School of Medicine, Stanford, California
| | - Olivier Gevaert
- Department of Medicine, Stanford University School of Medicine, Stanford, California
| | - Sandy Napel
- Department of Radiology, Stanford University School of Medicine, Stanford, California
| |
Collapse
|
41
|
Li B, Chen Q, Peng G, Guo Y, Chen K, Tian L, Ou S, Wang L. Segmentation of pulmonary nodules using adaptive local region energy with probability density function-based similarity distance and multi-features clustering. Biomed Eng Online 2016; 15:49. [PMID: 27150553 PMCID: PMC4858846 DOI: 10.1186/s12938-016-0164-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2016] [Accepted: 04/25/2016] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Pulmonary nodules in computerized tomography (CT) images are potential manifestations of lung cancer. Segmentation of potential nodule objects is the first necessary and crucial step in computer-aided detection system of pulmonary nodules. The segmentation of various types of nodules, especially for ground-glass opacity (GGO) nodules and juxta-vascular nodules, present various challenges. The nodule with GGO characteristic possesses typical intensity inhomogeneity and weak edges, which is difficult to define the boundary; the juxta-vascular nodule is connected to a vessel, and they have very similar intensities. Traditional segmentation methods may result in the problems of boundary leakage and a small volume over-segmentation. This paper deals with the above mentioned problems. METHODS A novel segmentation method for pulmonary nodules is proposed, which uses an adaptive local region energy model with probability density function (PDF)-based similarity distance and multi-features dynamic clustering refinement method. Our approach has several novel aspects: (1) in the proposed adaptive local region energy model, the local domain for local energy model is selected adaptively based on k-nearest-neighbour (KNN) estimate method, and measurable distances between probability density functions of multi-dimension features with high class separability are used to build the cost function. (2) A multi-features dynamic clustering method is used for the segmentation refinement of juxta-vascular nodules, which is based on the nodule segmentation using active contour model (ACM) with adaptive local region energy and vessel segmentation using flow direction feature (FDF)-based region growing method. (3) it handles various types of nodules under a united framework. RESULTS The proposed method has been validated on a clinical dataset of 113 chest CT scans that contain 157 nodules determined by a ground truth reading process, and evaluating the algorithm on the provided data leads to an average Tanimoto/Jaccard error of 0.17, 0.20 and 0.24 for GGO, juxta-vascular and GGO juxta-vascular nodules, respectively. CONCLUSIONS Experimental results show desirable performances of the proposed method. The proposed segmentation method outperforms the traditional methods.
Collapse
Affiliation(s)
- Bin Li
- />School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510640 Guangdong China
| | - QingLin Chen
- />School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510640 Guangdong China
| | - Guangming Peng
- />Department of Radiology, Guangzhou General Hospital of Guangzhou Command, Guangzhou, 510010 Guangdong China
| | - Yuanxing Guo
- />Department of Radiology, Guangzhou General Hospital of Guangzhou Command, Guangzhou, 510010 Guangdong China
| | - Kan Chen
- />School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510640 Guangdong China
| | - LianFang Tian
- />School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510640 Guangdong China
| | - Shanxing Ou
- />Department of Radiology, Guangzhou General Hospital of Guangzhou Command, Guangzhou, 510010 Guangdong China
| | - Lifei Wang
- />Department of Radiology, Shenzhen Third People’s Hospital, Shenzhen, 518112 Guangdong China
| |
Collapse
|
42
|
Krishnamurthy S, Narasimhan G, Rengasamy U. Three-dimensional lung nodule segmentation and shape variance analysis to detect lung cancer with reduced false positives. Proc Inst Mech Eng H 2015; 230:58-70. [DOI: 10.1177/0954411915619951] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
The three-dimensional analysis on lung computed tomography scan was carried out in this study to detect the malignant lung nodules. An automatic three-dimensional segmentation algorithm proposed here efficiently segmented the tissue clusters (nodules) inside the lung. However, an automatic morphological region-grow segmentation algorithm that was implemented to segment the well-circumscribed nodules present inside the lung did not segment the juxta-pleural nodule present on the inner surface of wall of the lung. A novel edge bridge and fill technique is proposed in this article to segment the juxta-pleural and pleural-tail nodules accurately. The centroid shift of each candidate nodule was computed. The nodules with more centroid shift in the consecutive slices were eliminated since malignant nodule’s resultant position did not usually deviate. The three-dimensional shape variation and edge sharp analyses were performed to reduce the false positives and to classify the malignant nodules. The change in area and equivalent diameter was more for malignant nodules in the consecutive slices and the malignant nodules showed a sharp edge. Segmentation was followed by three-dimensional centroid, shape and edge analysis which was carried out on a lung computed tomography database of 20 patient with 25 malignant nodules. The algorithms proposed in this article precisely detected 22 malignant nodules and failed to detect 3 with a sensitivity of 88%. Furthermore, this algorithm correctly eliminated 216 tissue clusters that were initially segmented as nodules; however, 41 non-malignant tissue clusters were detected as malignant nodules. Therefore, the false positive of this algorithm was 2.05 per patient.
Collapse
Affiliation(s)
| | - Ganesh Narasimhan
- Department of ECE, Rajalakshmi Institute of Technology, Chennai, India
| | | |
Collapse
|
43
|
Dhara AK, Mukhopadhyay S, Saha P, Garg M, Khandelwal N. Differential geometry-based techniques for characterization of boundary roughness of pulmonary nodules in CT images. Int J Comput Assist Radiol Surg 2015; 11:337-49. [PMID: 26337440 DOI: 10.1007/s11548-015-1284-0] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2015] [Accepted: 08/13/2015] [Indexed: 11/25/2022]
Abstract
PURPOSE Boundary roughness of a pulmonary nodule is an important indication of its malignancy. The irregularity of the shape of a nodule is represented in terms of a few diagnostic characteristics such as spiculation, lobulation, and sphericity. Quantitative characterization of these diagnostic characteristics is essential for designing a content-based image retrieval system and computer-aided system for diagnosis of lung cancer. METHODS This paper presents differential geometry-based techniques for computation of spiculation, lobulation, and sphericity using the binary mask of the segmented nodule. These shape features are computed in 3D considering complete nodule. RESULTS The performance of the proposed and competing methods is evaluated in terms of the precision, mean similarity, and normalized discounted cumulative gain on 891 nodules of Lung Image Database Consortium and Image Database Resource Initiative. The proposed methods are comparable to or better than gold standard technique. The reproducibility of proposed feature extraction techniques is evaluated using RIDER coffee break data set. The mean and standard deviation of the percent change of spiculation, lobulation, and sphericity are [Formula: see text], [Formula: see text], and [Formula: see text] %, respectively. CONCLUSION The prior works of computation of spiculation, lobulation, and sphericity require a set of four ground truths from radiologists and, hence, can not be used in practice. The proposed methods do not require ground truth information of nodules from radiologists, and hence, it can be used in real-life computer-aided diagnosis system for lung cancer.
Collapse
Affiliation(s)
- Ashis Kumar Dhara
- Department of Electronics and Electrical, Communication Engineering, Indian Institute of Technology Kharagpur, Kharagpur, 721302, India
| | - Sudipta Mukhopadhyay
- Department of Electronics and Electrical, Communication Engineering, Indian Institute of Technology Kharagpur, Kharagpur, 721302, India.
| | - Pramit Saha
- Department of Electrical Engineering, Jadavpur University, Kolkata, 700032, India
| | - Mandeep Garg
- Department of Radiodiagnosis, Postgraduate Institute of Medical Education and Research, Chandigarh, 160023, India
| | - Niranjan Khandelwal
- Department of Radiodiagnosis, Postgraduate Institute of Medical Education and Research, Chandigarh, 160023, India
| |
Collapse
|
44
|
Adhesion Pulmonary Nodules Detection Based on Dot-Filter and Extracting Centerline Algorithm. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:597313. [PMID: 26089968 PMCID: PMC4452339 DOI: 10.1155/2015/597313] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/02/2014] [Revised: 08/26/2014] [Accepted: 09/13/2014] [Indexed: 01/15/2023]
Abstract
A suspected pulmonary nodule detection method was proposed based on dot-filter and extracting centerline algorithm. In this paper, we focus on the distinguishing adhesion pulmonary nodules attached to vessels in two-dimensional (2D) lung computed tomography (CT) images. Firstly, the dot-filter based on Hessian matrix was constructed to enhance the circular area of the pulmonary CT images, which enhanced the circular suspected pulmonary nodule and suppresses the line-like areas. Secondly, to detect the nondistinguishable attached pulmonary nodules by the dot-filter, an algorithm based on extracting centerline was developed to enhance the circle area formed by the end or head of the vessels including the intersection of the lines. 20 sets of CT images were used in the experiments. In addition, 20 true/false nodules extracted were used to test the function of classifier. The experimental results show that the method based on dot-filter and extracting centerline algorithm can detect the attached pulmonary nodules accurately, which is a basis for further studies on the pulmonary nodule detection and diagnose.
Collapse
|
45
|
Guo W, Li Q. Effect of segmentation algorithms on the performance of computerized detection of lung nodules in CT. Med Phys 2015; 41:091906. [PMID: 25186393 DOI: 10.1118/1.4892056] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE The purpose of this study is to reveal how the performance of lung nodule segmentation algorithm impacts the performance of lung nodule detection, and to provide guidelines for choosing an appropriate segmentation algorithm with appropriate parameters in a computer-aided detection (CAD) scheme. METHODS The database consisted of 85 CT scans with 111 nodules of 3 mm or larger in diameter from the standard CT lung nodule database created by the Lung Image Database Consortium. The initial nodule candidates were identified as those with strong response to a selective nodule enhancement filter. A uniform viewpoint reformation technique was applied to a three-dimensional nodule candidate to generate 24 two-dimensional (2D) reformatted images, which would be used to effectively distinguish between true nodules and false positives. Six different algorithms were employed to segment the initial nodule candidates in the 2D reformatted images. Finally, 2D features from the segmented areas in the 24 reformatted images were determined, selected, and classified for removal of false positives. Therefore, there were six similar CAD schemes, in which only the segmentation algorithms were different. The six segmentation algorithms included the fixed thresholding (FT), Otsu thresholding (OTSU), fuzzy C-means (FCM), Gaussian mixture model (GMM), Chan and Vese model (CV), and local binary fitting (LBF). The mean Jaccard index and the mean absolute distance (Dmean) were employed to evaluate the performance of segmentation algorithms, and the number of false positives at a fixed sensitivity was employed to evaluate the performance of the CAD schemes. RESULTS For the segmentation algorithms of FT, OTSU, FCM, GMM, CV, and LBF, the highest mean Jaccard index between the segmented nodule and the ground truth were 0.601, 0.586, 0.588, 0.563, 0.543, and 0.553, respectively, and the corresponding Dmean were 1.74, 1.80, 2.32, 2.80, 3.48, and 3.18 pixels, respectively. With these segmentation results of the six segmentation algorithms, the six CAD schemes reported 4.4, 8.8, 3.4, 9.2, 13.6, and 10.4 false positives per CT scan at a sensitivity of 80%. CONCLUSIONS When multiple algorithms are available for segmenting nodule candidates in a CAD scheme, the "optimal" segmentation algorithm did not necessarily lead to the "optimal" CAD detection performance.
Collapse
Affiliation(s)
- Wei Guo
- School of Computer, Shenyang Aerospace University, Daoyi Development District, Shenyang, Liaoning 110136, China
| | - Qiang Li
- Medical Imaging Information Laboratory, Shanghai Advanced Research Institute, Chinese Academy of Sciences, 99 Haike Road, Pudong District, Shanghai 201203, China and Carl E. Ravin Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705
| |
Collapse
|
46
|
Hwang SH, Oh YW, Ham SY, Kang EY, Lee KY. Effect of the high-pitch mode in dual-source computed tomography on the accuracy of three-dimensional volumetry of solid pulmonary nodules: a phantom study. Korean J Radiol 2015; 16:641-7. [PMID: 25995695 PMCID: PMC4435995 DOI: 10.3348/kjr.2015.16.3.641] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2014] [Accepted: 02/16/2015] [Indexed: 12/05/2022] Open
Abstract
Objective To evaluate the influence of high-pitch mode (HPM) in dual-source computed tomography (DSCT) on the accuracy of three-dimensional (3D) volumetry for solid pulmonary nodules. Materials and Methods A lung phantom implanted with 45 solid pulmonary nodules (n = 15 for each of 4-mm, 6-mm, and 8-mm in diameter) was scanned twice, first in conventional pitch mode (CPM) and then in HPM using DSCT. The relative percentage volume errors (RPEs) of 3D volumetry were compared between the HPM and CPM. In addition, the intermode volume variability (IVV) of 3D volumetry was calculated. Results In the measurement of the 6-mm and 8-mm nodules, there was no significant difference in RPE (p > 0.05, respectively) between the CPM and HPM (IVVs of 1.2 ± 0.9%, and 1.7 ± 1.5%, respectively). In the measurement of the 4-mm nodules, the mean RPE in the HPM (35.1 ± 7.4%) was significantly greater (p < 0.01) than that in the CPM (18.4 ± 5.3%), with an IVV of 13.1 ± 6.6%. However, the IVVs were in an acceptable range (< 25%), regardless of nodule size. Conclusion The accuracy of 3D volumetry with HPM for solid pulmonary nodule is comparable to that with CPM. However, the use of HPM may adversely affect the accuracy of 3D volumetry for smaller (< 5 mm in diameter) nodule.
Collapse
Affiliation(s)
- Sung Ho Hwang
- Department of Radiology, Korea University Anam Hospital, Seoul 136-705, Korea
| | - Yu-Whan Oh
- Department of Radiology, Korea University Anam Hospital, Seoul 136-705, Korea
| | - Soo-Youn Ham
- Department of Radiology, Korea University Anam Hospital, Seoul 136-705, Korea
| | - Eun-Young Kang
- Department of Radiology, Korea University Guro Hospital, Seoul 152-703, Korea
| | - Ki Yeol Lee
- Department of Radiology, Korea University Ansan Hospital, Ansan 425-707, Korea
| |
Collapse
|
47
|
Messay T, Hardie RC, Tuinstra TR. Segmentation of pulmonary nodules in computed tomography using a regression neural network approach and its application to the Lung Image Database Consortium and Image Database Resource Initiative dataset. Med Image Anal 2015; 22:48-62. [PMID: 25791434 DOI: 10.1016/j.media.2015.02.002] [Citation(s) in RCA: 61] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2014] [Revised: 02/06/2015] [Accepted: 02/12/2015] [Indexed: 11/26/2022]
|
48
|
Computer-aided lung nodule recognition by SVM classifier based on combination of random undersampling and SMOTE. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:368674. [PMID: 25977704 PMCID: PMC4419492 DOI: 10.1155/2015/368674] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2015] [Revised: 03/09/2015] [Accepted: 03/14/2015] [Indexed: 11/19/2022]
Abstract
In lung cancer computer-aided detection/diagnosis (CAD) systems, classification of regions of interest (ROI) is often used to detect/diagnose lung nodule accurately. However, problems of unbalanced datasets often have detrimental effects on the performance of classification. In this paper, both minority and majority classes are resampled to increase the generalization ability. We propose a novel SVM classifier combined with random undersampling (RU) and SMOTE for lung nodule recognition. The combinations of the two resampling methods not only achieve a balanced training samples but also remove noise and duplicate information in the training sample and retain useful information to improve the effective data utilization, hence improving performance of SVM algorithm for pulmonary nodules classification under the unbalanced data. Eight features including 2D and 3D features are extracted for training and classification. Experimental results show that for different sizes of training datasets our RU-SMOTE-SVM classifier gets the highest classification accuracy among the four kinds of classifiers, and the average classification accuracy is more than 92.94%.
Collapse
|
49
|
Vivanti R, Joskowicz L, Karaaslan OA, Sosna J. Automatic lung tumor segmentation with leaks removal in follow-up CT studies. Int J Comput Assist Radiol Surg 2015; 10:1505-14. [PMID: 25605297 DOI: 10.1007/s11548-015-1150-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2014] [Accepted: 12/31/2014] [Indexed: 10/24/2022]
Abstract
PURPOSE In modern oncology, disease progression and response to treatment are routinely evaluated with a series of volumetric scans. The number of tumors and their volume (mass) over time provides a quantitative measure for the evaluation. Thus, many of the scans are follow-up scans. We present a new, fully automatic algorithm for lung tumors segmentation in follow-up CT studies that takes advantage of the baseline delineation. METHODS The inputs are a baseline CT scan and a delineation of the tumors in it and a follow-up scan; the output is the tumor delineations in the follow-up CT scan; the output is the tumor delineations in the follow-up CT scan. The algorithm consists of four steps: (1) deformable registration of the baseline scan and tumor's delineations to the follow-up CT scan; (2) segmentation of these tumors in the follow-up CT scan with the baseline CT and the tumor's delineations as priors; (3) detection and correction of follow-up tumors segmentation leaks based on the geometry of both the foreground and the background; and (4) tumor boundary regularization to account for the partial volume effects. RESULTS Our experimental results on 80 pairs of CT scans from 40 patients with ground-truth segmentations by a radiologist yield an average DICE overlap error of 14.5 % ([Formula: see text]), a significant improvement from the 30 % ([Formula: see text]) result of stand-alone level-set segmentation. CONCLUSION The key advantage of our method is that it automatically builds a patient-specific prior to the tumor. Using this prior in the segmentation process, we developed an algorithm that increases segmentation accuracy and robustness and reduces observer variability.
Collapse
Affiliation(s)
- R Vivanti
- The Rachel and Selim Benin School of Computer Science and Engineering, The Hebrew University of Jerusalem, Givat Ram Campus, 91904, Jerusalem, Israel,
| | | | | | | |
Collapse
|
50
|
Lassen BC, Jacobs C, Kuhnigk JM, van Ginneken B, van Rikxoort EM. Robust semi-automatic segmentation of pulmonary subsolid nodules in chest computed tomography scans. Phys Med Biol 2015; 60:1307-23. [PMID: 25591989 DOI: 10.1088/0031-9155/60/3/1307] [Citation(s) in RCA: 50] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
The malignancy of lung nodules is most often detected by analyzing changes of the nodule diameter in follow-up scans. A recent study showed that comparing the volume or the mass of a nodule over time is much more significant than comparing the diameter. Since the survival rate is higher when the disease is still in an early stage it is important to detect the growth rate as soon as possible. However manual segmentation of a volume is time-consuming. Whereas there are several well evaluated methods for the segmentation of solid nodules, less work is done on subsolid nodules which actually show a higher malignancy rate than solid nodules. In this work we present a fast, semi-automatic method for segmentation of subsolid nodules. As minimal user interaction the method expects a user-drawn stroke on the largest diameter of the nodule. First, a threshold-based region growing is performed based on intensity analysis of the nodule region and surrounding parenchyma. In the next step the chest wall is removed by a combination of a connected component analyses and convex hull calculation. Finally, attached vessels are detached by morphological operations. The method was evaluated on all nodules of the publicly available LIDC/IDRI database that were manually segmented and rated as non-solid or part-solid by four radiologists (Dataset 1) and three radiologists (Dataset 2). For these 59 nodules the Jaccard index for the agreement of the proposed method with the manual reference segmentations was 0.52/0.50 (Dataset 1/Dataset 2) compared to an inter-observer agreement of the manual segmentations of 0.54/0.58 (Dataset 1/Dataset 2). Furthermore, the inter-observer agreement using the proposed method (i.e. different input strokes) was analyzed and gave a Jaccard index of 0.74/0.74 (Dataset 1/Dataset 2). The presented method provides satisfactory segmentation results with minimal observer effort in minimal time and can reduce the inter-observer variability for segmentation of subsolid nodules in clinical routine.
Collapse
Affiliation(s)
- B C Lassen
- Fraunhofer MEVIS, Universitaetsallee 29, 28359 Bremen, Germany
| | | | | | | | | |
Collapse
|