1
|
Baidya Kayal E, Ganguly S, Sasi A, Sharma S, DS D, Saini M, Rangarajan K, Kandasamy D, Bakhshi S, Mehndiratta A. A proposed methodology for detecting the malignant potential of pulmonary nodules in sarcoma using computed tomographic imaging and artificial intelligence-based models. Front Oncol 2023; 13:1212526. [PMID: 37671060 PMCID: PMC10476362 DOI: 10.3389/fonc.2023.1212526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 07/31/2023] [Indexed: 09/07/2023] Open
Abstract
The presence of lung metastases in patients with primary malignancies is an important criterion for treatment management and prognostication. Computed tomography (CT) of the chest is the preferred method to detect lung metastasis. However, CT has limited efficacy in differentiating metastatic nodules from benign nodules (e.g., granulomas due to tuberculosis) especially at early stages (<5 mm). There is also a significant subjectivity associated in making this distinction, leading to frequent CT follow-ups and additional radiation exposure along with financial and emotional burden to the patients and family. Even 18F-fluoro-deoxyglucose positron emission technology-computed tomography (18F-FDG PET-CT) is not always confirmatory for this clinical problem. While pathological biopsy is the gold standard to demonstrate malignancy, invasive sampling of small lung nodules is often not clinically feasible. Currently, there is no non-invasive imaging technique that can reliably characterize lung metastases. The lung is one of the favored sites of metastasis in sarcomas. Hence, patients with sarcomas, especially from tuberculosis prevalent developing countries, can provide an ideal platform to develop a model to differentiate lung metastases from benign nodules. To overcome the lack of optimal specificity of CT scan in detecting pulmonary metastasis, a novel artificial intelligence (AI)-based protocol is proposed utilizing a combination of radiological and clinical biomarkers to identify lung nodules and characterize it as benign or metastasis. This protocol includes a retrospective cohort of nearly 2,000-2,250 sample nodules (from at least 450 patients) for training and testing and an ambispective cohort of nearly 500 nodules (from 100 patients; 50 patients each from the retrospective and prospective cohort) for validation. Ground-truth annotation of lung nodules will be performed using an in-house-built segmentation tool. Ground-truth labeling of lung nodules (metastatic/benign) will be performed based on histopathological results or baseline and/or follow-up radiological findings along with clinical outcome of the patient. Optimal methods for data handling and statistical analysis are included to develop a robust protocol for early detection and classification of pulmonary metastasis at baseline and at follow-up and identification of associated potential clinical and radiological markers.
Collapse
Affiliation(s)
- Esha Baidya Kayal
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Shuvadeep Ganguly
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Archana Sasi
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Swetambri Sharma
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Dheeksha DS
- Department of Radiodiagnosis, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Manish Saini
- Department of Radiodiagnosis, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Krithika Rangarajan
- Radiodiagnosis, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | | | - Sameer Bakhshi
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Amit Mehndiratta
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
- Department of Biomedical Engineering, All India Institute of Medical Sciences, New Delhi, Delhi, India
| |
Collapse
|
2
|
Detection of intracranial aneurysms using deep learning-based CAD system: usefulness of the scores of CNN's final layer for distinguishing between aneurysm and infundibular dilatation. Jpn J Radiol 2023; 41:131-141. [PMID: 36173510 PMCID: PMC9889446 DOI: 10.1007/s11604-022-01341-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 09/12/2022] [Indexed: 02/04/2023]
Abstract
PURPOSE We evaluated the diagnostic performance of a clinically available deep learning-based computer-assisted diagnosis software for detecting unruptured aneurysms (UANs) using magnetic resonance angiography and assessed the functionality of the convolutional neural network (CNN) final layer score for distinguishing between UAN and infundibular dilatation (ID). MATERIALS AND METHODS EIRL brain aneurysm (EIRL_BA) was used in this study. The subjects were 117 UAN and/or ID cases including 100 UAN lesions (average sizes of 2.56 ± 1.45 mm) and 40 ID lesions (average sizes of 1.75 ± 0.41 mm) in any of internal carotid artery, middle cerebral artery, and anterior communicating artery, and 123 normal controls. The sensitivity, specificity, and accuracy of EIRL_BA were determined for UAN and ID or UAN only. Furthermore, the relationship between the lesion category and score was examined using a linear regression analysis model, and the receiver operating characteristic (ROC) analysis was used to assess whether the scores represent UAN-like characteristics. RESULTS EIRL_BA showed a total of 203 candidates (an average of 1.73/case) in UAN and/or ID cases and 98 candidates (an average of 0.80/case) in normal controls. For diagnosing either UAN/ID, EIRL_BA showed an overall sensitivity of 80%, specificity of 84.2%, and accuracy of 83.7%, resulting in the positive likelihood ratio of 5.0. For diagnosing UAN only, the overall sensitivity of 89.0, specificity of 82.6%, and accuracy of 83.2% resulting in the positive likelihood ratio of 5.1. In a linear regression analysis, the scores significantly increased in the candidates' first and second ranks in UAN (p < 0.05) but not in ID. An ROC analysis using the score for diagnosing UAN showed an area under the curve of 0.836. CONCLUSION EIRL_BA is applicable for detecting small UAN, and the CNN's final layer scores may be an effective index for discriminating UAN and ID and representing the likelihood of UAN.
Collapse
|
3
|
Hussain MA, Gogoi L. Performance analyses of five neural network classifiers on nodule classification in lung CT images using WEKA: a comparative study. Phys Eng Sci Med 2022; 45:1193-1204. [PMID: 36315381 DOI: 10.1007/s13246-022-01187-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 10/08/2022] [Indexed: 11/06/2022]
Abstract
In this report, we are presenting our work on performance analyses of five different neural network classifiers viz. MLP, DL4JMLP, logistic regression, SGD and simple logistic classifier in lung nodule detection using WEKA interface. To the best of our knowledge, this report demonstrates first use of WEKA for comparative performance analyses of neural network classifiers in identifying lung nodules from lung CT-images. A total of 624 handcrafted features from 52 numbers of lung CT-images collected randomly from Lung Image Database Consortium (LIDC) were fed into WEKA to evaluate the performances of the classifiers under four different categories of computation. Performances of the classifiers were observed in terms of 11 important parameters viz. accuracy, kappa statistic, root mean squared error, TPR, FPR, precision, sensitivity, F-measurement, MCC, ROC area and PRC area. Results show 86.53%, 77.77%, 55.55%, 94.44% & 88.88% accuracy as well as 0.91, 0.86, 0.68, 0.91 & 0.93 ROC area for MLP, DL4JMLP, logistic, SGD and simple logistic classifier respectively at tenfold cross-validation by taking 66% of the data set for training and 34% for testing and validation purpose. SGDClassifier has been found the best performing followed by simple logistic classifier for the purpose.
Collapse
Affiliation(s)
- Md Anwar Hussain
- Department of Electronics and Communication Engineering, North Eastern Regional Institute of Science and Technology, Nirjuli, 791109, India
| | - Lakshipriya Gogoi
- Department of Electronics and Communication Engineering, North Eastern Regional Institute of Science and Technology, Nirjuli, 791109, India.
| |
Collapse
|
4
|
Bruntha PM, Pandian SIA, Anitha J, Abraham SS, Kumar SN. A Novel Hybridized Feature Extraction Approach for Lung Nodule Classification Based on Transfer Learning Technique. J Med Phys 2022; 47:1-9. [PMID: 35548037 PMCID: PMC9084582 DOI: 10.4103/jmp.jmp_61_21] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Revised: 08/11/2021] [Accepted: 09/05/2021] [Indexed: 12/24/2022] Open
Abstract
Purpose In the field of medical diagnosis, deep learning-based computer-aided detection of diseases will reduce the burden of physicians in the diagnosis of diseases especially in the case of lung cancer nodule classification. Materials and Methods A hybridized model which integrates deep features from Residual Neural Network using transfer learning and handcrafted features from the histogram of oriented gradients feature descriptor is proposed to classify the lung nodules as benign or malignant. The intrinsic convolutional neural network (CNN) features have been incorporated and they can resolve the drawbacks of handcrafted features that do not completely reflect the specific characteristics of a nodule. In the meantime, they also reduce the need for a large-scale annotated dataset for CNNs. For classifying malignant nodules and benign nodules, radial basis function support vector machine is used. The proposed hybridized model is evaluated on the LIDC-IDRI dataset. Results It has achieved an accuracy of 97.53%, sensitivity of 98.62%, specificity of 96.88%, precision of 95.04%, F1 score of 0.9679, false-positive rate of 3.117%, and false-negative rate of 1.38% and has been compared with other state of the art techniques. Conclusions The performance of the proposed hybridized feature-based classification technique is better than the deep features-based classification technique in lung nodule classification.
Collapse
Affiliation(s)
- P. Malin Bruntha
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| | - S. Immanuel Alex Pandian
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| | - J. Anitha
- Department of Computer Science Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| | - Siril Sam Abraham
- Department of Data Science, Pivotchain Solution Technologies Private Limited, Pune, Maharashtra, India
| | - S. Niranjan Kumar
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| |
Collapse
|
5
|
Liang S, Liu H, Yang F, Qin C, Feng Y. Classification of Benign and Malignant Pulmonary Nodules Using a Regularized Extreme Learning Machine. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
An L1/L2-norm-bound extreme learning machine classification algorithm is proposed to improve the accuracy of distinguishing between benign and malignant pulmonary nodules. In this algorithm, features extracted from the segmented lung nodule using the histogram of oriented gradients
method are used as inputs. L1-norm can promote sparsity in the weights of the output layer, and L2-norm can smooth output weights. The combination of the L1 norm and L2 norm can simplify the complexity of the network and prevent overfitting to improve classification accuracy. For each newly
tested lung nodule, the algorithm outputs a class label of either benign or malignant. The accuracy, sensitivity, and specificity reached 94.12%, 93%, and 95% respectively over the lung image database consortium and image database resource initiative dataset. Compared with other algorithms,
the average values of the three metrics increased by 6.5%, 7.94%, and 4.32%, respectively. An accuracy score of 95.83% can be achieved over a set of 120 urinary sediment images. Therefore, this algorithm has a good classification effect of pulmonary nodules.
Collapse
Affiliation(s)
- ShuFen Liang
- Faculty of Intelligent Manufacturing, Wuyi University, 529020, China
| | - HuiLin Liu
- Faculty of Intelligent Manufacturing, Wuyi University, 529020, China
| | - FangChen Yang
- Faculty of Intelligent Manufacturing, Wuyi University, 529020, China
| | - Chuanbo Qin
- Faculty of Intelligent Manufacturing, Wuyi University, 529020, China
| | - Yue Feng
- Faculty of Intelligent Manufacturing, Wuyi University, 529020, China
| |
Collapse
|
6
|
Liu A, Wang Z, Yang Y, Wang J, Dai X, Wang L, Lu Y, Xue F. Preoperative diagnosis of malignant pulmonary nodules in lung cancer screening with a radiomics nomogram. Cancer Commun (Lond) 2020; 40:16-24. [PMID: 32125097 PMCID: PMC7163925 DOI: 10.1002/cac2.12002] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2019] [Revised: 12/10/2019] [Indexed: 12/12/2022] Open
Abstract
Background Lung cancer is the most commonly diagnosed cancer worldwide. Its survival rate can be significantly improved by early screening. Biomarkers based on radiomics features have been found to provide important physiological information on tumors and considered as having the potential to be used in the early screening of lung cancer. In this study, we aim to establish a radiomics model and develop a tool to improve the discrimination between benign and malignant pulmonary nodules. Methods A retrospective study was conducted on 875 patients with benign or malignant pulmonary nodules who underwent computed tomography (CT) examinations between June 2013 and June 2018. We assigned 612 patients to a training cohort and 263 patients to a validation cohort. Radiomics features were extracted from the CT images of each patient. Least absolute shrinkage and selection operator (LASSO) was used for radiomics feature selection and radiomics score calculation. Multivariate logistic regression analysis was used to develop a classification model and radiomics nomogram. Radiomics score and clinical variables were used to distinguish benign and malignant pulmonary nodules in logistic model. The performance of the radiomics nomogram was evaluated by the area under the curve (AUC), calibration curve and Hosmer‐Lemeshow test in both the training and validation cohorts. Results A radiomics score was built and consisted of 20 features selected by LASSO from 1288 radiomics features in the training cohort. The multivariate logistic model and radiomics nomogram were constructed using the radiomics score and patients’ age. Good discrimination of benign and malignant pulmonary nodules was obtained from the training cohort (AUC, 0.836; 95% confidence interval [CI]: 0.793‐0.879) and validation cohort (AUC, 0.809; 95% CI: 0.745‐0.872). The Hosmer‐Lemeshow test also showed good performance for the logistic regression model in the training cohort (P = 0.765) and validation cohort (P = 0.064). Good alignment with the calibration curve indicated the good performance of the nomogram. Conclusions The established radiomics nomogram is a noninvasive preoperative prediction tool for malignant pulmonary nodule diagnosis. Validation revealed that this nomogram exhibited excellent discrimination and calibration capacities, suggesting its clinical utility in the early screening of lung cancer.
Collapse
Affiliation(s)
- Ailing Liu
- Department of Pulmonary and Critical Care Medicine, Weihai Municipal Hospital, Weihai, Shandong, 264200, P. R. China
| | - Zhiheng Wang
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, Shandong, 250002, P. R. China
| | - Yachao Yang
- Department of Physical Examination, Weihai Municipal Hospital, Weihai, Shandong, 264200, P. R. China
| | - Jingtao Wang
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, Shandong, 250002, P. R. China
| | - Xiaoyu Dai
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, Shandong, 250002, P. R. China
| | - Lijie Wang
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, Shandong, 250002, P. R. China
| | - Yuan Lu
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, Shandong, 250002, P. R. China
| | - Fuzhong Xue
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, Shandong, 250002, P. R. China.,Institute for Medical Dataology, Shandong University, Jinan, Shandong, 250002, P. R. China
| |
Collapse
|
7
|
Usage and implementation of neuro-fuzzy systems for classification and prediction in the diagnosis of different types of medical disorders: a decade review. Artif Intell Rev 2020. [DOI: 10.1007/s10462-020-09804-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
8
|
Decision Support System for Lung Cancer Using PET/CT and Microscopic Images. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2020; 1213:73-94. [DOI: 10.1007/978-3-030-33128-3_5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
9
|
A manifold learning regularization approach to enhance 3D CT image-based lung nodule classification. Int J Comput Assist Radiol Surg 2019; 15:287-295. [PMID: 31768885 DOI: 10.1007/s11548-019-02097-8] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2019] [Accepted: 11/16/2019] [Indexed: 02/07/2023]
Abstract
PURPOSE Diagnosis of lung cancer requires radiologists to review every lung nodule in CT images. Such a process can be very time-consuming, and the accuracy is affected by many factors, such as experience of radiologists and available diagnosis time. To address this problem, we proposed to develop a deep learning-based system to automatically classify benign and malignant lung nodules. METHODS The proposed method automatically determines benignity or malignancy given the 3D CT image patch of a lung nodule to assist diagnosis process. Motivated by the fact that real structure among data is often embedded on a low-dimensional manifold, we developed a novel manifold regularized classification deep neural network (MRC-DNN) to perform classification directly based on the manifold representation of lung nodule images. The concise manifold representation revealing important data structure is expected to benefit the classification, while the manifold regularization enforces strong, but natural constraints on network training, preventing over-fitting. RESULTS The proposed method achieves accurate manifold learning with reconstruction error of ~ 30 HU on real lung nodule CT image data. In addition, the classification accuracy on testing data is 0.90 with sensitivity of 0.81 and specificity of 0.95, which outperforms state-of-the-art deep learning methods. CONCLUSION The proposed MRC-DNN facilitates an accurate manifold learning approach for lung nodule classification based on 3D CT images. More importantly, MRC-DNN suggests a new and effective idea of enforcing regularization for network training, possessing the potential impact to a board range of applications.
Collapse
|
10
|
Li S, Xu P, Li B, Chen L, Zhou Z, Hao H, Duan Y, Folkert M, Ma J, Huang S, Jiang S, Wang J. Predicting lung nodule malignancies by combining deep convolutional neural network and handcrafted features. Phys Med Biol 2019; 64:175012. [PMID: 31307017 PMCID: PMC7106773 DOI: 10.1088/1361-6560/ab326a] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
To predict lung nodule malignancy with a high sensitivity and specificity for low dose CT (LDCT) lung cancer screening, we propose a fusion algorithm that combines handcrafted features (HF) into the features learned at the output layer of a 3D deep convolutional neural network (CNN). First, we extracted twenty-nine HF, including nine intensity features, eight geometric features, and twelve texture features based on grey-level co-occurrence matrix (GLCM). We then trained 3D CNNs modified from three 2D CNN architectures (AlexNet, VGG-16 Net and Multi-crop Net) to extract the CNN features learned at the output layer. For each 3D CNN, the CNN features combined with the 29 HF were used as the input for the support vector machine (SVM) coupled with the sequential forward feature selection (SFS) method to select the optimal feature subset and construct the classifiers. The fusion algorithm takes full advantage of the HF and the highest level CNN features learned at the output layer. It can overcome the disadvantage of the HF that may not fully reflect the unique characteristics of a particular lesion by combining the intrinsic CNN features. Meanwhile, it also alleviates the requirement of a large scale annotated dataset for the CNNs based on the complementary of HF. The patient cohort includes 431 malignant nodules and 795 benign nodules extracted from the LIDC/IDRI database. For each investigated CNN architecture, the proposed fusion algorithm achieved the highest AUC, accuracy, sensitivity, and specificity scores among all competitive classification models.
Collapse
Affiliation(s)
- Shulong Li
- School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China
| | - Panpan Xu
- Longgang District People’s Hospital, Shenzhen, 518172, China
| | - Bin Li
- School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China
| | - Liyuan Chen
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, 75235, USA
| | - Zhiguo Zhou
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, 75235, USA
| | - Hongxia Hao
- School of Computer Science and Technology, Xidian University, Xi’an, 710071, China
| | - Yingying Duan
- School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China
| | - Michael Folkert
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, 75235, USA
| | - Jianhua Ma
- School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China
| | - Shiying Huang
- School of Traditional Chinese Medicine, Southern Medical University, Guangzhou, 510515, China
| | - Steve Jiang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, 75235, USA
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, 75235, USA
| |
Collapse
|
11
|
Shen S, Han SX, Aberle DR, Bui AA, Hsu W. An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification. EXPERT SYSTEMS WITH APPLICATIONS 2019; 128:84-95. [PMID: 31296975 PMCID: PMC6623975 DOI: 10.1016/j.eswa.2019.01.048] [Citation(s) in RCA: 85] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
While deep learning methods have demonstrated performance comparable to human readers in tasks such as computer-aided diagnosis, these models are difficult to interpret, do not incorporate prior domain knowledge, and are often considered as a "black-box." The lack of model interpretability hinders them from being fully understood by end users such as radiologists. In this paper, we present a novel interpretable deep hierarchical semantic convolutional neural network (HSCNN) to predict whether a given pulmonary nodule observed on a computed tomography (CT) scan is malignant. Our network provides two levels of output: 1) low-level semantic features; and 2) a high-level prediction of nodule malignancy. The low-level outputs reflect diagnostic features often reported by radiologists and serve to explain how the model interprets the images in an expert-interpretable manner. The information from these low-level outputs, along with the representations learned by the convolutional layers, are then combined and used to infer the high-level output. This unified architecture is trained by optimizing a global loss function including both low- and high-level tasks, thereby learning all the parameters within a joint framework. Our experimental results using the Lung Image Database Consortium (LIDC) show that the proposed method not only produces interpretable lung cancer predictions but also achieves significantly better results compared to using a 3D CNN alone.
Collapse
Affiliation(s)
- Shiwen Shen
- Department of Bioengineering, University of California, Los Angeles, CA, USA
- Medical & Imaging Informatics Group, Department of Radiological Sciences, University of California, Los Angeles, CA, USA
| | - Simon X Han
- Department of Bioengineering, University of California, Los Angeles, CA, USA
- Medical & Imaging Informatics Group, Department of Radiological Sciences, University of California, Los Angeles, CA, USA
| | - Denise R Aberle
- Department of Bioengineering, University of California, Los Angeles, CA, USA
- Medical & Imaging Informatics Group, Department of Radiological Sciences, University of California, Los Angeles, CA, USA
| | - Alex A Bui
- Medical & Imaging Informatics Group, Department of Radiological Sciences, University of California, Los Angeles, CA, USA
| | - William Hsu
- Medical & Imaging Informatics Group, Department of Radiological Sciences, University of California, Los Angeles, CA, USA
| |
Collapse
|
12
|
Wang X, Mao K, Wang L, Yang P, Lu D, He P. An Appraisal of Lung Nodules Automatic Classification Algorithms for CT Images. SENSORS (BASEL, SWITZERLAND) 2019; 19:E194. [PMID: 30621101 PMCID: PMC6338921 DOI: 10.3390/s19010194] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2018] [Revised: 12/28/2018] [Accepted: 12/31/2018] [Indexed: 12/23/2022]
Abstract
Lung cancer is one of the most deadly diseases around the world representing about 26% of all cancers in 2017. The five-year cure rate is only 18% despite great progress in recent diagnosis and treatment. Before diagnosis, lung nodule classification is a key step, especially since automatic classification can help clinicians by providing a valuable opinion. Modern computer vision and machine learning technologies allow very fast and reliable CT image classification. This research area has become very hot for its high efficiency and labor saving. The paper aims to draw a systematic review of the state of the art of automatic classification of lung nodules. This research paper covers published works selected from the Web of Science, IEEEXplore, and DBLP databases up to June 2018. Each paper is critically reviewed based on objective, methodology, research dataset, and performance evaluation. Mainstream algorithms are conveyed and generic structures are summarized. Our work reveals that lung nodule classification based on deep learning becomes dominant for its excellent performance. It is concluded that the consistency of the research objective and integration of data deserves more attention. Moreover, collaborative works among developers, clinicians, and other parties should be strengthened.
Collapse
Affiliation(s)
- Xinqi Wang
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Keming Mao
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Lizhe Wang
- Norman Bethune Health Science Center of Jilin University, No. 2699 Qianjin Street, Changchun 130012, China.
| | - Peiyi Yang
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Duo Lu
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Ping He
- School of Computer Science and Engineering, Northeastern University, Shenyang 110004, China.
| |
Collapse
|
13
|
McBee MP, Awan OA, Colucci AT, Ghobadi CW, Kadom N, Kansagra AP, Tridandapani S, Auffermann WF. Deep Learning in Radiology. Acad Radiol 2018; 25:1472-1480. [PMID: 29606338 DOI: 10.1016/j.acra.2018.02.018] [Citation(s) in RCA: 227] [Impact Index Per Article: 37.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2017] [Revised: 02/22/2018] [Accepted: 02/23/2018] [Indexed: 02/07/2023]
Abstract
As radiology is inherently a data-driven specialty, it is especially conducive to utilizing data processing techniques. One such technique, deep learning (DL), has become a remarkably powerful tool for image processing in recent years. In this work, the Association of University Radiologists Radiology Research Alliance Task Force on Deep Learning provides an overview of DL for the radiologist. This article aims to present an overview of DL in a manner that is understandable to radiologists; to examine past, present, and future applications; as well as to evaluate how radiologists may benefit from this remarkable new tool. We describe several areas within radiology in which DL techniques are having the most significant impact: lesion or disease detection, classification, quantification, and segmentation. The legal and ethical hurdles to implementation are also discussed. By taking advantage of this powerful tool, radiologists can become increasingly more accurate in their interpretations with fewer errors and spend more time to focus on patient care.
Collapse
Affiliation(s)
- Morgan P McBee
- Department of Radiology and Medical Imaging, Cincinnati Children's Hospital, Cincinnati, Ohio
| | - Omer A Awan
- Department of Radiology, Temple University Hospital, Philadelphia, Pennsylvania
| | - Andrew T Colucci
- Department of Radiology, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | | | - Nadja Kadom
- Department of Radiology and Imaging Sciences, Children's Healthcare of Atlanta (Egleston), Emory University School of Medicine, Atlanta, Georgia
| | - Akash P Kansagra
- Mallinckrodt Institute of Radiology and Departments of Neurological Surgery and Neurology, Washington University School of Medicine, Saint Louis, Missouri
| | - Srini Tridandapani
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Electrical & Computer Engineering, Georgia Institute of Technology, Atlanta, Georgia
| | - William F Auffermann
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, 1365 Clifton Road NE, Atlanta, GA 30322.
| |
Collapse
|
14
|
Choi W, Oh JH, Riyahi S, Liu C, Jiang F, Chen W, White C, Rimner A, Mechalakos JG, Deasy JO, Lu W. Radiomics analysis of pulmonary nodules in low-dose CT for early detection of lung cancer. Med Phys 2018; 45:1537-1549. [PMID: 29457229 PMCID: PMC5903960 DOI: 10.1002/mp.12820] [Citation(s) in RCA: 88] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2017] [Revised: 02/05/2018] [Accepted: 02/07/2018] [Indexed: 01/13/2023] Open
Abstract
PURPOSE To develop a radiomics prediction model to improve pulmonary nodule (PN) classification in low-dose CT. To compare the model with the American College of Radiology (ACR) Lung CT Screening Reporting and Data System (Lung-RADS) for early detection of lung cancer. METHODS We examined a set of 72 PNs (31 benign and 41 malignant) from the Lung Image Database Consortium image collection (LIDC-IDRI). One hundred three CT radiomic features were extracted from each PN. Before the model building process, distinctive features were identified using a hierarchical clustering method. We then constructed a prediction model by using a support vector machine (SVM) classifier coupled with a least absolute shrinkage and selection operator (LASSO). A tenfold cross-validation (CV) was repeated ten times (10 × 10-fold CV) to evaluate the accuracy of the SVM-LASSO model. Finally, the best model from the 10 × 10-fold CV was further evaluated using 20 × 5- and 50 × 2-fold CVs. RESULTS The best SVM-LASSO model consisted of only two features: the bounding box anterior-posterior dimension (BB_AP) and the standard deviation of inverse difference moment (SD_IDM). The BB_AP measured the extension of a PN in the anterior-posterior direction and was highly correlated (r = 0.94) with the PN size. The SD_IDM was a texture feature that measured the directional variation of the local homogeneity feature IDM. Univariate analysis showed that both features were statistically significant and discriminative (P = 0.00013 and 0.000038, respectively). PNs with larger BB_AP or smaller SD_IDM were more likely malignant. The 10 × 10-fold CV of the best SVM model using the two features achieved an accuracy of 84.6% and 0.89 AUC. By comparison, Lung-RADS achieved an accuracy of 72.2% and 0.77 AUC using four features (size, type, calcification, and spiculation). The prediction improvement of SVM-LASSO comparing to Lung-RADS was statistically significant (McNemar's test P = 0.026). Lung-RADS misclassified 19 cases because it was mainly based on PN size, whereas the SVM-LASSO model correctly classified 10 of these cases by combining a size (BB_AP) feature and a texture (SD_IDM) feature. The performance of the SVM-LASSO model was stable when leaving more patients out with five- and twofold CVs (accuracy 84.1% and 81.6%, respectively). CONCLUSION We developed an SVM-LASSO model to predict malignancy of PNs with two CT radiomic features. We demonstrated that the model achieved an accuracy of 84.6%, which was 12.4% higher than Lung-RADS.
Collapse
Affiliation(s)
- Wookjin Choi
- Department of Medical
PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - Jung Hun Oh
- Department of Medical
PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - Sadegh Riyahi
- Department of Medical
PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - Chia‐Ju Liu
- Department of
RadiologyMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - Feng Jiang
- Department of
PathologyUniversity of Maryland School of MedicineBaltimoreMD21201USA
| | - Wengen Chen
- Department of Diagnostic Radiology
and Nuclear MedicineUniversity of Maryland School of MedicineBaltimoreMD21201USA
| | - Charles White
- Department of Diagnostic Radiology
and Nuclear MedicineUniversity of Maryland School of MedicineBaltimoreMD21201USA
| | - Andreas Rimner
- Department of Radiation
OncologyMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - James G. Mechalakos
- Department of Medical
PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - Joseph O. Deasy
- Department of Medical
PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| | - Wei Lu
- Department of Medical
PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNY10065USA
| |
Collapse
|
15
|
A Combination of Shape and Texture Features for Classification of Pulmonary Nodules in Lung CT Images. J Digit Imaging 2018; 29:466-75. [PMID: 26738871 DOI: 10.1007/s10278-015-9857-6] [Citation(s) in RCA: 83] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023] Open
Abstract
Classification of malignant and benign pulmonary nodules is important for further treatment plan. The present work focuses on the classification of benign and malignant pulmonary nodules using support vector machine. The pulmonary nodules are segmented using a semi-automated technique, which requires only a seed point from the end user. Several shape-based, margin-based, and texture-based features are computed to represent the pulmonary nodules. A set of relevant features is determined for the efficient representation of nodules in the feature space. The proposed classification scheme is validated on a data set of 891 nodules of Lung Image Database Consortium and Image Database Resource Initiative public database. The proposed classification scheme is evaluated for three configurations such as configuration 1 (composite rank of malignancy "1" and "2" as benign and "4" and "5" as malignant), configuration 2 (composite rank of malignancy "1","2", and "3" as benign and "4" and "5" as malignant), and configuration 3 (composite rank of malignancy "1" and "2" as benign and "3","4" and "5" as malignant). The performance of the classification is evaluated in terms of area (A z) under the receiver operating characteristic curve. The A z achieved by the proposed method for configuration-1, configuration-2, and configuration-3 are 0.9505, 0.8822, and 0.8488, respectively. The proposed method outperforms the most recent technique, which depends on the manual segmentation of pulmonary nodules by a trained radiologist.
Collapse
|
16
|
Liu S, Xie Y, Jirapatnakul A, Reeves AP. Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks. J Med Imaging (Bellingham) 2017; 4:041308. [PMID: 29181428 PMCID: PMC5685809 DOI: 10.1117/1.jmi.4.4.041308] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2017] [Accepted: 10/23/2017] [Indexed: 12/17/2022] Open
Abstract
A three-dimensional (3-D) convolutional neural network (CNN) trained from scratch is presented for the classification of pulmonary nodule malignancy from low-dose chest CT scans. Recent approval of lung cancer screening in the United States provides motivation for determining the likelihood of malignancy of pulmonary nodules from the initial CT scan finding to minimize the number of follow-up actions. Classifier ensembles of different combinations of the 3-D CNN and traditional machine learning models based on handcrafted 3-D image features are also explored. The dataset consisting of 326 nodules is constructed with balanced size and class distribution with the malignancy status pathologically confirmed. The results show that both the 3-D CNN single model and the ensemble models with 3-D CNN outperform the respective counterparts constructed using only traditional models. Moreover, complementary information can be learned by the 3-D CNN and the conventional models, which together are combined to construct an ensemble model with statistically superior performance compared with the single traditional model. The performance of the 3-D CNN model demonstrates the potential for improving the lung cancer screening follow-up protocol, which currently mainly depends on the nodule size.
Collapse
Affiliation(s)
- Shuang Liu
- Cornell University, School of Electrical and Computer Engineering, Ithaca, New York, United States
| | - Yiting Xie
- Cornell University, School of Electrical and Computer Engineering, Ithaca, New York, United States
| | - Artit Jirapatnakul
- Icahn School of Medicine at Mount Sinai, Department of Radiology, New York, United States
| | - Anthony P. Reeves
- Cornell University, School of Electrical and Computer Engineering, Ithaca, New York, United States
| |
Collapse
|
17
|
Learning Lung Nodule Malignancy Likelihood from Radiologist Annotations or Diagnosis Data. J Med Biol Eng 2017. [DOI: 10.1007/s40846-017-0317-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
18
|
Yip SSF, Parmar C, Blezek D, Estepar RSJ, Pieper S, Kim J, Aerts HJWL. Application of the 3D slicer chest imaging platform segmentation algorithm for large lung nodule delineation. PLoS One 2017; 12:e0178944. [PMID: 28594880 PMCID: PMC5464594 DOI: 10.1371/journal.pone.0178944] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2017] [Accepted: 05/22/2017] [Indexed: 11/24/2022] Open
Abstract
PURPOSE Accurate segmentation of lung nodules is crucial in the development of imaging biomarkers for predicting malignancy of the nodules. Manual segmentation is time consuming and affected by inter-observer variability. We evaluated the robustness and accuracy of a publically available semiautomatic segmentation algorithm that is implemented in the 3D Slicer Chest Imaging Platform (CIP) and compared it with the performance of manual segmentation. METHODS CT images of 354 manually segmented nodules were downloaded from the LIDC database. Four radiologists performed the manual segmentation and assessed various nodule characteristics. The semiautomatic CIP segmentation was initialized using the centroid of the manual segmentations, thereby generating four contours for each nodule. The robustness of both segmentation methods was assessed using the region of uncertainty (δ) and Dice similarity index (DSI). The robustness of the segmentation methods was compared using the Wilcoxon-signed rank test (pWilcoxon<0.05). The Dice similarity index (DSIAgree) between the manual and CIP segmentations was computed to estimate the accuracy of the semiautomatic contours. RESULTS The median computational time of the CIP segmentation was 10 s. The median CIP and manually segmented volumes were 477 ml and 309 ml, respectively. CIP segmentations were significantly more robust than manual segmentations (median δCIP = 14ml, median dsiCIP = 99% vs. median δmanual = 222ml, median dsimanual = 82%) with pWilcoxon~10-16. The agreement between CIP and manual segmentations had a median DSIAgree of 60%. While 13% (47/354) of the nodules did not require any manual adjustment, minor to substantial manual adjustments were needed for 87% (305/354) of the nodules. CIP segmentations were observed to perform poorly (median DSIAgree≈50%) for non-/sub-solid nodules with subtle appearances and poorly defined boundaries. CONCLUSION Semi-automatic CIP segmentation can potentially reduce the physician workload for 13% of nodules owing to its computational efficiency and superior stability compared to manual segmentation. Although manual adjustment is needed for many cases, CIP segmentation provides a preliminary contour for physicians as a starting point.
Collapse
Affiliation(s)
- Stephen S F Yip
- Department of Radiation Oncology, Dana-Farber Cancer Institute, Brigham and Women's Hospital, and Harvard Medical School, Boston, MA, United States of America
| | - Chintan Parmar
- Department of Radiation Oncology, Dana-Farber Cancer Institute, Brigham and Women's Hospital, and Harvard Medical School, Boston, MA, United States of America
| | - Daniel Blezek
- Biomedical Engineering Department, Mayo Graduate School of Medicine Rochester, MN, United States of America
| | - Raul San Jose Estepar
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States of America
| | - Steve Pieper
- Isomics, Inc., Cambridge, MA, United States of America
| | - John Kim
- Department of Radiology, University of Michigan Health System, Ann Arbor MI, United States of America
| | - Hugo J W L Aerts
- Department of Radiation Oncology, Dana-Farber Cancer Institute, Brigham and Women's Hospital, and Harvard Medical School, Boston, MA, United States of America
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States of America
| |
Collapse
|
19
|
Classification of Lung Nodule Malignancy Risk on Computed Tomography Images Using Convolutional Neural Network: A Comparison Between 2D and 3D Strategies. COMPUTER VISION – ACCV 2016 WORKSHOPS 2017. [DOI: 10.1007/978-3-319-54526-4_7] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
20
|
Ma L, Liu X, Fei B. Learning with distribution of optimized features for recognizing common CT imaging signs of lung diseases. Phys Med Biol 2016; 62:612-632. [PMID: 28033116 DOI: 10.1088/1361-6560/62/2/612] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Common CT imaging signs of lung diseases (CISLs) are defined as the imaging signs that frequently appear in lung CT images from patients. CISLs play important roles in the diagnosis of lung diseases. This paper proposes a novel learning method, namely learning with distribution of optimized feature (DOF), to effectively recognize the characteristics of CISLs. We improve the classification performance by learning the optimized features under different distributions. Specifically, we adopt the minimum spanning tree algorithm to capture the relationship between features and discriminant ability of features for selecting the most important features. To overcome the problem of various distributions in one CISL, we propose a hierarchical learning method. First, we use an unsupervised learning method to cluster samples into groups based on their distribution. Second, in each group, we use a supervised learning method to train a model based on their categories of CISLs. Finally, we obtain multiple classification decisions from multiple trained models and use majority voting to achieve the final decision. The proposed approach has been implemented on a set of 511 samples captured from human lung CT images and achieves a classification accuracy of 91.96%. The proposed DOF method is effective and can provide a useful tool for computer-aided diagnosis of lung diseases on CT images.
Collapse
Affiliation(s)
- Ling Ma
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA, USA. School of Computer Science, Beijing Institute of Technology, Beijing, People's Republic of China
| | | | | |
Collapse
|
21
|
Armato SG, Drukker K, Li F, Hadjiiski L, Tourassi GD, Engelmann RM, Giger ML, Redmond G, Farahani K, Kirby JS, Clarke LP. LUNGx Challenge for computerized lung nodule classification. J Med Imaging (Bellingham) 2016; 3:044506. [PMID: 28018939 PMCID: PMC5166709 DOI: 10.1117/1.jmi.3.4.044506] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2016] [Accepted: 11/17/2016] [Indexed: 11/14/2022] Open
Abstract
The purpose of this work is to describe the LUNGx Challenge for the computerized classification of lung nodules on diagnostic computed tomography (CT) scans as benign or malignant and report the performance of participants' computerized methods along with that of six radiologists who participated in an observer study performing the same Challenge task on the same dataset. The Challenge provided sets of calibration and testing scans, established a performance assessment process, and created an infrastructure for case dissemination and result submission. Ten groups applied their own methods to 73 lung nodules (37 benign and 36 malignant) that were selected to achieve approximate size matching between the two cohorts. Area under the receiver operating characteristic curve (AUC) values for these methods ranged from 0.50 to 0.68; only three methods performed statistically better than random guessing. The radiologists' AUC values ranged from 0.70 to 0.85; three radiologists performed statistically better than the best-performing computer method. The LUNGx Challenge compared the performance of computerized methods in the task of differentiating benign from malignant lung nodules on CT scans, placed in the context of the performance of radiologists on the same task. The continued public availability of the Challenge cases will provide a valuable resource for the medical imaging research community.
Collapse
Affiliation(s)
- Samuel G. Armato
- The University of Chicago, Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States
| | - Karen Drukker
- The University of Chicago, Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States
| | - Feng Li
- The University of Chicago, Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States
| | - Lubomir Hadjiiski
- University of Michigan, Department of Radiology, 1500 East Medical Center Drive, Ann Arbor, Michigan 48109, United States
| | - Georgia D. Tourassi
- Health Data Sciences Institute, Biomedical Science and Engineering Center, Oak Ridge National Laboratory, P.O. Box 2008 MS6085 Oak Ridge, Tennessee 37831-6085, United States
| | - Roger M. Engelmann
- The University of Chicago, Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States
| | - Maryellen L. Giger
- The University of Chicago, Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States
| | - George Redmond
- National Cancer Institute, Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, 9609 Medical Center Drive, Bethesda, Maryland 20892, United States
| | - Keyvan Farahani
- National Cancer Institute, Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, 9609 Medical Center Drive, Bethesda, Maryland 20892, United States
| | - Justin S. Kirby
- Leidos Biomedical Research, Inc., Frederick National Laboratory for Cancer Research, Cancer Imaging Program, 8560 Progress Drive, Frederick, Maryland 21702, United States
| | - Laurence P. Clarke
- National Cancer Institute, Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, 9609 Medical Center Drive, Bethesda, Maryland 20892, United States
| |
Collapse
|
22
|
Mansoor A, Bagci U, Foster B, Xu Z, Papadakis GZ, Folio LR, Udupa JK, Mollura DJ. Segmentation and Image Analysis of Abnormal Lungs at CT: Current Approaches, Challenges, and Future Trends. Radiographics 2016; 35:1056-76. [PMID: 26172351 DOI: 10.1148/rg.2015140232] [Citation(s) in RCA: 103] [Impact Index Per Article: 12.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
The computer-based process of identifying the boundaries of lung from surrounding thoracic tissue on computed tomographic (CT) images, which is called segmentation, is a vital first step in radiologic pulmonary image analysis. Many algorithms and software platforms provide image segmentation routines for quantification of lung abnormalities; however, nearly all of the current image segmentation approaches apply well only if the lungs exhibit minimal or no pathologic conditions. When moderate to high amounts of disease or abnormalities with a challenging shape or appearance exist in the lungs, computer-aided detection systems may be highly likely to fail to depict those abnormal regions because of inaccurate segmentation methods. In particular, abnormalities such as pleural effusions, consolidations, and masses often cause inaccurate lung segmentation, which greatly limits the use of image processing methods in clinical and research contexts. In this review, a critical summary of the current methods for lung segmentation on CT images is provided, with special emphasis on the accuracy and performance of the methods in cases with abnormalities and cases with exemplary pathologic findings. The currently available segmentation methods can be divided into five major classes: (a) thresholding-based, (b) region-based, (c) shape-based, (d) neighboring anatomy-guided, and (e) machine learning-based methods. The feasibility of each class and its shortcomings are explained and illustrated with the most common lung abnormalities observed on CT images. In an overview, practical applications and evolving technologies combining the presented approaches for the practicing radiologist are detailed.
Collapse
Affiliation(s)
- Awais Mansoor
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Ulas Bagci
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Brent Foster
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Ziyue Xu
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Georgios Z Papadakis
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Les R Folio
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Jayaram K Udupa
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| | - Daniel J Mollura
- From the Center for Infectious Disease Imaging, Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, Md
| |
Collapse
|
23
|
Amir GJ, Lehmann HP. After Detection: The Improved Accuracy of Lung Cancer Assessment Using Radiologic Computer-aided Diagnosis. Acad Radiol 2016; 23:186-91. [PMID: 26616209 DOI: 10.1016/j.acra.2015.10.014] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2015] [Revised: 10/11/2015] [Accepted: 10/13/2015] [Indexed: 11/17/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of this study was to evaluate the improved accuracy of radiologic assessment of lung cancer afforded by computer-aided diagnosis (CADx). MATERIALS AND METHODS Inclusion/exclusion criteria were formulated, and a systematic inquiry of research databases was conducted. Following title and abstract review, an in-depth review of 149 surviving articles was performed with accepted articles undergoing a Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-based quality review and data abstraction. RESULTS A total of 14 articles, representing 1868 scans, passed the review. Increases in the receiver operating characteristic (ROC) area under the curve of .8 or higher were seen in all nine studies that reported it, except for one that employed subspecialized radiologists. CONCLUSIONS This systematic review demonstrated improved accuracy of lung cancer assessment using CADx over manual review, in eight high-quality observer-performance studies. The improved accuracy afforded by radiologic lung-CADx suggests the need to explore its use in screening and regular clinical workflow.
Collapse
Affiliation(s)
- Guy J Amir
- Division of Health Sciences Informatics, Johns Hopkins University, 2024 East Monument Street, Suite 1-200, Baltimore, MD 21205, USA
| | - Harold P Lehmann
- Division of Health Sciences Informatics, Johns Hopkins University, 2024 East Monument Street, Suite 1-200, Baltimore, MD 21205, USA.
| |
Collapse
|
24
|
Dilger SKN, Uthoff J, Judisch A, Hammond E, Mott SL, Smith BJ, Newell JD, Hoffman EA, Sieren JC. Improved pulmonary nodule classification utilizing quantitative lung parenchyma features. J Med Imaging (Bellingham) 2015; 2:041004. [PMID: 26870744 DOI: 10.1117/1.jmi.2.4.041004] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2015] [Accepted: 07/09/2015] [Indexed: 11/14/2022] Open
Abstract
Current computer-aided diagnosis (CAD) models for determining pulmonary nodule malignancy characterize nodule shape, density, and border in computed tomography (CT) data. Analyzing the lung parenchyma surrounding the nodule has been minimally explored. We hypothesize that improved nodule classification is achievable by including features quantified from the surrounding lung tissue. To explore this hypothesis, we have developed expanded quantitative CT feature extraction techniques, including volumetric Laws texture energy measures for the parenchyma and nodule, border descriptors using ray-casting and rubber-band straightening, histogram features characterizing densities, and global lung measurements. Using stepwise forward selection and leave-one-case-out cross-validation, a neural network was used for classification. When applied to 50 nodules (22 malignant and 28 benign) from high-resolution CT scans, 52 features (8 nodule, 39 parenchymal, and 5 global) were statistically significant. Nodule-only features yielded an area under the ROC curve of 0.918 (including nodule size) and 0.872 (excluding nodule size). Performance was improved through inclusion of parenchymal (0.938) and global features (0.932). These results show a trend toward increased performance when the parenchyma is included, coupled with the large number of significant parenchymal features that support our hypothesis: the pulmonary parenchyma is influenced differentially by malignant versus benign nodules, assisting CAD-based nodule characterizations.
Collapse
Affiliation(s)
- Samantha K N Dilger
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States; University of Iowa, Holden Comprehensive Cancer Center, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Johanna Uthoff
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States; University of Iowa, Holden Comprehensive Cancer Center, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Alexandra Judisch
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Emily Hammond
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States; University of Iowa, Holden Comprehensive Cancer Center, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Sarah L Mott
- University of Iowa , Holden Comprehensive Cancer Center, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Brian J Smith
- University of Iowa, Holden Comprehensive Cancer Center, 200 Hawkins Drive, Iowa City, Iowa 52242, United States; University of Iowa, Department of Biostatistics, 145 North Riverside Drive, Iowa City, Iowa 52242, United States
| | - John D Newell
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Eric A Hoffman
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| | - Jessica C Sieren
- University of Iowa, Department of Biomedical Engineering, 3100 Seamans Center for the Engineering Arts and Sciences, Iowa City, Iowa 52242, United States; University of Iowa, Department of Radiology, 200 Hawkins Drive, Iowa City, Iowa 52242, United States; University of Iowa, Holden Comprehensive Cancer Center, 200 Hawkins Drive, Iowa City, Iowa 52242, United States
| |
Collapse
|
25
|
Reeves AP, Xie Y, Jirapatnakul A. Automated pulmonary nodule CT image characterization in lung cancer screening. Int J Comput Assist Radiol Surg 2015; 11:73-88. [DOI: 10.1007/s11548-015-1245-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2015] [Accepted: 06/08/2015] [Indexed: 02/06/2023]
|
26
|
Extracting fuzzy classification rules from texture segmented HRCT lung images. J Digit Imaging 2012; 26:227-38. [PMID: 22890442 DOI: 10.1007/s10278-012-9514-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Abstract
Automatic tools for detection and identification of lung and lesion from high-resolution CT (HRCT) are becoming increasingly important both for diagnosis and for delivering high-precision radiation therapy. However, development of robust and interpretable classifiers still presents a challenge especially in case of non-small cell lung carcinoma (NSCLC) patients. In this paper, we have attempted to devise such a classifier by extracting fuzzy rules from texture segmented regions from HRCT images of NSCLC patients. A fuzzy inference system (FIS) has been constructed starting from a feature extraction procedure applied on overlapping regions from the same organs and deriving simple if-then rules so that more linguistically interpretable decisions can be implemented. The proposed method has been tested on 138 regions extracted from CT scan images acquired from patients with lung cancer. Assuming two classes of tissues C1 (healthy tissues) and C2 (lesion) as negative and positive, respectively; preliminary results report an AUC = 0.98 for lesions and AUC = 0.93 for healthy tissue, with an optimal operating condition related to sensitivity = 0.96, and specificity = 0.98 for lesions and sensitivity 0.99, and specificity = 0.94 for healthy tissue. Finally, the following results have been obtained: false-negative rate (FNR) = 6 % (C1), FNR = 2 % (C2), false-positive rate (FPR) = 4 % (C1), FPR = 3 % (C2), true-positive rate (TPR) = 94 %, (C1) and TPR = 98 % (C2).
Collapse
|
27
|
Way T, Chan HP, Hadjiiski L, Sahiner B, Chughtai A, Song TK, Poopat C, Stojanovska J, Frank L, Attili A, Bogot N, Cascade PN, Kazerooni EA. Computer-aided diagnosis of lung nodules on CT scans: ROC study of its effect on radiologists' performance. Acad Radiol 2010; 17:323-32. [PMID: 20152726 DOI: 10.1016/j.acra.2009.10.016] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2009] [Revised: 10/02/2009] [Accepted: 10/13/2009] [Indexed: 10/19/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of this study was to evaluate the effect of computer-aided diagnosis (CAD) on radiologists' estimates of the likelihood of malignancy of lung nodules on computed tomographic (CT) imaging. METHODS AND MATERIALS A total of 256 lung nodules (124 malignant, 132 benign) were retrospectively collected from the thoracic CT scans of 152 patients. An automated CAD system was developed to characterize and provide malignancy ratings for lung nodules on CT volumetric images. An observer study was conducted using receiver-operating characteristic analysis to evaluate the effect of CAD on radiologists' characterization of lung nodules. Six fellowship-trained thoracic radiologists served as readers. The readers rated the likelihood of malignancy on a scale of 0% to 100% and recommended appropriate action first without CAD and then with CAD. The observer ratings were analyzed using the Dorfman-Berbaum-Metz multireader, multicase method. RESULTS The CAD system achieved a test area under the receiver-operating characteristic curve (A(z)) of 0.857 +/- 0.023 using the perimeter, two nodule radii measures, two texture features, and two gradient field features. All six radiologists obtained improved performance with CAD. The average A(z) of the radiologists improved significantly (P < .01) from 0.833 (range, 0.817-0.847) to 0.853 (range, 0.834-0.887). CONCLUSION CAD has the potential to increase radiologists' accuracy in assessing the likelihood of malignancy of lung nodules on CT imaging.
Collapse
|
28
|
Predicting Radiological Panel Opinions Using a Panel of Machine Learning Classifiers. ALGORITHMS 2009. [DOI: 10.3390/a2041473] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
29
|
Golosio B, Masala GL, Piccioli A, Oliva P, Carpinelli M, Cataldo R, Cerello P, De Carlo F, Falaschi F, Fantacci ME, Gargano G, Kasae P, Torsello M. A novel multithreshold method for nodule detection in lung CT. Med Phys 2009; 36:3607-18. [PMID: 19746795 DOI: 10.1118/1.3160107] [Citation(s) in RCA: 61] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Multislice computed tomography (MSCT) is a valuable tool for lung cancer detection, thanks to its ability to identify noncalcified nodules of small size (from about 3 mm). Due to the large number of images generated by MSCT, there is much interest in developing computer-aided detection (CAD) systems that could assist radiologists in the lung nodule detection task. A complete multistage CAD system, including lung boundary segmentation, regions of interest (ROIs) selection, feature extraction, and false positive reduction is presented. The selection of ROIs is based on a multithreshold surface-triangulation approach. Surface triangulation is performed at different threshold values, varying from a minimum to a maximum value in a wide range. At a given threshold value, a ROI is defined as the volume inside a connected component of the triangulated isosurface. The evolution of a ROI as a function of the threshold can be represented by a treelike structure. A multithreshold ROI is defined as a path on this tree, which starts from a terminal ROI and ends on the root ROI. For each ROI, the volume, surface area, roundness, density, and moments of inertia are computed as functions of the threshold and used as input to a classification system based on artificial neural networks. The method is suitable to detect different types of nodules, including juxta-pleural nodules and nodules connected to blood vessels. A training set of 109 low-dose MSCT scans made available by the Pisa center of the Italung-CT trial and annotated by expert radiologists was used for the algorithm design and optimization. The system performance was tested on an independent set of 23 low-dose MSCT scans coming from the Pisa Italung-CT center and on 83 scans made available by the Lung Image Database Consortium (LIDC) annotated by four expert radiologists. On the Italung-CT test set, for nodules having a diameter greater than or equal to 3 mm, the system achieved 84% and 71% sensitivity at false positive/scan rates of 10 and 4, respectively. For nodules having a diameter greater than or equal to 4 mm, the sensitivities were 97% and 80% at false positive/scan rates of 10 and 4, respectively. On the LIDC data set, the system achieved a 79% sensitivity at a false positive/scan rate of 4 in the detection of nodules with a diameter greater than or equal to 3 mm that have been annotated by all four radiologists.
Collapse
Affiliation(s)
- Bruno Golosio
- Struttura Dipartimentale di Matematica e Fisica, Università di Sassari, via Vienna 2, 07100 Sassari, Italy.
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
30
|
Way TW, Sahiner B, Chan HP, Hadjiiski L, Cascade PN, Chughtai A, Bogot N, Kazerooni E. Computer-aided diagnosis of pulmonary nodules on CT scans: improvement of classification performance with nodule surface features. Med Phys 2009; 36:3086-98. [PMID: 19673208 DOI: 10.1118/1.3140589] [Citation(s) in RCA: 88] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The purpose of this work is to develop a computer-aided diagnosis (CAD) system to differentiate malignant and benign lung nodules on CT scans. A fully automated system was designed to segment the nodule from its surrounding structured background in a local volume of interest (VOI) and to extract image features for classification. Image segmentation was performed with a 3D active contour method. The initial contour was obtained as the boundary of a binary object generated by k-means clustering within the VOI and smoothed by morphological opening. A data set of 256 lung nodules (124 malignant and 132 benign) from 152 patients was used in this study. In addition to morphological and texture features, the authors designed new nodule surface features to characterize the lung nodule surface smoothness and shape irregularity. The effects of two demographic features, age and gender, as adjunct to the image features were also investigated. A linear discriminant analysis (LDA) classifier built with features from stepwise feature selection was trained using simplex optimization to select the most effective features. A two-loop leave-one-out resampling scheme was developed to reduce the optimistic bias in estimating the test performance of the CAD system. The area under the receiver operating characteristic curve, A(z), for the test cases improved significantly (p < 0.05) from 0.821 +/- 0.026 to 0.857 +/- 0.023 when the newly developed image features were included with the original morphological and texture features. A similar experiment performed on the data set restricted to primary cancers and benign nodules, excluding the metastatic cancers, also resulted in an improved test A(z), though the improvement did not reach statistical significance (p = 0.07). The two demographic features did not significantly affect the performance of the CAD system (p > 0.05) when they were added to the feature space containing the morphological, texture, and new gradient field and radius features. To investigate if a support vector machine (SVM) classifier can achieve improved performance over the LDA classifier, we compared the performance of the LDA and SVMs with various kernels and parameters. Principal component analysis was used to reduce the dimensionality of the feature space for both the LDA and the SVM classifiers. When the number of selected principal components was varied, the highest test A(z) among the SVMs of various kernels and parameters was slightly higher than that of the LDA in one-loop leave-one-case-out resampling. However, no SVM with fixed architecture consistently performed better than the LDA in the range of principal components selected. This study demonstrated that the authors' proposed segmentation and feature extraction techniques are promising for classifying lung nodules on CT images.
Collapse
Affiliation(s)
- Ted W Way
- Department of Radiology, University of Michigan, Ann Arbor 48109-5842, USA
| | | | | | | | | | | | | | | |
Collapse
|
31
|
Chan HP, Hadjiiski L, Zhou C, Sahiner B. Computer-aided diagnosis of lung cancer and pulmonary embolism in computed tomography-a review. Acad Radiol 2008; 15:535-55. [PMID: 18423310 PMCID: PMC2800985 DOI: 10.1016/j.acra.2008.01.014] [Citation(s) in RCA: 58] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2007] [Revised: 01/01/2008] [Accepted: 01/17/2008] [Indexed: 02/08/2023]
Abstract
Computer-aided detection (CADe) and computer-aided diagnosis (CADx) have been important areas of research in the last two decades. Significant progress has been made in the area of breast cancer detection, and CAD techniques are being developed in many other areas. Recent advances in multidetector row computed tomography have made it an increasingly common modality for imaging of lung diseases. A thoracic examination using thin-section computed tomography contains hundreds of images. Detection of lung cancer and pulmonary embolism on computed tomographic (CT) examinations are demanding tasks for radiologists because they have to search for abnormalities in a large number of images, and the lesions can be subtle. If successfully developed, CAD can be a useful second opinion to radiologists in thoracic CT interpretation. In this review, we summarize the studies that have been reported in these areas, discuss some challenges in the development of CAD, and identify areas that deserve particular attention in future research.
Collapse
Affiliation(s)
- Heang-Ping Chan
- Department of Radiology, Med Inn Building C477, 1500 East Medical Center Drive, The University of Michigan, Ann Arbor, MI 48109-5842, USA.
| | | | | | | |
Collapse
|
32
|
Way TW, Chan HP, Goodsitt MM, Sahiner B, Hadjiiski LM, Zhou C, Chughtai A. Effect of CT scanning parameters on volumetric measurements of pulmonary nodules by 3D active contour segmentation: a phantom study. Phys Med Biol 2008; 53:1295-312. [PMID: 18296763 DOI: 10.1088/0031-9155/53/5/009] [Citation(s) in RCA: 45] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
The purpose of this study is to investigate the effects of CT scanning and reconstruction parameters on automated segmentation and volumetric measurements of nodules in CT images. Phantom nodules of known sizes were used so that segmentation accuracy could be quantified in comparison to ground-truth volumes. Spherical nodules having 4.8, 9.5 and 16 mm diameters and 50 and 100 mg cc(-1) calcium contents were embedded in lung-tissue-simulating foam which was inserted in the thoracic cavity of a chest section phantom. CT scans of the phantom were acquired with a 16-slice scanner at various tube currents, pitches, fields-of-view and slice thicknesses. Scans were also taken using identical techniques either within the same day or five months apart for study of reproducibility. The phantom nodules were segmented with a three-dimensional active contour (3DAC) model that we previously developed for use on patient nodules. The percentage volume errors relative to the ground-truth volumes were estimated under the various imaging conditions. There was no statistically significant difference in volume error for repeated CT scans or scans taken with techniques where only pitch, field of view, or tube current (mA) were changed. However, the slice thickness significantly (p < 0.05) affected the volume error. Therefore, to evaluate nodule growth, consistent imaging conditions and high resolution should be used for acquisition of the serial CT scans, especially for smaller nodules. Understanding the effects of scanning and reconstruction parameters on volume measurements by 3DAC allows better interpretation of data and assessment of growth. Tracking nodule growth with computerized segmentation methods would reduce inter- and intraobserver variabilities.
Collapse
Affiliation(s)
- Ted W Way
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA.
| | | | | | | | | | | | | |
Collapse
|
33
|
Way TW, Hadjiiski LM, Sahiner B, Chan HP, Cascade PN, Kazerooni EA, Bogot N, Zhou C. Computer-aided diagnosis of pulmonary nodules on CT scans: segmentation and classification using 3D active contours. Med Phys 2006; 33:2323-37. [PMID: 16898434 PMCID: PMC2728558 DOI: 10.1118/1.2207129] [Citation(s) in RCA: 130] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
We are developing a computer-aided diagnosis (CAD) system to classify malignant and benign lung nodules found on CT scans. A fully automated system was designed to segment the nodule from its surrounding structured background in a local volume of interest (VOI) and to extract image features for classification. Image segmentation was performed with a three-dimensional (3D) active contour (AC) method. A data set of 96 lung nodules (44 malignant, 52 benign) from 58 patients was used in this study. The 3D AC model is based on two-dimensional AC with the addition of three new energy components to take advantage of 3D information: (1) 3D gradient, which guides the active contour to seek the object surface, (2) 3D curvature, which imposes a smoothness constraint in the z direction, and (3) mask energy, which penalizes contours that grow beyond the pleura or thoracic wall. The search for the best energy weights in the 3D AC model was guided by a simplex optimization method. Morphological and gray-level features were extracted from the segmented nodule. The rubber band straightening transform (RBST) was applied to the shell of voxels surrounding the nodule. Texture features based on run-length statistics were extracted from the RBST image. A linear discriminant analysis classifier with stepwise feature selection was designed using a second simplex optimization to select the most effective features. Leave-one-case-out resampling was used to train and test the CAD system. The system achieved a test area under the receiver operating characteristic curve (A(z)) of 0.83 +/- 0.04. Our preliminary results indicate that use of the 3D AC model and the 3D texture features surrounding the nodule is a promising approach to the segmentation and classification of lung nodules with CAD. The segmentation performance of the 3D AC model trained with our data set was evaluated with 23 nodules available in the Lung Image Database Consortium (LIDC). The lung nodule volumes segmented by the 3D AC model for best classification were generally larger than those outlined by the LIDC radiologists using visual judgment of nodule boundaries.
Collapse
Affiliation(s)
- Ted W Way
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109, USA.
| | | | | | | | | | | | | | | |
Collapse
|
34
|
Shiraishi J, Abe H, Li F, Engelmann R, MacMahon H, Doi K. Computer-aided diagnosis for the detection and classification of lung cancers on chest radiographs ROC analysis of radiologists' performance. Acad Radiol 2006; 13:995-1003. [PMID: 16843852 DOI: 10.1016/j.acra.2006.04.007] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2006] [Revised: 04/17/2006] [Accepted: 04/19/2006] [Indexed: 11/19/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of the study is to investigate the effect of a computer-aided diagnostic (CAD) scheme on radiologist performance in the detection of lung cancers on chest radiographs. MATERIALS AND METHODS We combined two independent CAD schemes for the detection and classification of lung nodules into one new CAD scheme by use of a database of 150 chest images, including 108 cases with solitary pulmonary nodules and 42 cases without nodules. For the observer study, we selected 48 chest images, including 24 lung cancers, 12 benign nodules, and 12 cases without nodules, from the database to investigate radiologist performance in the detection of lung cancers. Nine radiologists participated in a receiver operating characteristic (ROC) study in which cases were interpreted first without and then with computer output, which indicated locations of possible lung nodules, together with a five-color scale illustrating the computer-estimated likelihood of malignancy of the detected nodules. RESULTS Performance of the CAD scheme indicated that sensitivity in detecting lung nodules was 80.6%, with 1.2 false-positive results per image, and sensitivity and specificity for classification of nodules by use of the same database for training and testing the CAD scheme were 87.7% and 66.7%, respectively. Average area under the ROC curve value for detection of lung cancers improved significantly (P = .008) from without (0.724) to with CAD (0.778). CONCLUSION This type of CAD scheme, which includes two functions, namely detection and classification, can improve radiologist accuracy in the diagnosis of lung cancer.
Collapse
Affiliation(s)
- Junji Shiraishi
- Department of Radiology, Kurt Rossmann Laboratories for Radiologic Image Research, The University of Chicago, 5841 South Maryland Avenue, MC2026 Chicago, IL 60637, USA.
| | | | | | | | | | | |
Collapse
|
35
|
Roy AS, Armato SG, Wilson A, Drukker K. Automated detection of lung nodules in CT scans: false-positive reduction with the radial-gradient index. Med Phys 2006; 33:1133-40. [PMID: 16696491 DOI: 10.1118/1.2178450] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023] Open
Abstract
We present a number of approaches based on the radial gradient index (RGI) to achieve false-positive reduction in automated CT lung nodule detection. A database of 38 cases was used that contained a total of 82 lung nodules. For each CT section, a complementary image known as an "RGI map" was constructed to enhance regions of high circularity and thus improve the contrast between nodules and normal anatomy. Thresholds on three RGI parameters were varied to construct RGI filters that sensitively eliminated false-positive structures. In a consistency approach, RGI filtering eliminated 36% of the false-positive structures detected by the automated method without the loss of any true positives. Use of an RGI filter prior to a linear discriminant classifier yielded notable improvements in performance, with the false-positive rate at a sensitivity of 70% being reduced from 0.5 to 0.28 per section. Finally, the performance of the linear discriminant classifier was evaluated with RGI-based features. RGI-based features achieved a substantial improvement in overall performance, with a 94.8% reduction in the false-positive rate at a fixed sensitivity of 70%. These results demonstrate the potential role of RGI analysis in an automated lung nodule detection method.
Collapse
Affiliation(s)
- Arunabha S Roy
- Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
| | | | | | | |
Collapse
|
36
|
Awai K, Murao K, Ozawa A, Nakayama Y, Nakaura T, Liu D, Kawanaka K, Funama Y, Morishita S, Yamashita Y. Pulmonary nodules: estimation of malignancy at thin-section helical CT--effect of computer-aided diagnosis on performance of radiologists. Radiology 2006; 239:276-84. [PMID: 16467210 DOI: 10.1148/radiol.2383050167] [Citation(s) in RCA: 63] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
PURPOSE To evaluate the effect of a computer-aided diagnosis (CAD) system on the diagnostic performance of radiologists for the estimation of the malignancy of pulmonary nodules on thin-section helical computed tomographic (CT) scans. MATERIALS AND METHODS The institutional review board approved use of the CT database; informed specific study-related consent was waived. The institutional review board approved participation of radiologists; informed consent was obtained from all observers. Thirty-three (18 malignant, 15 benign) pulmonary nodules of less than 3.0 cm in maximal diameter were evaluated. Receiver operating characteristic (ROC) analysis with a continuous rating scale was used to compare observer performance for the estimation of the likelihood of malignancy first without and then with the CAD system. The participants were 10 board-certified radiologists and nine radiology residents. RESULTS For all 19 participants, the mean area under the best-fit ROC curve (A(z)) values achieved without and with the CAD system were 0.843 +/- 0.097 (standard deviation) and 0.924 +/- 0.043, respectively. The difference was significant (P = .021). The mean A(z) values achieved without and with the CAD system were 0.910 +/- 0.052 and 0.944 +/- 0.040, respectively, for the 10 board-certified radiologists (P = .190) and 0.768 +/- 0.078 and 0.901 +/- 0.036, respectively, for the nine radiology residents (P = .009). CONCLUSION Use of the CAD system significantly (P = .009) improved the diagnostic performance of radiology residents for assessment of the malignancy of pulmonary nodules; however, it did not improve that of board-certified radiologists.
Collapse
Affiliation(s)
- Kazuo Awai
- Department of Diagnostic Radiology, Graduate School of Medical Sciences, Kumamoto University, 1-1-1 Honjyo, Kumamoto 860-8556, Japan
| | | | | | | | | | | | | | | | | | | |
Collapse
|
37
|
Ge Z, Sahiner B, Chan HP, Hadjiiski LM, Cascade PN, Bogot N, Kazerooni EA, Wei J, Zhou C. Computer-aided detection of lung nodules: false positive reduction using a 3D gradient field method and 3D ellipsoid fitting. Med Phys 2005; 32:2443-54. [PMID: 16193773 PMCID: PMC2800987 DOI: 10.1118/1.1944667] [Citation(s) in RCA: 63] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We are developing a computer-aided detection system to assist radiologists in the detection of lung nodules on thoracic computed tomography (CT) images. The purpose of this study was to improve the false-positive (FP) reduction stage of our algorithm by developing features that extract three-dimensional (3D) shape information from volumes of interest identified in the prescreening stage. We formulated 3D gradient field descriptors, and derived 19 gradient field features from their statistics. Six ellipsoid features were obtained by computing the lengths and the length ratios of the principal axes of an ellipsoid fitted to a segmented object. Both the gradient field features and the ellipsoid features were designed to distinguish spherical objects such as lung nodules from elongated objects such as vessels. The FP reduction performance in this new 25-dimensional feature space was compared to the performance in a 19-dimensional space that consisted of features extracted using previously developed methods. The performance in the 44-dimensional combined feature space was also evaluated. Linear discriminant analysis with stepwise feature selection was used for classification. The parameters used for feature selection were optimized using the simplex algorithm. Training and testing were performed using a leave-one-patient-out scheme. The FP reduction performances in different feature spaces were evaluated by using the area Az under the receiver operating characteristic curve and the number of FPs per CT section at a given sensitivity as accuracy measures. Our data set consisted of 82 CT scans (3551 axial sections) from 56 patients with section thickness ranging from 1.0 to 2.5 mm. Our prescreening algorithm detected 111 of the 116 solid nodules (nodule size: 3.0-30.6 mm) marked by experienced thoracic radiologists. The test Az values were 0.95 +/- 0.01, 0.88 +/- 0.02, and 0.94 +/- 0.01 in the new, previous, and combined feature spaces, respectively. The number of FPs per section at 80% sensitivity in these three feature spaces were 0.37, 1.61, and 0.34, respectively. The improvement in the test Az with the 25 new features was statistically significant (p<0.0001) compared to that with the previous 19 features alone.
Collapse
|
38
|
Partain CL, Chan HP, Gelovani JG, Giger ML, Izatt JA, Jolesz FA, Kandarpa K, Li KCP, McNitt-Gray M, Napel S, Summers RM, Gazelle GS. Biomedical Imaging Research Opportunities Workshop II: Report and Recommendations. Radiology 2005; 236:389-403. [PMID: 16040898 DOI: 10.1148/radiol.2362041876] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Affiliation(s)
- C Leon Partain
- Dept of Radiology, Vanderbilt Univ Medical Ctr, RR-1223, MCN, 1161 21st Ave South, Nashville, TN 37232-2675, USA
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
39
|
Goo JM, Tongdee T, Tongdee R, Yeo K, Hildebolt CF, Bae KT. Volumetric measurement of synthetic lung nodules with multi-detector row CT: effect of various image reconstruction parameters and segmentation thresholds on measurement accuracy. Radiology 2005; 235:850-6. [PMID: 15914478 DOI: 10.1148/radiol.2353040737] [Citation(s) in RCA: 118] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
PURPOSE To evaluate the effect of various multi-detector row computed tomographic (CT) reconstruction parameters and nodule segmentation thresholds on the accuracy of volumetric measurement of synthetic lung nodules. MATERIALS AND METHODS Synthetic lung nodules of four different diameters (3.2, 4.8, 6.4, and 12.7 mm) were scanned with multi-detector row CT. Images were reconstructed at various section thicknesses (0.75, 1.0, 2.0, 3.0, and 5.0 mm), fields of view (30, 20, and 10 cm), and reconstruction intervals (0.5, 1.0, and 2.0 mm). The nodules were segmented from the simulated background lung region by using four segmentation thresholds (-300, -400, -500, and -600 HU), and their volumes were estimated and compared with a reference standard (measurements according to fluid displacement) by computing the absolute percentage error (APE). APE was regressed against nodule size, and multivariate analysis of variance (MANOVA) was performed with APE as the dependent variable and with four within-subject factors (field of view, reconstruction interval, threshold, and section thickness). RESULTS The MANOVA demonstrated statistically significant effects for threshold (P = .02), section thickness (P < .01), and interaction of threshold and section thickness (P = .04). The regression of mean APE values on nodule size indicates that APE progressively increases with decreasing synthetic nodule size (R2 = 0.99, P < .01). CONCLUSION For accurate measurement of lung nodule volume, it is critical to select a section thickness and/or segmentation threshold appropriate for the size of a nodule.
Collapse
Affiliation(s)
- Jin Mo Goo
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S Kingshighway Blvd, St Louis, MO 63110, USA
| | | | | | | | | | | |
Collapse
|
40
|
Armato SG, Roy AS, Macmahon H, Li F, Doi K, Sone S, Altman MB. Evaluation of automated lung nodule detection on low-dose computed tomography scans from a lung cancer screening program(1). Acad Radiol 2005; 12:337-46. [PMID: 15766694 DOI: 10.1016/j.acra.2004.10.061] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2004] [Revised: 10/05/2004] [Accepted: 10/16/2004] [Indexed: 01/15/2023]
Abstract
RATIONALE AND OBJECTIVES The purpose of this study was to evaluate the performance of a fully automated lung nodule detection method in a large database of low-dose computed tomography (CT) scans from a lung cancer screening program. Because nodules demonstrate a spectrum of radiologic appearances, the performance of the automated method was evaluated on the basis of nodule malignancy status, size, subtlety, and radiographic opacity. MATERIALS AND METHODS A database of 393 thick-section (10 mm) low-dose CT scans was collected. Automated lung nodule detection proceeds in two phases: gray-level thresholding for the initial identification of nodule candidates, followed by the application of a rule-based classifier and linear discriminant analysis to distinguish between candidates that correspond to actual lung nodules and candidates that correspond to non-nodules. Free-response receiver operating characteristic analysis was used to evaluate the performance of the method based on a jackknife training/testing approach. RESULTS An overall nodule detection sensitivity of 70% (330 of 470) was attained with an average of 1.6 false-positive detections per section. At the same false-positive rate, 83% (57 of 69) of the malignant lung nodules in the database were detected. When the method was trained specifically for malignant nodules, a sensitivity of 80% (55 of 69) was attained with 0.85 false-positives per section. CONCLUSION We have evaluated an automated lung nodule detection method with a large number of low-dose CT scans from a lung cancer screening program. An overall sensitivity of 80% for malignant nodules was achieved with 0.85 false-positive detections per section. Such a computerized lung nodule detection method is expected to become an important part of CT-based lung cancer screening programs.
Collapse
Affiliation(s)
- Samuel G Armato
- Department of Radiology, MC 2026, University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637, USA.
| | | | | | | | | | | | | |
Collapse
|
41
|
Armato SG, McLennan G, McNitt-Gray MF, Meyer CR, Yankelevitz D, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA, MacMahon H, Reeves AP, Croft BY, Clarke LP. Lung image database consortium: developing a resource for the medical imaging research community. Radiology 2004; 232:739-48. [PMID: 15333795 DOI: 10.1148/radiol.2323032035] [Citation(s) in RCA: 165] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
To stimulate the advancement of computer-aided diagnostic (CAD) research for lung nodules in thoracic computed tomography (CT), the National Cancer Institute launched a cooperative effort known as the Lung Image Database Consortium (LIDC). The LIDC is composed of five academic institutions from across the United States that are working together to develop an image database that will serve as an international research resource for the development, training, and evaluation of CAD methods in the detection of lung nodules on CT scans. Prior to the collection of CT images and associated patient data, the LIDC has been engaged in a consensus process to identify, address, and resolve a host of challenging technical and clinical issues to provide a solid foundation for a scientifically robust database. These issues include the establishment of (a) a governing mission statement, (b) criteria to determine whether a CT scan is eligible for inclusion in the database, (c) an appropriate definition of the term qualifying nodule, (d) an appropriate definition of "truth" requirements, (e) a process model through which the database will be populated, and (f) a statistical framework to guide the application of assessment methods by users of the database. Through a consensus process in which careful planning and proper consideration of fundamental issues have been emphasized, the LIDC database is expected to provide a powerful resource for the medical imaging research community. This article is intended to share with the community the breadth and depth of these key issues.
Collapse
Affiliation(s)
- Samuel G Armato
- Department of Radiology, MC 2026, University of Chicago, 5841 S Maryland Ave, Chicago, IL 60637, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
42
|
Abstract
PURPOSE OF REVIEW With the development of newer forms of technology such as low-dose spiral computed tomography, there has been a resurgent interest in screening for lung cancer. The purpose of this review is to highlight recent advances in screening for lung cancer. Articles published since September 2002 are reviewed here. RECENT FINDINGS More frequent screenings (every 4 or 6 months) showed increased mortality from lung cancer, compared with annual screening. A mass screening conducted in 1990 was effective in a case-control study. The results of lung cancer screening by low-dose spiral computed tomography were reported from the Milan group and the Mayo Clinic. Computed tomography depicted peripheral early lung cancer, especially adenocarcinoma. These results are consistent with previous reports from other groups. Screening with imaging becomes more sensitive with automated computerized methods. SUMMARY A high percentage of stage IA lung cancers were detected by screening with low-dose helical computed tomography. The characteristics of the nodules detected by low-dose spiral computed tomography have been clarified. There have been many controversial discussions about cost effectiveness and overdiagnosis. There is still no evidence that screening tests reduce the rate of cancer-specific mortality. Several studies of screening for lung cancer are under way.
Collapse
Affiliation(s)
- Masaaki Kawahara
- Department of Internal Medicine, National Kinki Central Hospital for Chest Diseases, 1180 Nagasone, Sakai, Osaka 591-8555, Japan.
| |
Collapse
|