1
|
Hussain MA, Gogoi L. Performance analyses of five neural network classifiers on nodule classification in lung CT images using WEKA: a comparative study. Phys Eng Sci Med 2022; 45:1193-1204. [PMID: 36315381 DOI: 10.1007/s13246-022-01187-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 10/08/2022] [Indexed: 11/06/2022]
Abstract
In this report, we are presenting our work on performance analyses of five different neural network classifiers viz. MLP, DL4JMLP, logistic regression, SGD and simple logistic classifier in lung nodule detection using WEKA interface. To the best of our knowledge, this report demonstrates first use of WEKA for comparative performance analyses of neural network classifiers in identifying lung nodules from lung CT-images. A total of 624 handcrafted features from 52 numbers of lung CT-images collected randomly from Lung Image Database Consortium (LIDC) were fed into WEKA to evaluate the performances of the classifiers under four different categories of computation. Performances of the classifiers were observed in terms of 11 important parameters viz. accuracy, kappa statistic, root mean squared error, TPR, FPR, precision, sensitivity, F-measurement, MCC, ROC area and PRC area. Results show 86.53%, 77.77%, 55.55%, 94.44% & 88.88% accuracy as well as 0.91, 0.86, 0.68, 0.91 & 0.93 ROC area for MLP, DL4JMLP, logistic, SGD and simple logistic classifier respectively at tenfold cross-validation by taking 66% of the data set for training and 34% for testing and validation purpose. SGDClassifier has been found the best performing followed by simple logistic classifier for the purpose.
Collapse
Affiliation(s)
- Md Anwar Hussain
- Department of Electronics and Communication Engineering, North Eastern Regional Institute of Science and Technology, Nirjuli, 791109, India
| | - Lakshipriya Gogoi
- Department of Electronics and Communication Engineering, North Eastern Regional Institute of Science and Technology, Nirjuli, 791109, India.
| |
Collapse
|
2
|
A Novel Nodule Edge Sharpness Radiomic Biomarker Improves Performance of Lung-RADS for Distinguishing Adenocarcinomas from Granulomas on Non-Contrast CT Scans. Cancers (Basel) 2021; 13:cancers13112781. [PMID: 34205005 PMCID: PMC8199879 DOI: 10.3390/cancers13112781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Accepted: 05/31/2021] [Indexed: 11/18/2022] Open
Abstract
Simple Summary The great majority of pulmonary nodules on screening CT scans are benign (95%). Due to inaccurate diagnoses of granulomas from adenocarcinomas on CT scans, many patients with benign nodules are subjected to unnecessary surgical procedures. The aim of this retrospective study is to evaluate the discriminability of a new radiomic feature, nodule edge/interface sharpness (NIS), for distinguishing lung adenocarcinomas from benign granulomas on non-contrast CT scans. Moreover, we aim to evaluate whether NIS can improve the performance of Lung-RADS, by reclassifying benign nodules that were initially assessed as suspicious. In a cohort of 352 patients with diagnostic non-contrast CT scans, NIS radiomics was able to classify nodules with an area under the receiver operating characteristic curve (ROC AUC) of 0.77, and when combined with intra-tumoral textural and shape features, classification performance increased to AUC of 0.84. Additionally, the NIS classifier correctly reclassified 46% of those lesions that were actually benign but deemed suspicious by Lung-RADS. Combining NIS with Lung-RADS has the potential to alter patient management by significantly decreasing unnecessary biopsies/follow up imaging. Abstract The aim of this study is to evaluate whether NIS radiomics can distinguish lung adenocarcinomas from granulomas on non-contrast CT scans, and also to improve the performance of Lung-RADS by reclassifying benign nodules that were initially assessed as suspicious. The screening or standard diagnostic non-contrast CT scans of 362 patients was divided into training (St, N = 145), validation (Sv, N = 145), and independent validation (Siv, N = 62) sets from different institutions. Nodules were identified and manually segmented on CT images by a radiologist. A series of 264 features relating to the edge sharpness transition from the inside to the outside of the nodule were extracted. The top 10 features were used to train a linear discriminant analysis (LDA) machine learning classifier on St. In conjunction with the LDA classifier, NIS radiomics classified nodules with an AUC of 0.82 ± 0.04, 0.77, and 0.71 respectively on St, Sv, and Siv. We evaluated the ability of the NIS classifier to determine the proportion of the patients in Sv that were identified initially as suspicious by Lung-RADS but were reclassified as benign by applying the NIS scores. The NIS classifier was able to correctly reclassify 46% of those lesions that were actually benign but deemed suspicious by Lung-RADS alone on Sv.
Collapse
|
3
|
Quantitative vessel tortuosity: A potential CT imaging biomarker for distinguishing lung granulomas from adenocarcinomas. Sci Rep 2018; 8:15290. [PMID: 30327507 PMCID: PMC6191462 DOI: 10.1038/s41598-018-33473-0] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Accepted: 09/24/2018] [Indexed: 12/17/2022] Open
Abstract
Adenocarcinomas and active granulomas can both have a spiculated appearance on computed tomography (CT) and both are often fluorodeoxyglucose (FDG) avid on positron emission tomography (PET) scan, making them difficult to distinguish. Consequently, patients with benign granulomas are often subjected to invasive surgical biopsies or resections. In this study, quantitative vessel tortuosity (QVT), a novel CT imaging biomarker to distinguish between benign granulomas and adenocarcinomas on routine non-contrast lung CT scans is introduced. Our study comprised of CT scans of 290 patients from two different institutions, one cohort for training (N = 145) and the other (N = 145) for independent validation. In conjunction with a machine learning classifier, the top informative and stable QVT features yielded an area under receiver operating characteristic curve (ROC AUC) of 0.85 in the independent validation set. On the same cohort, the corresponding AUCs for two human experts including a radiologist and a pulmonologist were found to be 0.61 and 0.60, respectively. QVT features also outperformed well known shape and textural radiomic features which had a maximum AUC of 0.73 (p-value = 0.002), as well as features learned using a convolutional neural network AUC = 0.76 (p-value = 0.028). Our results suggest that QVT features could potentially serve as a non-invasive imaging biomarker to distinguish granulomas from adenocarcinomas on non-contrast CT scans.
Collapse
|
4
|
Quantitative Computed Tomography Classification of Lung Nodules: Initial Comparison of 2- and 3-Dimensional Analysis. J Comput Assist Tomogr 2017; 40:589-95. [PMID: 27096403 DOI: 10.1097/rct.0000000000000394] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
OBJECTIVE The aim of this study was to compare the performance of 2- (2D) and 3-dimensional (3D) quantitative computed tomography (CT) methods for classifying lung nodules as lung cancer, metastases, or benign. METHODS Using semiautomated software and computerized analysis, we analyzed more than 50 quantitative CT features of 96 solid nodules in 94 patients, in 2D from a single slice and in 3D from the entire nodule volume. Multivariable logistic regression was used to classify nodule types. Model performance was assessed by the area under the receiver operating characteristic curve (AUC) using leave-one-out cross-validation. RESULTS The AUC for distinguishing 53 primary lung cancers from 18 benign nodules and 25 metastases ranged from 0.79 to 0.83 and was not significantly different for 2D and 3D analyses (P = 0.29-0.78). Models distinguishing metastases from benign nodules were statistically significant only by 3D analysis (AUC = 0.84). CONCLUSIONS Three-dimensional CT methods did not improve discrimination of lung cancer, but may help distinguish benign nodules from metastases.
Collapse
|
5
|
Ma L, Liu X, Fei B. Learning with distribution of optimized features for recognizing common CT imaging signs of lung diseases. Phys Med Biol 2016; 62:612-632. [PMID: 28033116 DOI: 10.1088/1361-6560/62/2/612] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Common CT imaging signs of lung diseases (CISLs) are defined as the imaging signs that frequently appear in lung CT images from patients. CISLs play important roles in the diagnosis of lung diseases. This paper proposes a novel learning method, namely learning with distribution of optimized feature (DOF), to effectively recognize the characteristics of CISLs. We improve the classification performance by learning the optimized features under different distributions. Specifically, we adopt the minimum spanning tree algorithm to capture the relationship between features and discriminant ability of features for selecting the most important features. To overcome the problem of various distributions in one CISL, we propose a hierarchical learning method. First, we use an unsupervised learning method to cluster samples into groups based on their distribution. Second, in each group, we use a supervised learning method to train a model based on their categories of CISLs. Finally, we obtain multiple classification decisions from multiple trained models and use majority voting to achieve the final decision. The proposed approach has been implemented on a set of 511 samples captured from human lung CT images and achieves a classification accuracy of 91.96%. The proposed DOF method is effective and can provide a useful tool for computer-aided diagnosis of lung diseases on CT images.
Collapse
Affiliation(s)
- Ling Ma
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA, USA. School of Computer Science, Beijing Institute of Technology, Beijing, People's Republic of China
| | | | | |
Collapse
|
6
|
Pulmonary Nodule Detection Model Based on SVM and CT Image Feature-Level Fusion with Rough Sets. BIOMED RESEARCH INTERNATIONAL 2016; 2016:8052436. [PMID: 27722173 PMCID: PMC5046100 DOI: 10.1155/2016/8052436] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/04/2016] [Revised: 07/23/2016] [Accepted: 08/02/2016] [Indexed: 11/18/2022]
Abstract
In order to improve the detection accuracy of pulmonary nodules in CT image, considering two problems of pulmonary nodules detection model, including unreasonable feature structure and nontightness of feature representation, a pulmonary nodules detection algorithm is proposed based on SVM and CT image feature-level fusion with rough sets. Firstly, CT images of pulmonary nodule are analyzed, and 42-dimensional feature components are extracted, including six new 3-dimensional features proposed by this paper and others 2-dimensional and 3-dimensional features. Secondly, these features are reduced for five times with rough set based on feature-level fusion. Thirdly, a grid optimization model is used to optimize the kernel function of support vector machine (SVM), which is used as a classifier to identify pulmonary nodules. Finally, lung CT images of 70 patients with pulmonary nodules are collected as the original samples, which are used to verify the effectiveness and stability of the proposed model by four groups' comparative experiments. The experimental results show that the effectiveness and stability of the proposed model based on rough set feature-level fusion are improved in some degrees.
Collapse
|
7
|
Amir GJ, Lehmann HP. After Detection: The Improved Accuracy of Lung Cancer Assessment Using Radiologic Computer-aided Diagnosis. Acad Radiol 2016; 23:186-91. [PMID: 26616209 DOI: 10.1016/j.acra.2015.10.014] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2015] [Revised: 10/11/2015] [Accepted: 10/13/2015] [Indexed: 11/17/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of this study was to evaluate the improved accuracy of radiologic assessment of lung cancer afforded by computer-aided diagnosis (CADx). MATERIALS AND METHODS Inclusion/exclusion criteria were formulated, and a systematic inquiry of research databases was conducted. Following title and abstract review, an in-depth review of 149 surviving articles was performed with accepted articles undergoing a Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-based quality review and data abstraction. RESULTS A total of 14 articles, representing 1868 scans, passed the review. Increases in the receiver operating characteristic (ROC) area under the curve of .8 or higher were seen in all nine studies that reported it, except for one that employed subspecialized radiologists. CONCLUSIONS This systematic review demonstrated improved accuracy of lung cancer assessment using CADx over manual review, in eight high-quality observer-performance studies. The improved accuracy afforded by radiologic lung-CADx suggests the need to explore its use in screening and regular clinical workflow.
Collapse
Affiliation(s)
- Guy J Amir
- Division of Health Sciences Informatics, Johns Hopkins University, 2024 East Monument Street, Suite 1-200, Baltimore, MD 21205, USA
| | - Harold P Lehmann
- Division of Health Sciences Informatics, Johns Hopkins University, 2024 East Monument Street, Suite 1-200, Baltimore, MD 21205, USA.
| |
Collapse
|
8
|
Reeves AP, Xie Y, Jirapatnakul A. Automated pulmonary nodule CT image characterization in lung cancer screening. Int J Comput Assist Radiol Surg 2015; 11:73-88. [DOI: 10.1007/s11548-015-1245-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2015] [Accepted: 06/08/2015] [Indexed: 02/06/2023]
|
9
|
Alic L, Niessen WJ, Veenland JF. Quantification of heterogeneity as a biomarker in tumor imaging: a systematic review. PLoS One 2014; 9:e110300. [PMID: 25330171 PMCID: PMC4203782 DOI: 10.1371/journal.pone.0110300] [Citation(s) in RCA: 110] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2014] [Accepted: 09/15/2014] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND Many techniques are proposed for the quantification of tumor heterogeneity as an imaging biomarker for differentiation between tumor types, tumor grading, response monitoring and outcome prediction. However, in clinical practice these methods are barely used. This study evaluates the reported performance of the described methods and identifies barriers to their implementation in clinical practice. METHODOLOGY The Ovid, Embase, and Cochrane Central databases were searched up to 20 September 2013. Heterogeneity analysis methods were classified into four categories, i.e., non-spatial methods (NSM), spatial grey level methods (SGLM), fractal analysis (FA) methods, and filters and transforms (F&T). The performance of the different methods was compared. PRINCIPAL FINDINGS Of the 7351 potentially relevant publications, 209 were included. Of these studies, 58% reported the use of NSM, 49% SGLM, 10% FA, and 28% F&T. Differentiation between tumor types, tumor grading and/or outcome prediction was the goal in 87% of the studies. Overall, the reported area under the curve (AUC) ranged from 0.5 to 1 (median 0.87). No relation was found between the performance and the quantification methods used, or between the performance and the imaging modality. A negative correlation was found between the tumor-feature ratio and the AUC, which is presumably caused by overfitting in small datasets. Cross-validation was reported in 63% of the classification studies. Retrospective analyses were conducted in 57% of the studies without a clear description. CONCLUSIONS In a research setting, heterogeneity quantification methods can differentiate between tumor types, grade tumors, and predict outcome and monitor treatment effects. To translate these methods to clinical practice, more prospective studies are required that use external datasets for validation: these datasets should be made available to the community to facilitate the development of new and improved methods.
Collapse
Affiliation(s)
- Lejla Alic
- Biomedical Imaging Group Rotterdam, Department of Radiology and Medical Informatics, Erasmus Medical Center Rotterdam, Rotterdam, The Netherlands
- Department of Intelligent Imaging, Netherlands Organization for Applied Scientific Research (TNO), The Hague, The Netherlands
| | - Wiro J. Niessen
- Biomedical Imaging Group Rotterdam, Department of Radiology and Medical Informatics, Erasmus Medical Center Rotterdam, Rotterdam, The Netherlands
- Imaging Physics, Faculty of Applied Sciences, Delft University of Technology, Delft, The Netherlands
| | - Jifke F. Veenland
- Biomedical Imaging Group Rotterdam, Department of Radiology and Medical Informatics, Erasmus Medical Center Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
10
|
Stember JN, Ko JP, Naidich DP, Kaur M, Rusinek H. The self-overlap method for assessment of lung nodule morphology in chest CT. J Digit Imaging 2013; 26:239-47. [PMID: 23065123 DOI: 10.1007/s10278-012-9536-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
Surface morphology is an important indicator of malignant potential for solid-type lung nodules detected at CT, but is difficult to assess subjectively. Automated methods for morphology assessment have previously been described using a common measure of nodule shape, representative of the broad class of existing methods, termed area-to-perimeter-length ratio (APR). APR is static and thus highly susceptible to alterations by random noise and artifacts in image acquisition. We introduce and analyze the self-overlap (SO) method as a dynamic automated morphology detection scheme. SO measures the degree of change of nodule masks upon Gaussian blurring. We hypothesized that this new metric would afford equally high accuracy and superior precision than APR. Application of the two methods to a set of 119 patient lung nodules and a set of simulation nodules showed our approach to be slightly more accurate and on the order of ten times as precise, respectively. The dynamic quality of this new automated metric renders it less sensitive to image noise and artifacts than APR, and as such, SO is a potentially useful measure of cancer risk for solid-type lung nodules detected on CT.
Collapse
Affiliation(s)
- Joseph N Stember
- Department of Radiology, School of Medicine, New York University, New York, NY 10016, USA.
| | | | | | | | | |
Collapse
|
11
|
Aberle DR, Abtin F, Brown K. Computed tomography screening for lung cancer: has it finally arrived? Implications of the national lung screening trial. J Clin Oncol 2013; 31:1002-8. [PMID: 23401434 DOI: 10.1200/jco.2012.43.3110] [Citation(s) in RCA: 106] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023] Open
Abstract
The National Lung Screening Trial (NLST) has provided compelling evidence of the efficacy of lung cancer screening using low-dose helical computed tomography (LDCT) to reduce lung cancer mortality. The NLST randomized 53,454 older current or former heavy smokers to receive LDCT or chest radiography (CXR) for three annual screens. Participants were observed for a median of 6.5 years for outcomes. Vital status was available in more than 95% of participants. LDCT was positive in 24.2% of screens, compared with 6.9% of CXRs; more than 95% of all positive LDCT screens were not associated with lung cancer. LDCT detected more than twice the number of early-stage lung cancers and resulted in a stage shift from advanced to early-stage disease. Complications of LDCT screening were minimal. Lung cancer-specific mortality was reduced by 20% relative to CXR; all-cause mortality was reduced by 6.7%. The major harms of LDCT are radiation exposure, high false-positive rates, and the potential for overdiagnosis. This review discusses the risks and benefits of LDCT screening as well as an approach to LDCT implementation that incorporates systematic screening practice with smoking cessation programs and offers opportunities for better determination of appropriate risk cohorts for screening and for better diagnostic prediction of lung cancer in the setting of screen-detected nodules. The challenges of implementation are considered for screening programs, for primary care clinicians, and across socioeconomic strata. Considerations for future research to complement imaging-based screening to reduce the burden of lung cancer are discussed.
Collapse
Affiliation(s)
- Denise R Aberle
- David Geffen School of Medicine at University of California, Los Angeles, Los Angeles, CA 90024, USA.
| | | | | |
Collapse
|
12
|
Computer-aided diagnosis systems for lung cancer: challenges and methodologies. Int J Biomed Imaging 2013; 2013:942353. [PMID: 23431282 PMCID: PMC3570946 DOI: 10.1155/2013/942353] [Citation(s) in RCA: 116] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2012] [Accepted: 11/20/2012] [Indexed: 11/24/2022] Open
Abstract
This paper overviews one of the most important, interesting, and challenging problems in oncology, the problem of lung cancer diagnosis. Developing an effective computer-aided diagnosis (CAD) system for lung cancer is of great clinical importance and can increase the patient's chance of survival. For this reason, CAD systems for lung cancer have been investigated in a huge number of research studies. A typical CAD system for lung cancer diagnosis is composed of four main processing steps: segmentation of the lung fields, detection of nodules inside the lung fields, segmentation of the detected nodules, and diagnosis of the nodules as benign or malignant. This paper overviews the current state-of-the-art techniques that have been developed to implement each of these CAD processing steps. For each technique, various aspects of technical issues, implemented methodologies, training and testing databases, and validation methods, as well as achieved performances, are described. In addition, the paper addresses several challenges that researchers face in each implementation step and outlines the strengths and drawbacks of the existing approaches for lung cancer CAD systems.
Collapse
|
13
|
Chen H, Xu Y, Ma Y, Ma B. Neural network ensemble-based computer-aided diagnosis for differentiation of lung nodules on CT images: clinical evaluation. Acad Radiol 2010; 17:595-602. [PMID: 20167513 DOI: 10.1016/j.acra.2009.12.009] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2009] [Revised: 12/09/2009] [Accepted: 12/09/2009] [Indexed: 10/19/2022]
Abstract
RATIONALE AND OBJECTIVES To evaluate the diagnostic performance of a neural network ensemble-based computer-aided diagnosis (CAD) scheme for classifying lung nodules on thin-section computed tomography (CT). MATERIALS AND METHODS Thirty-two CT images that depicted 19 malignant nodules and 13 benign nodules were used. One of three possible classifications (probably benign, uncertain, and probably malignant) for each nodule was determined by using a neural network ensemble-based CAD scheme. The images were presented to three senior radiologists (each with more than 10 years of thoracic radiology experience) who were asked to determine the classification for each nodule blindly. The radiologists made their diagnostic decisions solely based on images and excluded any external data. The performance of the CAD scheme and of the radiologists was evaluated with receiver operating characteristic (ROC) analysis and agreement analysis. RESULTS Areas under the ROC curve (Az values) for the CAD scheme and the radiologist group were 0.79 and 0.82, respectively, and the partial areas under the ROC curves at a range of sensitivity values greater than or equal to 90% were 0.051 and 0.020 (P = .203), respectively. The weighted Kappa coefficients between the CAD scheme and each radiologist were 0.657, 0.431, and 0.606, respectively. For the diagnosis of the 11 small nodules (with diameters not greater than 10 mm), areas under the ROC curves of the CAD scheme and the radiologist group were 0.915 and 0.683 (P = .227), respectively. CONCLUSIONS The diagnostic performance of the neural network ensemble-based CAD scheme is similar to that of senior radiologists for classifying lung nodules on thin-section CT. Furthermore, the CAD scheme has certain advantages in diagnosing small lung nodules.
Collapse
|
14
|
Way T, Chan HP, Hadjiiski L, Sahiner B, Chughtai A, Song TK, Poopat C, Stojanovska J, Frank L, Attili A, Bogot N, Cascade PN, Kazerooni EA. Computer-aided diagnosis of lung nodules on CT scans: ROC study of its effect on radiologists' performance. Acad Radiol 2010; 17:323-32. [PMID: 20152726 DOI: 10.1016/j.acra.2009.10.016] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2009] [Revised: 10/02/2009] [Accepted: 10/13/2009] [Indexed: 10/19/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of this study was to evaluate the effect of computer-aided diagnosis (CAD) on radiologists' estimates of the likelihood of malignancy of lung nodules on computed tomographic (CT) imaging. METHODS AND MATERIALS A total of 256 lung nodules (124 malignant, 132 benign) were retrospectively collected from the thoracic CT scans of 152 patients. An automated CAD system was developed to characterize and provide malignancy ratings for lung nodules on CT volumetric images. An observer study was conducted using receiver-operating characteristic analysis to evaluate the effect of CAD on radiologists' characterization of lung nodules. Six fellowship-trained thoracic radiologists served as readers. The readers rated the likelihood of malignancy on a scale of 0% to 100% and recommended appropriate action first without CAD and then with CAD. The observer ratings were analyzed using the Dorfman-Berbaum-Metz multireader, multicase method. RESULTS The CAD system achieved a test area under the receiver-operating characteristic curve (A(z)) of 0.857 +/- 0.023 using the perimeter, two nodule radii measures, two texture features, and two gradient field features. All six radiologists obtained improved performance with CAD. The average A(z) of the radiologists improved significantly (P < .01) from 0.833 (range, 0.817-0.847) to 0.853 (range, 0.834-0.887). CONCLUSION CAD has the potential to increase radiologists' accuracy in assessing the likelihood of malignancy of lung nodules on CT imaging.
Collapse
|
15
|
Way TW, Sahiner B, Chan HP, Hadjiiski L, Cascade PN, Chughtai A, Bogot N, Kazerooni E. Computer-aided diagnosis of pulmonary nodules on CT scans: improvement of classification performance with nodule surface features. Med Phys 2009; 36:3086-98. [PMID: 19673208 DOI: 10.1118/1.3140589] [Citation(s) in RCA: 88] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The purpose of this work is to develop a computer-aided diagnosis (CAD) system to differentiate malignant and benign lung nodules on CT scans. A fully automated system was designed to segment the nodule from its surrounding structured background in a local volume of interest (VOI) and to extract image features for classification. Image segmentation was performed with a 3D active contour method. The initial contour was obtained as the boundary of a binary object generated by k-means clustering within the VOI and smoothed by morphological opening. A data set of 256 lung nodules (124 malignant and 132 benign) from 152 patients was used in this study. In addition to morphological and texture features, the authors designed new nodule surface features to characterize the lung nodule surface smoothness and shape irregularity. The effects of two demographic features, age and gender, as adjunct to the image features were also investigated. A linear discriminant analysis (LDA) classifier built with features from stepwise feature selection was trained using simplex optimization to select the most effective features. A two-loop leave-one-out resampling scheme was developed to reduce the optimistic bias in estimating the test performance of the CAD system. The area under the receiver operating characteristic curve, A(z), for the test cases improved significantly (p < 0.05) from 0.821 +/- 0.026 to 0.857 +/- 0.023 when the newly developed image features were included with the original morphological and texture features. A similar experiment performed on the data set restricted to primary cancers and benign nodules, excluding the metastatic cancers, also resulted in an improved test A(z), though the improvement did not reach statistical significance (p = 0.07). The two demographic features did not significantly affect the performance of the CAD system (p > 0.05) when they were added to the feature space containing the morphological, texture, and new gradient field and radius features. To investigate if a support vector machine (SVM) classifier can achieve improved performance over the LDA classifier, we compared the performance of the LDA and SVMs with various kernels and parameters. Principal component analysis was used to reduce the dimensionality of the feature space for both the LDA and the SVM classifiers. When the number of selected principal components was varied, the highest test A(z) among the SVMs of various kernels and parameters was slightly higher than that of the LDA in one-loop leave-one-case-out resampling. However, no SVM with fixed architecture consistently performed better than the LDA in the range of principal components selected. This study demonstrated that the authors' proposed segmentation and feature extraction techniques are promising for classifying lung nodules on CT images.
Collapse
Affiliation(s)
- Ted W Way
- Department of Radiology, University of Michigan, Ann Arbor 48109-5842, USA
| | | | | | | | | | | | | | | |
Collapse
|
16
|
Choi EJ, Jin GY, Han YM, Lee YS, Kweon KS. Solitary pulmonary nodule on helical dynamic CT scans: analysis of the enhancement patterns using a computer-aided diagnosis (CAD) system. Korean J Radiol 2009; 9:401-8. [PMID: 18838848 PMCID: PMC2627214 DOI: 10.3348/kjr.2008.9.5.401] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022] Open
Abstract
Objective We wanted to investigate the usefulness of a computer-aided diagnosis (CAD) system in assisting radiologists to diagnosis malignant solitary pulmonary nodules (SPNs), as compared with diagnosing SPNs with using direct personal drawing. Materials and Methods Forty patients with SPNs were analyzed. After the pre-contrast scan was performed, an additional ten series of post-contrast images were obtained at 20-second intervals. Two investigators measured the attenuation values of the SPNs: a radiologist who drew the regions of interest (ROIs), and a technician who used a CAD system. The Bland and Altman plots were used to compare the net enhancement between a CAD system and direct personal drawing. The diagnostic characteristics of the malignant SPNs were calculated by considering the CAD and direct personal drawing and with using Fisher's exact test. Results On the Bland and Altman plot, the net enhancement difference between the CAD system and direct personal drawing was not significant (within ± 2 standard deriation). The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy of diagnosing malignant SPNs using CAD was 92%, 85%, 75%, 96% and 88%, respectively. The sensitivity, specificity, PPV, NPV and accuracy of diagnosing malignant SPNs using direct drawing was 92%, 89%, 79%, 92% and 88%, respectively. Conclusion The CAD system was a useful tool for diagnosing malignant SPNs.
Collapse
Affiliation(s)
- Eun Jung Choi
- Department of Radiology, Chonbuk National University Hospital and Medical School, Research Institute for Medical Science, Chonbuk, Korea
| | | | | | | | | |
Collapse
|
17
|
Abstract
Computed tomography (CT) imaging is playing an increasingly important role in cancer detection, diagnosis, and lesion characterization, and it is the most sensitive test for lung nodule detection. Interpretation of lung nodules involves characterization and integration of clinical and other imaging information. Advances in lung nodule management using CT require optimization of CT data acquisition, postprocessing tools, and computer-aided diagnosis (CAD). The goal of CAD systems being developed is to both assist radiologists in the more sensitive detection of nodules and noninvasively differentiate benign from malignant lesions; the latter is important given that malignant lesions account for between 1% and 11% of pulmonary nodules. The aim of this review is to summarize the current state of the art regarding CAD techniques for the detection and characterization of solitary pulmonary nodules and their potential applications in the clinical workup of these lesions.
Collapse
|
18
|
|
19
|
Chan HP, Hadjiiski L, Zhou C, Sahiner B. Computer-aided diagnosis of lung cancer and pulmonary embolism in computed tomography-a review. Acad Radiol 2008; 15:535-55. [PMID: 18423310 PMCID: PMC2800985 DOI: 10.1016/j.acra.2008.01.014] [Citation(s) in RCA: 58] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2007] [Revised: 01/01/2008] [Accepted: 01/17/2008] [Indexed: 02/08/2023]
Abstract
Computer-aided detection (CADe) and computer-aided diagnosis (CADx) have been important areas of research in the last two decades. Significant progress has been made in the area of breast cancer detection, and CAD techniques are being developed in many other areas. Recent advances in multidetector row computed tomography have made it an increasingly common modality for imaging of lung diseases. A thoracic examination using thin-section computed tomography contains hundreds of images. Detection of lung cancer and pulmonary embolism on computed tomographic (CT) examinations are demanding tasks for radiologists because they have to search for abnormalities in a large number of images, and the lesions can be subtle. If successfully developed, CAD can be a useful second opinion to radiologists in thoracic CT interpretation. In this review, we summarize the studies that have been reported in these areas, discuss some challenges in the development of CAD, and identify areas that deserve particular attention in future research.
Collapse
Affiliation(s)
- Heang-Ping Chan
- Department of Radiology, Med Inn Building C477, 1500 East Medical Center Drive, The University of Michigan, Ann Arbor, MI 48109-5842, USA.
| | | | | | | |
Collapse
|
20
|
Gierada DS, Pilgram TK, Ford M, Fagerstrom RM, Church TR, Nath H, Garg K, Strollo DC. Lung cancer: interobserver agreement on interpretation of pulmonary findings at low-dose CT screening. Radiology 2007; 246:265-72. [PMID: 18024436 DOI: 10.1148/radiol.2461062097] [Citation(s) in RCA: 86] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
PURPOSE To evaluate agreement among radiologists on the interpretation of pulmonary findings at low-dose computed tomographic (CT) screening examinations for lung cancer. MATERIALS AND METHODS Institutional review board approval and informed consent were obtained. HIPAA guidelines were followed. Sixteen radiologists from the 10 National Lung Screening Trial screening centers of the National Cancer Institute's Lung Screening Study network reviewed image subsets from 135 baseline low-dose screening CT examinations in 135 trial participants (89 men, 46 women; mean age, 62.7 years +/- 5.4 [standard deviation]). Interpretations were classified into one of four of the following categories: noncalcified nodule 4 mm or larger in greatest transverse dimension (positive screening result); noncalcified nodule smaller than 4 mm in greatest transverse dimension (negative screening result); calcified, benign nodule (negative screening result); or no nodule (negative screening result). A recommendation for follow-up evaluation was obtained for each case. Interobserver agreement was evaluated by using the multirater kappa statistic and by using response frequencies and descriptive statistics. RESULTS Multirater kappa values ranged from 0.58 (for agreement among all four classifications; 95% confidence interval: 0.55, 0.61) to 0.64 (for agreement on classification as a positive or negative screening result; 95% confidence interval: 0.62, 0.65). The average percentage of reader pairs in agreement on the screening result per case (percentage agreement) was 82%. There was wide variation in the total number of abnormalities detected and classified as pulmonary nodules, with differences of up to more than twofold among radiologists. For cases classified as positive, multirater kappa for follow-up recommendations was 0.35. CONCLUSION Interobserver agreement was moderate to substantial; potential for considerable improvement exists. Clinical trial registration no. NCT00047385.
Collapse
Affiliation(s)
- David S Gierada
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S Kingshighway Blvd, St. Louis, MO 63105, USA.
| | | | | | | | | | | | | | | |
Collapse
|
21
|
Way TW, Hadjiiski LM, Sahiner B, Chan HP, Cascade PN, Kazerooni EA, Bogot N, Zhou C. Computer-aided diagnosis of pulmonary nodules on CT scans: segmentation and classification using 3D active contours. Med Phys 2006; 33:2323-37. [PMID: 16898434 PMCID: PMC2728558 DOI: 10.1118/1.2207129] [Citation(s) in RCA: 130] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
We are developing a computer-aided diagnosis (CAD) system to classify malignant and benign lung nodules found on CT scans. A fully automated system was designed to segment the nodule from its surrounding structured background in a local volume of interest (VOI) and to extract image features for classification. Image segmentation was performed with a three-dimensional (3D) active contour (AC) method. A data set of 96 lung nodules (44 malignant, 52 benign) from 58 patients was used in this study. The 3D AC model is based on two-dimensional AC with the addition of three new energy components to take advantage of 3D information: (1) 3D gradient, which guides the active contour to seek the object surface, (2) 3D curvature, which imposes a smoothness constraint in the z direction, and (3) mask energy, which penalizes contours that grow beyond the pleura or thoracic wall. The search for the best energy weights in the 3D AC model was guided by a simplex optimization method. Morphological and gray-level features were extracted from the segmented nodule. The rubber band straightening transform (RBST) was applied to the shell of voxels surrounding the nodule. Texture features based on run-length statistics were extracted from the RBST image. A linear discriminant analysis classifier with stepwise feature selection was designed using a second simplex optimization to select the most effective features. Leave-one-case-out resampling was used to train and test the CAD system. The system achieved a test area under the receiver operating characteristic curve (A(z)) of 0.83 +/- 0.04. Our preliminary results indicate that use of the 3D AC model and the 3D texture features surrounding the nodule is a promising approach to the segmentation and classification of lung nodules with CAD. The segmentation performance of the 3D AC model trained with our data set was evaluated with 23 nodules available in the Lung Image Database Consortium (LIDC). The lung nodule volumes segmented by the 3D AC model for best classification were generally larger than those outlined by the LIDC radiologists using visual judgment of nodule boundaries.
Collapse
Affiliation(s)
- Ted W Way
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109, USA.
| | | | | | | | | | | | | | | |
Collapse
|
22
|
Shah SK, McNitt-Gray MF, Rogers SR, Goldin JG, Suh RD, Sayre JW, Petkovska I, Kim HJ, Aberle DR. Computer aided characterization of the solitary pulmonary nodule using volumetric and contrast enhancement features. Acad Radiol 2005; 12:1310-9. [PMID: 16179208 DOI: 10.1016/j.acra.2005.06.005] [Citation(s) in RCA: 56] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2005] [Revised: 06/06/2005] [Accepted: 06/06/2005] [Indexed: 10/25/2022]
Abstract
RATIONALE AND OBJECTIVES To investigate the utility of a computer-aided diagnosis (CAD) in the task of differentiating malignant nodules from benign nodules based on quantitative features extracted from volumetric thin section CT image data acquired before and after the injection of contrast media. MATERIALS AND METHODS 35 volumetric CT datasets of solitary pulmonary nodules (SPN) with proven diagnoses (19 malignant/16 benign) were contoured by a thoracic radiologist. All studies had at least a baseline series obtained without contrast media and at least one series following an intravenous contrast injection at 45, 90, 180, and 360 seconds. Two separate contours were created for each nodule: one including only the solid portion and another including the ground-glass component, if any, of the nodule. For each contour 31 features were calculated that measured the attenuation, shape, and enhancement of the nodule due to the injection of contrast. These features were input into a feature selection step and three different classifiers to determine if the diagnosis could be predicted from the resulting feature vector. In addition, observer input was introduced to two of the classifiers as an a priori probability of malignancy and the resulting performance was compared. Training and testing was conducted in a resubstitution and leave-one-out fashion and performance was evaluated using ROC analysis. RESULTS In a leave-one-out testing methodology, the classifiers achieved areas under the ROC curves AZ that ranged from 0.69 to 0.92. A classifier based on logistic regression performed the best with an AZ of 0.92 while a classifier based on quadratic discriminant analysis performed the poorest (AZ, 0.69). The AZ increased when using a priori observer input in most cases reaching a maximum of 0.95. CONCLUSION Based on this initial work with a limited number of nodules in our dataset, it appears that CAD using volumetric and contrast-enhanced data has the potential to assist radiologists in the task of differentiating solitary pulmonary nodules and in the management of these patients. Further studies with an increased number of patients are required to validate these results.
Collapse
Affiliation(s)
- Sumit K Shah
- Department of Radiology, David Geffen School of Medicine at The University of California Los Angeles, Thoracic Imaging Research Group, 924 Westwood Blvd. Suite 650, Box 957319, Los Angeles, CA 90095-7319, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|