1
|
Momoki Y, Ichinose A, Nakamura K, Iwano S, Kamiya S, Yamada K, Naganawa S. Development of automatic generation system for lung nodule finding descriptions. PLoS One 2024; 19:e0300325. [PMID: 38512860 PMCID: PMC10956853 DOI: 10.1371/journal.pone.0300325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 02/23/2024] [Indexed: 03/23/2024] Open
Abstract
Worldwide, lung cancer is the leading cause of cancer-related deaths. To manage lung nodules, radiologists observe computed tomography images, review various imaging findings, and record these in radiology reports. The report contents should be of high quality and uniform regardless of the radiologist. Here, we propose an artificial intelligence system that automatically generates descriptions related to lung nodules in computed tomography images. Our system consists of an image recognition method for extracting contents-namely, bronchopulmonary segments and nodule characteristics from images-and a natural language processing method to generate fluent descriptions. To verify our system's clinical usefulness, we conducted an experiment in which two radiologists created nodule descriptions of findings using our system. Through our system, the similarity of the described contents between the two radiologists (p = 0.001) and the comprehensiveness of the contents (p = 0.025) improved, while the accuracy did not significantly deteriorate (p = 0.484).
Collapse
Affiliation(s)
- Yohei Momoki
- Medical Systems Research & Development Center, FUJIFILM Corporation, Minato, Tokyo, Japan
| | - Akimichi Ichinose
- Medical Systems Research & Development Center, FUJIFILM Corporation, Minato, Tokyo, Japan
| | - Keigo Nakamura
- Medical Systems Research & Development Center, FUJIFILM Corporation, Minato, Tokyo, Japan
| | - Shingo Iwano
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Shinichiro Kamiya
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Keiichiro Yamada
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| |
Collapse
|
2
|
Dai D, Dong C, Li Z, Xu S. MS-Net: Learning to assess the malignant status of a lung nodule by a radiologist and her peers. J Appl Clin Med Phys 2023:e13964. [PMID: 36929569 DOI: 10.1002/acm2.13964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2022] [Revised: 01/04/2023] [Accepted: 02/27/2023] [Indexed: 03/18/2023] Open
Abstract
BACKGROUND Automatically assessing the malignant status of lung nodules based on CTscan images can help reduce the workload of radiologists while improving their diagnostic accuracy. PURPOSE Despite remarkable progress in the automatic diagnosis of pulmonary nodules by deep learning technologies, two significant problems remain outstanding. First, end-to-end deep learning solutions tend to neglect the empirical (semantic) features accumulated by radiologists and only rely on automatic features discovered by neural networks to provide the final diagnostic results, leading to questionable reliability, and interpretability. Second, inconsistent diagnosis between radiologists, a widely acknowledged phenomenon in clinical settings, is rarely examined and quantitatively explored by existing machine learning approaches. This paper solves these problems. METHODS We propose a novel deep neural network called MS-Net, which comprises two sequential modules: A feature derivation and initial diagnosis module (FDID), followed by a diagnosis refinement module (DR). Specifically, to take advantage of accumulated empirical features and discovered automatic features, the FDID model of MS-Net first derives a range of perceptible features and provides two initial diagnoses for lung nodules; then, these results are fed to the subsequent DR module to refine the diagnoses further. In addition, to fully consider the individual and panel diagnosis opinions, we propose a new loss function called collaborative loss, which can collaboratively optimize the individual and her peers' opinions to provide a more accurate diagnosis. RESULTS We evaluate the performance of the proposed MS-Net on the Lung Image Database Consortium image collection (LIDC-IDRI). It achieves 92.4% of accuracy, 92.9% of sensitivity, and 92.0% of specificity when panel labels are the ground truth, which is superior to other state-of-the-art diagnosis models. As a byproduct, the MS-Net can automatically derive a range of semantic features of lung nodules, increasing the interpretability of the final diagnoses. CONCLUSIONS The proposed MS-Net can provide an automatic and accurate diagnosis of lung nodules, meeting the need for a reliable computer-aided diagnosis system in clinical practice.
Collapse
Affiliation(s)
- Duwei Dai
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Caixia Dong
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Zongfang Li
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Songhua Xu
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| |
Collapse
|
3
|
Akter O, Moni MA, Islam MM, Quinn JMW, Kamal AHM. Lung cancer detection using enhanced segmentation accuracy. APPL INTELL 2021. [DOI: 10.1007/s10489-020-02046-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
4
|
Palumbo B, Bianconi F, Palumbo I, Fravolini ML, Minestrini M, Nuvoli S, Stazza ML, Rondini M, Spanu A. Value of Shape and Texture Features from 18F-FDG PET/CT to Discriminate between Benign and Malignant Solitary Pulmonary Nodules: An Experimental Evaluation. Diagnostics (Basel) 2020; 10:E696. [PMID: 32942729 PMCID: PMC7555302 DOI: 10.3390/diagnostics10090696] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Revised: 09/10/2020] [Accepted: 09/10/2020] [Indexed: 12/12/2022] Open
Abstract
In this paper, we investigate the role of shape and texture features from 18F-FDG PET/CT to discriminate between benign and malignant solitary pulmonary nodules. To this end, we retrospectively evaluated cross-sectional data from 111 patients (64 males, 47 females, age = 67.5 ± 11.0) all with histologically confirmed benign (n=39) or malignant (n=72) solitary pulmonary nodules. Eighteen three-dimensional imaging features, including conventional, texture, and shape features from PET and CT were tested for significant differences (Wilcoxon-Mann-Withney) between the benign and malignant groups. Prediction models based on different feature sets and three classification strategies (Classification Tree, k-Nearest Neighbours, and Naïve Bayes) were also evaluated to assess the potential benefit of shape and texture features compared with conventional imaging features alone. Eight features from CT and 15 from PET were significantly different between the benign and malignant groups. Adding shape and texture features increased the performance of both the CT-based and PET-based prediction models with overall accuracy gain being 3.4-11.2 pp and 2.2-10.2 pp, respectively. In conclusion, we found that shape and texture features from 18F-FDG PET/CT can lead to a better discrimination between benign and malignant lung nodules by increasing the accuracy of the prediction models by an appreciable margin.
Collapse
Affiliation(s)
- Barbara Palumbo
- Section of Nuclear Medicine and Health Physics, Department of Surgical and Biomedical Sciences, Università degli Studi di Perugia, Piazza Lucio Severi 1, 06132 Perugia, Italy; (B.P.); (M.M.)
| | - Francesco Bianconi
- Department of Engineering, Università degli Studi di Perugia, Via Goffredo Duranti 93, 06135 Perugia, Italy;
| | - Isabella Palumbo
- Section of Radiation Oncology, Department of Surgical and Biomedical Sciences, Università degli Studi di Perugia, Piazza Lucio Severi 1, 06132 Perugia, Italy;
| | - Mario Luca Fravolini
- Department of Engineering, Università degli Studi di Perugia, Via Goffredo Duranti 93, 06135 Perugia, Italy;
| | - Matteo Minestrini
- Section of Nuclear Medicine and Health Physics, Department of Surgical and Biomedical Sciences, Università degli Studi di Perugia, Piazza Lucio Severi 1, 06132 Perugia, Italy; (B.P.); (M.M.)
| | - Susanna Nuvoli
- Unit of Nuclear Medicine, Department of Medical, Surgical and Experimental Sciences, Università degli Studi di Sassari, Viale San Pietro 8, 07100 Sassari, Italy; (S.N.); (M.L.S.); (M.R.); (A.S.)
| | - Maria Lina Stazza
- Unit of Nuclear Medicine, Department of Medical, Surgical and Experimental Sciences, Università degli Studi di Sassari, Viale San Pietro 8, 07100 Sassari, Italy; (S.N.); (M.L.S.); (M.R.); (A.S.)
| | - Maria Rondini
- Unit of Nuclear Medicine, Department of Medical, Surgical and Experimental Sciences, Università degli Studi di Sassari, Viale San Pietro 8, 07100 Sassari, Italy; (S.N.); (M.L.S.); (M.R.); (A.S.)
| | - Angela Spanu
- Unit of Nuclear Medicine, Department of Medical, Surgical and Experimental Sciences, Università degli Studi di Sassari, Viale San Pietro 8, 07100 Sassari, Italy; (S.N.); (M.L.S.); (M.R.); (A.S.)
| |
Collapse
|
5
|
A Novel Computer-Aided Diagnosis Scheme on Small Annotated Set: G2C-CAD. BIOMED RESEARCH INTERNATIONAL 2019; 2019:6425963. [PMID: 31119180 PMCID: PMC6500711 DOI: 10.1155/2019/6425963] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Accepted: 03/05/2019] [Indexed: 11/18/2022]
Abstract
Purpose Computer-aided diagnosis (CAD) can aid in improving diagnostic level; however, the main problem currently faced by CAD is that it cannot obtain sufficient labeled samples. To solve this problem, in this study, we adopt a generative adversarial network (GAN) approach and design a semisupervised learning algorithm, named G2C-CAD. Methods From the National Cancer Institute (NCI) Lung Image Database Consortium (LIDC) dataset, we extracted four types of pulmonary nodule sign images closely related to lung cancer: noncentral calcification, lobulation, spiculation, and nonsolid/ground-glass opacity (GGO) texture, obtaining a total of 3,196 samples. In addition, we randomly selected 2,000 non-lesion image blocks as negative samples. We split the data 90% for training and 10% for testing. We designed a DCGAN generative adversarial framework and trained it on the small sample set. We also trained our designed CNN-based fuzzy Co-forest on the labeled small sample set and obtained a preliminary classifier. Then, coupled with the simulated unlabeled samples generated by the trained DCGAN, we conducted iterative semisupervised learning, which continually improved the classification performance of the fuzzy Co-forest until the termination condition was reached. Finally, we tested the fuzzy Co-forest and compared its performance with that of a C4.5 random decision forest and the G2C-CAD system without the fuzzy scheme, using ROC and confusion matrix for evaluation. Results Four different types of lung cancer-related signs were used in the classification experiment: noncentral calcification, lobulation, spiculation, and nonsolid/ground-glass opacity (GGO) texture, along with negative image samples. For these five classes, the G2C-CAD system obtained AUCs of 0.946, 0.912, 0.908, 0.887, and 0.939, respectively. The average accuracy of G2C-CAD exceeded that of the C4.5 random decision tree by 14%. G2C-CAD also obtained promising test results on the LISS signs dataset; its AUCs for GGO, lobulation, spiculation, pleural indentation, and negative image samples were 0.972, 0.964, 0.941, 0.967, and 0.953, respectively. Conclusion The experimental results show that G2C-CAD is an appropriate method for addressing the problem of insufficient labeled samples in the medical image analysis field. Moreover, our system can be used to establish a training sample library for CAD classification diagnosis, which is important for future medical image analysis.
Collapse
|
6
|
Wang X, Mao K, Wang L, Yang P, Lu D, He P. An Appraisal of Lung Nodules Automatic Classification Algorithms for CT Images. SENSORS (BASEL, SWITZERLAND) 2019; 19:E194. [PMID: 30621101 PMCID: PMC6338921 DOI: 10.3390/s19010194] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2018] [Revised: 12/28/2018] [Accepted: 12/31/2018] [Indexed: 12/23/2022]
Abstract
Lung cancer is one of the most deadly diseases around the world representing about 26% of all cancers in 2017. The five-year cure rate is only 18% despite great progress in recent diagnosis and treatment. Before diagnosis, lung nodule classification is a key step, especially since automatic classification can help clinicians by providing a valuable opinion. Modern computer vision and machine learning technologies allow very fast and reliable CT image classification. This research area has become very hot for its high efficiency and labor saving. The paper aims to draw a systematic review of the state of the art of automatic classification of lung nodules. This research paper covers published works selected from the Web of Science, IEEEXplore, and DBLP databases up to June 2018. Each paper is critically reviewed based on objective, methodology, research dataset, and performance evaluation. Mainstream algorithms are conveyed and generic structures are summarized. Our work reveals that lung nodule classification based on deep learning becomes dominant for its excellent performance. It is concluded that the consistency of the research objective and integration of data deserves more attention. Moreover, collaborative works among developers, clinicians, and other parties should be strengthened.
Collapse
Affiliation(s)
- Xinqi Wang
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Keming Mao
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Lizhe Wang
- Norman Bethune Health Science Center of Jilin University, No. 2699 Qianjin Street, Changchun 130012, China.
| | - Peiyi Yang
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Duo Lu
- School of Software, Northeastern University, Shenyang 110004, China.
| | - Ping He
- School of Computer Science and Engineering, Northeastern University, Shenyang 110004, China.
| |
Collapse
|
7
|
A Combination of Shape and Texture Features for Classification of Pulmonary Nodules in Lung CT Images. J Digit Imaging 2018; 29:466-75. [PMID: 26738871 DOI: 10.1007/s10278-015-9857-6] [Citation(s) in RCA: 83] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023] Open
Abstract
Classification of malignant and benign pulmonary nodules is important for further treatment plan. The present work focuses on the classification of benign and malignant pulmonary nodules using support vector machine. The pulmonary nodules are segmented using a semi-automated technique, which requires only a seed point from the end user. Several shape-based, margin-based, and texture-based features are computed to represent the pulmonary nodules. A set of relevant features is determined for the efficient representation of nodules in the feature space. The proposed classification scheme is validated on a data set of 891 nodules of Lung Image Database Consortium and Image Database Resource Initiative public database. The proposed classification scheme is evaluated for three configurations such as configuration 1 (composite rank of malignancy "1" and "2" as benign and "4" and "5" as malignant), configuration 2 (composite rank of malignancy "1","2", and "3" as benign and "4" and "5" as malignant), and configuration 3 (composite rank of malignancy "1" and "2" as benign and "3","4" and "5" as malignant). The performance of the classification is evaluated in terms of area (A z) under the receiver operating characteristic curve. The A z achieved by the proposed method for configuration-1, configuration-2, and configuration-3 are 0.9505, 0.8822, and 0.8488, respectively. The proposed method outperforms the most recent technique, which depends on the manual segmentation of pulmonary nodules by a trained radiologist.
Collapse
|
8
|
Wang H, Zhao T, Li LC, Pan H, Liu W, Gao H, Han F, Wang Y, Qi Y, Liang Z. A hybrid CNN feature model for pulmonary nodule malignancy risk differentiation. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2018; 26:171-187. [PMID: 29036877 DOI: 10.3233/xst-17302] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The malignancy risk differentiation of pulmonary nodule is one of the most challenge tasks of computer-aided diagnosis (CADx). Most recently reported CADx methods or schemes based on texture and shape estimation have shown relatively satisfactory on differentiating the risk level of malignancy among the nodules detected in lung cancer screening. However, the existing CADx schemes tend to detect and analyze characteristics of pulmonary nodules from a statistical perspective according to local features only. Enlightened by the currently prevailing learning ability of convolutional neural network (CNN), which simulates human neural network for target recognition and our previously research on texture features, we present a hybrid model that takes into consideration of both global and local features for pulmonary nodule differentiation using the largest public database founded by the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI). By comparing three types of CNN models in which two of them were newly proposed by us, we observed that the multi-channel CNN model yielded the best discrimination in capacity of differentiating malignancy risk of the nodules based on the projection of distributions of extracted features. Moreover, CADx scheme using the new multi-channel CNN model outperformed our previously developed CADx scheme using the 3D texture feature analysis method, which increased the computed area under a receiver operating characteristic curve (AUC) from 0.9441 to 0.9702.
Collapse
Affiliation(s)
- Huafeng Wang
- North China University of Technology, School of Electrical Information, Beijing, China
- School of Software Engineering, Beihang University, Beijing, China
| | - Tingting Zhao
- School of Software Engineering, Beihang University, Beijing, China
| | - Lihong Connie Li
- Department of Engineering Science and Physics, City University of New York at CSI, Staten Island, NY, USA
| | - Haixia Pan
- School of Software Engineering, Beihang University, Beijing, China
| | - Wanquan Liu
- North China University of Technology, School of Electrical Information, Beijing, China
| | - Haoqi Gao
- School of Software Engineering, Beihang University, Beijing, China
| | - Fangfang Han
- Department of Biomedical, Northeast University, Shenyan, China
| | - Yuehai Wang
- North China University of Technology, School of Electrical Information, Beijing, China
| | - Yifan Qi
- School of Software Engineering, Beihang University, Beijing, China
| | - Zhengrong Liang
- Department of Radiology, State University of New York at Stony Brook, NY, USA
| |
Collapse
|
9
|
Han G, Liu X, Soomro NQ, Sun J, Zhao Y, Zhao X, Zhou C. Empirical Driven Automatic Detection of Lobulation Imaging Signs in Lung CT. BIOMED RESEARCH INTERNATIONAL 2017; 2017:3842659. [PMID: 28466009 PMCID: PMC5390675 DOI: 10.1155/2017/3842659] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/23/2016] [Accepted: 12/22/2016] [Indexed: 11/29/2022]
Abstract
Computer-aided detection (CAD) of lobulation can help radiologists to diagnose/detect lung diseases easily and accurately. Compared to CAD of nodule and other lung lesions, CAD of lobulation remained an unexplored problem due to very complex and varying nature of lobulation. Thus, many state-of-the-art methods could not detect successfully. Hence, we revisited classical methods with the capability of extracting undulated characteristics and designed a sliding window based framework for lobulation detection in this paper. Under the designed framework, we investigated three categories of lobulation classification algorithms: template matching, feature based classifier, and bending energy. The resultant detection algorithms were evaluated through experiments on LISS database. The experimental results show that the algorithm based on combination of global context feature and BOF encoding has best overall performance, resulting in F1 score of 0.1009. Furthermore, bending energy method is shown to be appropriate for reducing false positives. We performed bending energy method following the LIOP-LBP mixture feature, the average positive detection per image was reduced from 30 to 22, and F1 score increased to 0.0643 from 0.0599. To the best of our knowledge this is the first kind of work for direct lobulation detection and first application of bending energy to any kind of lobulation work.
Collapse
Affiliation(s)
- Guanghui Han
- Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
| | - Xiabi Liu
- Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
| | - Nouman Q. Soomro
- Department of Software Engineering, Mehran University of Engineering and Technology, SZAB Campus, Khairpur Mir's, Pakistan
| | - Jia Sun
- Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
| | - Yanfeng Zhao
- Department of Imaging Diagnosis, Cancer Institute and Hospital, Chinese Academy of Medical Sciences, Beijing, China
| | - Xinming Zhao
- Department of Imaging Diagnosis, Cancer Institute and Hospital, Chinese Academy of Medical Sciences, Beijing, China
| | - Chunwu Zhou
- Department of Imaging Diagnosis, Cancer Institute and Hospital, Chinese Academy of Medical Sciences, Beijing, China
| |
Collapse
|
10
|
Hancock MC, Magnan JF. Lung nodule malignancy classification using only radiologist-quantified image features as inputs to statistical learning algorithms: probing the Lung Image Database Consortium dataset with two statistical learning methods. J Med Imaging (Bellingham) 2016; 3:044504. [PMID: 27990453 DOI: 10.1117/1.jmi.3.4.044504] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2016] [Accepted: 11/14/2016] [Indexed: 01/12/2023] Open
Abstract
In the assessment of nodules in CT scans of the lungs, a number of image-derived features are diagnostically relevant. Currently, many of these features are defined only qualitatively, so they are difficult to quantify from first principles. Nevertheless, these features (through their qualitative definitions and interpretations thereof) are often quantified via a variety of mathematical methods for the purpose of computer-aided diagnosis (CAD). To determine the potential usefulness of quantified diagnostic image features as inputs to a CAD system, we investigate the predictive capability of statistical learning methods for classifying nodule malignancy. We utilize the Lung Image Database Consortium dataset and only employ the radiologist-assigned diagnostic feature values for the lung nodules therein, as well as our derived estimates of the diameter and volume of the nodules from the radiologists' annotations. We calculate theoretical upper bounds on the classification accuracy that are achievable by an ideal classifier that only uses the radiologist-assigned feature values, and we obtain an accuracy of 85.74 [Formula: see text], which is, on average, 4.43% below the theoretical maximum of 90.17%. The corresponding area-under-the-curve (AUC) score is 0.932 ([Formula: see text]), which increases to 0.949 ([Formula: see text]) when diameter and volume features are included and has an accuracy of 88.08 [Formula: see text]. Our results are comparable to those in the literature that use algorithmically derived image-based features, which supports our hypothesis that lung nodules can be classified as malignant or benign using only quantified, diagnostic image features, and indicates the competitiveness of this approach. We also analyze how the classification accuracy depends on specific features and feature subsets, and we rank the features according to their predictive power, statistically demonstrating the top four to be spiculation, lobulation, subtlety, and calcification.
Collapse
Affiliation(s)
- Matthew C Hancock
- Florida State University , Department of Mathematics, 208 Love Building, 1017 Academic Way, Tallahassee, Florida 32306-4510, United States
| | - Jerry F Magnan
- Florida State University , Department of Mathematics, 208 Love Building, 1017 Academic Way, Tallahassee, Florida 32306-4510, United States
| |
Collapse
|
11
|
Han F, Wang H, Zhang G, Han H, Song B, Li L, Moore W, Lu H, Zhao H, Liang Z. Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J Digit Imaging 2015; 28:99-115. [PMID: 25117512 DOI: 10.1007/s10278-014-9718-8] [Citation(s) in RCA: 115] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
Differentiation of malignant and benign pulmonary nodules is of paramount clinical importance. Texture features of pulmonary nodules in CT images reflect a powerful character of the malignancy in addition to the geometry-related measures. This study first compared three well-known types of two-dimensional (2D) texture features (Haralick, Gabor, and local binary patterns or local binary pattern features) on CADx of lung nodules using the largest public database founded by Lung Image Database Consortium and Image Database Resource Initiative and then investigated extension from 2D to three-dimensional (3D) space. Quantitative comparison measures were made by the well-established support vector machine (SVM) classifier, the area under the receiver operating characteristic curves (AUC) and the p values from hypothesis t tests. While the three feature types showed about 90% differentiation rate, the Haralick features achieved the highest AUC value of 92.70% at an adequate image slice thickness, where a thinner or thicker thickness will deteriorate the performance due to excessive image noise or loss of axial details. Gain was observed when calculating 2D features on all image slices as compared to the single largest slice. The 3D extension revealed potential gain when an optimal number of directions can be found. All the observations from this systematic investigation study on the three feature types can lead to the conclusions that the Haralick feature type is a better choice, the use of the full 3D data is beneficial, and an adequate tradeoff between image thickness and noise is desired for an optimal CADx performance. These conclusions provide a guideline for further research on lung nodule differentiation using CT imaging.
Collapse
Affiliation(s)
- Fangfang Han
- Department of Radiology, State University of New York, Stony Brook, NY, 11794, USA
| | | | | | | | | | | | | | | | | | | |
Collapse
|
12
|
Wang W, Luo J, Yang X, Lin H. Data analysis of the Lung Imaging Database Consortium and Image Database Resource Initiative. Acad Radiol 2015; 22:488-95. [PMID: 25601306 DOI: 10.1016/j.acra.2014.12.004] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2014] [Revised: 12/04/2014] [Accepted: 12/06/2014] [Indexed: 11/28/2022]
Abstract
RATIONALE AND OBJECTIVES The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI) is the largest publicly available computed tomography (CT) image reference data set of lung nodules. In this article, a comprehensive data analysis of the data set and a uniform data model are presented with the purpose of facilitating potential researchers to have an in-depth understanding to and efficient use of the data set in their lung cancer-related investigations. MATERIALS AND METHODS A uniform data model was designed for representation and organization of various types of information contained in different source data files. A software tool was developed for the processing and analysis of the database, which 1) automatically aligns and graphically displays the nodule outlines marked manually by radiologists onto the corresponding CT images; 2) extracts diagnostic nodule characteristics annotated by radiologists; 3) calculates a variety of nodule image features based on the outlines of nodules, including diameter, volume, and degree of roundness, and so forth; 4) integrates all the extracted nodule information into the uniform data model and stores it in a common and easy-to-access data format; and 5) analyzes and summarizes various feature distributions of nodules in several different categories. Using this data processing and analysis tool, all 1018 CT scans from the data set were processed and analyzed for their statistical distribution. RESULTS The information contained in different source data files with different formats was extracted and integrated into a new and uniform data model. Based on the new data model, the statistical distributions of nodules in terms of nodule geometric features and diagnostic characteristics were summarized. In the LIDC/IDRI data set, 2655 nodules ≥3 mm, 5875 nodules <3 mm, and 7411 non-nodules are identified, respectively. Among the 2655 nodules, 1) 775, 488, 481, and 911 were marked by one, two, three, or four radiologists, respectively; 2) most of nodules ≥3 mm (85.7%) have a diameter <10.0 mm with the mean value of 6.72 mm; and 3) 10.87%, 31.4%, 38.8%, 16.4%, and 2.6% of nodules were assessed with a malignancy score of 1, 2, 3, 4, and 5, respectively. CONCLUSIONS This study demonstrates the usefulness of the proposed software tool to the potential users for an in-depth understanding of the LIDC/IDRI data set, therefore likely to be beneficial to their future investigations. The analysis results also demonstrate the distribution diversity of nodules characteristics, therefore being useful as a reference resource for assessing the performance of a new and existing nodule detection and/or segmentation schemes.
Collapse
Affiliation(s)
- Weisheng Wang
- College of Computer Science and Electronic Engineering, Hunan University, 410082 Changsha, China
| | - Jiawei Luo
- College of Computer Science and Electronic Engineering, Hunan University, 410082 Changsha, China.
| | - Xuedong Yang
- Department of Computer Science, University of Regina, Regina, Saskatchewan, Canada
| | - Hongli Lin
- College of Computer Science and Electronic Engineering, Hunan University, 410082 Changsha, China
| |
Collapse
|
13
|
Lin H, Wang W, Luo J, Yang X. Development of a personalized training system using the Lung Image Database Consortium and Image Database resource Initiative Database. Acad Radiol 2014; 21:1614-22. [PMID: 25442354 DOI: 10.1016/j.acra.2014.07.020] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2014] [Revised: 04/21/2014] [Accepted: 07/21/2014] [Indexed: 11/18/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of this study was to develop a personalized training system using the Lung Image Database Consortium (LIDC) and Image Database resource Initiative (IDRI) Database, because collecting, annotating, and marking a large number of appropriate computed tomography (CT) scans, and providing the capability of dynamically selecting suitable training cases based on the performance levels of trainees and the characteristics of cases are critical for developing a efficient training system. MATERIALS AND METHODS A novel approach is proposed to develop a personalized radiology training system for the interpretation of lung nodules in CT scans using the Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI) database, which provides a Content-Boosted Collaborative Filtering (CBCF) algorithm for predicting the difficulty level of each case of each trainee when selecting suitable cases to meet individual needs, and a diagnostic simulation tool to enable trainees to analyze and diagnose lung nodules with the help of an image processing tool and a nodule retrieval tool. RESULTS Preliminary evaluation of the system shows that developing a personalized training system for interpretation of lung nodules is needed and useful to enhance the professional skills of trainees. CONCLUSIONS The approach of developing personalized training systems using the LIDC/IDRL database is a feasible solution to the challenges of constructing specific training program in terms of cost and training efficiency.
Collapse
Affiliation(s)
- Hongli Lin
- Key Laboratory for Embedded and Network Computing of Hunan Province, School of information science and engineering, Hunan University, 410082 Changsha, China.
| | - Weisheng Wang
- Key Laboratory for Embedded and Network Computing of Hunan Province, School of information science and engineering, Hunan University, 410082 Changsha, China
| | - Jiawei Luo
- Key Laboratory for Embedded and Network Computing of Hunan Province, School of information science and engineering, Hunan University, 410082 Changsha, China
| | - Xuedong Yang
- Department of Computer Science, University of Regina, Regina, Saskatchewan, Canada
| |
Collapse
|
14
|
Stember JN. The normal mode analysis shape detection method for automated shape determination of lung nodules. J Digit Imaging 2014; 28:224-30. [PMID: 25223520 DOI: 10.1007/s10278-014-9732-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Surface morphology and shape in general are important predictors for the behavior of solid-type lung nodules detected on CT. More broadly, shape analysis is useful in many areas of computer-aided diagnosis and essentially all scientific and engineering disciplines. Automated methods for shape detection have all previously, to the author's knowledge, relied on some sort of geometric measure. I introduce Normal Mode Analysis Shape Detection (NMA-SD), an approach that measures shape indirectly via the motion it would undergo if one imagined the shape to be a pseudomolecule. NMA-SD allows users to visualize internal movements in the imaging object and thereby develop an intuition for which motions are important, and which geometric features give rise to them. This can guide the identification of appropriate classification features to distinguish among classes of interest. I employ normal mode analysis (NMA) to animate pseudomolecules representing simulated lung nodules. Doing so, I am able to assign a testing set of nodules into the classes circular, elliptical, and irregular with roughly 97 % accuracy. This represents a proof-of-principle that one can obtain shape information by treating voxels as pseudoatoms in a pseudomolecule, and analyzing the pseudomolecule's predicted motion.
Collapse
Affiliation(s)
- Joseph N Stember
- Department of Radiology, Columbia University Medical Center, 180 Fort Washington Avenue, 3rd Floor Harkness Pavillion, Room 313, New York, NY, 10032, USA,
| |
Collapse
|
15
|
Stember JN, Ko JP, Naidich DP, Kaur M, Rusinek H. The self-overlap method for assessment of lung nodule morphology in chest CT. J Digit Imaging 2013; 26:239-47. [PMID: 23065123 DOI: 10.1007/s10278-012-9536-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
Surface morphology is an important indicator of malignant potential for solid-type lung nodules detected at CT, but is difficult to assess subjectively. Automated methods for morphology assessment have previously been described using a common measure of nodule shape, representative of the broad class of existing methods, termed area-to-perimeter-length ratio (APR). APR is static and thus highly susceptible to alterations by random noise and artifacts in image acquisition. We introduce and analyze the self-overlap (SO) method as a dynamic automated morphology detection scheme. SO measures the degree of change of nodule masks upon Gaussian blurring. We hypothesized that this new metric would afford equally high accuracy and superior precision than APR. Application of the two methods to a set of 119 patient lung nodules and a set of simulation nodules showed our approach to be slightly more accurate and on the order of ten times as precise, respectively. The dynamic quality of this new automated metric renders it less sensitive to image noise and artifacts than APR, and as such, SO is a potentially useful measure of cancer risk for solid-type lung nodules detected on CT.
Collapse
Affiliation(s)
- Joseph N Stember
- Department of Radiology, School of Medicine, New York University, New York, NY 10016, USA.
| | | | | | | | | |
Collapse
|
16
|
Classification of pulmonary nodules by using hybrid features. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2013; 2013:148363. [PMID: 23970942 PMCID: PMC3708407 DOI: 10.1155/2013/148363] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/28/2013] [Revised: 05/24/2013] [Accepted: 05/29/2013] [Indexed: 11/17/2022]
Abstract
Early detection of pulmonary nodules is extremely important for the diagnosis and treatment of lung cancer. In this study, a new classification approach for pulmonary nodules from CT imagery is presented by using hybrid features. Four different methods are introduced for the proposed system. The overall detection performance is evaluated using various classifiers. The results are compared to similar techniques in the literature by using standard measures. The proposed approach with the hybrid features results in 90.7% classification accuracy (89.6% sensitivity and 87.5% specificity).
Collapse
|
17
|
Computer-aided diagnosis systems for lung cancer: challenges and methodologies. Int J Biomed Imaging 2013; 2013:942353. [PMID: 23431282 PMCID: PMC3570946 DOI: 10.1155/2013/942353] [Citation(s) in RCA: 116] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2012] [Accepted: 11/20/2012] [Indexed: 11/24/2022] Open
Abstract
This paper overviews one of the most important, interesting, and challenging problems in oncology, the problem of lung cancer diagnosis. Developing an effective computer-aided diagnosis (CAD) system for lung cancer is of great clinical importance and can increase the patient's chance of survival. For this reason, CAD systems for lung cancer have been investigated in a huge number of research studies. A typical CAD system for lung cancer diagnosis is composed of four main processing steps: segmentation of the lung fields, detection of nodules inside the lung fields, segmentation of the detected nodules, and diagnosis of the nodules as benign or malignant. This paper overviews the current state-of-the-art techniques that have been developed to implement each of these CAD processing steps. For each technique, various aspects of technical issues, implemented methodologies, training and testing databases, and validation methods, as well as achieved performances, are described. In addition, the paper addresses several challenges that researchers face in each implementation step and outlines the strengths and drawbacks of the existing approaches for lung cancer CAD systems.
Collapse
|
18
|
Magalhães Barros Netto S, Corrêa Silva A, Acatauassú Nunes R, Gattass M. Automatic segmentation of lung nodules with growing neural gas and support vector machine. Comput Biol Med 2012; 42:1110-21. [PMID: 23021776 DOI: 10.1016/j.compbiomed.2012.09.003] [Citation(s) in RCA: 72] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2010] [Revised: 06/25/2012] [Accepted: 09/05/2012] [Indexed: 11/26/2022]
Abstract
Lung cancer is distinguished by presenting one of the highest incidences and one of the highest rates of mortality among all other types of cancer. Unfortunately, this disease is often diagnosed late, affecting the treatment outcome. In order to help specialists in the search and identification of lung nodules in tomographic images, many research centers have developed computer-aided detection systems (CAD systems) to automate procedures. This work seeks to develop a methodology for automatic detection of lung nodules. The proposed method consists of the acquisition of computerized tomography images of the lung, the reduction of the volume of interest through techniques for the extraction of the thorax, extraction of the lung, and reconstruction of the original shape of the parenchyma. After that, growing neural gas (GNG) is applied to constrain even more the structures that are denser than the pulmonary parenchyma (nodules, blood vessels, bronchi, etc.). The next stage is the separation of the structures resembling lung nodules from other structures, such as vessels and bronchi. Finally, the structures are classified as either nodule or non-nodule, through shape and texture measurements together with support vector machine. The methodology ensures that nodules of reasonable size be found with 86% sensitivity and 91% specificity. This results in a mean accuracy of 91% for 10 experiments of training and testing in a sample of 48 nodules occurring in 29 exams. The rate of false positives per exam was of 0.138, for the 29 exams analyzed.
Collapse
Affiliation(s)
- Stelmo Magalhães Barros Netto
- Federal University of Maranhão - UFMA, Applied Computing Group - NCA, Av. dos Portugueses, SN, Campus do Bacanga, Bacanga 65085-580, São Luís, MA, Brazil.
| | | | | | | |
Collapse
|
19
|
Kamiya H, Murayama S, Kakinohana Y, Miyara T. Pulmonary nodules: a quantitative method of diagnosis by evaluating nodule perimeter difference to approximate oval using three-dimensional CT images. Clin Imaging 2011; 35:123-6. [PMID: 21377050 DOI: 10.1016/j.clinimag.2010.03.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2010] [Accepted: 03/08/2010] [Indexed: 11/25/2022]
Abstract
The purpose of this study was to investigate whether maximum nodule perimeter to the approximate oval could discriminate benign nodules from malignancy. Measurement of maximum nodule perimeter difference to the approximate oval was performed using volume-rendering images of three directions of each pulmonary nodule. The margin was then traced manually and our custom software delineated the approximate oval automatically. The maximum nodule perimeter difference was 26.5±23.3 mm for malignant and 16.6±16.9 mm for benign nodules, showing an almost statistically significant difference (P=.07). This study suggests that the maximum nodule perimeter difference to the approximate oval of the malignant nodules has a tendency to be longer than benign nodules.
Collapse
Affiliation(s)
- Hisashi Kamiya
- Department of Radiology, Faculty of Medicine, University of the Ryukyus, Nishihara-cho, Okinawa, Japan.
| | | | | | | |
Collapse
|
20
|
Kim N, Seo JB, Lee Y, Lee JG, Kim SS, Kang SH. Development of an automatic classification system for differentiation of obstructive lung disease using HRCT. J Digit Imaging 2008; 22:136-48. [PMID: 18712567 DOI: 10.1007/s10278-008-9147-7] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2007] [Revised: 06/26/2008] [Accepted: 07/28/2008] [Indexed: 11/26/2022] Open
Abstract
The motivation is to introduce new shape features and optimize the classifier to improve performance of differentiating obstructive lung diseases, based on high-resolution computerized tomography (HRCT) images. Two hundred sixty-five HRCT images from 82 subjects were selected. On each image, two experienced radiologists selected regions of interest (ROIs) representing area of severe centrilobular emphysema, mild centrilobular emphysema, bronchiolitis obliterans, or normal lung. Besides 13 textural features, additional 11 shape features were employed to evaluate the contribution of shape features. To optimize the system, various ROI size (16 x 16, 32 x 32, and 64 x 64 pixels) and other classifier parameters were tested. For automated classification, the Bayesian classifier and support vector machine (SVM) were implemented. To assess cross-validation of the system, a five-folding method was used. In the comparison of methods employing only the textural features, adding shape features yielded the significant improvement of overall sensitivity (7.3%, 6.1%, and 4.1% in the Bayesian and 9.1%, 7.5%, and 6.4% in the SVM, in the ROI size 16 x 16, 32 x 32, 64 x 64 pixels, respectively; t test, P < 0.01). After feature selection, most of cluster shape features were survived ,and the feature selected set shows better performance of the overall sensitivity (93.5 +/- 1.0% in the SVM in the ROI size 64 x 64 pixels; t test, P < 0.01). Adding shape features to conventional texture features is much useful to improve classification performance of obstructive lung diseases in both Bayesian and SVM classifiers. In addition, the shape features contribute more to overall sensitivity in smaller ROI.
Collapse
Affiliation(s)
- Namkug Kim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 388-1, Pungnap2-dong, Songpa-gu, Seoul, 138-736, Republic of Korea
| | | | | | | | | | | |
Collapse
|
21
|
Texture-Based Quantification of Pulmonary Emphysema on High-Resolution Computed Tomography: Comparison With Density-Based Quantification and Correlation With Pulmonary Function Test. Invest Radiol 2008; 43:395-402. [DOI: 10.1097/rli.0b013e31816901c7] [Citation(s) in RCA: 76] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
22
|
Iwano S, Nakamura T, Kamioka Y, Ikeda M, Ishigaki T. Computer-aided differentiation of malignant from benign solitary pulmonary nodules imaged by high-resolution CT. Comput Med Imaging Graph 2008; 32:416-22. [PMID: 18501556 DOI: 10.1016/j.compmedimag.2008.04.001] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2007] [Revised: 03/21/2008] [Accepted: 04/11/2008] [Indexed: 10/22/2022]
Abstract
We investigated the possibility of using computer analysis of high-resolution CT images to radiologically classify the shape of pulmonary nodules. From a total of 107 HRCT images of solid, solitary pulmonary nodules with prior differentiation as benign (n=55) or malignant (n=52), we extracted the desired pulmonary nodules and calculated two quantitative parameters for characterizing nodules: circularity and second central moment. Using discriminant analysis for two thresholds in differentiating malignant from benign states resulted in a sensitivity of 76.9%, a specificity of 80%, a positive predictive value of 78.4%, and a negative predictive value of 78.6%.
Collapse
Affiliation(s)
- Shingo Iwano
- Department of Radiology, Nagoya University, School of Medicine, 65 Tsurumai-cho, Shouwa-ku, Nagoya 466-8550, Japan.
| | | | | | | | | |
Collapse
|
23
|
Abstract
RECIST (Response Evaluation Criteria in Solid Tumors) is a widely employed method introduced in 2000 to assess change in tumor size in response to therapy. The simplicity of the technique, however, contrasts sharply with the increasing sophistication of imaging instrumentation. Anatomically based imaging measurement, although supportive of drug development and key to some accelerated drug approvals, is being pressed to improve its methodologic robustness, particularly in the light of more functionally-based imaging that is sensitive to tissue molecular response such as fluorodeoxyglucose positron emission tomography. Nevertheless ready availability of computed tomography and magnetic resonance imaging machines largely assures anatomically based imaging a continuing role in clinical trials for the foreseeable future. Recent advances in image processing enabled by the computational power of modern clinical scanners open a considerable opportunity to characterize tumor response to therapy as a complement to image acquisition. Various alternative quantitative volumetric approaches have been proposed but have yet to gain wide acceptance by clinical and regulatory communities, nor have these more complex techniques shown incontrovertible evidence of greater reproducibility or predictive value of clinical events and outcome. Unless plans are created for clinical trials that incorporate the design needed to prove the added value and unique clinical utility of these novel approaches, any theoretical benefit of these more elaborate methods could remain unfulfilled.
Collapse
Affiliation(s)
- C Carl Jaffe
- Diagnostic Imaging Branch, Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|