1
|
Xie L, Xu Y, Zheng M, Chen Y, Sun M, Archer MA, Mao W, Tong Y, Wan Y. An anthropomorphic diagnosis system of pulmonary nodules using weak annotation-based deep learning. Comput Med Imaging Graph 2024; 118:102438. [PMID: 39426342 DOI: 10.1016/j.compmedimag.2024.102438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Revised: 09/18/2024] [Accepted: 09/19/2024] [Indexed: 10/21/2024]
Abstract
The accurate categorization of lung nodules in CT scans is an essential aspect in the prompt detection and diagnosis of lung cancer. The categorization of grade and texture for nodules is particularly significant since it can aid radiologists and clinicians to make better-informed decisions concerning the management of nodules. However, currently existing nodule classification techniques have a singular function of nodule classification and rely on an extensive amount of high-quality annotation data, which does not meet the requirements of clinical practice. To address this issue, we develop an anthropomorphic diagnosis system of pulmonary nodules (PN) based on deep learning (DL) that is trained by weak annotation data and has comparable performance to full-annotation based diagnosis systems. The proposed system uses DL models to classify PNs (benign vs. malignant) with weak annotations, which eliminates the need for time-consuming and labor-intensive manual annotations of PNs. Moreover, the PN classification networks, augmented with handcrafted shape features acquired through the ball-scale transform technique, demonstrate capability to differentiate PNs with diverse labels, including pure ground-glass opacities, part-solid nodules, and solid nodules. Through 5-fold cross-validation on two datasets, the system achieved the following results: (1) an Area Under Curve (AUC) of 0.938 for PN localization and an AUC of 0.912 for PN differential diagnosis on the LIDC-IDRI dataset of 814 testing cases, (2) an AUC of 0.943 for PN localization and an AUC of 0.815 for PN differential diagnosis on the in-house dataset of 822 testing cases. In summary, our system demonstrates efficient localization and differential diagnosis of PNs in a resource limited environment, and thus could be translated into clinical use in the future.
Collapse
Affiliation(s)
- Lipeng Xie
- School of Cyber Science and Engineering, Zhengzhou University, Zhengzhou, China
| | - Yongrui Xu
- Department of Cardio-thoracic Surgery, Nanjing Medical University Affiliated Wuxi People's Hospital, Wuxi, Jiangsu, China; Nanjing Medical University, Nanjing, Jiangsu, China
| | - Mingfeng Zheng
- Department of Cardio-thoracic Surgery, Nanjing Medical University Affiliated Wuxi People's Hospital, Wuxi, Jiangsu, China; Nanjing Medical University, Nanjing, Jiangsu, China
| | - Yundi Chen
- Department of Biomedical Engineering, Binghamton University, Binghamton, NY, USA
| | - Min Sun
- Division of Oncology, University of Pittsburgh Medical Center Hillman Cancer Center at St. Margaret, Pittsburgh, PA, USA
| | - Michael A Archer
- Division of Thoracic Surgery, SUNY Upstate Medical University, USA
| | - Wenjun Mao
- Department of Cardio-thoracic Surgery, Nanjing Medical University Affiliated Wuxi People's Hospital, Wuxi, Jiangsu, China; Nanjing Medical University, Nanjing, Jiangsu, China.
| | - Yubing Tong
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 602 Goddard building, 3710 Hamilton Walk, Philadelphia, PA 19104, USA.
| | - Yuan Wan
- Department of Biomedical Engineering, Binghamton University, Binghamton, NY, USA.
| |
Collapse
|
2
|
Li ZH, Wang RL, Lu M, Wang X, Huang YP, Yang JW, Zhang TY. A novel method for identifying aerobic granular sludge state using sorting, densification and clarification dynamics during the settling process. WATER RESEARCH 2024; 253:121336. [PMID: 38382291 DOI: 10.1016/j.watres.2024.121336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Revised: 01/22/2024] [Accepted: 02/17/2024] [Indexed: 02/23/2024]
Abstract
Aerobic granular sludge is one of the most promising biological wastewater treatment technologies, yet maintaining its stability is still a challenge for its application, and predicting the state of the granules is essential in addressing this issue. This study explored the potential of dynamic texture entropy, derived from settling images, as a predictive tool for the state of granular sludge. Three processes, traditional thickening, often overlooked clarification, and innovative particle sorting, were used to capture the complexity and diversity of granules. It was found that rapid sorting during settling indicates stable granules, which helps to identify the state of granules. Furthermore, a relationship between sorting time and granule heterogeneity was identified, helping to adjust selection pressure. Features of the dynamic texture entropy well correlated with the respirogram, i.e., R2 were 0.86 and 0.91 for the specific endogenous respiration rate (SOURe) and the specific quasi-endogenous respiration rate (SOURq), respectively, providing a biologically based approach for monitoring the state of granules. The classification accuracy of models using features of dynamic texture entropy as an input was greater than 0.90, significantly higher than the input of conventional features, demonstrating the significant advantage of this approach. These findings contributed to developing robust monitoring tools that facilitate the maintenance of stable granular sludge operations.
Collapse
Affiliation(s)
- Zhi-Hua Li
- Key Laboratory of Northwest Water Resource, Environment, and Ecology, MOE, School of Environmental and Municipal Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China; Xi'an Key Laboratory of Intelligent Equipment Technology for Environmental Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China.
| | - Ruo-Lan Wang
- Key Laboratory of Northwest Water Resource, Environment, and Ecology, MOE, School of Environmental and Municipal Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China; Xi'an Key Laboratory of Intelligent Equipment Technology for Environmental Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China
| | - Meng Lu
- Key Laboratory of Northwest Water Resource, Environment, and Ecology, MOE, School of Environmental and Municipal Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China; Xi'an Key Laboratory of Intelligent Equipment Technology for Environmental Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China
| | - Xin Wang
- Key Laboratory of Northwest Water Resource, Environment, and Ecology, MOE, School of Environmental and Municipal Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China; Xi'an Key Laboratory of Intelligent Equipment Technology for Environmental Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China
| | - Yong-Peng Huang
- Key Laboratory of Northwest Water Resource, Environment, and Ecology, MOE, School of Environmental and Municipal Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China; Xi'an Key Laboratory of Intelligent Equipment Technology for Environmental Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China
| | - Jia-Wei Yang
- Key Laboratory of Northwest Water Resource, Environment, and Ecology, MOE, School of Environmental and Municipal Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China; Xi'an Key Laboratory of Intelligent Equipment Technology for Environmental Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, China
| | - Tian-Yu Zhang
- Department of Mathematical Sciences, Montana State University, Bozeman, MT 59717, USA
| |
Collapse
|
3
|
Chang HH, Wu CZ, Gallogly AH. Pulmonary Nodule Classification Using a Multiview Residual Selective Kernel Network. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:347-362. [PMID: 38343233 DOI: 10.1007/s10278-023-00928-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 09/13/2023] [Accepted: 09/25/2023] [Indexed: 03/02/2024]
Abstract
Lung cancer is one of the leading causes of death worldwide and early detection is crucial to reduce the mortality. A reliable computer-aided diagnosis (CAD) system can help facilitate early detection of malignant nodules. Although existing methods provide adequate classification accuracy, there is still room for further improvement. This study is dedicated to investigating a new CAD scheme for predicting the malignant likelihood of lung nodules in computed tomography (CT) images in light of a deep learning strategy. Conceived from the residual learning and selective kernel, we investigated an efficient residual selective kernel (RSK) block to handle the diversity of lung nodules with various shapes and obscure structures. Founded on this RSK block, we established a multiview RSK network (MRSKNet), to which three anatomical planes in the axial, coronal, and sagittal directions were fed. To reinforce the classification efficiency, seven handcrafted texture features with a filter-like computation strategy were explored, among which the homogeneity (HOM) feature maps are combined with the corresponding intensity CT images for concatenation input, leading to an improved network architecture. Evaluated on the public benchmark Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) challenge database with ten-fold cross validation of binary classification, our experimental results indicated high area under receiver operating characteristic (AUC) and accuracy scores. A better compromise between recall and specificity was struck using the suggested concatenation strategy comparing to many state-of-the-art approaches. The proposed pulmonary nodule classification framework exhibited great efficacy and achieved a higher AUC of 0.9711. The association of handcrafted texture features with deep learning models is promising in advancing the classification performance. The developed pulmonary nodule CAD network architecture is of potential in facilitating the diagnosis of lung cancer for further image processing applications.
Collapse
Affiliation(s)
- Herng-Hua Chang
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, 1 Sec. 4 Roosevelt Road, Daan, Taipei, 10617, Taiwan.
| | - Cheng-Zhe Wu
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, 1 Sec. 4 Roosevelt Road, Daan, Taipei, 10617, Taiwan
| | - Audrey Haihong Gallogly
- Department of Radiation Oncology, Keck Medical School, University of Southern California, Los Angeles, CA, USA
| |
Collapse
|
4
|
Baidya Kayal E, Ganguly S, Sasi A, Sharma S, DS D, Saini M, Rangarajan K, Kandasamy D, Bakhshi S, Mehndiratta A. A proposed methodology for detecting the malignant potential of pulmonary nodules in sarcoma using computed tomographic imaging and artificial intelligence-based models. Front Oncol 2023; 13:1212526. [PMID: 37671060 PMCID: PMC10476362 DOI: 10.3389/fonc.2023.1212526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 07/31/2023] [Indexed: 09/07/2023] Open
Abstract
The presence of lung metastases in patients with primary malignancies is an important criterion for treatment management and prognostication. Computed tomography (CT) of the chest is the preferred method to detect lung metastasis. However, CT has limited efficacy in differentiating metastatic nodules from benign nodules (e.g., granulomas due to tuberculosis) especially at early stages (<5 mm). There is also a significant subjectivity associated in making this distinction, leading to frequent CT follow-ups and additional radiation exposure along with financial and emotional burden to the patients and family. Even 18F-fluoro-deoxyglucose positron emission technology-computed tomography (18F-FDG PET-CT) is not always confirmatory for this clinical problem. While pathological biopsy is the gold standard to demonstrate malignancy, invasive sampling of small lung nodules is often not clinically feasible. Currently, there is no non-invasive imaging technique that can reliably characterize lung metastases. The lung is one of the favored sites of metastasis in sarcomas. Hence, patients with sarcomas, especially from tuberculosis prevalent developing countries, can provide an ideal platform to develop a model to differentiate lung metastases from benign nodules. To overcome the lack of optimal specificity of CT scan in detecting pulmonary metastasis, a novel artificial intelligence (AI)-based protocol is proposed utilizing a combination of radiological and clinical biomarkers to identify lung nodules and characterize it as benign or metastasis. This protocol includes a retrospective cohort of nearly 2,000-2,250 sample nodules (from at least 450 patients) for training and testing and an ambispective cohort of nearly 500 nodules (from 100 patients; 50 patients each from the retrospective and prospective cohort) for validation. Ground-truth annotation of lung nodules will be performed using an in-house-built segmentation tool. Ground-truth labeling of lung nodules (metastatic/benign) will be performed based on histopathological results or baseline and/or follow-up radiological findings along with clinical outcome of the patient. Optimal methods for data handling and statistical analysis are included to develop a robust protocol for early detection and classification of pulmonary metastasis at baseline and at follow-up and identification of associated potential clinical and radiological markers.
Collapse
Affiliation(s)
- Esha Baidya Kayal
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Shuvadeep Ganguly
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Archana Sasi
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Swetambri Sharma
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Dheeksha DS
- Department of Radiodiagnosis, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Manish Saini
- Department of Radiodiagnosis, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Krithika Rangarajan
- Radiodiagnosis, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | | | - Sameer Bakhshi
- Medical Oncology, Dr. B.R.Ambedkar Institute Rotary Cancer Hospital, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Amit Mehndiratta
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
- Department of Biomedical Engineering, All India Institute of Medical Sciences, New Delhi, Delhi, India
| |
Collapse
|
5
|
M DL, M DP. An Improved Convolution Neural Network and Modified Regularized K-Means-Based Automatic Lung Nodule Detection and Classification. J Digit Imaging 2023; 36:1431-1446. [PMID: 37106212 PMCID: PMC10406790 DOI: 10.1007/s10278-023-00809-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 03/03/2023] [Accepted: 03/08/2023] [Indexed: 04/29/2023] Open
Abstract
If lung cancer is not detected in its initial phases, it can be fatal. However, because of the quantity and structure of its nodules, lung cancer is difficult to detect early. For accurate detections, radiologists require assistance from automated tools. Numerous expert methods have been created over time to assist radiologists in the diagnosis of lung cancer. However, this requires accurate research. Therefore, in this article, we propose a framework to precisely detect lung cancer by categorizing it between benign and malignant nodules. To achieve this objective, an efficient deep-learning algorithm is presented. The presented technique consists of four stages, namely pre-processing, segmentation, classification, and severity stage analysis. Initially, the collected image is given to the pre-processing stage to eliminate the distortion present in the image. Then, the noise-free image is given to the segmentation stage. For segmentation, in this paper, modified regularized K-means (MRKM) clustering algorithm is presented. After the segmentation process, the segmented nodule image is fed to the classification stage to categorize the nodule as benign or malignant (risk nodule). For classification, an improved convolution neural network (ICNN) is presented. The proposed ICNN is designed by modifying CNN with the integration of the adaptive tree seed optimization (ATSO) algorithm. Finally, the stage identification is carried out based on the size of the nodule and we classify the malignant nodule as S1-S4. The presented technique attained the maximum accuracy of 96.5% and performance compared with existing state-of-art methods.
Collapse
Affiliation(s)
- Dhasny Lydia M
- Department of Data Science and Business Systems, School of Computing, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu India
| | - Dr. Prakash M
- Department of Data Science and Business Systems, School of Computing, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu India
| |
Collapse
|
6
|
Saleem MA, Thien Le N, Asdornwised W, Chaitusaney S, Javeed A, Benjapolakul W. Sooty Tern Optimization Algorithm-Based Deep Learning Model for Diagnosing NSCLC Tumours. SENSORS (BASEL, SWITZERLAND) 2023; 23:2147. [PMID: 36850744 PMCID: PMC9959990 DOI: 10.3390/s23042147] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 02/05/2023] [Accepted: 02/08/2023] [Indexed: 06/18/2023]
Abstract
Lung cancer is one of the most common causes of cancer deaths in the modern world. Screening of lung nodules is essential for early recognition to facilitate treatment that improves the rate of patient rehabilitation. An increase in accuracy during lung cancer detection is vital for sustaining the rate of patient persistence, even though several research works have been conducted in this research domain. Moreover, the classical system fails to segment cancer cells of different sizes accurately and with excellent reliability. This paper proposes a sooty tern optimization algorithm-based deep learning (DL) model for diagnosing non-small cell lung cancer (NSCLC) tumours with increased accuracy. We discuss various algorithms for diagnosing models that adopt the Otsu segmentation method to perfectly isolate the lung nodules. Then, the sooty tern optimization algorithm (SHOA) is adopted for partitioning the cancer nodules by defining the best characteristics, which aids in improving diagnostic accuracy. It further utilizes a local binary pattern (LBP) for determining appropriate feature retrieval from the lung nodules. In addition, it adopts CNN and GRU-based classifiers for identifying whether the lung nodules are malignant or non-malignant depending on the features retrieved during the diagnosing process. The experimental results of this SHOA-optimized DNN model achieved an accuracy of 98.32%, better than the baseline schemes used for comparison.
Collapse
Affiliation(s)
- Muhammad Asim Saleem
- Center of Excellence in Artificial Intelligence, Machine Learning and Smart Grid Technology, Department of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand
| | - Ngoc Thien Le
- Center of Excellence in Artificial Intelligence, Machine Learning and Smart Grid Technology, Department of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand
| | - Widhyakorn Asdornwised
- Center of Excellence in Artificial Intelligence, Machine Learning and Smart Grid Technology, Department of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand
| | - Surachai Chaitusaney
- Center of Excellence in Artificial Intelligence, Machine Learning and Smart Grid Technology, Department of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand
| | - Ashir Javeed
- Aging Research Center, Karolinska Institutet, 171 65 Stockholm, Sweden
| | - Watit Benjapolakul
- Center of Excellence in Artificial Intelligence, Machine Learning and Smart Grid Technology, Department of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand
| |
Collapse
|
7
|
Texture Feature-Based Machine Learning Classification on MRI Image for Sepsis-Associated Encephalopathy Detection: A Pilot Study. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2023; 2023:6403556. [PMID: 36778786 PMCID: PMC9911249 DOI: 10.1155/2023/6403556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 12/21/2022] [Accepted: 12/26/2022] [Indexed: 02/05/2023]
Abstract
Objective The objective of this study was to assess the performance of combining MRI-based texture analysis with machine learning for differentiating sepsis-associated encephalopathy (SAE) from sepsis alone. Method Sixty-six MRI-T1WI images of an SAE patient and 125 images of patients with sepsis alone were collected. Frontal lobe, brain stem, hippocampus, and amygdala were selected as regions of interest (ROIs). 279 texture features of each ROI were obtained using MaZda software. After the dimension reduction, 30 highly discriminative features of each ROI were adopted to differentiate SAE from sepsis alone using the CatBoost model. Results The classification models of frontal, brain stem, hippocampus, and amygdala were constructed. The classification accuracy was above 0.83, and the area under the curve (AUC) exceeded 0.90 in the validation set. Conclusion The texture features differed between SAE patients and patients with sepsis alone in different anatomical locations, suggesting that MRI-based texture analysis with machine learning might be helpful in differentiating SAE from sepsis alone.
Collapse
|
8
|
Liang X, Kong Y, Shang H, Yang M, Lu W, Zeng Q, Zhang G, Ye X. Computed tomography findings, associated factors, and management of pulmonary nodules in 54,326 healthy individuals. J Cancer Res Ther 2022; 18:2041-2048. [PMID: 36647968 DOI: 10.4103/jcrt.jcrt_1586_22] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
Introduction To investigate the pulmonary nodules detected by low-dose computed tomography (LDCT), identified factors affecting the size and number of pulmonary nodules (single or multiple), and the pulmonary nodules diagnosed and management as lung cancer in healthy individuals. Methods A retrospective analysis was conducted on 54,326 healthy individuals who received chest LDCT screening. According to the results of screening, the detection rates of pulmonary nodules, grouped according to the size and number of pulmonary nodules (single or multiple), and the patients' gender, age, history of smoking, hypertension, and diabetes were statistically analyzed to determine the correlation between each factor and the characteristics of the nodules. The pulmonary nodules in healthy individuals diagnosed with lung cancer were managed with differently protocols. Results The detection rate of pulmonary nodules was 38.8% (21,055/54,326). The baseline demographic characteristics of patients with pulmonary nodules were: 58% male and 42% female patients, 25.7% smoking and 74.3% nonsmoking individuals, 40-60 years old accounted for 49%, 54.8% multiple nodules, and 45.2% single nodules, and ≤5-mm size accounted for 80.4%, 6-10 mm for 18.2%, and 11-30 mm for 1.4%. Multiple pulmonary nodules were more common in hypertensive patients. Diabetes is not an independent risk factor for several pulmonary nodules. Of all patients with lung nodules, 26 were diagnosed with lung cancer, accounting for 0.1% of all patients with pulmonary nodules, 0.6% with nodules ≥5 mm, and 2.2% with nodules ≥8 mm, respectively. Twenty-six patients with lung cancer were treated with surgical resection (57.7%), microwave ablation (MWA, 38.5%), and follow-up (3.8%). Conclusions LDCT was suitable for large-scale pulmonary nodules screening in healthy individuals, which was helpful for the early detection of suspicious lesions in the lung. In addition to surgical resection, MWA is an option for early lung cancer treatment.
Collapse
Affiliation(s)
- Xinyu Liang
- Department of Oncology, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, Shandong Key Laboratory of Rheumatic Disease and Translational Medicine, Shandong Lung Cancer Institute, No. 16766, Jingshi Road; Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong Province, China
| | - Yongmei Kong
- Shandong Second Provincial General Hospital, Jinan, Shandong Province, China
| | - Hui Shang
- Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong Province; Department of Radiology, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, No. 16766 Jingshi Road, Jinan, Shandong, China
| | - Mingxin Yang
- Department of Health Management, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, No. 16766, Jingshi Road, Jinan, Shandong Province, China
| | - Wenjing Lu
- Department of Oncology, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, Shandong Key Laboratory of Rheumatic Disease and Translational Medicine, Shandong Lung Cancer Institute, No. 16766, Jingshi Road; Shandong University of Traditional Chinese Medicine, Jinan, Shandong Province, China
| | - Qingshi Zeng
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, No. 16766 Jingshi Road, Jinan, Shandong, China
| | - Guang Zhang
- Department of Health Management, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, No. 16766, Jingshi Road, Jinan, Shandong Province, China
| | - Xin Ye
- Department of Oncology, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, Shandong Key Laboratory of Rheumatic Disease and Translational Medicine, Shandong Lung Cancer Institute, No. 16766, Jingshi Road, Jinan, Shandong Province, China
| |
Collapse
|
9
|
Hage Chehade A, Abdallah N, Marion JM, Oueidat M, Chauvet P. Lung and colon cancer classification using medical imaging: a feature engineering approach. Phys Eng Sci Med 2022; 45:729-746. [PMID: 35670909 DOI: 10.1007/s13246-022-01139-x] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Accepted: 05/03/2022] [Indexed: 12/24/2022]
Abstract
Lung and colon cancers lead to a significant portion of deaths. Their simultaneous occurrence is uncommon, however, in the absence of early diagnosis, the metastasis of cancer cells is very high between these two organs. Currently, histopathological diagnosis and appropriate treatment are the only way to improve the chances of survival and reduce cancer mortality. Using artificial intelligence in the histopathological diagnosis of colon and lung cancer can provide significant help to specialists in identifying cases of colon and lung cancers with less effort, time and cost. The objective of this study is to set up a computer-aided diagnostic system that can accurately classify five types of colon and lung tissues (two classes for colon cancer and three classes for lung cancer) by analyzing their histopathological images. Using machine learning, features engineering and image processing techniques, the six models XGBoost, SVM, RF, LDA, MLP and LightGBM were used to perform the classification of histopathological images of lung and colon cancers that were acquired from the LC25000 dataset. The main advantage of using machine learning models is that they allow a better interpretability of the classification model since they are based on feature engineering; however, deep learning models are black box networks whose working is very difficult to understand due to the complex network design. The acquired experimental results show that machine learning models give satisfactory results and are very precise in identifying classes of lung and colon cancer subtypes. The XGBoost model gave the best performance with an accuracy of 99% and a F1-score of 98.8%. The implementation and the development of this model will help healthcare specialists identify types of colon and lung cancers. The code will be available upon request.
Collapse
Affiliation(s)
| | - Nassib Abdallah
- LARIS, SFR MATHSTIC, Univ Angers, Angers, France.,LaTIM, INSERM, UMR 1101, Univ Brest, Brest, France
| | | | | | | |
Collapse
|
10
|
Fahmy D, Kandil H, Khelifi A, Yaghi M, Ghazal M, Sharafeldeen A, Mahmoud A, El-Baz A. How AI Can Help in the Diagnostic Dilemma of Pulmonary Nodules. Cancers (Basel) 2022; 14:cancers14071840. [PMID: 35406614 PMCID: PMC8997734 DOI: 10.3390/cancers14071840] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 03/29/2022] [Accepted: 03/30/2022] [Indexed: 02/04/2023] Open
Abstract
Simple Summary Pulmonary nodules are considered a sign of bronchogenic carcinoma, detecting them early will reduce their progression and can save lives. Lung cancer is the second most common type of cancer in both men and women. This manuscript discusses the current applications of artificial intelligence (AI) in lung segmentation as well as pulmonary nodule segmentation and classification using computed tomography (CT) scans, published in the last two decades, in addition to the limitations and future prospects in the field of AI. Abstract Pulmonary nodules are the precursors of bronchogenic carcinoma, its early detection facilitates early treatment which save a lot of lives. Unfortunately, pulmonary nodule detection and classification are liable to subjective variations with high rate of missing small cancerous lesions which opens the way for implementation of artificial intelligence (AI) and computer aided diagnosis (CAD) systems. The field of deep learning and neural networks is expanding every day with new models designed to overcome diagnostic problems and provide more applicable and simply used models. We aim in this review to briefly discuss the current applications of AI in lung segmentation, pulmonary nodule detection and classification.
Collapse
Affiliation(s)
- Dalia Fahmy
- Diagnostic Radiology Department, Mansoura University Hospital, Mansoura 35516, Egypt;
| | - Heba Kandil
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
- Information Technology Department, Faculty of Computers and Informatics, Mansoura University, Mansoura 35516, Egypt
| | - Adel Khelifi
- Computer Science and Information Technology Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates;
| | - Maha Yaghi
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (M.Y.); (M.G.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (M.Y.); (M.G.)
| | - Ahmed Sharafeldeen
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
| | - Ali Mahmoud
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
- Correspondence:
| |
Collapse
|
11
|
Martin SS, Kolaneci D, Wichmann JL, Lenga L, Leithner D, Vogl TJ, Jacobi V. Development and evaluation of a computer-based decision support system for diffuse lung diseases at high-resolution computed tomography. Acta Radiol 2022; 63:328-335. [PMID: 33657848 DOI: 10.1177/0284185121995799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND High-resolution computed tomography (HRCT) is essential in narrowing the possible differential diagnoses of diffuse and interstitial lung diseases. PURPOSE To investigate the value of a novel computer-based decision support system (CDSS) for facilitating diagnosis of diffuse lung diseases at HRCT. MATERIAL AND METHODS A CDSS was developed that includes about 100 different illustrations of the most common HRCT signs and patterns and describes the corresponding pathologies in detail. The logical set-up of the software facilitates a structured evaluation. By selecting one or more CT patterns, the program generates a ranked list of the most likely differential diagnoses. Three independent and blinded radiology residents initially evaluated 40 cases with different lung diseases alone; after at least 12 weeks, observers re-evaluated all cases using the CDSS. RESULTS In 40 patients, a total of 113 HRCT patterns were evaluated. The percentage of correctly classified patterns was higher with CDSS (96.8%) compared to assessment without CDSS (90.3%; P < 0.01). Moreover, the percentage of correct diagnosis (81.7% vs. 64.2%) and differential diagnoses (89.2% vs. 38.3%) were superior with CDSS compared to evaluation without CDSS (both P < 0.01). CONCLUSION Addition of a CDSS using a structured approach providing explanations of typical HRCT patterns and graphical illustrations significantly improved the performance of trainees in characterizing and correctly identifying diffuse lung diseases.
Collapse
Affiliation(s)
- Simon S Martin
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Delina Kolaneci
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Julian L Wichmann
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Lukas Lenga
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Doris Leithner
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Thomas J Vogl
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Volkmar Jacobi
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| |
Collapse
|
12
|
Deep Learning Applications in Computed Tomography Images for Pulmonary Nodule Detection and Diagnosis: A Review. Diagnostics (Basel) 2022; 12:diagnostics12020298. [PMID: 35204388 PMCID: PMC8871398 DOI: 10.3390/diagnostics12020298] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 01/21/2022] [Accepted: 01/22/2022] [Indexed: 12/26/2022] Open
Abstract
Lung cancer has one of the highest mortality rates of all cancers and poses a severe threat to people’s health. Therefore, diagnosing lung nodules at an early stage is crucial to improving patient survival rates. Numerous computer-aided diagnosis (CAD) systems have been developed to detect and classify such nodules in their early stages. Currently, CAD systems for pulmonary nodules comprise data acquisition, pre-processing, lung segmentation, nodule detection, false-positive reduction, segmentation, and classification. A number of review articles have considered various components of such systems, but this review focuses on segmentation and classification parts. Specifically, categorizing segmentation parts based on lung nodule type and network architectures, i.e., general neural network and multiview convolution neural network (CNN) architecture. Moreover, this work organizes related literature for classification of parts based on nodule or non-nodule and benign or malignant. The essential CT lung datasets and evaluation metrics used in the detection and diagnosis of lung nodules have been systematically summarized as well. Thus, this review provides a baseline understanding of the topic for interested readers.
Collapse
|
13
|
Improved cost-sensitive multikernel learning support vector machine algorithm based on particle swarm optimization in pulmonary nodule recognition. Soft comput 2022. [DOI: 10.1007/s00500-021-06718-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
AbstractIn the lung computer-aided detection (Lung CAD) system, the region of interest (ROI) of lung nodules has more false positives, making the imbalance between positive and negative (true positive and false positive) samples more likely to lead to misclassification of true positive nodules, a cost-sensitive multikernel learning support vector machine (CS-MKL-SVM) algorithm is proposed. Different penalty coefficients are assigned to positive and negative samples, so that the model can better learn the features of true positive nodules and improve the classification effect. To further improve the detection rate of pulmonary nodules and overall recognition accuracy, a score function named F-new based on the harmonic mean of accuracy (ACC) and sensitivity (SEN) is proposed as a fitness function for subsequent particle swarm optimization (PSO) parameter optimization, and a feasibility analysis of this function is performed. Compared with the fitness function that considers only accuracy or sensitivity, both the detection rate and the recognition accuracy of pulmonary nodules can be improved by this new algorithm. Compared with the grid search algorithm, using PSO for parameter search can reduce the model training time by nearly 20 times and achieve rapid parameter optimization. The maximum F-new obtained on the test set is 0.9357 for the proposed algorithm. When the maximum value of F-new is achieved, the corresponding recognition ACC is 91%, and SEN is 96.3%. Compared with the radial basis function in the single kernel, the F-new of the algorithm in this paper is 2.16% higher, ACC is 1.00% higher and SEN is equal. Compared with the polynomial kernel function in the single kernel, the F-new of the algorithm is 3.64% higher, ACC is 1.00% higher and SEN is 7.41% higher. The experimental results show that the F-new, ACC and SEN of the proposed algorithm is the best among them, and the results obtained by using multikernel function combined with F-new index are better than the single kernel function. Compared with the MKL-SVM algorithm of grid search, the ACC of the algorithm in this paper is reduced by 1%, and the results are equal to those of the MKL-SVM algorithm based on PSO only. Compared with the above two algorithms, SEN is increased by 3.71% and 7.41%, respectively. Therefore, it can be seen that the cost sensitive method can effectively reduce the missed detection of nodules, and the availability of the new algorithm can be further verified.
Collapse
|
14
|
Arumuga Maria Devi T, Mebin Jose VI. Three Stream Network Model for Lung Cancer Classification in the CT Images. OPEN COMPUTER SCIENCE 2021. [DOI: 10.1515/comp-2020-0145] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
Abstract
Lung cancer is considered to be one of the deadly diseases that threaten the survival of human beings. It is a challenging task to identify lung cancer in its early stage from the medical images because of the ambiguity in the lung regions. This paper proposes a new architecture to detect lung cancer obtained from the CT images. The proposed architecture has a three-stream network to extract the manual and automated features from the images. Among these three streams, automated feature extraction as well as the classification is done using residual deep neural network and custom deep neural network. Whereas the manual features are the handcrafted features obtained using high and low-frequency sub-bands in the frequency domain that are classified using a Support Vector Machine Classifier. This makes the architecture robust enough to capture all the important features required to classify lung cancer from the input image. Hence, there is no chance of missing feature information. Finally, all the obtained prediction scores are combined by weighted based fusion. The experimental results show 98.2% classification accuracy which is relatively higher in comparison to other existing methods.
Collapse
|
15
|
A novel technology to integrate imaging and clinical markers for non-invasive diagnosis of lung cancer. Sci Rep 2021; 11:4597. [PMID: 33633213 PMCID: PMC7907202 DOI: 10.1038/s41598-021-83907-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 02/09/2021] [Indexed: 12/17/2022] Open
Abstract
This study presents a non-invasive, automated, clinical diagnostic system for early diagnosis of lung cancer that integrates imaging data from a single computed tomography scan and breath bio-markers obtained from a single exhaled breath to quickly and accurately classify lung nodules. CT imaging and breath volatile organic compounds data were collected from 47 patients. Spherical Harmonics-based shape features to quantify the shape complexity of the pulmonary nodules, 7th-Order Markov Gibbs Random Field based appearance model to describe the spatial non-homogeneities in the pulmonary nodule, and volumetric features (size) of pulmonary nodules were calculated from CT images. 27 VOCs in exhaled breath were captured by a micro-reactor approach and quantied using mass spectrometry. CT and breath markers were input into a deep-learning autoencoder classifier with a leave-one-subject-out cross validation for nodule classification. To mitigate the limitation of a small sample size and validate the methodology for individual markers, retrospective CT scans from 467 patients with 727 pulmonary nodules, and breath samples from 504 patients were analyzed. The CAD system achieved 97.8% accuracy, 97.3% sensitivity, 100% specificity, and 99.1% area under curve in classifying pulmonary nodules.
Collapse
|
16
|
Wu M, Li Y, Fu B, Wang G, Chu Z, Deng D. Evaluate the performance of four artificial intelligence-aided diagnostic systems in identifying and measuring four types of pulmonary nodules. J Appl Clin Med Phys 2021; 22:318-326. [PMID: 33369008 PMCID: PMC7856495 DOI: 10.1002/acm2.13142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 10/19/2020] [Accepted: 12/04/2020] [Indexed: 12/19/2022] Open
Abstract
PURPOSE This study aims to evaluate the performance of four artificial intelligence-aided diagnostic systems in identifying and measuring four types of pulmonary nodules. METHODS Four types of nodules were implanted in a commercial lung phantom. The phantom was scanned with multislice spiral computed tomography, after which four systems (A, B, C, D) were used to identify the nodules and measure their volumes. RESULTS The relative volume error (RVE) of system A was the lowest for all nodules, except for small ground glass nodules (SGGNs). System C had the smallest RVE for SGGNs, -0.13 (-0.56, 0.00). In the Bland-Altman test, only systems A and C passed the consistency test, P = 0.40. In terms of precision, the miss rate (MR) of system C was 0.00% for small solid nodules (SSNs), ground glass nodules (GGNs), and solid nodules (SNs) but 4.17% for SGGNs. The comparable system D MRs for SGGNs, SSNs, and GGNs were 71.30%, 25.93%, and 47.22%, respectively, the highest among all the systems. Receiver operating characteristic curve analysis indicated that system A had the best performance in recognizing SSNs and GGNs, with areas under the curve of 0.91 and 0.68. System C had the best performance for SGGNs (AUC = 0.91). CONCLUSION Among four types nodules, SGGNs are the most difficult to recognize, indicating the need to improve higher accuracy and precision of artificial systems. System A most accurately measured nodule volume. System C was most precise in recognizing all four types of nodules, especially SGGN.
Collapse
Affiliation(s)
- Ming‐yue Wu
- School of Public Health and ManagementChongqing Medical UniversityChongqingChina
| | - Yong Li
- Department of RadiologyThe First Affiliated Hospital of Chongqing Medical UniversityChongqingChina
| | - Bin‐jie Fu
- Department of RadiologyThe First Affiliated Hospital of Chongqing Medical UniversityChongqingChina
| | - Guo‐shu Wang
- Department of RadiologyThe First Affiliated Hospital of Chongqing Medical UniversityChongqingChina
| | - Zhi‐gang Chu
- Department of RadiologyThe First Affiliated Hospital of Chongqing Medical UniversityChongqingChina
| | - Dan Deng
- School of Public Health and ManagementChongqing Medical UniversityChongqingChina
| |
Collapse
|
17
|
Ziyad SR, Radha V, Vayyapuri T. Overview of Computer Aided Detection and Computer Aided Diagnosis Systems for Lung Nodule Detection in Computed Tomography. Curr Med Imaging 2020; 16:16-26. [PMID: 31989890 DOI: 10.2174/1573405615666190206153321] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2018] [Revised: 01/02/2019] [Accepted: 01/10/2019] [Indexed: 11/22/2022]
Abstract
BACKGROUND Lung cancer has become a major cause of cancer-related deaths. Detection of potentially malignant lung nodules is essential for the early diagnosis and clinical management of lung cancer. In clinical practice, the interpretation of Computed Tomography (CT) images is challenging for radiologists due to a large number of cases. There is a high rate of false positives in the manual findings. Computer aided detection system (CAD) and computer aided diagnosis systems (CADx) enhance the radiologists in accurately delineating the lung nodules. OBJECTIVES The objective is to analyze CAD and CADx systems for lung nodule detection. It is necessary to review the various techniques followed in CAD and CADx systems proposed and implemented by various research persons. This study aims at analyzing the recent application of various concepts in computer science to each stage of CAD and CADx. METHODS This review paper is special in its own kind because it analyses the various techniques proposed by different eminent researchers in noise removal, contrast enhancement, thorax removal, lung segmentation, bone suppression, segmentation of trachea, classification of nodule and nonnodule and final classification of benign and malignant nodules. RESULTS A comparison of the performance of different techniques implemented by various researchers for the classification of nodule and non-nodule has been tabulated in the paper. CONCLUSION The findings of this review paper will definitely prove to be useful to the research community working on automation of lung nodule detection.
Collapse
Affiliation(s)
- Shabana Rasheed Ziyad
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin AbdulAziz University, Al Kharj, Saudi Arabia
| | - Venkatachalam Radha
- Department of Computer Science, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, India
| | - Thavavel Vayyapuri
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin AbdulAziz University, Al Kharj, Saudi Arabia
| |
Collapse
|
18
|
Lo Vercio L, Amador K, Bannister JJ, Crites S, Gutierrez A, MacDonald ME, Moore J, Mouches P, Rajasheka D, Schimert S, Subbanna N, Tuladhar A, Wang N, Wilms M, Winder A, Forkert ND. Supervised machine learning tools: a tutorial for clinicians. J Neural Eng 2020; 17. [PMID: 33036008 DOI: 10.1088/1741-2552/abbff2] [Citation(s) in RCA: 60] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 10/09/2020] [Indexed: 12/13/2022]
Abstract
In an increasingly data-driven world, artificial intelligence is expected to be a key tool for converting big data into tangible benefits and the healthcare domain is no exception to this. Machine learning aims to identify complex patterns in multi-dimensional data and use these uncovered patterns to classify new unseen cases or make data-driven predictions. In recent years, deep neural networks have shown to be capable of producing results that considerably exceed those of conventional machine learning methods for various classification and regression tasks. In this paper, we provide an accessible tutorial of the most important supervised machine learning concepts and methods, including deep learning, which are potentially the most relevant for the medical domain. We aim to take some of the mystery out of machine learning and depict how machine learning models can be useful for medical applications. Finally, this tutorial provides a few practical suggestions for how to properly design a machine learning model for a generic medical problem.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Jasmine Moore
- Radiology, University of Calgary, Calgary, Alberta, CANADA
| | | | | | | | | | - Anup Tuladhar
- Radiology, University of Calgary, Calgary, Alberta, CANADA
| | - Nanjia Wang
- Radiology, University of Calgary, Calgary, Alberta, CANADA
| | - Matthias Wilms
- Radiology, University of Calgary, Calgary, Alberta, CANADA
| | - Anthony Winder
- Radiology, University of Calgary, Calgary, Alberta, CANADA
| | - Nils Daniel Forkert
- Radiology, University of Calgary, 3330 Hospital Drive NW, Calgary, Alberta, T2N 1N4, CANADA
| |
Collapse
|
19
|
ROI-based feature learning for efficient true positive prediction using convolutional neural network for lung cancer diagnosis. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-04787-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
20
|
Amaral JLM, Sancho AG, Faria ACD, Lopes AJ, Melo PL. Differential diagnosis of asthma and restrictive respiratory diseases by combining forced oscillation measurements, machine learning and neuro-fuzzy classifiers. Med Biol Eng Comput 2020; 58:2455-2473. [PMID: 32776208 DOI: 10.1007/s11517-020-02240-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2020] [Accepted: 07/26/2020] [Indexed: 01/30/2023]
Abstract
To design machine learning classifiers to facilitate the clinical use and increase the accuracy of the forced oscillation technique (FOT) in the differential diagnosis of patients with asthma and restrictive respiratory diseases. FOT and spirometric exams were performed in 97 individuals, including controls (n = 20), asthmatic patients (n = 38), and restrictive (n = 39) patients. The first experiment of this study showed that the best FOT parameter was the resonance frequency, providing moderate accuracy (AUC = 0.87). In the second experiment, a neuro-fuzzy classifier and different supervised machine learning techniques were investigated, including k-nearest neighbors, random forests, AdaBoost with decision trees, and support vector machines with a radial basis kernel. All classifiers achieved high accuracy (AUC ≥ 0.9) in the differentiation between patient groups. In the third and fourth experiments, the use of different feature selection techniques allowed us to achieve high accuracy with only three FOT parameters. In addition, the neuro-fuzzy classifier also provided rules to explain the classification. Neuro-fuzzy and machine learning classifiers can aid in the differential diagnosis of patients with asthma and restrictive respiratory diseases. They can assist clinicians as a support system providing accurate diagnostic options.
Collapse
Affiliation(s)
- Jorge L M Amaral
- Department of Electronics and Telecommunications Engineering, State University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Alexandre G Sancho
- Biomedical Instrumentation Laboratory, Institute of Biology Roberto Alcantara Gomes and Laboratory of Clinical and Experimental Research in Vascular Biology, State University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Alvaro C D Faria
- Biomedical Instrumentation Laboratory, Institute of Biology Roberto Alcantara Gomes and Laboratory of Clinical and Experimental Research in Vascular Biology, State University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Agnaldo J Lopes
- Pulmonary Function Laboratory, Pedro Ernesto University Hospital, State University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Pedro L Melo
- Biomedical Instrumentation Laboratory, Institute of Biology Roberto Alcantara Gomes and Laboratory of Clinical and Experimental Research in Vascular Biology, State University of Rio de Janeiro, Rio de Janeiro, Brazil.
| |
Collapse
|
21
|
Afzali A, Babapour Mofrad F, Pouladian M. Contour-based lung shape analysis in order to tuberculosis detection: modeling and feature description. Med Biol Eng Comput 2020; 58:1965-1986. [PMID: 32572669 DOI: 10.1007/s11517-020-02192-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2019] [Accepted: 05/18/2020] [Indexed: 11/26/2022]
Abstract
Statistical shape analysis of lung is a reliable alternative method for diagnosing pulmonary diseases such as tuberculosis (TB). The 2D contour-based lung shape analysis is investigated and developed using Fourier descriptors (FDs). The proposed 2D lung shape analysis is carried out in threefold: (1) represent the normal and the abnormal (i.e. pulmonary tuberculosis (PTB)) lung shape models using Fourier descriptors modeling (FDM) framework from chest X-ray (CXR) images, (2) estimate and compare the 2D inter-patient lung shape variations for the normal and abnormal lungs by applying principal component analysis (PCA) techniques, and (3) describe the optimal type of contour-based feature vectors to train a classifier in order to detect TB using one publicly available dataset-namely the Montgomery dataset. Since almost all of the previous works in lung shape analysis are content-based analysis, we proposed contour-based lung shape analysis for statistical modeling and feature description of PTB cases. The results show that the proposed approach is able to explain more than 95% of total variations in both of the normal and PTB cases using only 6 and 7 principal component modes for the right and the left lungs, respectively. In case of PTB detection, using 138 lung cases (80 normal and 58 PTB cases), we achieved the accuracy (ACC) and the area under the curve (AUC) of 82.03% and 88.75%, respectively. In comparison with existing state-of-art studies in the same dataset, the proposed approach is a very promising supplement for diagnosis of PTB disease. The method is robust and valuable for application in 2D automatic segmentation, classification, and atlas registration. Moreover, the approach could be used for any kind of pulmonary diseases. Graphical abstract Contour-based lung shape analysis in order to detect tuberculosis: modeling and feature description.
Collapse
Affiliation(s)
- Ali Afzali
- Department of Medical Radiation Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Farshid Babapour Mofrad
- Department of Medical Radiation Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran.
| | - Majid Pouladian
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| |
Collapse
|
22
|
Shakir H, Rasheed H, Rasool Khan TM. Radiomic feature selection for lung cancer classifiers. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2020. [DOI: 10.3233/jifs-179672] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Hina Shakir
- Department of Electrical Engineering, Bahria University, Karachi, Pakistan
| | - Haroon Rasheed
- Department of Electrical Engineering, Bahria University, Karachi, Pakistan
| | - Tariq Mairaj Rasool Khan
- Department of Electrical and Power Engineering, PNEC, National University of Science and Technology, Pakistan
| |
Collapse
|
23
|
An Efficient Content-Based Image Retrieval System for the Diagnosis of Lung Diseases. J Digit Imaging 2020; 33:971-987. [PMID: 32399717 DOI: 10.1007/s10278-020-00338-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022] Open
Abstract
The main problem in content-based image retrieval (CBIR) systems is the semantic gap which needs to be reduced for efficient retrieval. The common imaging signs (CISs) which appear in the patient's lung CT scan play a significant role in the identification of cancerous lung nodules and many other lung diseases. In this paper, we propose a new combination of descriptors for the effective retrieval of these imaging signs. First, we construct a feature database by combining local ternary pattern (LTP), local phase quantization (LPQ), and discrete wavelet transform. Next, joint mutual information (JMI)-based feature selection is deployed to reduce the redundancy and to select an optimal feature set for CISs retrieval. To this end, similarity measurement is performed by combining visual and semantic information in equal proportion to construct a balanced graph and the shortest path is computed for learning contextual similarity to obtain final similarity between each query and database image. The proposed system is evaluated on a publicly available database of lung CT imaging signs (LISS), and results are retrieved based on visual feature similarity comparison and graph-based similarity comparison. The proposed system achieves a mean average precision (MAP) of 60% and 0.48 AUC of precision-recall (P-R) graph using only visual features similarity comparison. These results further improve on graph-based similarity measure with a MAP of 70% and 0.58 AUC which shows the superiority of our proposed scheme.
Collapse
|
24
|
Zhang G, Yang Z, Gong L, Jiang S, Wang L, Zhang H. Classification of lung nodules based on CT images using squeeze-and-excitation network and aggregated residual transformations. Radiol Med 2020; 125:374-383. [PMID: 31916105 DOI: 10.1007/s11547-019-01130-9] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2019] [Accepted: 12/27/2019] [Indexed: 12/19/2022]
Abstract
Lung cancer is pointed as a leading cause of cancer death worldwide. Early lung nodule diagnosis has great significance for treating lung cancer and increasing patient survival. In this paper, we present a novel method to classify the malignant from benign lung nodules based on CT images using squeeze-and-excitation network and aggregated residual transformations (SE-ResNeXt). The state-of-the-art SE-ResNeXt module, which integrates the advantages of SENet for feature recalibration and ResNeXt for feature reuse, has great ability in boosting feature discriminability on imaging pattern recognition. The method is evaluated on the public available LUng Nodule Analysis 2016 (LUNA16) database with 1004 (450 malignant and 554 benign) nodules, achieving an area under the receiver operating characteristic curve (AUC) of 0. 9563 and accuracy of 91.67%. The promising results demonstrate that our method has strong robustness in the classification of nodules. The method has the potential to help radiologists better interpret diagnostic data and differentiate the benign from malignant lung nodules on CT images in clinical practice. To our best knowledge, the effectiveness of SE-ResNeXt on lung nodule classification has not been extensively explored.
Collapse
Affiliation(s)
- Guobin Zhang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Zhiyong Yang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Li Gong
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Shan Jiang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China. .,Centre for Advanced Mechanisms and Robotics, Tianjin University, 135 Yaguan Road, Jinnan District, Tianjin, 300350, China.
| | - Lu Wang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Hongyun Zhang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| |
Collapse
|
25
|
Wei G, Qiu M, Zhang K, Li M, Wei D, Li Y, Liu P, Cao H, Xing M, Yang F. A multi-feature image retrieval scheme for pulmonary nodule diagnosis. Medicine (Baltimore) 2020; 99:e18724. [PMID: 31977863 PMCID: PMC7004710 DOI: 10.1097/md.0000000000018724] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
Deep analysis of radiographic images can quantify the extent of intra-tumoral heterogeneity for personalized medicine.In this paper, we propose a novel content-based multi-feature image retrieval (CBMFIR) scheme to discriminate pulmonary nodules benign or malignant. Two types of features are applied to represent the pulmonary nodules. With each type of features, a single-feature distance metric model is proposed to measure the similarity of pulmonary nodules. And then, multiple single-feature distance metric models learned from different types of features are combined to a multi-feature distance metric model. Finally, the learned multi-feature distance metric is used to construct a content-based image retrieval (CBIR) scheme to assist the doctors in diagnosis of pulmonary nodules. The classification accuracy and retrieval accuracy are used to evaluate the performance of the scheme.The classification accuracy is 0.955 ± 0.010, and the retrieval accuracies outperform the comparison methods.The proposed CBMFIR scheme is effective in diagnosis of pulmonary nodules. Our method can better integrate multiple types of features from pulmonary nodules.
Collapse
Affiliation(s)
- Guohui Wei
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
- Shandong Provincial Key Laboratory for Distributed Computer Software Novel Technology, Jinan, China
| | - Min Qiu
- Affiliated Hospital of Jining Medical University
| | - Kuixing Zhang
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| | - Ming Li
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| | - Dejian Wei
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| | - Yanjun Li
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| | - Peiyu Liu
- Shandong Provincial Key Laboratory for Distributed Computer Software Novel Technology, Jinan, China
| | - Hui Cao
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| | - Mengmeng Xing
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| | - Feng Yang
- School of Science and Engineering, Shandong University of Traditional Chinese Medicine
| |
Collapse
|
26
|
Decision Support System for Lung Cancer Using PET/CT and Microscopic Images. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2020; 1213:73-94. [DOI: 10.1007/978-3-030-33128-3_5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
27
|
Wang Q, Shen F, Shen L, Huang J, Sheng W. Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network. J Digit Imaging 2019; 32:971-979. [PMID: 31062113 PMCID: PMC6841817 DOI: 10.1007/s10278-019-00221-3] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Remarkable progress has been made in image classification and segmentation, due to the recent study of deep convolutional neural networks (CNNs). To solve the similar problem of diagnostic lung nodule detection in low-dose computed tomography (CT) scans, we propose a new Computer-Aided Detection (CAD) system using CNNs and CT image segmentation techniques. Unlike former studies focusing on the classification of malignant nodule types or relying on prior image processing, in this work, we put raw CT image patches directly in CNNs to reduce the complexity of the system. Specifically, we split each CT image into several patches, which are divided into 6 types consisting of 3 nodule types and 3 non-nodule types. We compare the performance of ResNet with different CNNs architectures on CT images from a publicly available dataset named the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI). Results show that our best model reaches a high detection sensitivity of 92.8% with 8 false positives per scan (FPs/scan). Compared with related work, our work obtains a state-of-the-art effect.
Collapse
Affiliation(s)
- Qin Wang
- Shanghai Jiao Tong University, Shanghai, 201100, China
| | - Fengyi Shen
- Shanghai Jiao Tong University, Shanghai, 201100, China
| | - Linyao Shen
- Shanghai Jiao Tong University, Shanghai, 201100, China
| | - Jia Huang
- Shanghai Chest Hospital, Shanghai, 200030, China
| | | |
Collapse
|
28
|
Huang W, Xue Y, Wu Y. A CAD system for pulmonary nodule prediction based on deep three-dimensional convolutional neural networks and ensemble learning. PLoS One 2019; 14:e0219369. [PMID: 31299053 PMCID: PMC6625700 DOI: 10.1371/journal.pone.0219369] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2018] [Accepted: 06/21/2019] [Indexed: 01/08/2023] Open
Abstract
Background Detection of pulmonary nodules is an important aspect of an automatic detection system. Incomputer-aided diagnosis (CAD) systems, the ability to detect pulmonary nodules is highly important, which plays an important role in the diagnosis and early treatment of lung cancer. Currently, the detection of pulmonary nodules depends mainly on doctor experience, which varies. This paper aims to address the challenge of pulmonary nodule detection more effectively. Methods A method for detecting pulmonary nodules based on an improved neural network is presented in this paper. Nodules are clusters of tissue with a diameter of 3 mm to 30 mm in the pulmonary parenchyma. Because pulmonary nodules are similar to other lung structures and have a low density, false positive nodules often occur. Thus, our team proposed an improved convolutional neural network (CNN) framework to detect nodules. First, a nonsharpening mask is used to enhance the nodules in computed tomography (CT) images; then, CT images of 512×512 pixels are segmented into smaller images of 96×96 pixels. Second, in the 96×96 pixel images which contain or exclude pulmonary nodules, the plaques corresponding to positive and negative samples are segmented. Third, CT images segmented into 96×96 pixels are down-sampled to 64×64 and 32×32 size respectively. Fourth, an improved fusion neural network structure is constructed that consists of three three-dimensional convolutional neural networks, designated as CNN-1, CNN-2, and CNN-3, to detect false positive pulmonary nodules. The networks’ input sizes are 32×32×32, 64×64×64, and 96×96×96 and include 5, 7, and 9 layers, respectively. Finally, we use the AdaBoost classifier to fuse the results of CNN-1, CNN-2, and CNN-3. We call this new neural network framework the Amalgamated-Convolutional Neural Network (A-CNN) and use it to detect pulmonary nodules. Findings Our team trained A-CNN using the LUNA16 and Ali Tianchi datasets and evaluated its performance using the LUNA16 dataset. We discarded nodules less than 5mm in diameter. When the average number of false positives per scan was 0.125 and 0.25, the sensitivity of A-CNN reached as high as 81.7% and 85.1%, respectively.
Collapse
Affiliation(s)
- Wenkai Huang
- Center for Research on Leading Technology of Special Equipment, School of Mechanical & Electrical Engineering, Guangzhou University, Guangzhou, P.R. China
| | - Yihao Xue
- School of Mechanical & Electrical Engineering, Guangzhou University, Guangzhou, P.R. China
| | - Yu Wu
- Laboratory Center, Guangzhou University, Guangzhou, P.R. China
- * E-mail:
| |
Collapse
|
29
|
Gao M, Jiang H, Zhang D, Ma H, Qian W. Quantitative pathologic analysis of pulmonary nodules using three-dimensional computed tomography images based on latent Dirichlet allocation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2019:6255-6258. [PMID: 31947272 DOI: 10.1109/embc.2019.8856964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The main purpose of this paper is to quantificationally predict the pathologic characteristics of pulmonary nodules using a novel and effective computer assisted diagnosis (CADx) scheme based on latent Dirichlet allocation (LDA) model. To make use of LDA model, we propose a novel 3D rotation invariant LBP feature to construct image words through the K-means algorithm from 3D pulmonary nodule slices. A topic distribution for each pulmonary nodule can be acquired by well-trained LDA model, which was used for pathologic analysis based on rank-based statistical analysis. Using the LIDC/IDRI database, this study made experiments based on different parameters, including topic number and size of vocabulary. Experiments demonstrate that the performance of all the characteristics reached to accuracies of more than 80%. Especially, this study obtained an accuracy of 84.2% with the root mean square error (RMSE) of 1.068 on quantitative assessment of malignancy likelihood. Compared with the latest study of multi-task convolutional neutral network regression, the proposed method can obtain more accurate results of characteristic prediction of a pulmonary nodule.
Collapse
|
30
|
S R SC, Rajaguru H. Lung Cancer Detection using Probabilistic Neural Network with modified Crow-Search Algorithm. Asian Pac J Cancer Prev 2019; 20:2159-2166. [PMID: 31350980 PMCID: PMC6745229 DOI: 10.31557/apjcp.2019.20.7.2159] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2019] [Accepted: 07/09/2019] [Indexed: 02/06/2023] Open
Abstract
Objective: Lung cancer is a type of malignancy that occurs most commonly among men and the third most common type of malignancy among women. The timely recognition of lung cancer is necessary for decreasing the effect of death rate worldwide. Since the symptoms of lung cancer are identified only at an advanced stage, it is essential to predict the disease at its earlier stage using any medical imaging techniques. This work aims to propose a classification methodology for lung cancer automatically at the initial stage. Methods: The work adopts computed tomography (CT) imaging modality of lungs for the examination and probabilistic neural network (PNN) for the classification task. After pre-processing of the input lung images, feature extraction for the work is carried out based on the Gray-Level Co-Occurrence Matrix (GLCM) and chaotic crow search algorithm (CCSA) based feature selection is proposed. Results: Specificity, Sensitivity, Positive and Negative Predictive Values, Accuracy are the computation metrics used. The results indicate that the CCSA based feature selection effectively provides an accuracy of 90%. Conclusion: The strategy for the selection of appropriate extracted features is employed to improve the efficiency of classification and the work shows that the PNN with CCSA based feature selection gives an improved classification than without using CCSA for feature selection.
Collapse
Affiliation(s)
- Sannasi Chakravarthy S R
- Department of Electronics and Communication Engineering, Bannari Amman Institute of Technology, India.
| | - Harikumar Rajaguru
- Department of Electronics and Communication Engineering, Bannari Amman Institute of Technology, India.
| |
Collapse
|
31
|
Quantitative Imaging features Improve Discrimination of Malignancy in Pulmonary nodules. Sci Rep 2019; 9:8528. [PMID: 31189944 PMCID: PMC6561979 DOI: 10.1038/s41598-019-44562-z] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Accepted: 05/17/2019] [Indexed: 12/26/2022] Open
Abstract
Pulmonary nodules are frequently detected radiological abnormalities in lung cancer screening. Nodules of the highest- and lowest-risk for cancer are often easily diagnosed by a trained radiologist there is still a high rate of indeterminate pulmonary nodules (IPN) of unknown risk. Here, we test the hypothesis that computer extracted quantitative features (“radiomics”) can provide improved risk-assessment in the diagnostic setting. Nodules were segmented in 3D and 219 quantitative features are extracted from these volumes. Using these features novel malignancy risk predictors are formed with various stratifications based on size, shape and texture feature categories. We used images and data from the National Lung Screening Trial (NLST), curated a subset of 479 participants (244 for training and 235 for testing) that included incident lung cancers and nodule-positive controls. After removing redundant and non-reproducible features, optimal linear classifiers with area under the receiver operator characteristics (AUROC) curves were used with an exhaustive search approach to find a discriminant set of image features, which were validated in an independent test dataset. We identified several strong predictive models, using size and shape features the highest AUROC was 0.80. Using non-size based features the highest AUROC was 0.85. Combining features from all the categories, the highest AUROC were 0.83.
Collapse
|
32
|
Zhang G, Yang Z, Gong L, Jiang S, Wang L, Cao X, Wei L, Zhang H, Liu Z. An Appraisal of Nodule Diagnosis for Lung Cancer in CT Images. J Med Syst 2019; 43:181. [PMID: 31093830 DOI: 10.1007/s10916-019-1327-0] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2019] [Accepted: 05/08/2019] [Indexed: 12/17/2022]
Abstract
As "the second eyes" of radiologists, computer-aided diagnosis systems play a significant role in nodule detection and diagnosis for lung cancer. In this paper, we aim to provide a systematic survey of state-of-the-art techniques (both traditional techniques and deep learning techniques) for nodule diagnosis from computed tomography images. This review first introduces the current progress and the popular structure used for nodule diagnosis. In particular, we provide a detailed overview of the five major stages in the computer-aided diagnosis systems: data acquisition, nodule segmentation, feature extraction, feature selection and nodule classification. Second, we provide a detailed report of the selected works and make a comprehensive comparison between selected works. The selected papers are from the IEEE Xplore, Science Direct, PubMed, and Web of Science databases up to December 2018. Third, we discuss and summarize the better techniques used in nodule diagnosis and indicate the existing future challenges in this field, such as improving the area under the receiver operating characteristic curve and accuracy, developing new deep learning-based diagnosis techniques, building efficient feature sets (fusing traditional features and deep features), developing high-quality labeled databases with malignant and benign nodules and promoting the cooperation between medical organizations and academic institutions.
Collapse
Affiliation(s)
- Guobin Zhang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Zhiyong Yang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Li Gong
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Shan Jiang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China. .,Centre for advanced Mechanisms and Robotics, Tianjin University, 135 Yaguan Road, Jinnan District, Tianjin, 300350, China.
| | - Lu Wang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Xi Cao
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Lin Wei
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Hongyun Zhang
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| | - Ziqi Liu
- School of Mechanical Engineering, Tianjin University, Tianjin, 300350, China
| |
Collapse
|
33
|
Zhang Z, Sejdić E. Radiological images and machine learning: Trends, perspectives, and prospects. Comput Biol Med 2019; 108:354-370. [PMID: 31054502 PMCID: PMC6531364 DOI: 10.1016/j.compbiomed.2019.02.017] [Citation(s) in RCA: 77] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2018] [Revised: 02/19/2019] [Accepted: 02/19/2019] [Indexed: 01/18/2023]
Abstract
The application of machine learning to radiological images is an increasingly active research area that is expected to grow in the next five to ten years. Recent advances in machine learning have the potential to recognize and classify complex patterns from different radiological imaging modalities such as x-rays, computed tomography, magnetic resonance imaging and positron emission tomography imaging. In many applications, machine learning based systems have shown comparable performance to human decision-making. The applications of machine learning are the key ingredients of future clinical decision making and monitoring systems. This review covers the fundamental concepts behind various machine learning techniques and their applications in several radiological imaging areas, such as medical image segmentation, brain function studies and neurological disease diagnosis, as well as computer-aided systems, image registration, and content-based image retrieval systems. Synchronistically, we will briefly discuss current challenges and future directions regarding the application of machine learning in radiological imaging. By giving insight on how take advantage of machine learning powered applications, we expect that clinicians can prevent and diagnose diseases more accurately and efficiently.
Collapse
Affiliation(s)
- Zhenwei Zhang
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Ervin Sejdić
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA.
| |
Collapse
|
34
|
Khan SA, Nazir M, Khan MA, Saba T, Javed K, Rehman A, Akram T, Awais M. Lungs nodule detection framework from computed tomography images using support vector machine. Microsc Res Tech 2019; 82:1256-1266. [PMID: 30974031 DOI: 10.1002/jemt.23275] [Citation(s) in RCA: 63] [Impact Index Per Article: 12.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Revised: 02/21/2019] [Accepted: 03/31/2019] [Indexed: 11/11/2022]
Affiliation(s)
- Sajid A. Khan
- Department of Computer ScienceShaheed Zulfikar Ali Bhutto Institute of Science and Technology Islamabad Pakistan
- Department of Software EngineeringFoundation University Islamabad Pakistan
| | - Muhammad Nazir
- Department of CS & EHITEC University Taxila Cantonment Pakistan
| | | | - Tanzila Saba
- College of Computer and Information SciencesPrince Sultan University Riyadh Saudi Arabia
| | - Kashif Javed
- Department of RoboticsSMME NUST Islamabad Pakistan
| | - Amjad Rehman
- College of Business AdministrationAl Yamamah University Riyadh Saudi Arabia
| | - Tallha Akram
- Department of EECOMSATS University Islamabad, Wah Campus Islamabad Pakistan
| | - Muhammad Awais
- Department of EECOMSATS University Islamabad, Wah Campus Islamabad Pakistan
| |
Collapse
|
35
|
Khan SA, Hussain S, Yang S, Iqbal K. Effective and Reliable Framework for Lung Nodules Detection from CT Scan Images. Sci Rep 2019; 9:4989. [PMID: 30899052 PMCID: PMC6428823 DOI: 10.1038/s41598-019-41510-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 03/11/2019] [Indexed: 12/01/2022] Open
Abstract
Lung cancer is considered more serious among other prevailing cancer types. One of the reasons for it is that it is usually not diagnosed until it has spread and by that time it becomes very difficult to treat. Early detection of lung cancer can significantly increase the chances of survival of a cancer patient. An effective nodule detection system can play a key role in early detection of lung cancer thus increasing the chances of successful treatment. In this research work, we have proposed a novel classification framework for nodule classification. The framework consists of multiple phases that include image contrast enhancement, segmentation, optimal feature extraction, followed by employment of these features for training and testing of Support Vector Machine. We have empirically tested the efficacy of our technique by utilizing the well-known Lung Image Consortium Database (LIDC) dataset. The empirical results suggest that the technique is highly effective for reducing the false positive rates. We were able to receive an impressive sensitivity rate of 97.45%.
Collapse
Affiliation(s)
- Sajid Ali Khan
- Department of Software Engineering, Foundation University Islamabad, Islamabad, Pakistan.,Department of Computer Science, Shaheed Zulfikar Ali Bhutto Institute of Science and Technology, Islamabad, Pakistan
| | - Shariq Hussain
- Department of Software Engineering, Foundation University Islamabad, Islamabad, Pakistan
| | - Shunkun Yang
- School of Reliability and Systems Engineering, Beihang University, Beijing, China.
| | - Khalid Iqbal
- COMSATS University Islamabad, Attock Campus, Attock, Pakistan
| |
Collapse
|
36
|
Liu H, Jing B, Han W, Long Z, Mo X, Li H. A Comparative Texture Analysis Based on NECT and CECT Images to Differentiate Lung Adenocarcinoma from Squamous Cell Carcinoma. J Med Syst 2019; 43:59. [PMID: 30707369 DOI: 10.1007/s10916-019-1175-y] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2018] [Accepted: 01/21/2019] [Indexed: 12/22/2022]
Abstract
The purpose of the study was to compare the texture based discriminative performances between non-contrast enhanced computed tomography (NECT) and contrast-enhanced computed tomography (CECT) images in differentiating lung adenocarcinoma (ADC) from squamous cell carcinoma (SCC) patients. Eighty-seven lung cancer subjects were enrolled in the study, including pathologically proved 47 ADC patients and 40 SCC patients, and 261 texture features were extracted from the manually delineated region of interests on CECT and NECT images respectively. Fisher score was then used to select the effective discriminative texture features between groups, and the selected texture features were adopted to differentiate ADC from SCC using Support Vector Machine and Leave-one-out cross-validation. Both NECT and CECT images could achieve the same best classification accuracy of 95.4%, and most of the informative features were from the gray-level co-occurrence matrix. In addition, CECT images were found with enhanced texture features compared with NECT images, and combining texture features of CECT and NECT images together could further improve the prediction accuracy. Besides the texture feature, the tumor location information also contributed to the differential diagnosis between ADC and SCC.
Collapse
Affiliation(s)
- Han Liu
- School of Biomedical Engineering, Capital Medical University, Fengtai District, Beijing, 100069, China
| | - Bin Jing
- School of Biomedical Engineering, Capital Medical University, Fengtai District, Beijing, 100069, China
| | - Wenjuan Han
- Department of Radiology, the General Hospital of Chinese People's Armed Police Forces, Beijing, 100039, China
| | - Zhuqing Long
- School of Biomedical Engineering, Capital Medical University, Fengtai District, Beijing, 100069, China
| | - Xiao Mo
- School of Biomedical Engineering, Capital Medical University, Fengtai District, Beijing, 100069, China
| | - Haiyun Li
- School of Biomedical Engineering, Capital Medical University, Fengtai District, Beijing, 100069, China.
| |
Collapse
|
37
|
Wu W, Hu H, Gong J, Li X, Huang G, Nie S. Malignant-benign classification of pulmonary nodules based on random forest aided by clustering analysis. ACTA ACUST UNITED AC 2019; 64:035017. [DOI: 10.1088/1361-6560/aafab0] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
38
|
Onishi Y, Teramoto A, Tsujimoto M, Tsukamoto T, Saito K, Toyama H, Imaizumi K, Fujita H. Automated Pulmonary Nodule Classification in Computed Tomography Images Using a Deep Convolutional Neural Network Trained by Generative Adversarial Networks. BIOMED RESEARCH INTERNATIONAL 2019; 2019:6051939. [PMID: 30719445 PMCID: PMC6334309 DOI: 10.1155/2019/6051939] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Revised: 11/24/2018] [Accepted: 12/18/2018] [Indexed: 02/01/2023]
Abstract
Lung cancer is a leading cause of death worldwide. Although computed tomography (CT) examinations are frequently used for lung cancer diagnosis, it can be difficult to distinguish between benign and malignant pulmonary nodules on the basis of CT images alone. Therefore, a bronchoscopic biopsy may be conducted if malignancy is suspected following CT examinations. However, biopsies are highly invasive, and patients with benign nodules may undergo many unnecessary biopsies. To prevent this, an imaging diagnosis with high classification accuracy is essential. In this study, we investigate the automated classification of pulmonary nodules in CT images using a deep convolutional neural network (DCNN). We use generative adversarial networks (GANs) to generate additional images when only small amounts of data are available, which is a common problem in medical research, and evaluate whether the classification accuracy is improved by generating a large amount of new pulmonary nodule images using the GAN. Using the proposed method, CT images of 60 cases with confirmed pathological diagnosis by biopsy are analyzed. The benign nodules assessed in this study are difficult for radiologists to differentiate because they cannot be rejected as being malignant. A volume of interest centered on the pulmonary nodule is extracted from the CT images, and further images are created using axial sections and augmented data. The DCNN is trained using nodule images generated by the GAN and then fine-tuned using the actual nodule images to allow the DCNN to distinguish between benign and malignant nodules. This pretraining and fine-tuning process makes it possible to distinguish 66.7% of benign nodules and 93.9% of malignant nodules. These results indicate that the proposed method improves the classification accuracy by approximately 20% in comparison with training using only the original images.
Collapse
Affiliation(s)
- Yuya Onishi
- Graduate School of Health Sciences, Fujita Health University, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | - Atsushi Teramoto
- Graduate School of Health Sciences, Fujita Health University, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | - Masakazu Tsujimoto
- Fujita Health University Hospital, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | - Tetsuya Tsukamoto
- School of Medicine, Fujita Health University, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | - Kuniaki Saito
- Graduate School of Health Sciences, Fujita Health University, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | - Hiroshi Toyama
- School of Medicine, Fujita Health University, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | - Kazuyoshi Imaizumi
- School of Medicine, Fujita Health University, 1–98 Dengakugakubo, Kutsukake-cho, Toyoake City, Aichi 470-1192, Japan
| | | |
Collapse
|
39
|
Shariaty F, Mousavi M. Application of CAD systems for the automatic detection of lung nodules. INFORMATICS IN MEDICINE UNLOCKED 2019. [DOI: 10.1016/j.imu.2019.100173] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022] Open
|
40
|
Gong J, Liu J, Jiang Y, Sun X, Zheng B, Nie S. Fusion of quantitative imaging features and serum biomarkers to improve performance of computer‐aided diagnosis scheme for lung cancer: A preliminary study. Med Phys 2018; 45:5472-5481. [PMID: 30317652 DOI: 10.1002/mp.13237] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2018] [Revised: 10/03/2018] [Accepted: 10/03/2018] [Indexed: 12/19/2022] Open
Affiliation(s)
- Jing Gong
- School of Medical Instrument and Food Engineering University of Shanghai for Science and Technology 516 Jun Gong Road Shanghai 200093 China
- Department of Radiology Fudan University Shanghai Cancer Center 270 Dongan Road Shanghai 200032 China
| | - Ji‐yu Liu
- Radiology Department Shanghai Pulmonary Hospital 507 Zheng Min Road Shanghai 200433 China
| | - Yao‐jun Jiang
- Department of Radiology The First Affiliated Hospital of Zhengzhou University Zhengzhou 450052 China
| | - Xi‐wen Sun
- Radiology Department Shanghai Pulmonary Hospital 507 Zheng Min Road Shanghai 200433 China
| | - Bin Zheng
- School of Electrical and Computer Engineering University of Oklahoma Norman OK 73019 USA
| | - Sheng‐dong Nie
- School of Medical Instrument and Food Engineering University of Shanghai for Science and Technology 516 Jun Gong Road Shanghai 200093 China
| |
Collapse
|
41
|
Automatic nodule detection for lung cancer in CT images: A review. Comput Biol Med 2018; 103:287-300. [PMID: 30415174 DOI: 10.1016/j.compbiomed.2018.10.033] [Citation(s) in RCA: 57] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2018] [Revised: 10/29/2018] [Accepted: 10/29/2018] [Indexed: 12/18/2022]
Abstract
Automatic lung nodule detection has great significance for treating lung cancer and increasing patient survival. This work summarizes a critical review of recent techniques for automatic lung nodule detection in computed tomography images. This review indicates the current tendency and obtained progress as well as future challenges in this field. This research covered the databases including Web of Science, PubMed, and the Press, including IEEE Xplore and Science Direct, up to May 2018. Each part of the paper is summarized carefully in terms of the method and validation results for better comparison. Based on the results, some techniques show better performance for lung nodule detection. However, researchers should pay attention to the existing challenges, such as high sensitivity with a low false positive rate, large and different patient databases, developing or optimizing the detection technique of various types of lung nodules with different sizes, shapes, textures and locations, combining electronic medical records and picture archiving and communication systems, building efficient feature sets for better classification and promoting the cooperation and communication between academic institutions and medical organizations. We believe that automatic computer-aided detection systems will be developed with strong robustness, high efficiency and security assurance. This review will be helpful for professional researchers and radiologists to further learn about the latest techniques in computer-aided detection systems.
Collapse
|
42
|
Abstract
Lung cancer mortality is currently the highest among all kinds of fatal cancers. With the help of computer-aided detection systems, a timely detection of malignant pulmonary nodule at early stage could improve the patient survival rate efficiently. However, the sizes of the pulmonary nodules are usually various, and it is more difficult to detect small diameter nodules. The traditional convolution neural network uses pooling layers to reduce the resolution progressively, but it hampers the network’s ability to capture the tiny but vital features of the pulmonary nodules. To tackle this problem, we propose a novel 3D spatial pyramid dilated convolution network to classify the malignancy of the pulmonary nodules. Instead of using the pooling layers, we use 3D dilated convolution to learn the detailed characteristic information of the pulmonary nodules. Furthermore, we show that the fusion of multiple receptive fields from different dilated convolutions could further improve the classification performance of the model. Extensive experimental results demonstrate that our model achieves a better result with an accuracy of 88 . 6 % , which outperforms other state-of-the- art methods.
Collapse
|
43
|
Le V, Yang D, Zhu Y, Zheng B, Bai C, Shi H, Hu J, Zhai C, Lu S. Quantitative CT analysis of pulmonary nodules for lung adenocarcinoma risk classification based on an exponential weighted grey scale angular density distribution feature. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 160:141-151. [PMID: 29728241 DOI: 10.1016/j.cmpb.2018.04.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2017] [Revised: 02/21/2018] [Accepted: 04/02/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVES To improve lung nodule classification efficiency, we propose a lung nodule CT image characterization method. We propose a multi-directional feature extraction method to effectively represent nodules of different risk levels. The proposed feature combined with pattern recognition model to classify lung adenocarcinomas risk to four categories: Atypical Adenomatous Hyperplasia (AAH), Adenocarcinoma In Situ (AIS), Minimally Invasive Adenocarcinoma (MIA), and Invasive Adenocarcinoma (IA). METHODS First, we constructed the reference map using an integral image and labelled this map using a K-means approach. The density distribution map of the lung nodule image was generated after scanning all pixels in the nodule image. An exponential function was designed to weight the angular histogram for each component of the distribution map, and the features of the image were described. Then, quantitative measurement was performed using a Random Forest classifier. The evaluation data were obtained from the LIDC-IDRI database and the CT database which provided by Shanghai Zhongshan hospital (ZSDB). In the LIDC-IDRI, the nodules are categorized into three configurations with five ranks of malignancy ("1" to "5"). In the ZSDB, the nodule categories are AAH, AIS, MIA, and IA. RESULTS The average of Student's t-test p-values were less than 0.02. The AUCs for the LIDC-IDRI database were 0.9568, 0.9320, and 0.8288 for Configurations 1, 2, and 3, respectively. The AUCs for the ZSDB were 0.9771, 0.9917, 0.9590, and 0.9971 for AAH, AIS, MIA and IA, respectively. CONCLUSION The experimental results demonstrate that the proposed method outperforms the state-of-the-art and is robust for different lung CT image datasets.
Collapse
Affiliation(s)
- Vanbang Le
- School of Information Science and Engineering, East China University of Science and Technology, Shanghai, Postcode 200237, China
| | - Dawei Yang
- Department of Pulmonary Medicine, ZhongShan Hospital, Fudan University, Shanghai, Postcode 200032, China; Shanghai Respiratory Research Institute, Shanghai, Postcode 200032, China
| | - Yu Zhu
- School of Information Science and Engineering, East China University of Science and Technology, Shanghai, Postcode 200237, China.
| | - Bingbing Zheng
- School of Information Science and Engineering, East China University of Science and Technology, Shanghai, Postcode 200237, China.
| | - Chunxue Bai
- Department of Pulmonary Medicine, ZhongShan Hospital, Fudan University, Shanghai, Postcode 200032, China; Shanghai Respiratory Research Institute, Shanghai, Postcode 200032, China.
| | - Hongcheng Shi
- Department of Nuclear Medicine, ZhongShan Hospital, Fudan University, Shanghai, Postcode 200032, China.
| | - Jie Hu
- Department of Pulmonary Medicine, ZhongShan Hospital, Fudan University, Shanghai, Postcode 200032, China; Shanghai Respiratory Research Institute, Shanghai, Postcode 200032, China
| | - Changwen Zhai
- Department of Pathology, ZhongShan Hospital, Fudan University, Shanghai, Postcode 200032, China.
| | - Shaohua Lu
- Department of Pathology, ZhongShan Hospital, Fudan University, Shanghai, Postcode 200032, China
| |
Collapse
|
44
|
Pulmonary Nodule Recognition Based on Multiple Kernel Learning Support Vector Machine-PSO. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2018; 2018:1461470. [PMID: 29853983 PMCID: PMC5949190 DOI: 10.1155/2018/1461470] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2017] [Accepted: 03/12/2018] [Indexed: 11/30/2022]
Abstract
Pulmonary nodule recognition is the core module of lung CAD. The Support Vector Machine (SVM) algorithm has been widely used in pulmonary nodule recognition, and the algorithm of Multiple Kernel Learning Support Vector Machine (MKL-SVM) has achieved good results therein. Based on grid search, however, the MKL-SVM algorithm needs long optimization time in course of parameter optimization; also its identification accuracy depends on the fineness of grid. In the paper, swarm intelligence is introduced and the Particle Swarm Optimization (PSO) is combined with MKL-SVM algorithm to be MKL-SVM-PSO algorithm so as to realize global optimization of parameters rapidly. In order to obtain the global optimal solution, different inertia weights such as constant inertia weight, linear inertia weight, and nonlinear inertia weight are applied to pulmonary nodules recognition. The experimental results show that the model training time of the proposed MKL-SVM-PSO algorithm is only 1/7 of the training time of the MKL-SVM grid search algorithm, achieving better recognition effect. Moreover, Euclidean norm of normalized error vector is proposed to measure the proximity between the average fitness curve and the optimal fitness curve after convergence. Through statistical analysis of the average of 20 times operation results with different inertial weights, it can be seen that the dynamic inertial weight is superior to the constant inertia weight in the MKL-SVM-PSO algorithm. In the dynamic inertial weight algorithm, the parameter optimization time of nonlinear inertia weight is shorter; the average fitness value after convergence is much closer to the optimal fitness value, which is better than the linear inertial weight. Besides, a better nonlinear inertial weight is verified.
Collapse
|
45
|
Zia ur Rehman M, Javaid M, Shah SIA, Gilani SO, Jamil M, Butt SI. An appraisal of nodules detection techniques for lung cancer in CT images. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.11.017] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
46
|
Gupta A, Saar T, Martens O, Moullec YL. Automatic detection of multisize pulmonary nodules in CT images: Large-scale validation of the false-positive reduction step. Med Phys 2018; 45:1135-1149. [DOI: 10.1002/mp.12746] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 11/07/2017] [Accepted: 12/14/2017] [Indexed: 11/08/2022] Open
Affiliation(s)
- Anindya Gupta
- Thomas Johann Seebeck Department of Electronics; Tallinn University of Technology; Tallinn 19086 Estonia
| | - Tonis Saar
- Eliko Tehnoloogia Arenduskeskus OÜ; Tallinn 12618 and OÜ Tallinn 10143 Estonia
| | - Olev Martens
- Thomas Johann Seebeck Department of Electronics; Tallinn University of Technology; Tallinn 19086 Estonia
| | - Yannick Le Moullec
- Thomas Johann Seebeck Department of Electronics; Tallinn University of Technology; Tallinn 19086 Estonia
| |
Collapse
|
47
|
Shi L, He Y, Yuan Z, Benedict S, Valicenti R, Qiu J, Rong Y. Radiomics for Response and Outcome Assessment for Non-Small Cell Lung Cancer. Technol Cancer Res Treat 2018; 17:1533033818782788. [PMID: 29940810 PMCID: PMC6048673 DOI: 10.1177/1533033818782788] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 03/09/2018] [Accepted: 05/16/2018] [Indexed: 12/24/2022] Open
Abstract
Routine follow-up visits and radiographic imaging are required for outcome evaluation and tumor recurrence monitoring. Yet more personalized surveillance is required in order to sufficiently address the nature of heterogeneity in nonsmall cell lung cancer and possible recurrences upon completion of treatment. Radiomics, an emerging noninvasive technology using medical imaging analysis and data mining methodology, has been adopted to the area of cancer diagnostics in recent years. Its potential application in response assessment for cancer treatment has also drawn considerable attention. Radiomics seeks to extract a large amount of valuable information from patients' medical images (both pretreatment and follow-up images) and quantitatively correlate image features with diagnostic and therapeutic outcomes. Radiomics relies on computers to identify and analyze vast amounts of quantitative image features that were previously overlooked, unmanageable, or failed to be identified (and recorded) by human eyes. The research area has been focusing on the predictive accuracy of pretreatment features for outcome and response and the early discovery of signs of tumor response, recurrence, distant metastasis, radiation-induced lung injury, death, and other outcomes, respectively. This review summarized the application of radiomics in response assessments in radiotherapy and chemotherapy for non-small cell lung cancer, including image acquisition/reconstruction, region of interest definition/segmentation, feature extraction, and feature selection and classification. The literature search for references of this article includes PubMed peer-reviewed publications over the last 10 years on the topics of radiomics, textural features, radiotherapy, chemotherapy, lung cancer, and response assessment. Summary tables of radiomics in response assessment and treatment outcome prediction in radiation oncology have been developed based on the comprehensive review of the literature.
Collapse
Affiliation(s)
- Liting Shi
- Department of Radiology, Taishan Medical University, Tai’an, China
| | - Yaoyao He
- Department of Radiology, Taishan Medical University, Tai’an, China
| | - Zilong Yuan
- Department of Radiology, Hubei Cancer Hospital, Wuhan, China
| | - Stanley Benedict
- Department of Radiation Oncology, University of California Davis
Comprehensive Cancer Center, Sacramento, CA, USA
| | - Richard Valicenti
- Department of Radiation Oncology, University of California Davis
Comprehensive Cancer Center, Sacramento, CA, USA
| | - Jianfeng Qiu
- Department of Radiology, Taishan Medical University, Tai’an, China
| | - Yi Rong
- Department of Radiation Oncology, University of California Davis
Comprehensive Cancer Center, Sacramento, CA, USA
| |
Collapse
|
48
|
Content-based image retrieval for Lung Nodule Classification Using Texture Features and Learned Distance Metric. J Med Syst 2017; 42:13. [PMID: 29185058 DOI: 10.1007/s10916-017-0874-5] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2017] [Accepted: 11/22/2017] [Indexed: 10/18/2022]
Abstract
Similarity measurement of lung nodules is a critical component in content-based image retrieval (CBIR), which can be useful in differentiating between benign and malignant lung nodules on computer tomography (CT). This paper proposes a new two-step CBIR scheme (TSCBIR) for computer-aided diagnosis of lung nodules. Two similarity metrics, semantic relevance and visual similarity, are introduced to measure the similarity of different nodules. The first step is to search for K most similar reference ROIs for each queried ROI with the semantic relevance metric. The second step is to weight each retrieved ROI based on its visual similarity to the queried ROI. The probability is computed to predict the likelihood of the queried ROI depicting a malignant lesion. In order to verify the feasibility of the proposed algorithm, a lung nodule dataset including 366 nodule regions of interest (ROIs) is assembled from LIDC-IDRI lung images on CT scans. Three groups of texture features are implemented to represent a nodule ROI. Our experimental results on the assembled lung nodule dataset show good performance improvement over existing popular classifiers.
Collapse
|
49
|
3D multi-view convolutional neural networks for lung nodule classification. PLoS One 2017; 12:e0188290. [PMID: 29145492 PMCID: PMC5690636 DOI: 10.1371/journal.pone.0188290] [Citation(s) in RCA: 81] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2017] [Accepted: 10/11/2017] [Indexed: 12/23/2022] Open
Abstract
The 3D convolutional neural network (CNN) is able to make full use of the spatial 3D context information of lung nodules, and the multi-view strategy has been shown to be useful for improving the performance of 2D CNN in classifying lung nodules. In this paper, we explore the classification of lung nodules using the 3D multi-view convolutional neural networks (MV-CNN) with both chain architecture and directed acyclic graph architecture, including 3D Inception and 3D Inception-ResNet. All networks employ the multi-view-one-network strategy. We conduct a binary classification (benign and malignant) and a ternary classification (benign, primary malignant and metastatic malignant) on Computed Tomography (CT) images from Lung Image Database Consortium and Image Database Resource Initiative database (LIDC-IDRI). All results are obtained via 10-fold cross validation. As regards the MV-CNN with chain architecture, results show that the performance of 3D MV-CNN surpasses that of 2D MV-CNN by a significant margin. Finally, a 3D Inception network achieved an error rate of 4.59% for the binary classification and 7.70% for the ternary classification, both of which represent superior results for the corresponding task. We compare the multi-view-one-network strategy with the one-view-one-network strategy. The results reveal that the multi-view-one-network strategy can achieve a lower error rate than the one-view-one-network strategy.
Collapse
|
50
|
Phillips I, Ajaz M, Ezhil V, Prakash V, Alobaidli S, McQuaid SJ, South C, Scuffham J, Nisbet A, Evans P. Clinical applications of textural analysis in non-small cell lung cancer. Br J Radiol 2017; 91:20170267. [PMID: 28869399 DOI: 10.1259/bjr.20170267] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Lung cancer is the leading cause of cancer mortality worldwide. Treatment pathways include regular cross-sectional imaging, generating large data sets which present intriguing possibilities for exploitation beyond standard visual interpretation. This additional data mining has been termed "radiomics" and includes semantic and agnostic approaches. Textural analysis (TA) is an example of the latter, and uses a range of mathematically derived features to describe an image or region of an image. Often TA is used to describe a suspected or known tumour. TA is an attractive tool as large existing image sets can be submitted to diverse techniques for data processing, presentation, interpretation and hypothesis testing with annotated clinical outcomes. There is a growing anthology of published data using different TA techniques to differentiate between benign and malignant lung nodules, differentiate tissue subtypes of lung cancer, prognosticate and predict outcome and treatment response, as well as predict treatment side effects and potentially aid radiotherapy planning. The aim of this systematic review is to summarize the current published data and understand the potential future role of TA in managing lung cancer.
Collapse
Affiliation(s)
- Iain Phillips
- 1 Royal Surrey County Hospital, University of Surrey, Guildford, UK
| | - Mazhar Ajaz
- 1 Royal Surrey County Hospital, University of Surrey, Guildford, UK.,2 Surrey Clinical Research Centre, University of Surrey, Guildford, UK
| | - Veni Ezhil
- 1 Royal Surrey County Hospital, University of Surrey, Guildford, UK
| | - Vineet Prakash
- 1 Royal Surrey County Hospital, University of Surrey, Guildford, UK
| | - Sheaka Alobaidli
- 3 Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, UK
| | | | | | - James Scuffham
- 1 Royal Surrey County Hospital, University of Surrey, Guildford, UK
| | - Andrew Nisbet
- 1 Royal Surrey County Hospital, University of Surrey, Guildford, UK
| | - Philip Evans
- 3 Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, UK
| |
Collapse
|