1
|
Sun L, Zhang M, Lu Y, Zhu W, Yi Y, Yan F. Nodule-CLIP: Lung nodule classification based on multi-modal contrastive learning. Comput Biol Med 2024; 175:108505. [PMID: 38688129 DOI: 10.1016/j.compbiomed.2024.108505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 02/28/2024] [Accepted: 04/21/2024] [Indexed: 05/02/2024]
Abstract
The latest developments in deep learning have demonstrated the importance of CT medical imaging for the classification of pulmonary nodules. However, challenges remain in fully leveraging the relevant medical annotations of pulmonary nodules and distinguishing between the benign and malignant labels of adjacent nodules. Therefore, this paper proposes the Nodule-CLIP model, which deeply mines the potential relationship between CT images, complex attributes of lung nodules, and benign and malignant attributes of lung nodules through a comparative learning method, and optimizes the model in the image feature extraction network by using its similarities and differences to improve its ability to distinguish similar lung nodules. Firstly, we segment the 3D lung nodule information by U-Net to reduce the interference caused by the background of lung nodules and focus on the lung nodule images. Secondly, the image features, class features, and complex attribute features are aligned by contrastive learning and loss function in Nodule-CLIP to achieve lung nodule image optimization and improve classification ability. A series of testing and ablation experiments were conducted on the public dataset LIDC-IDRI, and the final benign and malignant classification rate was 90.6%, and the recall rate was 92.81%. The experimental results show the advantages of this method in terms of lung nodule classification as well as interpretability.
Collapse
Affiliation(s)
- Lijing Sun
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Mengyi Zhang
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China.
| | - Yu Lu
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Wenjun Zhu
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Yang Yi
- College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, 211800, Jiangsu, China
| | - Fei Yan
- Jiangsu Institute of Cancer Research & The Affiliated Cancer Hospital of Nanjing Medical University, Jiangsu Cancer Hospital, Nanjing, 210009, Jiangsu, China
| |
Collapse
|
2
|
UrRehman Z, Qiang Y, Wang L, Shi Y, Yang Q, Khattak SU, Aftab R, Zhao J. Effective lung nodule detection using deep CNN with dual attention mechanisms. Sci Rep 2024; 14:3934. [PMID: 38365831 PMCID: PMC10873370 DOI: 10.1038/s41598-024-51833-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 01/10/2024] [Indexed: 02/18/2024] Open
Abstract
Novel methods are required to enhance lung cancer detection, which has overtaken other cancer-related causes of death as the major cause of cancer-related mortality. Radiologists have long-standing methods for locating lung nodules in patients with lung cancer, such as computed tomography (CT) scans. Radiologists must manually review a significant amount of CT scan pictures, which makes the process time-consuming and prone to human error. Computer-aided diagnosis (CAD) systems have been created to help radiologists with their evaluations in order to overcome these difficulties. These systems make use of cutting-edge deep learning architectures. These CAD systems are designed to improve lung nodule diagnosis efficiency and accuracy. In this study, a bespoke convolutional neural network (CNN) with a dual attention mechanism was created, which was especially crafted to concentrate on the most important elements in images of lung nodules. The CNN model extracts informative features from the images, while the attention module incorporates both channel attention and spatial attention mechanisms to selectively highlight significant features. After the attention module, global average pooling is applied to summarize the spatial information. To evaluate the performance of the proposed model, extensive experiments were conducted using benchmark dataset of lung nodules. The results of these experiments demonstrated that our model surpasses recent models and achieves state-of-the-art accuracy in lung nodule detection and classification tasks.
Collapse
Affiliation(s)
- Zia UrRehman
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan, China
| | - Yan Qiang
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan, China
- School of Software, North University of China, Taiyuan, China
| | - Long Wang
- Jinzhong College of Information, Jinzhong, China
| | - Yiwei Shi
- NHC Key Laboratory of Pneumoconiosis, Shanxi Key Laboratory of Respiratory Diseases, Department of Pulmonary and Critical Care Medicine, The First Hospital of Shanxi Medical University, Taiyuan, Shanxi, China
| | | | - Saeed Ullah Khattak
- Centre of Biotechnology and Microbiology, University of Peshawar, Peshawar, 25120, Pakistan
| | - Rukhma Aftab
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan, China
| | - Juanjuan Zhao
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan, China.
- Jinzhong College of Information, Jinzhong, China.
| |
Collapse
|
3
|
Ma L, Li G, Feng X, Fan Q, Liu L. TiCNet: Transformer in Convolutional Neural Network for Pulmonary Nodule Detection on CT Images. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:196-208. [PMID: 38343213 DOI: 10.1007/s10278-023-00904-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Revised: 07/19/2023] [Accepted: 08/10/2023] [Indexed: 03/02/2024]
Abstract
Lung cancer is the leading cause of cancer death. Since lung cancer appears as nodules in the early stage, detecting the pulmonary nodules in an early phase could enhance the treatment efficiency and improve the survival rate of patients. The development of computer-aided analysis technology has made it possible to automatically detect lung nodules in Computed Tomography (CT) screening. In this paper, we propose a novel detection network, TiCNet. It is attempted to embed a transformer module in the 3D Convolutional Neural Network (CNN) for pulmonary nodule detection on CT images. First, we integrate the transformer and CNN in an end-to-end structure to capture both the short- and long-range dependency to provide rich information on the characteristics of nodules. Second, we design the attention block and multi-scale skip pathways for improving the detection of small nodules. Last, we develop a two-head detector to guarantee high sensitivity and specificity. Experimental results on the LUNA16 dataset and PN9 dataset showed that our proposed TiCNet achieved superior performance compared with existing lung nodule detection methods. Moreover, the effectiveness of each module has been proven. The proposed TiCNet model is an effective tool for pulmonary nodule detection. Validation revealed that this model exhibited excellent performance, suggesting its potential usefulness to support lung cancer screening.
Collapse
Affiliation(s)
- Ling Ma
- College of Software, Nankai University, Tianjin, China
| | - Gen Li
- College of Software, Nankai University, Tianjin, China
| | - Xingyu Feng
- College of Software, Nankai University, Tianjin, China
| | - Qiliang Fan
- College of Software, Nankai University, Tianjin, China
| | - Lizhi Liu
- Department of Radiology, Sun Yat-Sen University Cancer Center, Guangdong, China.
| |
Collapse
|
4
|
Cao Y, Feng J, Wang C, Yang F, Wang X, Xu J, Huang C, Zhang S, Li Z, Mao L, Zhang T, Jia B, Li T, Li H, Zhang B, Shi H, Li D, Zhang N, Yu Y, Meng X, Zhang Z. LNAS: a clinically applicable deep-learning system for mediastinal enlarged lymph nodes segmentation and station mapping without regard to the pathogenesis using unenhanced CT images. LA RADIOLOGIA MEDICA 2024; 129:229-238. [PMID: 38108979 DOI: 10.1007/s11547-023-01747-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 10/20/2023] [Indexed: 12/19/2023]
Abstract
BACKGROUND The accurate identification and evaluation of lymph nodes by CT images is of great significance for disease diagnosis, treatment, and prognosis. PURPOSE To assess the lymph nodes' segmentation, size, and station by artificial intelligence (AI) for unenhanced chest CT images and evaluate its value in clinical scenarios. MATERIAL AND METHODS This retrospective study proposed an end-to-end Lymph Nodes Analysis System (LNAS) consisting of three models: the Lymph Node Segmentation model (LNS), the Mediastinal Organ Segmentation model (MOS), and the Lymph Node Station Registration model (LNR). We selected a healthy chest CT image as the template image and annotated 14 lymph node station masks according to the IASLC to build the lymph node station mapping template. The exact contours and stations of the lymph nodes were annotated by two junior radiologists and reviewed by a senior radiologist. Patients aged 18 and above, who had undergone unenhanced chest CT and had at least one suspicious enlarged mediastinal lymph node in imaging reports, were included. Exclusions were patients who had thoracic surgeries in the past 2 weeks or artifacts on CT images affecting lymph node observation by radiologists. The system was trained on 6725 consecutive chest CTs that from Tianjin Medical University General Hospital, among which 6249 patients had suspicious enlarged mediastinal lymph nodes. A total of 519 consecutive chest CTs from Qilu Hospital of Shandong University (Qingdao) were used for external validation. The gold standard for each CT was determined by two radiologists and reviewed by one senior radiologist. RESULTS The patient-level sensitivity of the LNAS system reached of 93.94% and 92.89% in internal and external test dataset, respectively. And the lesion-level sensitivity (recall) reached 89.48% and 85.97% in internal and external test dataset. For man-machine comparison, AI significantly apparently shortened the average reading time (p < 0.001) and had better lesion-level and patient-level sensitivities. CONCLUSION AI improved the sensitivity lymph node segmentation by radiologists with an advantage in reading time.
Collapse
Affiliation(s)
- Yang Cao
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Jintang Feng
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
- Department of Radiology, Tianjin Chest Hospital, Tianjin, China
| | | | - Fan Yang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Xiaomeng Wang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | | | | | | | | | - Li Mao
- Deepwise AI Lab, Beijing, China
| | - Tianzhu Zhang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Bingzhen Jia
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Tongli Li
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Hui Li
- Department of Radiology, Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China
| | - Bingjin Zhang
- Department of Radiology, Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China
| | - Hongmei Shi
- Department of Radiology, Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China
| | - Dong Li
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Ningnannan Zhang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Yizhou Yu
- Deepwise AI Lab, Beijing, China
- Department of Computer Science, The University of Hong Kong, Hong Kong, China
| | - Xiangshui Meng
- Department of Radiology, Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China
| | - Zhang Zhang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China.
| |
Collapse
|
5
|
Moosavi AS, Mahboobi A, Arabzadeh F, Ramezani N, Moosavi HS, Mehrpoor G. Segmentation and classification of lungs CT-scan for detecting COVID-19 abnormalities by deep learning technique: U-Net model. J Family Med Prim Care 2024; 13:691-698. [PMID: 38605799 PMCID: PMC11006039 DOI: 10.4103/jfmpc.jfmpc_695_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 07/12/2023] [Accepted: 09/22/2023] [Indexed: 04/13/2024] Open
Abstract
Background Artificial intelligence (AI) techniques have been ascertained useful in the analysis and description of infectious areas in radiological images promptly. Our aim in this study was to design a web-based application for detecting and labeling infected tissues on CT (computed tomography) lung images of patients based on the deep learning (DL) method as a type of AI. Materials and Methods The U-Net architecture, one of the DL networks, is used as a hybrid model with pre-trained densely connected convolutional network 121 (DenseNet121) architecture for the segmentation process. The proposed model was constructed on 1031 persons' CT-scan images from Ibn Sina Hospital of Iran in 2021 and some publicly available datasets. The network was trained using 6000 slices, validated on 1000 slices images, and tested against the 150 slices. Accuracy, sensitivity, specificity, and area under the receiver operating characteristics (ROC) curve (AUC) were calculated to evaluate model performance. Results The results indicate the acceptable ability of the U-Net-DenseNet121 model in detecting COVID-19 abnormality (accuracy = 0.88 and AUC = 0.96 for thresholds of 0.13 and accuracy = 0.88 and AUC = 0.90 for thresholds of 0.2). Based on this model, we developed the "Imaging-Tech" web-based application for use at hospitals and clinics to make our project's output more practical and attractive in the market. Conclusion We designed a DL-based model for the segmentation of COVID-19 CT scan images and, based on this model, constructed a web-based application that, according to the results, is a reliable detector for infected tissue in lung CT-scans. The availability of such tools would aid in automating, prioritizing, fastening, and broadening the treatment of COVID-19 patients globally.
Collapse
Affiliation(s)
| | - Ashraf Mahboobi
- Department of Radiologist, Babol University of Medical Sciences, Babol, Iran
| | - Farzin Arabzadeh
- Department of Radiologist, Dr. Arabzadeh Radiology and Sonography Clinic, Behbahan, Iran
| | - Nazanin Ramezani
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Helia S. Moosavi
- Computer Science Bachelor Degree, University of Toronto, On, Canada
| | - Golbarg Mehrpoor
- Department of Rheumatologist, Alborz University of Medical Sciences, Karaj, Iran
| |
Collapse
|
6
|
Zhu K, Shen Z, Wang M, Jiang L, Zhang Y, Yang T, Zhang H, Zhang M. Visual Knowledge Domain of Artificial Intelligence in Computed Tomography: A Review Based on Bibliometric Analysis. J Comput Assist Tomogr 2024:00004728-990000000-00279. [PMID: 38271538 DOI: 10.1097/rct.0000000000001585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
ABSTRACT Artificial intelligence (AI)-assisted medical imaging technology is a new research area of great interest that has developed rapidly over the last decade. However, there has been no bibliometric analysis of published studies in this field. The present review focuses on AI-related studies on computed tomography imaging in the Web of Science database and uses CiteSpace and VOSviewer to generate a knowledge map and conduct the basic information analysis, co-word analysis, and co-citation analysis. A total of 7265 documents were included and the number of documents published had an overall upward trend. Scholars from the United States and China have made outstanding achievements, and there is a general lack of extensive cooperation in this field. In recent years, the research areas of great interest and difficulty have been the optimization and upgrading of algorithms, and the application of theoretical models to practical clinical applications. This review will help researchers understand the developments, research areas of great interest, and research frontiers in this field and provide reference and guidance for future studies.
Collapse
|
7
|
Fan W, Liu H, Zhang Y, Chen X, Huang M, Xu B. Diagnostic value of artificial intelligence based on computed tomography (CT) density in benign and malignant pulmonary nodules: a retrospective investigation. PeerJ 2024; 12:e16577. [PMID: 38188164 PMCID: PMC10768667 DOI: 10.7717/peerj.16577] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 11/13/2023] [Indexed: 01/09/2024] Open
Abstract
Objective To evaluate the diagnostic value of artificial intelligence (AI) in the detection and management of benign and malignant pulmonary nodules (PNs) using computed tomography (CT) density. Methods A retrospective analysis was conducted on the clinical data of 130 individuals diagnosed with PNs based on pathological confirmation. The utilization of AI and physicians has been employed in the diagnostic process of distinguishing benign and malignant PNs. The CT images depicting PNs were integrated into AI-based software. The gold standard for evaluating the accuracy of AI diagnosis software and physician interpretation was the pathological diagnosis. Results Out of 226 PNs screened from 130 patients diagnosed by AI and physician reading based on CT, 147 were confirmed by pathology. AI had a sensitivity of 94.69% and radiologists had a sensitivity of 85.40% in identifying PNs. The chi-square analysis indicated that the screening capacity of AI was superior to that of physician reading, with statistical significance (p < 0.05). 195 of the 214 PNs suggested by AI were confirmed pathologically as malignant, and 19 were identified as benign; among the 29 PNs suggested by AI as low risk, 13 were confirmed pathologically as malignant, and 16 were identified as benign. From the physician reading, 193 PNs were identified as malignant, 183 were confirmed malignant by pathology, and 10 appeared benign. Physician reading also identified 30 low-risk PNs, 19 of which were pathologically malignant and 11 benign. The physician readings and AI had kappa values of 0.432 and 0.547, respectively. The physician reading and AI area under curves (AUCs) were 0.814 and 0.798, respectively. Both of the diagnostic techniques had worthy diagnostic value, as indicated by their AUCs of >0.7. Conclusion It is anticipated that the use of AI-based CT diagnosis in the detection of PNs would increase the precision in early detection of lung carcinoma, as well as yield more precise evidence for clinical management.
Collapse
Affiliation(s)
- Wei Fan
- Department of Radiology, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Huitong Liu
- Department of Orthopaedics, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Yan Zhang
- Department of Radiology, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Xiaolong Chen
- Department of Radiology, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Minggang Huang
- Department of Radiology, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Bingqiang Xu
- Department of Radiology, Shaanxi Provincial People’s Hospital, Xi’an, China
| |
Collapse
|
8
|
Jenkin Suji R, Bhadauria SS, Wilfred Godfrey W. A survey and taxonomy of 2.5D approaches for lung segmentation and nodule detection in CT images. Comput Biol Med 2023; 165:107437. [PMID: 37717526 DOI: 10.1016/j.compbiomed.2023.107437] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 08/20/2023] [Accepted: 08/28/2023] [Indexed: 09/19/2023]
Abstract
CAD systems for lung cancer diagnosis and detection can significantly offer unbiased, infatiguable diagnostics with minimal variance, decreasing the mortality rate and the five-year survival rate. Lung segmentation and lung nodule detection are critical steps in the lung cancer CAD system pipeline. Literature on lung segmentation and lung nodule detection mostly comprises techniques that process 3-D volumes or 2-D slices and surveys. However, surveys that highlight 2.5D techniques for lung segmentation and lung nodule detection still need to be included. This paper presents a background and discussion on 2.5D methods to fill this gap. Further, this paper also gives a taxonomy of 2.5D approaches and a detailed description of the 2.5D approaches. Based on the taxonomy, various 2.5D techniques for lung segmentation and lung nodule detection are clustered into these 2.5D approaches, which is followed by possible future work in this direction.
Collapse
|
9
|
Xu L, Wang Z, Wu T, Zhao M, Wu Y, Huang Y, Chen J, Sharma A, Sharma HS. Innovative emergency strategies for patients with severe traumatic brain injury: An IoT-based resource integration. INTERNATIONAL REVIEW OF NEUROBIOLOGY 2023; 171:301-316. [PMID: 37783560 DOI: 10.1016/bs.irn.2023.03.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Severe traumatic brain injury patients are in critical condition, and rapid rescue is very important for prognosis. Currently, the resuscitation process is complex and it is difficult to get to the operating room quickly to target treatment. We present a new strategy based on the Internet of Things system to integrate complex first aid procedures for efficient and comprehensive rescuing of patients with severe traumatic brain injury. This system includes three modules: human sign monitoring equipment, emergency transport equipment, and a network diagnosis and treatment progress control center. The system not only supports the streamlining of rescue procedures but also transmits the patient's status and optimal treatment strategies in real-time by using an advanced Internet of Things system. After deploying the system in a hospital, we conducted a validation study to evaluate its feasibility and superiority in clinical use. The preliminary results of the study show that this system can significantly shorten the treatment time, which may help the prognosis of severe traumatic brain injury patients.
Collapse
Affiliation(s)
- Longbiao Xu
- Department of Neurosurgery, The Third Affiliated Hospital of Zhejiang Chinese Medical University, P.R. China
| | - Zhe Wang
- Linping Hospital of Traditional Chinese Medicine, Hangzhou City, Zhejiang Province, China
| | - Tianya Wu
- Department of Neurosurgery, Zhuji Affiliated Hospital of Shaoxing University, Zhuji People's Hospital of Zhejiang Province, P.R. China
| | - Ming Zhao
- Department of Neurosurgery, Zhuji Affiliated Hospital of Shaoxing University, Zhuji People's Hospital of Zhejiang Province, P.R. China
| | - Ying Wu
- Department of Neurosurgery, Zhuji Affiliated Hospital of Shaoxing University, Zhuji People's Hospital of Zhejiang Province, P.R. China
| | - Yubo Huang
- The Third School of Clinical Medicine, Zhejiang Chinese Medical University, P.R. China
| | - Jie Chen
- Department of Neurosurgery, Zhuji Affiliated Hospital of Shaoxing University, Zhuji People's Hospital of Zhejiang Province, P.R. China
| | - Aruna Sharma
- International Experimental Central Nervous System Injury & Repair (IECNSIR), Dept. of Surgical Sciences, Anesthesiology & Intensive Care Medicine, Uppsala University Hospital, Uppsala University, Uppsala, Sweden.
| | - Hari Shanker Sharma
- International Experimental Central Nervous System Injury & Repair (IECNSIR), Dept. of Surgical Sciences, Anesthesiology & Intensive Care Medicine, Uppsala University Hospital, Uppsala University, Uppsala, Sweden.
| |
Collapse
|
10
|
Riaz Z, Khan B, Abdullah S, Khan S, Islam MS. Lung Tumor Image Segmentation from Computer Tomography Images Using MobileNetV2 and Transfer Learning. Bioengineering (Basel) 2023; 10:981. [PMID: 37627866 PMCID: PMC10451633 DOI: 10.3390/bioengineering10080981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 08/14/2023] [Accepted: 08/17/2023] [Indexed: 08/27/2023] Open
Abstract
BACKGROUND Lung cancer is one of the most fatal cancers worldwide, and malignant tumors are characterized by the growth of abnormal cells in the tissues of lungs. Usually, symptoms of lung cancer do not appear until it is already at an advanced stage. The proper segmentation of cancerous lesions in CT images is the primary method of detection towards achieving a completely automated diagnostic system. METHOD In this work, we developed an improved hybrid neural network via the fusion of two architectures, MobileNetV2 and UNET, for the semantic segmentation of malignant lung tumors from CT images. The transfer learning technique was employed and the pre-trained MobileNetV2 was utilized as an encoder of a conventional UNET model for feature extraction. The proposed network is an efficient segmentation approach that performs lightweight filtering to reduce computation and pointwise convolution for building more features. Skip connections were established with the Relu activation function for improving model convergence to connect the encoder layers of MobileNetv2 to decoder layers in UNET that allow the concatenation of feature maps with different resolutions from the encoder to decoder. Furthermore, the model was trained and fine-tuned on the training dataset acquired from the Medical Segmentation Decathlon (MSD) 2018 Challenge. RESULTS The proposed network was tested and evaluated on 25% of the dataset obtained from the MSD, and it achieved a dice score of 0.8793, recall of 0.8602 and precision of 0.93. It is pertinent to mention that our technique outperforms the current available networks, which have several phases of training and testing.
Collapse
Affiliation(s)
- Zainab Riaz
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong SAR, China; (Z.R.); (B.K.); (M.S.I.)
| | - Bangul Khan
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong SAR, China; (Z.R.); (B.K.); (M.S.I.)
- Department of Biomedical Engineering, City University Hongkong, Hong Kong SAR, China
| | - Saad Abdullah
- Division of Intelligent Future Technologies, School of Innovation, Design and Engineering, Mälardalen University, P.O. Box 883, 721 23 Västerås, Sweden
| | - Samiullah Khan
- Center for Eye & Vision Research, 17W Science Park, Hong Kong SAR, China;
| | - Md Shohidul Islam
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong SAR, China; (Z.R.); (B.K.); (M.S.I.)
| |
Collapse
|
11
|
Bishnoi V, Goel N. Tensor-RT-Based Transfer Learning Model for Lung Cancer Classification. J Digit Imaging 2023; 36:1364-1375. [PMID: 37059889 PMCID: PMC10407002 DOI: 10.1007/s10278-023-00822-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 03/26/2023] [Accepted: 03/28/2023] [Indexed: 04/16/2023] Open
Abstract
Cancer is a leading cause of death across the globe, in which lung cancer constitutes the maximum mortality rate. Early diagnosis through computed tomography scan imaging helps to identify the stages of lung cancer. Several deep learning-based classification methods have been employed for developing automatic systems for the diagnosis and detection of computed tomography scan lung slices. However, the diagnosis based on nodule detection is a challenging task as it requires manual annotation of nodule regions. Also, these computer-aided systems have yet not achieved the desired performance in real-time lung cancer classification. In the present paper, a high-speed real-time transfer learning-based framework is proposed for the classification of computed tomography lung cancer slices into benign and malignant. The proposed framework comprises of three modules: (i) pre-processing and segmentation of lung images using K-means clustering based on cosine distance and morphological operations; (ii) tuning and regularization of the proposed model named as weighted VGG deep network (WVDN); (iii) model inference in Nvidia tensor-RT during post-processing for the deployment in real-time applications. In this study, two pre-trained CNN models were experimented and compared with the proposed model. All the models have been trained on 19,419 computed tomography scan lung slices, which were obtained from the publicly available Lung Image Database Consortium and Image Database Resource Initiative dataset. The proposed model achieved the best classification metric, an accuracy of 0.932, precision, recall, an F1 score of 0.93, and Cohen's kappa score of 0.85. A statistical evaluation has also been performed on the classification parameters and achieved a p-value <0.0001 for the proposed model. The quantitative and statistical results validate the improved performance of the proposed model as compared to state-of-the-art methods. The proposed framework is based on complete computed tomography slices rather than the marked annotations and may help in improving clinical diagnosis.
Collapse
Affiliation(s)
- Vidhi Bishnoi
- Indira Gandhi Delhi Technical University for Women, Delhi, India
| | - Nidhi Goel
- Indira Gandhi Delhi Technical University for Women, Delhi, India
| |
Collapse
|
12
|
Javed MA, Bin Liaqat H, Meraj T, Alotaibi A, Alshammari M. Identification and Classification of Lungs Focal Opacity Using CNN Segmentation and Optimal Feature Selection. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:6357252. [PMID: 37538561 PMCID: PMC10396675 DOI: 10.1155/2023/6357252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 09/07/2022] [Accepted: 09/26/2022] [Indexed: 08/05/2023]
Abstract
Lung cancer is one of the deadliest cancers around the world, with high mortality rate in comparison to other cancers. A lung cancer patient's survival probability in late stages is very low. However, if it can be detected early, the patient survival rate can be improved. Diagnosing lung cancer early is a complicated task due to having the visual similarity of lungs nodules with trachea, vessels, and other surrounding tissues that leads toward misclassification of lung nodules. Therefore, correct identification and classification of nodules is required. Previous studies have used noisy features, which makes results comprising. A predictive model has been proposed to accurately detect and classify the lung nodules to address this problem. In the proposed framework, at first, the semantic segmentation was performed to identify the nodules in images in the Lungs image database consortium (LIDC) dataset. Optimal features for classification include histogram oriented gradients (HOGs), local binary patterns (LBPs), and geometric features are extracted after segmentation of nodules. The results shown that support vector machines performed better in identifying the nodules than other classifiers, achieving the highest accuracy of 97.8% with sensitivity of 100%, specificity of 93%, and false positive rate of 6.7%.
Collapse
Affiliation(s)
| | - Hannan Bin Liaqat
- Department of Information Technology, Division of Science and Technology University of Education, Township Campus Lahore, Lahore, Pakistan
| | - Talha Meraj
- Department of Computer Science, COMSATS University Islamabad—Wah Campus, Wah Cantt, Rawalpindi 47040, Pakistan
| | - Aziz Alotaibi
- Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Majid Alshammari
- Department of Information Technology, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| |
Collapse
|
13
|
Motta PC, Cortez PC, Silva BRS, Yang G, de Albuquerque VHC. Automatic COVID-19 and Common-Acquired Pneumonia Diagnosis Using Chest CT Scans. Bioengineering (Basel) 2023; 10:529. [PMID: 37237599 PMCID: PMC10215490 DOI: 10.3390/bioengineering10050529] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 04/22/2023] [Accepted: 04/24/2023] [Indexed: 05/28/2023] Open
Abstract
Even with over 80% of the population being vaccinated against COVID-19, the disease continues to claim victims. Therefore, it is crucial to have a secure Computer-Aided Diagnostic system that can assist in identifying COVID-19 and determining the necessary level of care. This is especially important in the Intensive Care Unit to monitor disease progression or regression in the fight against this epidemic. To accomplish this, we merged public datasets from the literature to train lung and lesion segmentation models with five different distributions. We then trained eight CNN models for COVID-19 and Common-Acquired Pneumonia classification. If the examination was classified as COVID-19, we quantified the lesions and assessed the severity of the full CT scan. To validate the system, we used Resnetxt101 Unet++ and Mobilenet Unet for lung and lesion segmentation, respectively, achieving accuracy of 98.05%, F1-score of 98.70%, precision of 98.7%, recall of 98.7%, and specificity of 96.05%. This was accomplished in just 19.70 s per full CT scan, with external validation on the SPGC dataset. Finally, when classifying these detected lesions, we used Densenet201 and achieved accuracy of 90.47%, F1-score of 93.85%, precision of 88.42%, recall of 100.0%, and specificity of 65.07%. The results demonstrate that our pipeline can correctly detect and segment lesions due to COVID-19 and Common-Acquired Pneumonia in CT scans. It can differentiate these two classes from normal exams, indicating that our system is efficient and effective in identifying the disease and assessing the severity of the condition.
Collapse
Affiliation(s)
- Pedro Crosara Motta
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| | - Paulo César Cortez
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| | - Bruno R. S. Silva
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, London SW7 2AZ, UK
| | - Victor Hugo C. de Albuquerque
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| |
Collapse
|
14
|
Huang S, Yang J, Shen N, Xu Q, Zhao Q. Artificial intelligence in lung cancer diagnosis and prognosis: Current application and future perspective. Semin Cancer Biol 2023; 89:30-37. [PMID: 36682439 DOI: 10.1016/j.semcancer.2023.01.006] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Revised: 01/18/2023] [Accepted: 01/18/2023] [Indexed: 01/22/2023]
Abstract
Lung cancer is one of the malignant tumors with the highest incidence and mortality in the world. The overall five-year survival rate of lung cancer is relatively lower than many leading cancers. Early diagnosis and prognosis of lung cancer are essential to improve the patient's survival rate. With artificial intelligence (AI) approaches widely applied in lung cancer, early diagnosis and prediction have achieved excellent performance in recent years. This review summarizes various types of AI algorithm applications in lung cancer, including natural language processing (NLP), machine learning and deep learning, and reinforcement learning. In addition, we provides evidence regarding the application of AI in lung cancer diagnostic and clinical prognosis. This review aims to elucidate the value of AI in lung cancer diagnosis and prognosis as the novel screening decision-making for the precise treatment of lung cancer patients.
Collapse
Affiliation(s)
- Shigao Huang
- Department of Radiation Oncology, The First Affiliated Hospital, Air Force Medical University, Xi'an, Shanxi, China
| | - Jie Yang
- Chongqing Industry&Trade Polytechnic, Chongqing, China
| | - Na Shen
- Hong Kong Shue Yan University, Hong Kong, China
| | - Qingsong Xu
- Faculty of Science and Technology, University of Macau, Taipa, Macau SAR, China
| | - Qi Zhao
- Cancer Center, Institute of Translational Medicine, Faculty of Health Sciences, University of Macau, Taipa, Macau SAR, China; MoE Frontiers Science Center for Precision Oncology, University of Macau, Taipa, Macau SAR, China.
| |
Collapse
|
15
|
Pulmonary Nodule Detection Based on Multiscale Feature Fusion. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:8903037. [PMID: 36590762 PMCID: PMC9797290 DOI: 10.1155/2022/8903037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 12/10/2022] [Accepted: 12/12/2022] [Indexed: 12/24/2022]
Abstract
As cancer with the highest morbidity and mortality in the world, lung cancer is characterized by pulmonary nodules in the early stage. The detection of pulmonary nodules is an important method for the early detection of lung cancer, which can greatly improve the survival rate of lung cancer patients. However, the accuracy of conventional detection methods for lung nodules is low. With the development of medical imaging technology, deep learning plays an increasingly important role in medical image detection, and pulmonary nodules can be accurately detected by CT images. Based on the above, a pulmonary nodule detection method based on deep learning is proposed. In the candidate nodule detection stage, the multiscale features and Faster R-CNN, a general-purpose detection framework based on deep learning, were combined together to improve the detection of small-sized lung nodules. In the false-positive nodule filtration stage, a 3D convolutional neural network based on multiscale fusion is designed to reduce false-positive nodules. The experiment results show that the candidate nodule detection model based on Faster R-CNN integrating multiscale features has achieved a sensitivity of 98.6%, 10% higher than that of the other single-scale model, the proposed method achieved a sensitivity of 90.5% at the level of 4 false-positive nodules per scan, and the CPM score reached 0.829. The results are higher than methods in other works of literature. It can be seen that the detection method of pulmonary nodules based on multiscale fusion has a higher detection rate for small nodules and improves the classification performance of true and false-positive pulmonary nodules. This will help doctors when making a lung cancer diagnosis.
Collapse
|
16
|
Melekoglu E, Kocabicak U, Uçar MK, Bilgin C, Bozkurt MR, Cunkas M. A new diagnostic method for chronic obstructive pulmonary disease using the photoplethysmography signal and hybrid artificial intelligence. PeerJ Comput Sci 2022; 8:e1188. [PMID: 37346306 PMCID: PMC10280226 DOI: 10.7717/peerj-cs.1188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 11/22/2022] [Indexed: 06/23/2023]
Abstract
Background and Purpose Chronic obstructive pulmonary disease (COPD), is a primary public health issue globally and in our country, which continues to increase due to poor awareness of the disease and lack of necessary preventive measures. COPD is the result of a blockage of the air sacs known as alveoli within the lungs; it is a persistent sickness that causes difficulty in breathing, cough, and shortness of breath. COPD is characterized by breathing signs and symptoms and airflow challenge because of anomalies in the airways and alveoli that occurs as the result of significant exposure to harmful particles and gases. The spirometry test (breath measurement test), used for diagnosing COPD, is creating difficulties in reaching hospitals, especially in patients with disabilities or advanced disease and in children. To facilitate the diagnostic treatment and prevent these problems, it is far evaluated that using photoplethysmography (PPG) signal in the diagnosis of COPD disease would be beneficial in order to simplify and speed up the diagnosis process and make it more convenient for monitoring. A PPG signal includes numerous components, including volumetric changes in arterial blood that are related to heart activity, fluctuations in venous blood volume that modify the PPG signal, a direct current (DC) component that shows the optical properties of the tissues, and modest energy changes in the body. PPG has typically received the usage of a pulse oximeter, which illuminates the pores and skin and measures adjustments in mild absorption. PPG occurring with every heart rate is an easy signal to measure. PPG signal is modeled by machine learning to predict COPD. Methods During the studies, the PPG signal was cleaned of noise, and a brand-new PPG signal having three low-frequency bands of the PPG was obtained. Each of the four signals extracted 25 features. An aggregate of 100 features have been extracted. Additionally, weight, height, and age were also used as characteristics. In the feature selection process, we employed the Fisher method. The intention of using this method is to improve performance. Results This improved PPG prediction models have an accuracy rate of 0.95 performance value for all individuals. Classification algorithms used in feature selection algorithm has contributed to a performance increase. Conclusion According to the findings, PPG-based COPD prediction models are suitable for usage in practice.
Collapse
Affiliation(s)
| | - Umit Kocabicak
- Computer Engineering, Sakarya University, Sakarya, Turkey
| | | | - Cahit Bilgin
- Faculty of Medicine, Sakarya University, Sakarya, Turkey
| | | | - Mehmet Cunkas
- Electrical and Electronics Engineering, Selcuk University, Konya, Turkey
| |
Collapse
|
17
|
Wang H, Tang N, Zhang C, Hao Y, Meng X, Li J. Practice toward standardized performance testing of computer-aided detection algorithms for pulmonary nodule. Front Public Health 2022; 10:1071673. [PMID: 36568775 PMCID: PMC9768365 DOI: 10.3389/fpubh.2022.1071673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Accepted: 11/21/2022] [Indexed: 12/12/2022] Open
Abstract
This study aimed at implementing practice to build a standardized protocol to test the performance of computer-aided detection (CAD) algorithms for pulmonary nodules. A test dataset was established according to a standardized procedure, including data collection, curation and annotation. Six types of pulmonary nodules were manually annotated as reference standard. Three specific rules to match algorithm output with reference standard were applied and compared. These rules included: (1) "center hit" [whether the center of algorithm highlighted region of interest (ROI) hit the ROI of reference standard]; (2) "center distance" (whether the distance between algorithm highlighted ROI center and reference standard center was below a certain threshold); (3) "area overlap" (whether the overlap between algorithm highlighted ROI and reference standard was above a certain threshold). Performance metrics were calculated and the results were compared among ten algorithms under test (AUTs). The test set currently consisted of CT sequences from 593 patients. Under "center hit" rule, the average recall rate, average precision, and average F1 score of ten algorithms under test were 54.68, 38.19, and 42.39%, respectively. Correspondingly, the results under "center distance" rule were 55.43, 38.69, and 42.96%, and the results under "area overlap" rule were 40.35, 27.75, and 31.13%. Among the six types of pulmonary nodules, the AUTs showed the highest miss rate for pure ground-glass nodules, with an average of 59.32%, followed by pleural nodules and solid nodules, with an average of 49.80 and 42.21%, respectively. The algorithm testing results changed along with specific matching methods adopted in the testing process. The AUTs showed uneven performance on different types of pulmonary nodules. This centralized testing protocol supports the comparison between algorithms with similar intended use, and helps evaluate algorithm performance.
Collapse
Affiliation(s)
- Hao Wang
- Division of Active Medical Device and Medical Optics, Institute for Medical Device Control, National Institutes for Food and Drug Control, Beijing, China
| | - Na Tang
- School of Bioengineering, Chongqing University, Chongqing, China
| | - Chao Zhang
- Division of Active Medical Device and Medical Optics, Institute for Medical Device Control, National Institutes for Food and Drug Control, Beijing, China
| | - Ye Hao
- Division of Active Medical Device and Medical Optics, Institute for Medical Device Control, National Institutes for Food and Drug Control, Beijing, China
| | - Xiangfeng Meng
- Division of Active Medical Device and Medical Optics, Institute for Medical Device Control, National Institutes for Food and Drug Control, Beijing, China,*Correspondence: Xiangfeng Meng
| | - Jiage Li
- Division of Active Medical Device and Medical Optics, Institute for Medical Device Control, National Institutes for Food and Drug Control, Beijing, China,Jiage Li
| |
Collapse
|
18
|
Hussain MA, Gogoi L. Performance analyses of five neural network classifiers on nodule classification in lung CT images using WEKA: a comparative study. Phys Eng Sci Med 2022; 45:1193-1204. [PMID: 36315381 DOI: 10.1007/s13246-022-01187-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 10/08/2022] [Indexed: 11/06/2022]
Abstract
In this report, we are presenting our work on performance analyses of five different neural network classifiers viz. MLP, DL4JMLP, logistic regression, SGD and simple logistic classifier in lung nodule detection using WEKA interface. To the best of our knowledge, this report demonstrates first use of WEKA for comparative performance analyses of neural network classifiers in identifying lung nodules from lung CT-images. A total of 624 handcrafted features from 52 numbers of lung CT-images collected randomly from Lung Image Database Consortium (LIDC) were fed into WEKA to evaluate the performances of the classifiers under four different categories of computation. Performances of the classifiers were observed in terms of 11 important parameters viz. accuracy, kappa statistic, root mean squared error, TPR, FPR, precision, sensitivity, F-measurement, MCC, ROC area and PRC area. Results show 86.53%, 77.77%, 55.55%, 94.44% & 88.88% accuracy as well as 0.91, 0.86, 0.68, 0.91 & 0.93 ROC area for MLP, DL4JMLP, logistic, SGD and simple logistic classifier respectively at tenfold cross-validation by taking 66% of the data set for training and 34% for testing and validation purpose. SGDClassifier has been found the best performing followed by simple logistic classifier for the purpose.
Collapse
Affiliation(s)
- Md Anwar Hussain
- Department of Electronics and Communication Engineering, North Eastern Regional Institute of Science and Technology, Nirjuli, 791109, India
| | - Lakshipriya Gogoi
- Department of Electronics and Communication Engineering, North Eastern Regional Institute of Science and Technology, Nirjuli, 791109, India.
| |
Collapse
|
19
|
Xu X, Li J, Yang Y, Sang S, Deng S. The correlation between PD-L1 expression and metabolic parameters of 18FDG PET/CT and the prognostic value of PD-L1 in non-small cell lung cancer. Clin Imaging 2022; 89:120-127. [DOI: 10.1016/j.clinimag.2022.06.016] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 06/08/2022] [Accepted: 06/26/2022] [Indexed: 12/12/2022]
|
20
|
Martinez-Millana A, Saez-Saez A, Tornero-Costa R, Azzopardi-Muscat N, Traver V, Novillo-Ortiz D. Artificial intelligence and its impact on the domains of universal health coverage, health emergencies and health promotion: An overview of systematic reviews. Int J Med Inform 2022; 166:104855. [PMID: 35998421 PMCID: PMC9551134 DOI: 10.1016/j.ijmedinf.2022.104855] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 08/01/2022] [Accepted: 08/11/2022] [Indexed: 12/04/2022]
Abstract
An overview of systematic reviews on the application of AI including 129 studies. AI use is prominent in Universal Health Coverage, featuring image analysis in neoplasms. Half of the reviews did not evaluate validation procedures nor reporting guidelines. Risk of bias was only included un a third of the reviews. There is not sufficient evidence to transfer AI to actual healthcare delivery.
Background Artificial intelligence is fueling a new revolution in medicine and in the healthcare sector. Despite the growing evidence on the benefits of artificial intelligence there are several aspects that limit the measure of its impact in people’s health. It is necessary to assess the current status on the application of AI towards the improvement of people’s health in the domains defined by WHO’s Thirteenth General Programme of Work (GPW13) and the European Programme of Work (EPW), to inform about trends, gaps, opportunities, and challenges. Objective To perform a systematic overview of systematic reviews on the application of artificial intelligence in the people’s health domains as defined in the GPW13 and provide a comprehensive and updated map on the application specialties of artificial intelligence in terms of methodologies, algorithms, data sources, outcomes, predictors, performance, and methodological quality. Methods A systematic search in MEDLINE, EMBASE, Cochrane and IEEEXplore was conducted between January 2015 and June 2021 to collect systematic reviews using a combination of keywords related to the domains of universal health coverage, health emergencies protection, and better health and wellbeing as defined by the WHO’s PGW13 and EPW. Eligibility criteria was based on methodological quality and the inclusion of practical implementation of artificial intelligence. Records were classified and labeled using ICD-11 categories into the domains of the GPW13. Descriptors related to the area of implementation, type of modeling, data entities, outcomes and implementation on care delivery were extracted using a structured form and methodological aspects of the included reviews studies was assessed using the AMSTAR checklist. Results The search strategy resulted in the screening of 815 systematic reviews from which 203 were assessed for eligibility and 129 were included in the review. The most predominant domain for artificial intelligence applications was Universal Health Coverage (N = 98) followed by Health Emergencies (N = 16) and Better Health and Wellbeing (N = 15). Neoplasms area on Universal Health Coverage was the disease area featuring most of the applications (21.7 %, N = 28). The reviews featured analytics primarily over both public and private data sources (67.44 %, N = 87). The most used type of data was medical imaging (31.8 %, N = 41) and predictors based on regions of interest and clinical data. The most prominent subdomain of Artificial Intelligence was Machine Learning (43.4 %, N = 56), in which Support Vector Machine method was predominant (20.9 %, N = 27). Regarding the purpose, the application of Artificial Intelligence I is focused on the prediction of the diseases (36.4 %, N = 47). With respect to the validation, more than a half of the reviews (54.3 %, N = 70) did not report a validation procedure and, whenever available, the main performance indicator was the accuracy (28.7 %, N = 37). According to the methodological quality assessment, a third of the reviews (34.9 %, N = 45) implemented methods for analysis the risk of bias and the overall AMSTAR score below was 5 (4.01 ± 1.93) on all the included systematic reviews. Conclusion Artificial intelligence is being used for disease modelling, diagnose, classification and prediction in the three domains of GPW13. However, the evidence is often limited to laboratory and the level of adoption is largely unbalanced between ICD-11 categoriesand diseases. Data availability is a determinant factor on the developmental stage of artificial intelligence applications. Most of the reviewed studies show a poor methodological quality and are at high risk of bias, which limits the reproducibility of the results and the reliability of translating these applications to real clinical scenarios. The analyzed papers show results only in laboratory and testing scenarios and not in clinical trials nor case studies, limiting the supporting evidence to transfer artificial intelligence to actual care delivery.
Collapse
Affiliation(s)
- Antonio Martinez-Millana
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - Aida Saez-Saez
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - Roberto Tornero-Costa
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - Natasha Azzopardi-Muscat
- Division of Country Health Policies and Systems, World Health Organization, Regional Office for Europe, Copenhagen, Denmark
| | - Vicente Traver
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - David Novillo-Ortiz
- Division of Country Health Policies and Systems, World Health Organization, Regional Office for Europe, Copenhagen, Denmark.
| |
Collapse
|
21
|
Yin X, Liao H, Yun H, Lin N, Li S, Xiang Y, Ma X. Artificial intelligence-based prediction of clinical outcome in immunotherapy and targeted therapy of lung cancer. Semin Cancer Biol 2022; 86:146-159. [PMID: 35963564 DOI: 10.1016/j.semcancer.2022.08.002] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 08/06/2022] [Accepted: 08/08/2022] [Indexed: 11/26/2022]
Abstract
Lung cancer accounts for the main proportion of malignancy-related deaths and most patients are diagnosed at an advanced stage. Immunotherapy and targeted therapy have great advances in application in clinics to treat lung cancer patients, yet the efficacy is unstable. The response rate of these therapies varies among patients. Some biomarkers have been proposed to predict the outcomes of immunotherapy and targeted therapy, including programmed cell death-ligand 1 (PD-L1) expression and oncogene mutations. Nevertheless, the detection tests are invasive, time-consuming, and have high demands on tumor tissue. The predictive performance of conventional biomarkers is also unsatisfactory. Therefore, novel biomarkers are needed to effectively predict the outcomes of immunotherapy and targeted therapy. The application of artificial intelligence (AI) can be a possible solution, as it has several advantages. AI can help identify features that are unable to be used by humans and perform repetitive tasks. By combining AI methods with radiomics, pathology, genomics, transcriptomics, proteomics, and clinical data, the integrated model has shown predictive value in immunotherapy and targeted therapy, which significantly improves the precision treatment of lung cancer patients. Herein, we reviewed the application of AI in predicting the outcomes of immunotherapy and targeted therapy in lung cancer patients, and discussed the challenges and future directions in this field.
Collapse
Affiliation(s)
- Xiaomeng Yin
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Hu Liao
- Department of Thoracic Surgery, West China Hospital, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Hong Yun
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Nan Lin
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Shen Li
- West China School of Medicine, West China Hospital, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Yu Xiang
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Xuelei Ma
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China.
| |
Collapse
|
22
|
Moragheb MA, Badie A, Noshad A. An Effective Approach for Automated Lung Node Detection using CT Scans. J Biomed Phys Eng 2022; 12:377-386. [PMID: 36059280 PMCID: PMC9395629 DOI: 10.31661/jbpe.v0i0.2110-1412] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2021] [Accepted: 05/20/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Pulmonary or benign nodules are classified as nodules with a diameter of 3 cm or less and defined as non-cancerous nodules. The early diagnosis of malignant lung nodules is important for a more reliable prognosis of lung cancer and less invasive chemotherapy and radiotherapy procedures. OBJECTIVE This study aimed to introduce an improved hybrid approach for efficient nodule mask generation and false-positive reduction. MATERIAL AND METHODS In this experimental study, nodule segmentation preprocessing was conducted to prepare the input computed tomography (CT) scans for the U-Net convolutional neural network (CNN) model, and includes the normalization of CT scans and transfer of pixel values corresponding to the radiodensity of Hounsfield Units (HU). A U-Net CNN was developed based on lung CT scans for nodule identification. RESULTS The U-net model converged to a dice coefficient of 0.678 with a sensitivity of 75%. Many false positives were considered in every real positive, at 11.1, reduced in the proposed CNN to 2.32 FPs (False Positive) per TP (True Positive). CONCLUSION Based on the disadvantages of the largest nodule, the similarity of extracted features of the current study with those of others was imperative. The improved hybrid approach introduced was useful for other image classification tasks as expected.
Collapse
Affiliation(s)
- Mohammad Amin Moragheb
- MSc, Department of Computer Engineering, Faculty of Engineering, Mamasani Higher Education Center, Mamasani, Iran
| | - Ali Badie
- MSc, Department of Computer Engineering, Faculty of Engineering, Salman Farsi University of Kazerun, Kazerun, Iran
| | - Ali Noshad
- BSc, Department of Computer Engineering, Salman Farsi University of Kazerun, Kazerun, Iran
| |
Collapse
|
23
|
An Improved U-Net Image Segmentation Method and Its Application for Metallic Grain Size Statistics. MATERIALS 2022; 15:ma15134417. [PMID: 35806543 PMCID: PMC9267311 DOI: 10.3390/ma15134417] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 06/17/2022] [Accepted: 06/19/2022] [Indexed: 02/01/2023]
Abstract
Grain size is one of the most important parameters for metallographic microstructure analysis, which can partly determine the material performance. The measurement of grain size is based on accurate image segmentation methods, which include traditional image processing methods and emerging machine-learning-based methods. Unfortunately, traditional image processing methods can hardly segment grains correctly from metallographic images with low contrast and blurry boundaries. Moreover, the proposed machine-learning-based methods need a large dataset to train the model and can hardly deal with the segmentation challenge of complex images with fuzzy boundaries and complex structure. In this paper, an improved U-Net model is proposed to automatically accomplish image segmentation of complex metallographic images with only a small training set. The experiments on metallographic images show the significant advantage of the method, especially for the metallographic images with low contrast, a fuzzy boundary and complex structure. Compared with other deep learning methods, the improved U-Net scored higher in ACC, MIoU, Precision, and F1 indexes, among which ACC was 0.97, MIoU was 0.752, Precision was 0.98, and F1 was 0.96. The grain size was calculated based on the segmentation according to the American Society for Testing Material (ASTM) standards, producing a satisfactory result.
Collapse
|
24
|
Guan X, Qin T, Qi T. Precision Medicine in Lung Cancer Theranostics: Paving the Way from Traditional Technology to Advance Era. Cancer Control 2022. [PMCID: PMC8862127 DOI: 10.1177/10732748221077351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Precision medicine for lung cancer theranostics is an advanced model combining prevention, diagnosis, and treatment for individual or specific population diseases to match individual patient differences. It involves collection and integration of genome, transcriptome, proteome, and metabolome features of lung cancer patients, combined with clinical characteristics. Subsequently, large data and artificial intelligence (AI) analysis have emerged to identify the most suitable therapeutic targets and personal treatment strategies for treatment of patients with lung cancer. We review the development and challenges associated with diagnosis and therapy of lung cancer from traditional technology, including immunotherapy prediction markers, liquid biopsy, surgery, and tumor immune microenvironment and patient-derived xenograft models, to AI in the era of precision medicine. AI has improved precision medicine and the predictive ability and accuracy of patient outcomes. Finally, we discuss some opportunities and challenges for lung cancer theranostics. Precision medicine in lung cancer can help us find the optimum treatment dose and time for a specific patient, which can advance the development of lung cancer therapeutics.
Collapse
Affiliation(s)
- Xiaoyong Guan
- Department of Laboratory Medicine, The First Affiliated Hospital of Guangxi University of Science and Technology, Liuzhou, China
| | - Tian Qin
- Department of Oncology, The First Affiliated Hospital of Guangxi University of Science and Technology, Liuzhou, China
| | - Tao Qi
- Oncology Hematology Department, Xijing 986 Hospital, Fourth Military Medical University, Xi’an, China
| |
Collapse
|
25
|
Deep Learning Applications in Computed Tomography Images for Pulmonary Nodule Detection and Diagnosis: A Review. Diagnostics (Basel) 2022; 12:diagnostics12020298. [PMID: 35204388 PMCID: PMC8871398 DOI: 10.3390/diagnostics12020298] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 01/21/2022] [Accepted: 01/22/2022] [Indexed: 12/26/2022] Open
Abstract
Lung cancer has one of the highest mortality rates of all cancers and poses a severe threat to people’s health. Therefore, diagnosing lung nodules at an early stage is crucial to improving patient survival rates. Numerous computer-aided diagnosis (CAD) systems have been developed to detect and classify such nodules in their early stages. Currently, CAD systems for pulmonary nodules comprise data acquisition, pre-processing, lung segmentation, nodule detection, false-positive reduction, segmentation, and classification. A number of review articles have considered various components of such systems, but this review focuses on segmentation and classification parts. Specifically, categorizing segmentation parts based on lung nodule type and network architectures, i.e., general neural network and multiview convolution neural network (CNN) architecture. Moreover, this work organizes related literature for classification of parts based on nodule or non-nodule and benign or malignant. The essential CT lung datasets and evaluation metrics used in the detection and diagnosis of lung nodules have been systematically summarized as well. Thus, this review provides a baseline understanding of the topic for interested readers.
Collapse
|
26
|
Lin FY, Chang YC, Huang HY, Li CC, Chen YC, Chen CM. A radiomics approach for lung nodule detection in thoracic CT images based on the dynamic patterns of morphological variation. Eur Radiol 2022; 32:3767-3777. [PMID: 35020016 DOI: 10.1007/s00330-021-08456-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Revised: 09/20/2021] [Accepted: 11/02/2021] [Indexed: 11/28/2022]
Abstract
OBJECTIVES To propose and evaluate a set of radiomic features, called morphological dynamics features, for pulmonary nodule detection, which were rooted in the dynamic patterns of morphological variation and needless precise lesion segmentation. MATERIALS AND METHODS Two datasets were involved, namely, university hospital (UH) and LIDC datasets, comprising 72 CT scans (360 nodules) and 888 CT scans (2230 nodules), respectively. Each nodule was annotated by multiple radiologists. Denoted the category of nodules identified by at least k radiologists as ALk. A nodule detection algorithm, called CAD-MD algorithm, was proposed based on the morphological dynamics radiomic features, characterizing a lesion by ten sets of the same features with different values extracted from ten different thresholding results. Each nodule candidate was classified by a two-level classifier, including ten decision trees and a random forest, respectively. The CAD-MD algorithm was compared with a deep learning approach, the N-Net, using the UH dataset. RESULTS On the AL1 and AL2 of the UH dataset, the AUC of the AFROC curves were 0.777 and 0.851 for the CAD-MD algorithm and 0.478 and 0.472 for the N-Net, respectively. The CAD-MD algorithm achieved the sensitivities of 84.4% and 91.4% with 2.98 and 3.69 FPs/scan and the N-Net 74.4% and 80.7% with 3.90 and 4.49 FPs/scan, respectively. On the LIDC dataset, the CAD-MD algorithm attained the sensitivities of 87.6%, 89.2%, 92.2%, and 95.0% with 4 FPs/scan for AL1-AL4, respectively. CONCLUSION The morphological dynamics radiomic features might serve as an effective set of radiomic features for lung nodule detection. KEY POINTS • Texture features varied with such CT system settings as reconstruction kernels of CT images, CT scanner models, and parameter settings, and so on. • Shape and first-order statistics were shown to be the most robust features against variation in CT imaging parameters. • The morphological dynamics radiomic features, which mainly characterized the dynamic patterns of morphological variation, were shown to be effective for lung nodule detection.
Collapse
Affiliation(s)
- Fan-Ya Lin
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, No. 1, Sec. 1, Jen-Ai Road, Taipei, 100, Taiwan
| | - Yeun-Chung Chang
- Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan
| | | | - Chia-Chen Li
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, No. 1, Sec. 1, Jen-Ai Road, Taipei, 100, Taiwan
| | - Yi-Chang Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, No. 1, Sec. 1, Jen-Ai Road, Taipei, 100, Taiwan.,Department of Medical Imaging, Cardinal Tien Hospital, New Taipei City, Taiwan
| | - Chung-Ming Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, No. 1, Sec. 1, Jen-Ai Road, Taipei, 100, Taiwan.
| |
Collapse
|
27
|
Abstract
PURPOSE OF REVIEW In this article, we focus on the role of artificial intelligence in the management of lung cancer. We summarized commonly used algorithms, current applications and challenges of artificial intelligence in lung cancer. RECENT FINDINGS Feature engineering for tabular data and computer vision for image data are commonly used algorithms in lung cancer research. Furthermore, the use of artificial intelligence in lung cancer has extended to the entire clinical pathway including screening, diagnosis and treatment. Lung cancer screening mainly focuses on two aspects: identifying high-risk populations and the automatic detection of lung nodules. Artificial intelligence diagnosis of lung cancer covers imaging diagnosis, pathological diagnosis and genetic diagnosis. The artificial intelligence clinical decision-support system is the main application of artificial intelligence in lung cancer treatment. Currently, the challenges of artificial intelligence applications in lung cancer mainly focus on the interpretability of artificial intelligence models and limited annotated datasets; and recent advances in explainable machine learning, transfer learning and federated learning might solve these problems. SUMMARY Artificial intelligence shows great potential in many aspects of the management of lung cancer, especially in screening and diagnosis. Future studies on interpretability and privacy are needed for further application of artificial intelligence in lung cancer.
Collapse
Affiliation(s)
- Kai Zhang
- Department of Thoracic Surgery, Peking University People's Hospital, Beijing, China
| | | |
Collapse
|
28
|
Jena SR, George ST, Ponraj DN. Lung cancer detection and classification with DGMM-RBCNN technique. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-06182-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
29
|
Huang G, Wei X, Tang H, Bai F, Lin X, Xue D. A systematic review and meta-analysis of diagnostic performance and physicians' perceptions of artificial intelligence (AI)-assisted CT diagnostic technology for the classification of pulmonary nodules. J Thorac Dis 2021; 13:4797-4811. [PMID: 34527320 PMCID: PMC8411165 DOI: 10.21037/jtd-21-810] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 07/09/2021] [Indexed: 12/26/2022]
Abstract
Background Lung cancer was the second most commonly diagnosed cancer and the leading cause of cancer death in 2020. Although artificial intelligence (AI)-assisted diagnostic technologies have shown promise and has been used in clinical practice in recent years, no products related to AI-assisted CT diagnostic technologies for the classification of pulmonary nodules have been approved by the National Medical Products Administration in China. The objective of this article was to systematically review the diagnostic performance of AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant and to analyze physicians’ perceptions of this technology in China. Methods All relevant studies from 6 literature databases were searched and screened according to the inclusion and exclusion criteria. Data were extracted and the study quality was assessed by two reviewers. The study heterogeneity and publication bias were estimated. A questionnaire survey on the perceptions of physicians was conducted in 9 public tertiary hospitals in China. A meta-analysis, meta-regression and univariate logistic model were used in the systematic review and to explore the association of physicians’ perceptions with their rate of support for the clinical application of the technology. Results Twenty-seven studies with 5,727 pulmonary nodules were finally included in the meta-analysis. We found that the quality of the included studies was generally acceptable and that the pooled sensitivity and specificity of AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant were 0.90 and 0.89, respectively. The pooled diagnostic odds ratio (DOR) was 70.33. The majority of the surveyed physicians in China perceived “reduced workload for radiologists” and “improved diagnostic efficiency” as the important benefits of this technology. In addition, diagnostic accuracy (including misdiagnosis) and practical experience were significantly associated with whether physicians supported its clinical application. Conclusions In the context of lung cancer diagnosis, AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant has good diagnostic performance, but its specificity needs to be improved.
Collapse
Affiliation(s)
- Guo Huang
- NHC Key Laboratory of Health Technology Assessment (Fudan University), Department of Hospital Management, School of Public Health, Fudan University, Shanghai, China
| | - Xuefeng Wei
- Health Commission of Gansu Province, Lanzhou, China
| | - Huiqin Tang
- Health Commission of Hubei Province, Wuhan, China
| | - Fei Bai
- National Center for Medical Service Administration, Beijing, China
| | - Xia Lin
- National Center for Medical Service Administration, Beijing, China
| | - Di Xue
- NHC Key Laboratory of Health Technology Assessment (Fudan University), Department of Hospital Management, School of Public Health, Fudan University, Shanghai, China
| |
Collapse
|
30
|
Wang S, Liu X, Zhao J, Liu Y, Liu S, Liu Y, Zhao J. Computer auxiliary diagnosis technique of detecting cholangiocarcinoma based on medical imaging: A review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 208:106265. [PMID: 34311415 DOI: 10.1016/j.cmpb.2021.106265] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 06/28/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVES Cholangiocarcinoma (CCA) is one of the most aggressive human malignant tumors and is becoming one of the main factors of death and disability globally. Specifically, 60% to 70% of CCA patients were diagnosed with local invasion or distant metastasis and lost the chance of radical operation. The overall median survival time was less than 12 months. As a non-invasive diagnostic technology, medical imaging consisting of computed tomography (CT) imaging, magnetic resonance imaging (MRI), and ultrasound (US) imaging, is the most effectively and commonly used method to detect CCA. The computer auxiliary diagnosis (CAD) system based on medical imaging is helpful for rapid diagnosis and provides credible "second opinion" for specialists. The purpose of this review is to categorize and review the CAD technique of detecting CCA based on medical imaging. METHODS This work applies a four-level screening process to choose suitable publications. 125 research papers published in different academic research databases were selected and analyzed according to specific criteria. From the five steps of medical image acquisition, processing, analysis, understanding and verification of CAD combined with artificial intelligence algorithms, we obtain the most advanced insights related to CCA detection. RESULTS This work provides a comprehensive analysis and comparison analysis of the current CAD systems of detecting CCA. After careful investigation, we find that the main detection methods are traditional machine learning method and deep learning method. For the detection, the most commonly used method is semi-automatic segmentation algorithm combined with support vector machine classifier method, combination of which has good detection performance. The end-to-end training mode makes deep learning method more and more popular in CAD systems. However, due to the limited medical training data, the accuracy of deep learning method is unsatisfactory. CONCLUSIONS Based on analysis of artificial intelligence methods applied in CCA, this work is expected to be truly applied in clinical practice in the future to improve the level of clinical diagnosis and treatment of it. This work concludes by providing a prediction of future trends, which will be of great significance for researchers in the medical imaging of CCA and artificial intelligence.
Collapse
Affiliation(s)
- Shiyu Wang
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| | - Xiang Liu
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China.
| | - Jingwen Zhao
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| | - Yiwen Liu
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| | - Shuhong Liu
- Department of Pathology and Hepatology, The Fifth Medical Centre of Chinese PLA General Hospital, Beijing 100039, China
| | - Yisi Liu
- Department of Pathology and Hepatology, The Fifth Medical Centre of Chinese PLA General Hospital, Beijing 100039, China
| | - Jingmin Zhao
- Department of Pathology and Hepatology, The Fifth Medical Centre of Chinese PLA General Hospital, Beijing 100039, China.
| |
Collapse
|
31
|
Gu Y, Chi J, Liu J, Yang L, Zhang B, Yu D, Zhao Y, Lu X. A survey of computer-aided diagnosis of lung nodules from CT scans using deep learning. Comput Biol Med 2021; 137:104806. [PMID: 34461501 DOI: 10.1016/j.compbiomed.2021.104806] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 08/23/2021] [Accepted: 08/23/2021] [Indexed: 12/17/2022]
Abstract
Lung cancer has one of the highest mortalities of all cancers. According to the National Lung Screening Trial, patients who underwent low-dose computed tomography (CT) scanning once a year for 3 years showed a 20% decline in lung cancer mortality. To further improve the survival rate of lung cancer patients, computer-aided diagnosis (CAD) technology shows great potential. In this paper, we summarize existing CAD approaches applying deep learning to CT scan data for pre-processing, lung segmentation, false positive reduction, lung nodule detection, segmentation, classification and retrieval. Selected papers are drawn from academic journals and conferences up to November 2020. We discuss the development of deep learning, describe several important aspects of lung nodule CAD systems and assess the performance of the selected studies on various datasets, which include LIDC-IDRI, LUNA16, LIDC, DSB2017, NLST, TianChi, and ELCAP. Overall, in the detection studies reviewed, the sensitivity of these techniques is found to range from 61.61% to 98.10%, and the value of the FPs per scan is between 0.125 and 32. In the selected classification studies, the accuracy ranges from 75.01% to 97.58%. The precision of the selected retrieval studies is between 71.43% and 87.29%. Based on performance, deep learning based CAD technologies for detection and classification of pulmonary nodules achieve satisfactory results. However, there are still many challenges and limitations remaining including over-fitting, lack of interpretability and insufficient annotated data. This review helps researchers and radiologists to better understand CAD technology for pulmonary nodule detection, segmentation, classification and retrieval. We summarize the performance of current techniques, consider the challenges, and propose directions for future high-impact research.
Collapse
Affiliation(s)
- Yu Gu
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China.
| | - Jingqian Chi
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China.
| | - Jiaqi Liu
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China
| | - Lidong Yang
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China
| | - Baohua Zhang
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China
| | - Dahua Yu
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China
| | - Ying Zhao
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China
| | - Xiaoqi Lu
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, China; College of Information Engineering, Inner Mongolia University of Technology, Hohhot, 010051, China
| |
Collapse
|
32
|
Lung Nodule Detection from Feature Engineering to Deep Learning in Thoracic CT Images: a Comprehensive Review. J Digit Imaging 2021; 33:655-677. [PMID: 31997045 DOI: 10.1007/s10278-020-00320-6] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
This paper presents a systematic review of the literature focused on the lung nodule detection in chest computed tomography (CT) images. Manual detection of lung nodules by the radiologist is a sequential and time-consuming process. The detection is subjective and depends on the radiologist's experiences. Owing to the variation in shapes and appearances of a lung nodule, it is very difficult to identify the proper location of the nodule from a huge number of slices generated by the CT scanner. Small nodules (< 10 mm in diameter) may be missed by this manual detection process. Therefore, computer-aided diagnosis (CAD) system acts as a "second opinion" for the radiologists, by making final decision quickly with higher accuracy and greater confidence. The goal of this survey work is to present the current state of the artworks and their progress towards lung nodule detection to the researchers and readers in this domain. This review paper has covered the published works from 2009 to April 2018. Different nodule detection approaches are described elaborately in this work. Recently, it is observed that deep learning (DL)-based approaches are applied extensively for nodule detection and characterization. Therefore, emphasis has been given to convolutional neural network (CNN)-based DL approaches by describing different CNN-based networks.
Collapse
|
33
|
Zhang Y, Jiang B, Zhang L, Greuter MJW, de Bock GH, Zhang H, Xie X. Lung Nodule Detectability of Artificial Intelligence-assisted CT Image Reading in Lung Cancer Screening. Curr Med Imaging 2021; 18:327-334. [PMID: 34365951 DOI: 10.2174/1573405617666210806125953] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 06/11/2021] [Accepted: 06/17/2021] [Indexed: 11/22/2022]
Abstract
BACKGROUND Artificial intelligence (AI)-based automatic lung nodule detection system improves the detection rate of nodules. It is important to evaluate the clinical value of AI system by comparing AI-assisted nodule detection with actu-al radiology reports. OBJECTIVE To compare the detection rate of lung nodules between the actual radiology reports and AI-assisted reading in lung cancer CT screening. METHODS Participants in chest CT screening from November to December 2019 were retrospectively included. In the real-world radiologist observation, 14 residents and 15 radiologists participated to finalize radiology reports. In AI-assisted reading, one resident and one radiologist reevaluated all subjects with the assistance of an AI system to lo-cate and measure the detected lung nodules. A reading panel determined the type and number of detected lung nodules between these two methods. RESULTS In 860 participants (57±7 years), the reading panel confirmed 250 patients with >1 solid nodule, while radiolo-gists observed 131, lower than 247 by AI-assisted reading (p<0.001). The panel confirmed 111 patients with >1 non-solid nodule, whereas radiologist observation identified 28, lower than 110 by AI-assisted reading (p<0.001). The accuracy and sensitivity of radiologist observation for solid nodules were 86.2% and 52.4%, lower than 99.1% and 98.8% by AI-assisted reading, respectively. These metrics were 90.4% and 25.2% for non-solid nodules, lower than 98.8% and 99.1% by AI-assisted reading, respectively. CONCLUSION Comparing with the actual radiology reports, AI-assisted reading greatly improves the accuracy and sensi-tivity of nodule detection in chest CT, which benefits lung nodule detection, especially for non-solid nodules.
Collapse
Affiliation(s)
- Yaping Zhang
- Department of Radiology, Shanghai General Hospital of Nanjing Medical University, Haining Rd.100, Shanghai 200080. China
| | - Beibei Jiang
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Haining Rd.100, Shanghai 200080. 0
| | - Lu Zhang
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Haining Rd.100, Shanghai 200080. 0
| | - Marcel J W Greuter
- Department of Radiology, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713GZ Gro-ningen. Netherlands
| | - Geertruida H de Bock
- Department of Epidemiology, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713GZ Groningen. Netherlands
| | - Hao Zhang
- Department of Radiology, Shanghai General Hospital of Nanjing Medical University, Haining Rd.100, Shanghai 200080. China
| | - Xueqian Xie
- Department of Radiology, Shanghai General Hospital of Nanjing Medical University, Haining Rd.100, Shanghai 200080. China
| |
Collapse
|
34
|
Gao J, Jiang Q, Zhou B, Chen D. Lung Nodule Detection using Convolutional Neural Networks with Transfer Learning on CT Images. Comb Chem High Throughput Screen 2021; 24:814-824. [PMID: 32664836 DOI: 10.2174/1386207323666200714002459] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 02/06/2020] [Accepted: 05/21/2020] [Indexed: 11/22/2022]
Abstract
AIM AND OBJECTIVE Lung nodule detection is critical in improving the five-year survival rate and reducing mortality for patients with lung cancer. Numerous methods based on Convolutional Neural Networks (CNNs) have been proposed for lung nodule detection in Computed Tomography (CT) images. With the collaborative development of computer hardware technology, the detection accuracy and efficiency can still be improved. MATERIALS AND METHODS In this study, an automatic lung nodule detection method using CNNs with transfer learning is presented. We first compared three of the state-of-the-art convolutional neural network (CNN) models, namely, VGG16, VGG19 and ResNet50, to determine the most suitable model for lung nodule detection. We then utilized two different training strategies, namely, freezing layers and fine-tuning, to illustrate the effectiveness of transfer learning. Furthermore, the hyper-parameters of the CNN model such as optimizer, batch size and epoch were optimized. RESULTS Evaluated on the Lung Nodule Analysis 2016 (LUNA16) challenge, promising results with an accuracy of 96.86%, a precision of 91.10%, a sensitivity of 90.78%, a specificity of 98.13%, and an AUC of 99.37% were achieved. CONCLUSION Compared with other works, state-of-the-art specificity is obtained, which demonstrates that the proposed method is effective and applicable to lung nodule detection.
Collapse
Affiliation(s)
- Jun Gao
- College of Information Engineering, Shanghai Maritime University, Shanghai 201306, China
| | - Qian Jiang
- College of Information Engineering, Shanghai Maritime University, Shanghai 201306, China
| | - Bo Zhou
- Shanghai University of Medicine & Health Science, Shanghai 201308, China
| | - Daozheng Chen
- College of Information Engineering, Shanghai Maritime University, Shanghai 201306, China
| |
Collapse
|
35
|
Li N, Wang L, Hu Y, Han W, Zheng F, Song W, Jiang J. Global evolution of research on pulmonary nodules: a bibliometric analysis. Future Oncol 2021; 17:2631-2645. [PMID: 33880950 DOI: 10.2217/fon-2020-0987] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Aim: To provide a historical and global picture of research concerning lung nodules, compare the contributions of major countries and explore research trends over the past 10 years. Methods: A bibliometric analysis of publications from Scopus (1970-2020) and Web of Science (2011-2020). Results: Publications about pulmonary nodules showed an enormous growth trend from 1970 to 2020. There is a high level of collaboration among the 20 most productive countries and regions, with the USA located at the center of the collaboration network. The keywords 'deep learning', 'artificial intelligence' and 'machine learning' are current hotspots. Conclusions: Abundant research has focused on pulmonary nodules. Deep learning is emerging as a promising tool for lung cancer diagnosis and management.
Collapse
Affiliation(s)
- Ning Li
- Department of Epidemiology & Biostatistics, Institute of Basic Medicine Sciences, Chinese Academy of Medical Sciences/School of Basic Medicine, Peking Union Medical College, Beijing, 100005, China
| | - Lei Wang
- Department of Epidemiology & Biostatistics, Institute of Basic Medicine Sciences, Chinese Academy of Medical Sciences/School of Basic Medicine, Peking Union Medical College, Beijing, 100005, China
| | - Yaoda Hu
- Department of Epidemiology & Biostatistics, Institute of Basic Medicine Sciences, Chinese Academy of Medical Sciences/School of Basic Medicine, Peking Union Medical College, Beijing, 100005, China
| | - Wei Han
- Department of Epidemiology & Biostatistics, Institute of Basic Medicine Sciences, Chinese Academy of Medical Sciences/School of Basic Medicine, Peking Union Medical College, Beijing, 100005, China
| | - Fuling Zheng
- Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Wei Song
- Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Jingmei Jiang
- Department of Epidemiology & Biostatistics, Institute of Basic Medicine Sciences, Chinese Academy of Medical Sciences/School of Basic Medicine, Peking Union Medical College, Beijing, 100005, China
| |
Collapse
|
36
|
Singh R, Kalra MK, Homayounieh F, Nitiwarangkul C, McDermott S, Little BP, Lennes IT, Shepard JAO, Digumarthy SR. Artificial intelligence-based vessel suppression for detection of sub-solid nodules in lung cancer screening computed tomography. Quant Imaging Med Surg 2021; 11:1134-1143. [PMID: 33816155 DOI: 10.21037/qims-20-630] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Background Lung cancer screening (LCS) with low-dose computed tomography (LDCT) helps early lung cancer detection, commonly presenting as small pulmonary nodules. Artificial intelligence (AI)-based vessel suppression (AI-VS) and automatic detection (AI-AD) algorithm can improve detection of subsolid nodules (SSNs) on LDCT. We assessed the impact of AI-VS and AI-AD in detection and classification of SSNs [ground-glass nodules (GGNs) and part-solid nodules (PSNs)], on LDCT performed for LCS. Methods Following regulatory approval, 123 LDCT examinations with sub-solid pulmonary nodules (average diameter ≥6 mm) were processed to generate three image series for each examination-unprocessed, AI-VS, and AI-AD series with annotated lung nodules. Two thoracic radiologists in consensus formed the standard of reference (SOR) for this study. Two other thoracic radiologists (R1 and R2; 5 and 10 years of experience in thoracic CT image interpretation) independently assessed the unprocessed images alone, then together with AI-VS series, and finally with AI-AD for detecting all ≥6 mm GGN and PSN. We performed receiver operator characteristics (ROC) and Cohen's Kappa analyses for statistical analyses. Results On unprocessed images, R1 and R2 detected 232/310 nodules (R1: 114 GGN, 118 PSN) and 255/310 nodules (R2: 122 GGN, 133 PSN), respectively (P>0.05). On AI-VS images, they detected 249/310 nodules (119 GGN, 130 PSN) and 277/310 nodules (128 GGN, 149 PSN), respectively (P≥0.12). When compared to the SOR, accuracy (AUC) for detection of PSN on the AI-VS images (AUC 0.80-0.81) was greater than on the unprocessed images (AUC 0.70-0.76). AI-VS images enabled detection of solid components in five nodules deemed as GGN on the unprocessed images. Accuracy of AI-AD was lower than both the radiologists (AUC 0.60-0.72). Conclusions AI-VS improved the detection and classification of SSN into GGN and PSN on LDCT of the chest for the two radiologist (R1 and R2) readers.
Collapse
Affiliation(s)
- Ramandeep Singh
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Mannudeep K Kalra
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Fatemeh Homayounieh
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Chayanin Nitiwarangkul
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA.,Division of Diagnostic Radiology, Department of Diagnostic and Therapeutic Radiology, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Ratchathewi, Bangkok, Thailand
| | - Shaunagh McDermott
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Brent P Little
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Inga T Lennes
- Harvard Medical School, Boston, MA, USA.,Massachusetts General Hospital Cancer Center, Division of Thoracic Oncology, Massachusetts General Hospital, Boston, MA, USA
| | - Jo-Anne O Shepard
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Subba R Digumarthy
- Division of Thoracic Imaging and Intervention, Massachusetts General Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| |
Collapse
|
37
|
Abd Elaziz M, A. A. Al-qaness M, Abo Zaid EO, Lu S, Ali Ibrahim R, A. Ewees A. Automatic clustering method to segment COVID-19 CT images. PLoS One 2021; 16:e0244416. [PMID: 33417610 PMCID: PMC7793265 DOI: 10.1371/journal.pone.0244416] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Accepted: 12/10/2020] [Indexed: 01/19/2023] Open
Abstract
Coronavirus pandemic (COVID-19) has infected more than ten million persons worldwide. Therefore, researchers are trying to address various aspects that may help in diagnosis this pneumonia. Image segmentation is a necessary pr-processing step that implemented in image analysis and classification applications. Therefore, in this study, our goal is to present an efficient image segmentation method for COVID-19 Computed Tomography (CT) images. The proposed image segmentation method depends on improving the density peaks clustering (DPC) using generalized extreme value (GEV) distribution. The DPC is faster than other clustering methods, and it provides more stable results. However, it is difficult to determine the optimal number of clustering centers automatically without visualization. So, GEV is used to determine the suitable threshold value to find the optimal number of clustering centers that lead to improving the segmentation process. The proposed model is applied for a set of twelve COVID-19 CT images. Also, it was compared with traditional k-means and DPC algorithms, and it has better performance using several measures, such as PSNR, SSIM, and Entropy.
Collapse
Affiliation(s)
- Mohamed Abd Elaziz
- Hubei Engineering Research Center on Big Data Security, School of Cyber Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
- Department of Mathematics, Faculty of Science, Zagazig University, Zagazig, Egypt
| | - Mohammed A. A. Al-qaness
- State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China
| | | | - Songfeng Lu
- Hubei Engineering Research Center on Big Data Security, School of Cyber Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Rehab Ali Ibrahim
- Department of Mathematics, Faculty of Science, Zagazig University, Zagazig, Egypt
| | - Ahmed A. Ewees
- Department of Computer, Damietta University, Damietta, Egypt
| |
Collapse
|
38
|
Tan W, Huang P, Li X, Ren G, Chen Y, Yang J. Analysis of segmentation of lung parenchyma based on deep learning methods. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2021; 29:945-959. [PMID: 34487013 DOI: 10.3233/xst-210956] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Precise segmentation of lung parenchyma is essential for effective analysis of the lung. Due to the obvious contrast and large regional area compared to other tissues in the chest, lung tissue is less difficult to segment. Special attention to details of lung segmentation is also needed. To improve the quality and speed of segmentation of lung parenchyma based on computed tomography (CT) or computed tomography angiography (CTA) images, the 4th International Symposium on Image Computing and Digital Medicine (ISICDM 2020) provides interesting and valuable research ideas and approaches. For the work of lung parenchyma segmentation, 9 of the 12 participating teams used the U-Net network or its modified forms, and others used the methods to improve the segmentation accuracy include attention mechanism, multi-scale feature information fusion. Among them, U-Net achieves the best results including that the final dice coefficient of CT segmentation is 0.991 and the final dice coefficient of CTA segmentation is 0.984. In addition, attention U-Net and nnU-Net network also performs well. In this paper, the methods chosen by 12 teams from different research groups are evaluated and their segmentation results are analyzed for the study and references to those involved.
Collapse
Affiliation(s)
- Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China
- College of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Peifang Huang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China
- College of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Xiaoshuo Li
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China
- College of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Genqiang Ren
- College of Electronics and Information Engineering, Tongji University, Shanghai, China
| | - Yufei Chen
- College of Electronics and Information Engineering, Tongji University, Shanghai, China
| | - Jinzhu Yang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China
- College of Computer Science and Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
39
|
Wang D, He K, Wang B, Liu X, Zhou J. Solitary Pulmonary nodule segmentation based on pyramid and improved grab cut. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 199:105910. [PMID: 33383329 DOI: 10.1016/j.cmpb.2020.105910] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Accepted: 12/13/2020] [Indexed: 02/05/2023]
Abstract
BACKGROUND AND OBJECTIVE Accurate segmentation of solitary pulmonary nodule of digital radiography image is essential for lesion appearance measurement and medical follow-up. However, the imaging characteristics of digital radiography, the inhomogeneity and fuzzy contours of nodules often lead to poor performances. This work aims to develop a segmentation framework that satisfies the requirements of accurate segmentation. METHODS In this work, an interactive segmentation method which combined the enhanced total-variance pyramid and improved Grab cut was proposed to improve the performance of nodule segmentation. The edge-preserving multi-resolution pyramid structure did the rough segmentation on low resolution images, which provided contour nearby curves to initial the following accuracy segmentation and shortened the time of energy decreasing. With the multiscale information being incorporated to optimize the edge term and improve the appearance model, a novel Gibbs energy functional was constructed to extract the nodule in a proper scale. By introducing the multiscale processing and optimizing the energy terms, the proposed method could overcome the inhomogeneity and fuzzy contours. RESULTS For evaluation of the nodule segmentation, quantitative metrics such as precision, intersection over union, and dice similarity coefficient were introduced and compared in the experimental part. The proposed solitary pulmonary nodule segmentation method produced the results with mean values of precision 0.957, dice similarity coefficient 0.933, and intersection over union 0.891, respectively. And the corresponding standard deviation values were 0.041, 0.047, and 0.045. CONCLUSIONS From the quantitative assessment and comparison in the experiments, the proposed method achieved a competitive performance in accuracy and stability, even in the cases with low contrast and fuzzy contours.
Collapse
Affiliation(s)
- Dan Wang
- School of Computer Science, Sichuan University, 610065 Chengdu, China
| | - Kun He
- School of Computer Science, Sichuan University, 610065 Chengdu, China.
| | - Bin Wang
- School of Computer Science, Sichuan University, 610065 Chengdu, China
| | - Xiaoju Liu
- Department of Oncology, West China Hospital Sichuan University, No. 37 Guoxue Lane, Wuhou District, 610065 Chengdu, China
| | - Jiliu Zhou
- School of Computer Science, Sichuan University, 610065 Chengdu, China
| |
Collapse
|
40
|
Sadad T, Rehman A, Hussain A, Abbasi AA, Khan MQ. A Review on Multi-organ Cancer Detection Using Advanced Machine Learning Techniques. Curr Med Imaging 2020; 17:686-694. [PMID: 33334293 DOI: 10.2174/1573405616666201217112521] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Revised: 07/07/2020] [Accepted: 07/23/2020] [Indexed: 12/24/2022]
Abstract
Abnormal behaviors of tumors pose a risk to human survival. Thus, the detection of cancers at their initial stage is beneficial for patients and lowers the mortality rate. However, this can be difficult due to various factors related to imaging modalities, such as complex background, low contrast, brightness issues, poorly defined borders and the shape of the affected area. Recently, computer-aided diagnosis (CAD) models have been used to accurately diagnose tumors in different parts of the human body, especially breast, brain, lung, liver, skin and colon cancers. These cancers are diagnosed using various modalities, including computed tomography (CT), magnetic resonance imaging (MRI), colonoscopy, mammography, dermoscopy and histopathology. The aim of this review was to investigate existing approaches for the diagnosis of breast, brain, lung, liver, skin and colon tumors. The review focuses on decision-making systems, including handcrafted features and deep learning architectures for tumor detection.
Collapse
Affiliation(s)
- Tariq Sadad
- Department of Computer Science and Software Engineering, International Islamic University, Islamabad, Pakistan
| | - Amjad Rehman
- Artificial Intelligence & Data Analytics Lab CCIS Prince Sultan University, Riyadh 11586, Saudi Arabia
| | - Ayyaz Hussain
- Department of Computer Science, Quaid-i-Azam University, Islamabad, Pakistan
| | - Aaqif Afzaal Abbasi
- Department of Software Engineering, Foundation University, Islamabad, Pakistan
| | - Muhammad Qasim Khan
- Department of Computer Science, COMSATS University (Attock Campus) Islamabad, Pakistan
| |
Collapse
|
41
|
Dang Y, Wang R, Qian K, Lu J, Zhang H, Zhang Y. Clinical and radiological predictors of epidermal growth factor receptor mutation in nonsmall cell lung cancer. J Appl Clin Med Phys 2020; 22:271-280. [PMID: 33314737 PMCID: PMC7856515 DOI: 10.1002/acm2.13107] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Revised: 10/26/2020] [Accepted: 10/30/2020] [Indexed: 01/06/2023] Open
Abstract
Purpose To determine the prognostic factors of epidermal growth factor receptor (EGFR) mutation status in a group of patients with nonsmall cell lung cancer (NSCLC) by analyzing their clinical and radiological features. Materials and methods Patients with NSCLC who underwent EGFR mutation detection between 2014 and 2017 were included. Clinical features and general imaging features were collected, and radiomic features were extracted from CT data by 3D Slicer software. Prognostic factors of EGFR mutation status were selected by least absolute shrinkage and selection operator (LASSO) logistic regression analysis, and receiver operating characteristic (ROC) curves were drawn for each prediction model of EGFR mutation. Results A total of 118 patients were enrolled in this study. The smoking index (P = 0.028), pleural retraction (P = 0.041), and three radiomic features were significantly associated with EGFR mutation status. The areas under the ROC curve (AUCs) for prediction models of clinical features, general imaging features, and radiomic features were 0.284, 0.703, and 0.815, respectively, and the AUC for the combined prediction model of the three models was 0.894. Finally, a nomogram was established for individualized EGFR mutation prediction. Conclusions The combination of radiomic features with clinical features and general imaging features can enable discrimination of EGFR mutation status better than the use of any group of features alone. Our study may help develop a noninvasive biomarker to identify EGFR mutation status by using a combination of the three group features.
Collapse
Affiliation(s)
- Yutao Dang
- Department of Thoracic Surgery, Xuanwu Hospital, Capital Medical University, Beijing, China.,Department of Thoracic Surgery, Shijingshan Hospital of Beijing City, Shijingshan Teaching Hospital of Capital Medical University, Beijing, China
| | - Ruotian Wang
- Department of Thoracic Surgery, Xuanwu Hospital, Capital Medical University, Beijing, China
| | - Kun Qian
- Department of Thoracic Surgery, Xuanwu Hospital, Capital Medical University, Beijing, China
| | - Jie Lu
- Department of Radiology, Xuanwu Hospital, Capital Medical University, Beijing, China
| | - Haixiang Zhang
- Center for Applied Mathematics, Tianjin University, Tianjin, China
| | - Yi Zhang
- Department of Thoracic Surgery, Xuanwu Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
42
|
Wu Z, Ge R, Shi G, Zhang L, Chen Y, Luo L, Cao Y, Yu H. MD-NDNet: a multi-dimensional convolutional neural network for false-positive reduction in pulmonary nodule detection. Phys Med Biol 2020; 65:235053. [PMID: 32698172 DOI: 10.1088/1361-6560/aba87c] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Pulmonary nodule false-positive reduction is of great significance for automated nodule detection in clinical diagnosis of low-dose computed tomography (LDCT) lung cancer screening. Due to individual intra-nodule variations and visual similarities between true nodules and false positives as soft tissues in LDCT images, the current clinical practices remain subject to shortcomings of potential high-risk and time-consumption issues. In this paper, we propose a multi-dimensional nodule detection network (MD-NDNet) for automatic nodule false-positive reduction using deep convolutional neural network (DCNNs). The underlying method collaboratively integrates multi-dimensional nodule information to complementarily and comprehensively extract nodule inter-plane volumetric correlation features using three-dimensional CNNs (3D CNNs) and spatial nodule correlation features from sagittal, coronal, and axial planes using two-dimensional CNNs (2D CNNs) with attention module. To incorporate different sizes and shapes of nodule candidates, a multi-scale ensemble strategy is employed for probability aggregation with weights. The proposed method is evaluated on the LUNA16 challenge dataset in ISBI 2016 with ten-fold cross-validation. Experiment results show that the proposed framework achieves classification performance with a CPM score of 0.9008. All of these indicate that our method enables an efficient, accurate and reliable pulmonary nodule detection for clinical diagnosis.
Collapse
Affiliation(s)
- Zhan Wu
- School of Cyberspace Security, Southeast University, Nanjing, Jiangsu, China. Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA, United States of America
| | | | | | | | | | | | | | | |
Collapse
|
43
|
Halder A, Chatterjee S, Dey D, Kole S, Munshi S. An adaptive morphology based segmentation technique for lung nodule detection in thoracic CT image. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 197:105720. [PMID: 32877818 DOI: 10.1016/j.cmpb.2020.105720] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Accepted: 08/19/2020] [Indexed: 05/13/2023]
Abstract
Lung cancer is one of the most life-threatening cancers mostly indicated by the presence of nodules in the lung. Doctors and radiological experts use High-Resolution Computed Tomography (HRCT) images for nodule detection and further decision making from visual inspection. Manual detection of lung nodules is a time-consuming process. Therefore, Computer-aided detection (CADe) systems have been developed for accurate nodule detection and segmentation. CADe-based systems assist radiologists to detect lung nodules with greater confidence and a lesser amount of time and have a significant impact on the accurate, uniform, and early-stage diagnosis of lung cancer. In this research work, an adaptive morphology-based segmentation technique (AMST) has been introduced by designing an adaptive morphological filter for improved segmentation of the lung nodule region. The adaptive morphological filter detects candidate nodule regions by employing adaptive structuring element (ASE) and at the same time improves nodule detection accuracy by reducing false positives (FPs) from the Computed Tomography (CT) slices. The detected nodule candidate regions are then processed for feature extraction. In this study, morphological, texture and intensity-based features have been used with support vector machine (SVM) classifier for lung nodule detection. The performance of the proposed framework has been evaluated by incorporating a 10-fold cross-validation technique on Lung Image Database Consortium-Image Database Resource Initiative (LIDC/IDRI) dataset and on a private dataset, collected from a consultant radiologist. It has been observed that the proposed automated computer-aided detection system has achieved overall classification performance indices with 94.88% sensitivity, 93.45% specificity and 94.27% detection accuracy with 1.8 FPs/scan on LIDC/IDRI dataset and 91.43% sensitivity, 90.45% specificity, 92.83% accuracy with 3.2 FPs/scan on a private dataset. The results show that the proposed CADe system presented in this paper outperforms the other state-of-the-art methods for automatic nodule detection from the HRCT image.
Collapse
Affiliation(s)
- Amitava Halder
- Computer Science and Engineering Department, Supreme Knowledge Foundation Group of Institutions, Hooghly 712139, India.
| | | | - Debangshu Dey
- Electrical Engineering Department, Jadavpur University, Kolkata 700032, India
| | - Surajit Kole
- Theism Ultrasound Centre, 14 B Dumdum Rd., Kolkata 700030, India
| | - Sugata Munshi
- Electrical Engineering Department, Jadavpur University, Kolkata 700032, India
| |
Collapse
|
44
|
|
45
|
Ramamurthy M, Krishnamurthi I, Vimal S, Robinson YH. Deep learning based genome analysis and NGS-RNA LL identification with a novel hybrid model. Biosystems 2020; 197:104211. [PMID: 32795485 DOI: 10.1016/j.biosystems.2020.104211] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Revised: 07/08/2020] [Accepted: 07/16/2020] [Indexed: 12/18/2022]
Abstract
The conventional image segmentation techniques have a lot of issues with highest computational cost and low level accuracy for medical image diagnosis and genome analysis. The deep learning based optimization models utilize to predict the liver cancer with RNA genome using CT images and the prediction of genome classification with NGS is a higher probable in recent medical disease classification. This paper proposes a hybrid deep learning technique constructs with SegNet, MultiResUNet, and Krill Herd optimization (KHO) algorithm to perform the extraction of the liver lesions and RNA sequencing that the optimization techniques used into the deep learning method. The proposed technique implements the SegNet for segregating the liver with genome from the CT scan; the MultiResUNet is constructed to perform the extractions of liver lesions. The KHO algorithm is combined with the deep learning approaches for tuning the hyper parameters to every Convolutional neural network model and enhances the segmentation process which may elaborately identifies the sequence that causes the liver classification disease. The proposed technique is compared with the related techniques on liver lesion classification (LL) for NGS in genome. The performance results show that the proposed technique is better to other algorithms on various performance metrics.
Collapse
Affiliation(s)
- Madhumitha Ramamurthy
- Department of Information Technology, Karpagam College of Engineering, Coimbatore, TamilNadu, India.
| | - Ilango Krishnamurthi
- Department of CSE, Sri Krishna College of Engineering and Technology, Coimbatore, TamilNadu, India.
| | - S Vimal
- Department of Information Technology, National Engineering College, Kovilpatti, Tamil Nadu, India.
| | - Y Harold Robinson
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, India.
| |
Collapse
|
46
|
A Novel Pulmonary Nodule Detection Model Based on Multi-Step Cascaded Networks. SENSORS 2020; 20:s20154301. [PMID: 32752225 PMCID: PMC7435753 DOI: 10.3390/s20154301] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Revised: 07/27/2020] [Accepted: 07/27/2020] [Indexed: 11/24/2022]
Abstract
Pulmonary nodule detection in chest computed tomography (CT) is of great significance for the early diagnosis of lung cancer. Therefore, it has attracted more and more researchers to propose various computer-assisted pulmonary nodule detection methods. However, these methods still could not provide convincing results because the nodules are easily confused with calcifications, vessels, or other benign lumps. In this paper, we propose a novel deep convolutional neural network (DCNN) framework for detecting pulmonary nodules in the chest CT image. The framework consists of three cascaded networks: First, a U-net network integrating inception structure and dense skip connection is proposed to segment the region of lung parenchyma from the chest CT image. The inception structure is used to replace the first convolution layer for better feature extraction with respect to multiple receptive fields, while the dense skip connection could reuse these features and transfer them through the network. Secondly, a modified U-net network where all the convolution layers are replaced by dilated convolution is proposed to detect the “suspicious nodules” in the image. The dilated convolution can increase the receptive fields to improve the ability of the network in learning global information of the image. Thirdly, a modified U-net adapting multi-scale pooling and multi-resolution convolution connection is proposed to find the true pulmonary nodule in the image with multiple candidate regions. During the detection, the result of the former step is used as the input of the latter step to follow the “coarse-to-fine” detection process. Moreover, the focal loss, perceptual loss and dice loss were used together to replace the cross-entropy loss to solve the problem of imbalance distribution of positive and negative samples. We apply our method on two public datasets to evaluate its ability in pulmonary nodule detection. Experimental results illustrate that the proposed method outperform the state-of-the-art methods with respect to accuracy, sensitivity and specificity.
Collapse
|
47
|
Liu C, Pang M. Automatic lung segmentation based on image decomposition and wavelet transform. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.102032] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
48
|
|
49
|
Lung nodules detection using semantic segmentation and classification with optimal features. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-04870-2] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
50
|
Automatic Detection of Pulmonary Nodules using Three-dimensional Chain Coding and Optimized Random Forest. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10072346] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
The detection of pulmonary nodules on computed tomography scans provides a clue for the early diagnosis of lung cancer. Manual detection mandates a heavy radiological workload as it identifies nodules slice-by-slice. This paper presents a fully automated nodule detection with three significant contributions. First, an automated seeded region growing is designed to segment the lung regions from the tomography scans. Second, a three-dimensional chain code algorithm is implemented to refine the border of the segmented lungs. Lastly, nodules inside the lungs are detected using an optimized random forest classifier. The experiments for our proposed detection are conducted using 888 scans from a public dataset, and achieves a favorable result of 93.11% accuracy, 94.86% sensitivity, and 91.37% specificity, with only 0.0863 false positives per exam.
Collapse
|