1
|
Deng Z, Yang Y, Suzuki K. Federated Active Learning Framework for Efficient Annotation Strategy in Skin-Lesion Classification. J Invest Dermatol 2024:S0022-202X(24)01858-X. [PMID: 38909844 DOI: 10.1016/j.jid.2024.05.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 05/10/2024] [Accepted: 05/27/2024] [Indexed: 06/25/2024]
Abstract
Federated learning (FL) enables multiple institutes to train models collaboratively without sharing private data. Current FL research focuses on communication efficiency, privacy protection, and personalization and assumes that the data of FL have already been ideally collected. However, in medical scenarios, data annotation demands both expertise and intensive labor, which is a critical problem in FL. Active learning (AL) has shown promising performance in reducing the number of data annotations in medical image analysis. We propose a federated AL framework in which AL is executed periodically and interactively under FL. We exploit a local model in each hospital and a global model acquired from FL to construct an ensemble. We use ensemble entropy-based AL as an efficient data-annotation strategy in FL. Therefore, our federated AL framework can decrease the amount of annotated data and preserve patient privacy while maintaining the performance of FL. To our knowledge, this federated AL framework applied to medical images has not been previously reported. We validated our framework on real-world dermoscopic datasets. Using only 50% of samples, our framework was able to achieve state-of-the-art performance on a skin-lesion classification task. Our framework performed better than several state-of-the-art AL methods under FL and achieved comparable performance with full-data FL.
Collapse
Affiliation(s)
- Zhipeng Deng
- Biomedical Artificial Intelligence Research Unit (BMAI), Institute of Innovative Research, Tokyo Institute of Technology, Tokyo, Japan; Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan
| | - Yuqiao Yang
- Biomedical Artificial Intelligence Research Unit (BMAI), Institute of Innovative Research, Tokyo Institute of Technology, Tokyo, Japan; Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan
| | - Kenji Suzuki
- Biomedical Artificial Intelligence Research Unit (BMAI), Institute of Innovative Research, Tokyo Institute of Technology, Tokyo, Japan; Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan.
| |
Collapse
|
2
|
Hanaoka T, Matoba H, Nakayama J, Ono S, Ikegawa K, Okada M. A spatio-temporal image analysis for growth of indeterminate pulmonary nodules detected by CT scan. Radiol Phys Technol 2024; 17:71-82. [PMID: 37889460 DOI: 10.1007/s12194-023-00750-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 09/29/2023] [Accepted: 10/05/2023] [Indexed: 10/28/2023]
Abstract
The objective is to evaluate the performance of computational image classification for indeterminate pulmonary nodules (IPN) chronologically detected by CT scan. Total 483 patients with 670 abnormal pulmonary nodules, who were taken chest thin-section CT (TSCT) images at least twice and resected as suspicious nodules in our hospital, were enrolled in this study. Nodular regions from the initial and the latest TSCT images were cut manually for each case, and approached by Python development environment, using the open-source cv2 library, to measure the nodular change rate (NCR). These NCRs were statistically compared with clinico-pathological factors, and then, this discriminator was evaluated for clinical performance. NCR showed significant differences among the nodular consistencies. In terms of histological subtypes, NCR of invasive adenocarcinoma (ADC) were significantly distinguishable from other lesions, but not from minimally invasive ADC. Only for cancers, NCR was significantly associated with loco-regional invasivity, p53-immunoreactivity, and Ki67-immunoreactivity. Regarding Epidermal Growth Factor Receptor gene mutation of ADC-related nodules, NCR showed a significant negative correlation. On staging of lung cancer cases, NCR was significantly increased with progression from pTis-stage 0 up to pT1b-stage IA2. For clinical shared decision-making (SDM) whether urgent resection or watchful-waiting, receiver operating characteristic (ROC) analysis showed that area under the ROC curve was 0.686. For small-sized IPN detected by CT scan, this approach shows promise as a potential navigator to improve work-up for life-threatening cancer screening and assist SDM before surgery.
Collapse
Affiliation(s)
- Takaomi Hanaoka
- Department of Thoracic Surgery, JA Nagano North Alps Medical Center Azumi Hospital, 3207-1 Ikeda, Ikeda-machi, Kita-azumi-gun, Nagano, 399-8605, Japan.
| | - Hisanori Matoba
- Department of Molecular Pathology, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan
| | - Jun Nakayama
- Department of Molecular Pathology, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan
- Department of Pathology, JA Nagano North Alps Medical Center Azumi Hospital, 3207-1 Ikeda, Ikeda-Machi, Kita-azumi-gun, Nagano, 399-8605, Japan
| | - Shotaro Ono
- Department of Thoracic Surgery, JA Nagano North Alps Medical Center Azumi Hospital, 3207-1 Ikeda, Ikeda-machi, Kita-azumi-gun, Nagano, 399-8605, Japan
| | - Kayoko Ikegawa
- Department of Respirology, JA Nagano North Alps Medical Center Azumi Hospital, 3207-1 Ikeda, Ikeda-machi, Kita-azumi-gun, Nagano, 399-8605, Japan
| | - Mitsuyo Okada
- Department of Respirology, JA Nagano North Alps Medical Center Azumi Hospital, 3207-1 Ikeda, Ikeda-machi, Kita-azumi-gun, Nagano, 399-8605, Japan
| |
Collapse
|
3
|
Abid A, Zo Afshan. Fault detection and identification in induction motor using weightless neural network. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2024; 95:025106. [PMID: 38350475 DOI: 10.1063/5.0169851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 01/18/2024] [Indexed: 02/15/2024]
Abstract
This paper presents a novel multiclass, multiparameter real-valued weightless neural network-based classifier for fault detection and identification. In contrast to primitive variants of weightless neural nets, the proposed method is capable of multiclass identification with real-valued input features and has improved recognition and generalization capabilities. The major accomplishments of the proposed method include an improved input-to-address mapping strategy that is suitable for address assignment within discriminator units and an effective memory expansion scheme based on similarity metric-based membership value. The developed classifier is utilized for fault detection and identification in single-phase and three-phase induction motors. The sensitivity analysis of the method is investigated for design parameter variation and the fault diagnosis is performed for multiple faults of the motor. The proposed method achieves the highest accuracy of 99.6% and 89.25% for single-phase and three-phase induction motor fault identification, respectively.
Collapse
Affiliation(s)
- Anam Abid
- Department of Mechatronics Engineering, University of Engineering and Technology, Peshawar, Pakistan
| | - Zo Afshan
- Department of Electrical and Computer Engineering, Air University, Islamabad, Pakistan
| |
Collapse
|
4
|
Deng Z, Jin Z, Suzuki K. Radiation Dose Reduction in Digital Breast Tomosynthesis by MTANN with Multi-scale Kernels. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-7. [PMID: 38082827 DOI: 10.1109/embc40787.2023.10340529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Digital breast tomosynthesis (DBT) is an advanced three-dimensional screening modality for the early detection of breast cancer. DBT is able to reduce the problem of tissue overlap in standard two-dimensional mammograms, thus improving the sensitivity and specificity of cancer detection. Although DBT can improve diagnostic accuracy, it leads to higher radiation dose to patients compared to two-dimensional mammography. In this paper, we propose a novel radiation dose reduction technique that introduces multi-scale kernels to our original massive-training artificial neural network (MTANN) to reduce radiation dose substantially, while maintaining high image quality in DBT. After training our new MTANN with low-dose (LD) images and the corresponding "teaching" high-dose (HD) images, we can convert new LD images to "virtual" high-dose (VHD) images where noise and artifact in the LD images are significantly reduced. In VHD images, it is critical to preserve subtle structures and tiny patterns such as microcalcifications (MCs) which are essential for breast cancer diagnosis. We developed anatomical MTANN experts including an MC-specific expert with multi-scale kernels, which are combined by gating layers to generate whole VHD images. Our MTANN scheme was able to achieve a 79% dose reduction while preserving details of MCs. Experimental results demonstrated that our method achieved the highest performance among the best-known noise-reduction techniques and state-of-the-art deep-learning techniques.Clinical Relevance- Our method can decrease the dose radiation dose in DBT and maintain the image quality.
Collapse
|
5
|
Hasan Z, Key S, Habib AR, Wong E, Aweidah L, Kumar A, Sacks R, Singh N. Convolutional Neural Networks in ENT Radiology: Systematic Review of the Literature. Ann Otol Rhinol Laryngol 2023; 132:417-430. [PMID: 35651308 DOI: 10.1177/00034894221095899] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
INTRODUCTION Convolutional neural networks (CNNs) represent a state-of-the-art methodological technique in AI and deep learning, and were specifically created for image classification and computer vision tasks. CNNs have been applied in radiology in a number of different disciplines, mostly outside otolaryngology, potentially due to a lack of familiarity with this technology within the otolaryngology community. CNNs have the potential to revolutionize clinical practice by reducing the time required to perform manual tasks. This literature search aims to present a comprehensive systematic review of the published literature with regard to CNNs and their utility to date in ENT radiology. METHODS Data were extracted from a variety of databases including PubMED, Proquest, MEDLINE Open Knowledge Maps, and Gale OneFile Computer Science. Medical subject headings (MeSH) terms and keywords were used to extract related literature from each databases inception to October 2020. Inclusion criteria were studies where CNNs were used as the main intervention and CNNs focusing on radiology relevant to ENT. Titles and abstracts were reviewed followed by the contents. Once the final list of articles was obtained, their reference lists were also searched to identify further articles. RESULTS Thirty articles were identified for inclusion in this study. Studies utilizing CNNs in most ENT subspecialties were identified. Studies utilized CNNs for a number of tasks including identification of structures, presence of pathology, and segmentation of tumors for radiotherapy planning. All studies reported a high degree of accuracy of CNNs in performing the chosen task. CONCLUSION This study provides a better understanding of CNN methodology used in ENT radiology demonstrating a myriad of potential uses for this exciting technology including nodule and tumor identification, identification of anatomical variation, and segmentation of tumors. It is anticipated that this field will continue to evolve and these technologies and methodologies will become more entrenched in our everyday practice.
Collapse
Affiliation(s)
- Zubair Hasan
- Faculty of Medicine and Health, University of Sydney, Camperdown, NSW, Australia
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Westmead, NSW, Australia
| | - Seraphina Key
- Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, VIC, Australia
| | - Al-Rahim Habib
- Faculty of Medicine and Health, University of Sydney, Camperdown, NSW, Australia
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Westmead, NSW, Australia
- Department of Otolaryngology - Head and Neck Surgery, Princess Alexandra Hospital, Woolloongabba, QLD, Australia
| | - Eugene Wong
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Westmead, NSW, Australia
| | - Layal Aweidah
- Faculty of Medicine, University of Notre Dame, Darlinghurst, NSW, Australia
| | - Ashnil Kumar
- School of Biomedical Engineering, Faculty of Engineering, University of Sydney, Darlington, NSW, Australia
| | - Raymond Sacks
- Faculty of Medicine and Health, University of Sydney, Camperdown, NSW, Australia
- Department of Otolaryngology - Head and Neck Surgery, Concord Hospital, Concord, NSW, Australia
| | - Narinder Singh
- Faculty of Medicine and Health, University of Sydney, Camperdown, NSW, Australia
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Westmead, NSW, Australia
| |
Collapse
|
6
|
Kaur P, Kaur A. Review of Progress in Diagnostic Studies of Autism Spectrum Disorder Using Neuroimaging. Interdiscip Sci 2023; 15:111-130. [PMID: 36633792 DOI: 10.1007/s12539-022-00548-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Revised: 12/27/2022] [Accepted: 12/27/2022] [Indexed: 01/13/2023]
Abstract
This review article summarizes the recent advances in the diagnostic studies of autism spectrum disorders (ASDs) considering some of the most influential research articles from the last two decades. ASD is a heterogeneous neurodevelopmental disorder characterized by abnormalities in social interaction, communication, and behavioral patterns as well as some unique strengths and differences. The current diagnosis systems are based on autism diagnostic observation schedule (ADOS) or autism diagnostic interview-revised (ADI-R), but biological markers are also important for an effective diagnosis of ASDs. The amalgamation of neuroimaging techniques, such as structural and functional magnetic resonance imaging (sMRI and fMRI), with machine-learning and deep-learning approaches helps throw new light on typical biological markers of ASDs at the early stage of life. To assess the performance of a deep neural network, we develop a light-weighted CNN model for ASD classification. The overall accuracy, precision, and F1-score of the proposed model are 99.92%, 99.93% and 99.92%, respectively. All the neuroimaging studies we have reviewed can be divided into 3 categories, viz. thickness, volume and functional connectivity-based studies. We conclude with a discussion of the major findings of considered studies and promising directions for future research in this field.
Collapse
Affiliation(s)
- Palwinder Kaur
- Department of Computer Science and Technology, Central University of Punjab, Bathinda, Punjab, 151001, India
| | - Amandeep Kaur
- Department of Computer Science and Technology, Central University of Punjab, Bathinda, Punjab, 151001, India.
| |
Collapse
|
7
|
Computer-Aided Diagnosis of Pulmonary Nodules in Rheumatoid Arthritis. Life (Basel) 2022; 12:life12111935. [PMID: 36431070 PMCID: PMC9697803 DOI: 10.3390/life12111935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Revised: 11/17/2022] [Accepted: 11/18/2022] [Indexed: 11/22/2022] Open
Abstract
(1) Background: Rheumatoid arthritis (RA) is considered a systemic inflammatory pathology characterized by symmetric polyarthritis associated with extra-articular manifestations, such as lung disease. The purpose of the present study is to use CAD in the detection of rheumatoid pulmonary nodules. In addition, we aim to identify the characteristics and associations between clinical, laboratory and imaging data in patients with rheumatoid arthritis and lung nodules. (2) Methods: The study included a number of 42 patients diagnosed with rheumatoid arthritis according to the 2010 American College of Rheumatology (ACR)/European League Against Rheumatism (EULAR) criteria, examined from January 2017 to November 2022 in the Departments of Rheumatology and Radiology and Medical Imaging of the University of Medicine and Pharmacy of Craiova. Medical records were reviewed. A retrospective blinded review of CT for biopsy-proven pulmonary nodules in RA using Veolity LungCAD software was performed (MeVis Medical Solutions AG, Bremen, Germany). Imaging was also reviewed by a senior radiologist. (3) Results: The interobserver agreement proved to be moderate (κ = 0.478) for the overall examined cases. CAD interpretation resulted in false positive results in the case of 12 lung nodules, whereas false negative results were reported in the case of 8 lung nodules. The mean time it took for the detection of lung nodules using CAD was 4.2 min per patient, whereas the detection of lung nodules by the radiologist was 8.1 min per patient. This resulted in a faster interpretation of lung CT scans, almost reducing the detection time by half (p < 0.001). (4) Conclusions: The CAD software is useful in identifying lung nodules, in shortening the interpretation time of the CT examination and also in aiding the radiologist in better assessing all the pulmonary lung nodules. However, the CAD software cannot replace the human eye yet due to the relative high rate of false positive and false negative results.
Collapse
|
8
|
Saihood A, Karshenas H, Nilchi ARN. Deep fusion of gray level co-occurrence matrices for lung nodule classification. PLoS One 2022; 17:e0274516. [PMID: 36174073 PMCID: PMC9521911 DOI: 10.1371/journal.pone.0274516] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 08/28/2022] [Indexed: 11/19/2022] Open
Abstract
Lung cancer is a serious threat to human health, with millions dying because of its late diagnosis. The computerized tomography (CT) scan of the chest is an efficient method for early detection and classification of lung nodules. The requirement for high accuracy in analyzing CT scan images is a significant challenge in detecting and classifying lung cancer. In this paper, a new deep fusion structure based on the long short-term memory (LSTM) has been introduced, which is applied to the texture features computed from lung nodules through new volumetric grey-level-co-occurrence-matrices (GLCMs), classifying the nodules into benign, malignant, and ambiguous. Also, an improved Otsu segmentation method combined with the water strider optimization algorithm (WSA) is proposed to detect the lung nodules. WSA-Otsu thresholding can overcome the fixed thresholds and time requirement restrictions in previous thresholding methods. Extended experiments are used to assess this fusion structure by considering 2D-GLCM based on 2D-slices and approximating the proposed 3D-GLCM computations based on volumetric 2.5D-GLCMs. The proposed methods are trained and assessed through the LIDC-IDRI dataset. The accuracy, sensitivity, and specificity obtained for 2D-GLCM fusion are 94.4%, 91.6%, and 95.8%, respectively. For 2.5D-GLCM fusion, the accuracy, sensitivity, and specificity are 97.33%, 96%, and 98%, respectively. For 3D-GLCM, the accuracy, sensitivity, and specificity of the proposed fusion structure reached 98.7%, 98%, and 99%, respectively, outperforming most state-of-the-art counterparts. The results and analysis also indicate that the WSA-Otsu method requires a shorter execution time and yields a more accurate thresholding process.
Collapse
Affiliation(s)
- Ahmed Saihood
- Artificial Intelligence Department, Faculty of Computer Engineering, University of Isfahan, Isfahan, Iran
- Faculty of Computer Science and Mathematics, University of Thi-Qar, Nasiriyah, Thi-Qar, Iraq
| | - Hossein Karshenas
- Artificial Intelligence Department, Faculty of Computer Engineering, University of Isfahan, Isfahan, Iran
| | - Ahmad Reza Naghsh Nilchi
- Artificial Intelligence Department, Faculty of Computer Engineering, University of Isfahan, Isfahan, Iran
| |
Collapse
|
9
|
Lee JH, Hwang EJ, Kim H, Park CM. A narrative review of deep learning applications in lung cancer research: from screening to prognostication. Transl Lung Cancer Res 2022; 11:1217-1229. [PMID: 35832457 PMCID: PMC9271435 DOI: 10.21037/tlcr-21-1012] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 05/16/2022] [Indexed: 01/17/2023]
Abstract
Background and Objective Deep learning (DL) algorithms have been developed for various tasks, including lung nodule detection on chest radiographs or lung cancer computed tomography screening, potential candidate selection in lung cancer screening, malignancy prediction for indeterminate pulmonary nodules, lung cancer staging, treatment response prediction, prognostication, and prediction of genetic mutations in lung cancer. Furthermore, these DL algorithms have been applied in various clinical settings in order for them to be generalized in real-world clinical practice. Multiple DL algorithms have been corroborated to be on par with experts or current clinical prediction models for several specific tasks. However, no article has yet comprehensively reviewed DL algorithms dedicated to lung cancer research. This narrative review presents an overview of the literature dealing with DL techniques applied in lung cancer research and briefly summarizes the results according to the DL algorithms’ clinical use cases. Methods we performed a narrative review by searching the Embase and OVID-MEDLINE databases for articles published in English from October, 2016 until September, 2021 and reviewing the bibliographies of key references to identify important literature related to DL in lung cancer research. The background, development, results, and clinical implications of each DL algorithm are briefly discussed. Lastly, we end this review article by highlighting future directions in lung cancer research using DL techniques. Key Content and Findings DL algorithms have been introduced to show comparable or higher performance than human experts in various clinical settings. Specifically, they have been actively applied to detect lung nodules in chest radiographs or computed tomography (CT) examinations, optimize candidate selection for lung cancer screening (LCS), predict the malignancy of lung nodules, stage lung cancer, and predict treatment response, patients’ prognoses, and genetic mutations in lung cancers. Conclusions DL algorithms have corroborated their potential value for various tasks, ranging from lung cancer screening to prognostication of lung cancer patients. Future research is warranted for the clinical application of these algorithms in daily clinical practice and verification of their real-world clinical usefulness.
Collapse
Affiliation(s)
- Jong Hyuk Lee
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea
| | - Eui Jin Hwang
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea
| | - Hyungjin Kim
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea
| | - Chang Min Park
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea.,Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
| |
Collapse
|
10
|
Yick HTV, Chan PK, Wen C, Fung WC, Yan CH, Chiu KY. Artificial intelligence reshapes current understanding and management of osteoarthritis: A narrative review. JOURNAL OF ORTHOPAEDICS, TRAUMA AND REHABILITATION 2022. [DOI: 10.1177/22104917221082315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Current practice of osteoarthritis has its insufficiencies which researchers are tackling with artificial intelligence (AI). This article discusses three kinds of AI models, namely diagnostic models, prediction models and morphological models. Diagnostic models enhance efficiency in diagnosis by providing an automated algorithm in knee images processing. Prediction models utilize behavioral and radiological data to assess the risk of osteoarthritis before symptom onset and needs to perform surgery. Morphological models detect biomechanical changes to facilitate understanding of pathophysiology and provide personalized intervention. Through reviewing present evidence, we demonstrate that AI could assist doctors in diagnosis, predict osteoarthritis and guide future research.
Collapse
Affiliation(s)
- Hin Ting Victor Yick
- Department of Orthopaedics and Traumatology, Queen Mary Hospital, University of Hong Kong, Hong Kong, Hong Kong SAR
| | - Ping Keung Chan
- Department of Orthopaedics and Traumatology, Queen Mary Hospital, University of Hong Kong, Hong Kong, Hong Kong SAR
| | - Chunyi Wen
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR
| | - Wing Chiu Fung
- Department of Orthopaedics and Traumatology, Queen Mary Hospital, University of Hong Kong, Hong Kong, Hong Kong SAR
| | - Chun Hoi Yan
- Department of Orthopaedics and Traumatology, Queen Mary Hospital, University of Hong Kong, Hong Kong, Hong Kong SAR
| | - Kwong Yuen Chiu
- Department of Orthopaedics and Traumatology, Queen Mary Hospital, University of Hong Kong, Hong Kong, Hong Kong SAR
| |
Collapse
|
11
|
Kim Y, Park JY, Hwang EJ, Lee SM, Park CM. Applications of artificial intelligence in the thorax: a narrative review focusing on thoracic radiology. J Thorac Dis 2021; 13:6943-6962. [PMID: 35070379 PMCID: PMC8743417 DOI: 10.21037/jtd-21-1342] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Accepted: 12/14/2021] [Indexed: 12/12/2022]
Abstract
OBJECTIVE This review will focus on how AI-and, specifically, deep learning-can be applied to complement aspects of the current healthcare system. We describe how AI-based tools can augment existing clinical workflows by discussing the applications of AI to worklist prioritization and patient triage, the performance-boosting effects of AI as a second reader, and the use of AI to facilitate complex quantifications. We also introduce prominent examples of recent AI applications, such as tuberculosis screening in resource-constrained environments, the detection of lung cancer with screening CT, and the diagnosis of COVID-19. We also provide examples of prognostic predictions and new discoveries beyond existing clinical practices. BACKGROUND Artificial intelligence (AI) has shown promising performance for thoracic diseases, particularly in the field of thoracic radiology. However, it has not yet been established how AI-based image analysis systems can help physicians in clinical practice. METHODS This review included peer-reviewed research articles on AI in the thorax published in English between 2015 and 2021. CONCLUSIONS With advances in technology and appropriate preparation of physicians, AI could address various clinical problems that have not been solved due to a lack of clinical resources or technological limitations. KEYWORDS Artificial intelligence (AI); deep learning (DL); computer aided diagnosis (CAD); thoracic radiology; pulmonary medicine.
Collapse
Affiliation(s)
- Yisak Kim
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
- Integrated Major in Innovative Medical Science, Seoul National University Graduate School, Seoul, Korea
| | - Ji Yoon Park
- Department of Radiology, Seoul National University College of Medicine, Seoul, Korea
| | - Eui Jin Hwang
- Department of Radiology, Seoul National University College of Medicine, Seoul, Korea
| | - Sang Min Lee
- Departments of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Chang Min Park
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
- Integrated Major in Innovative Medical Science, Seoul National University Graduate School, Seoul, Korea
- Department of Radiology, Seoul National University College of Medicine, Seoul, Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
| |
Collapse
|
12
|
An F, Li X, Ma X. Medical Image Classification Algorithm Based on Visual Attention Mechanism-MCNN. OXIDATIVE MEDICINE AND CELLULAR LONGEVITY 2021; 2021:6280690. [PMID: 33688390 PMCID: PMC7914083 DOI: 10.1155/2021/6280690] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Revised: 02/02/2021] [Accepted: 02/06/2021] [Indexed: 11/23/2022]
Abstract
Due to the complexity of medical images, traditional medical image classification methods have been unable to meet the actual application needs. In recent years, the rapid development of deep learning theory has provided a technical approach for solving medical image classification. However, deep learning has the following problems in the application of medical image classification. First, it is impossible to construct a deep learning model with excellent performance according to the characteristics of medical images. Second, the current deep learning network structure and training strategies are less adaptable to medical images. Therefore, this paper first introduces the visual attention mechanism into the deep learning model so that the information can be extracted more effectively according to the problem of medical images, and the reasoning is realized at a finer granularity. It can increase the interpretability of the model. Additionally, to solve the problem of matching the deep learning network structure and training strategy to medical images, this paper will construct a novel multiscale convolutional neural network model that can automatically extract high-level discriminative appearance features from the original image, and the loss function uses the Mahalanobis distance optimization model to obtain a better training strategy, which can improve the robust performance of the network model. The medical image classification task is completed by the above method. Based on the above ideas, this paper proposes a medical classification algorithm based on a visual attention mechanism-multiscale convolutional neural network. The lung nodules and breast cancer images were classified by the method in this paper. The experimental results show that the accuracy of medical image classification in this paper is not only higher than that of traditional machine learning methods but also improved compared with other deep learning methods, and the method has good stability and robustness.
Collapse
Affiliation(s)
- Fengping An
- School of Physics and Electronic Electrical Engineering, Huaiyin Normal University, Huaian 223300, China
| | - Xiaowei Li
- School of Physics and Electronic Electrical Engineering, Huaiyin Normal University, Huaian 223300, China
| | - Xingmin Ma
- System Second Department, North China Institute of Computing Technology, Beijing 100083, China
| |
Collapse
|
13
|
Applications of Deep Learning in Biomedicine. SYSTEMS MEDICINE 2021. [DOI: 10.1016/b978-0-12-801238-3.11507-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
|
14
|
Fukuoka D. [The History and Current Status of Artificial Intelligence in Radiation Technology]. Nihon Hoshasen Gijutsu Gakkai Zasshi 2020; 76:1197-1202. [PMID: 33229849 DOI: 10.6009/jjrt.2020_jsrt_76.11.1197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Daisuke Fukuoka
- The United Graduate School of Drug Discovery and Medical Information Sciences, Gifu University
| |
Collapse
|
15
|
Debelee TG, Kebede SR, Schwenker F, Shewarega ZM. Deep Learning in Selected Cancers' Image Analysis-A Survey. J Imaging 2020; 6:121. [PMID: 34460565 PMCID: PMC8321208 DOI: 10.3390/jimaging6110121] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Revised: 10/19/2020] [Accepted: 10/26/2020] [Indexed: 02/08/2023] Open
Abstract
Deep learning algorithms have become the first choice as an approach to medical image analysis, face recognition, and emotion recognition. In this survey, several deep-learning-based approaches applied to breast cancer, cervical cancer, brain tumor, colon and lung cancers are studied and reviewed. Deep learning has been applied in almost all of the imaging modalities used for cervical and breast cancers and MRIs for the brain tumor. The result of the review process indicated that deep learning methods have achieved state-of-the-art in tumor detection, segmentation, feature extraction and classification. As presented in this paper, the deep learning approaches were used in three different modes that include training from scratch, transfer learning through freezing some layers of the deep learning network and modifying the architecture to reduce the number of parameters existing in the network. Moreover, the application of deep learning to imaging devices for the detection of various cancer cases has been studied by researchers affiliated to academic and medical institutes in economically developed countries; while, the study has not had much attention in Africa despite the dramatic soar of cancer risks in the continent.
Collapse
Affiliation(s)
- Taye Girma Debelee
- Artificial Intelligence Center, 40782 Addis Ababa, Ethiopia; (S.R.K.); (Z.M.S.)
- College of Electrical and Mechanical Engineering, Addis Ababa Science and Technology University, 120611 Addis Ababa, Ethiopia
| | - Samuel Rahimeto Kebede
- Artificial Intelligence Center, 40782 Addis Ababa, Ethiopia; (S.R.K.); (Z.M.S.)
- Department of Electrical and Computer Engineering, Debreberhan University, 445 Debre Berhan, Ethiopia
| | - Friedhelm Schwenker
- Institute of Neural Information Processing, University of Ulm, 89081 Ulm, Germany;
| | | |
Collapse
|
16
|
Liew CJY, Leong LCH, Teo LLS, Ong CC, Cheah FK, Tham WP, Salahudeen HMM, Lee CH, Kaw GJL, Tee AKH, Tsou IYY, Tay KH, Quah R, Tan BP, Chou H, Tan D, Poh ACC, Tan AGS. A practical and adaptive approach to lung cancer screening: a review of international evidence and position on CT lung cancer screening in the Singaporean population by the College of Radiologists Singapore. Singapore Med J 2020; 60:554-559. [PMID: 31781779 DOI: 10.11622/smedj.2019145] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Lung cancer is the leading cause of cancer-related death around the world, being the top cause of cancer-related deaths among men and the second most common cause of cancer-related deaths among women in Singapore. Currently, no screening programme for lung cancer exists in Singapore. Since there is mounting evidence indicating a different epidemiology of lung cancer in Asian countries, including Singapore, compared to the rest of the world, a unique and adaptive approach must be taken for a screening programme to be successful at reducing mortality while maintaining cost-effectiveness and a favourable risk-benefit ratio. This review article promotes the use of low-dose computed tomography of the chest and explores the radiological challenges and future directions.
Collapse
Affiliation(s)
| | | | - Lynette Li San Teo
- Department of Diagnostic Imaging, National University Hospital, Singapore
| | - Ching Ching Ong
- Department of Diagnostic Imaging, National University Hospital, Singapore
| | - Foong Koon Cheah
- Department of Diagnostic Radiology, Singapore General Hospital, Singapore
| | - Wei Ping Tham
- Department of Diagnostic Radiology, Singapore General Hospital, Singapore
| | | | - Chau Hung Lee
- Department of Diagnostic Radiology, Tan Tock Seng Hospital, Singapore
| | | | - Augustine Kim Huat Tee
- Department of Respiratory and Critical Care Medicine, Changi General Hospital, Singapore
| | - Ian Yu Yan Tsou
- Department of Diagnostic Radiology, Mount Elizabeth Hospital, Singapore
| | - Kiang Hiong Tay
- Department of Diagnostic Radiology, Singapore General Hospital, Singapore
| | - Raymond Quah
- Department of Diagnostic Radiology, Farrer Park Hospital, Singapore
| | - Bien Peng Tan
- Department of Diagnostic Radiology, Tan Tock Seng Hospital, Singapore
| | - Hong Chou
- Department of Diagnostic Radiology, Khoo Teck Puat Hospital, Singapore
| | - Daniel Tan
- Department of Diagnostic Radiology Oncology, Farrer Park Hospital, Singapore
| | | | | |
Collapse
|
17
|
Lai YC, Chiu CH, Cai ZQ, Lin JY, Yao CY, Lyu DY, Lee SY, Chen KW, Chen IY. OCT-Based Periodontal Inspection Framework. SENSORS (BASEL, SWITZERLAND) 2019; 19:E5496. [PMID: 31842494 PMCID: PMC6960521 DOI: 10.3390/s19245496] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 12/07/2019] [Accepted: 12/09/2019] [Indexed: 11/23/2022]
Abstract
Periodontal diagnosis requires discovery of the relations among teeth, gingiva (i.e., gums), and alveolar bones, but alveolar bones are inside gingiva and not visible for inspection. Traditional probe examination causes pain, and X-ray based examination is not suited for frequent inspection. This work develops an automatic non-invasive periodontal inspection framework based on gum penetrative Optical Coherence Tomography (OCT), which can be frequently applied without high radiation. We sum up interference responses of all penetration depths for all shooting directions respectively to form the shooting amplitude projection. Because the reaching interference strength decays exponentially with tissues' penetration depth, this projection mainly reveals the responses of the top most gingiva or teeth. Since gingiva and teeth have different air-tissue responses, the gumline, revealing itself as an obvious boundary between teeth and gingiva, is the basis line for periodontal inspection. Our system can also automatically identify regions of gingiva, teeth, and alveolar bones from slices of the cross-sectional volume. Although deep networks can successfully and possibly segment noisy maps, reducing the number of manually labeled maps for training is critical for our framework. In order to enhance the effectiveness and efficiency of training and classification, we adjust Snake segmentation to consider neighboring slices in order to locate those regions possibly containing gingiva-teeth and gingiva-alveolar boundaries. Additionally, we also adapt a truncated direct logarithm based on the Snake-segmented region for intensity quantization to emphasize these boundaries for easier identification. Later, the alveolar-gingiva boundary point directly under the gumline is the desired alveolar sample, and we can measure the distance between the gumline and alveolar line for visualization and direct periodontal inspection. At the end, we experimentally verify our choice in intensity quantization and boundary identification against several other algorithms while applying the framework to locate gumline and alveolar line in vivo data successfully.
Collapse
Affiliation(s)
- Yu-Chi Lai
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| | - Chia-Hsing Chiu
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| | - Zhong-Qi Cai
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| | - Jin-Yang Lin
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| | - Chih-Yuan Yao
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| | - Dong-Yuan Lyu
- Department of Dentistry, National Yang-Ming University, Taipei 112, Taiwan; (D.-Y.L.)
| | - Shyh-Yuan Lee
- Department of Dentistry, National Yang-Ming University, Taipei 112, Taiwan; (D.-Y.L.)
- Department of Stomatology, Taipei Veterans General Hospital, Taipei 112, Taiwan
- Department of Dentistry, Taipei City Hospital, Taipei 103, Taiwan
| | - Kuo-Wei Chen
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| | - I-Yu Chen
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-C.L.); (C.-H.C.); (Z.-Q.C.); (J.-Y.L.); (K.-W.C.); (I.-Y.C.)
| |
Collapse
|
18
|
Gruetzemacher R, Gupta A, Paradice D. 3D deep learning for detecting pulmonary nodules in CT scans. J Am Med Inform Assoc 2019; 25:1301-1310. [PMID: 30137371 DOI: 10.1093/jamia/ocy098] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Accepted: 07/03/2018] [Indexed: 01/09/2023] Open
Abstract
Objective To demonstrate and test the validity of a novel deep-learning-based system for the automated detection of pulmonary nodules. Materials and Methods The proposed system uses 2 3D deep learning models, 1 for each of the essential tasks of computer-aided nodule detection: candidate generation and false positive reduction. A total of 888 scans from the LIDC-IDRI dataset were used for training and evaluation. Results Results for candidate generation on the test data indicated a detection rate of 94.77% with 30.39 false positives per scan, while the test results for false positive reduction exhibited a sensitivity of 94.21% with 1.789 false positives per scan. The overall system detection rate on the test data was 89.29% with 1.789 false positives per scan. Discussion An extensive and rigorous validation was conducted to assess the performance of the proposed system. The system demonstrated a novel combination of 3D deep neural network architectures and demonstrates the use of deep learning for both candidate generation and false positive reduction to be evaluated with a substantial test dataset. The results strongly support the ability of deep learning pulmonary nodule detection systems to generalize to unseen data. The source code and trained model weights have been made available. Conclusion A novel deep-neural-network-based pulmonary nodule detection system is demonstrated and validated. The results provide comparison of the proposed deep-learning-based system over other similar systems based on performance.
Collapse
Affiliation(s)
- Ross Gruetzemacher
- Department of Systems & Technology, Raymond J. Harbert College of Business, Auburn University, Auburn, AL, USA 36849
| | - Ashish Gupta
- Department of Systems & Technology, Raymond J. Harbert College of Business, Auburn University, Auburn, AL, USA 36849
| | - David Paradice
- Department of Systems & Technology, Raymond J. Harbert College of Business, Auburn University, Auburn, AL, USA 36849
| |
Collapse
|
19
|
Evolving the pulmonary nodules diagnosis from classical approaches to deep learning-aided decision support: three decades' development course and future prospect. J Cancer Res Clin Oncol 2019; 146:153-185. [PMID: 31786740 DOI: 10.1007/s00432-019-03098-5] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Accepted: 11/25/2019] [Indexed: 02/06/2023]
Abstract
PURPOSE Lung cancer is the commonest cause of cancer deaths worldwide, and its mortality can be reduced significantly by performing early diagnosis and screening. Since the 1960s, driven by the pressing needs to accurately and effectively interpret the massive volume of chest images generated daily, computer-assisted diagnosis of pulmonary nodule has opened up new opportunities to relax the limitation from physicians' subjectivity, experiences and fatigue. And the fair access to the reliable and affordable computer-assisted diagnosis will fight the inequalities in incidence and mortality between populations. It has been witnessed that significant and remarkable advances have been achieved since the 1980s, and consistent endeavors have been exerted to deal with the grand challenges on how to accurately detect the pulmonary nodules with high sensitivity at low false-positive rate as well as on how to precisely differentiate between benign and malignant nodules. There is a lack of comprehensive examination of the techniques' development which is evolving the pulmonary nodules diagnosis from classical approaches to machine learning-assisted decision support. The main goal of this investigation is to provide a comprehensive state-of-the-art review of the computer-assisted nodules detection and benign-malignant classification techniques developed over three decades, which have evolved from the complicated ad hoc analysis pipeline of conventional approaches to the simplified seamlessly integrated deep learning techniques. This review also identifies challenges and highlights opportunities for future work in learning models, learning algorithms and enhancement schemes for bridging current state to future prospect and satisfying future demand. CONCLUSION It is the first literature review of the past 30 years' development in computer-assisted diagnosis of lung nodules. The challenges indentified and the research opportunities highlighted in this survey are significant for bridging current state to future prospect and satisfying future demand. The values of multifaceted driving forces and multidisciplinary researches are acknowledged that will make the computer-assisted diagnosis of pulmonary nodules enter into the main stream of clinical medicine and raise the state-of-the-art clinical applications as well as increase both welfares of physicians and patients. We firmly hold the vision that fair access to the reliable, faithful, and affordable computer-assisted diagnosis for early cancer diagnosis would fight the inequalities in incidence and mortality between populations, and save more lives.
Collapse
|
20
|
The Performance of Deep Learning Algorithms on Automatic Pulmonary Nodule Detection and Classification Tested on Different Datasets That Are Not Derived from LIDC-IDRI: A Systematic Review. Diagnostics (Basel) 2019; 9:diagnostics9040207. [PMID: 31795409 PMCID: PMC6963966 DOI: 10.3390/diagnostics9040207] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 11/25/2019] [Accepted: 11/28/2019] [Indexed: 12/27/2022] Open
Abstract
The aim of this study was to systematically review the performance of deep learning technology in detecting and classifying pulmonary nodules on computed tomography (CT) scans that were not from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) database. Furthermore, we explored the difference in performance when the deep learning technology was applied to test datasets different from the training datasets. Only peer-reviewed, original research articles utilizing deep learning technology were included in this study, and only results from testing on datasets other than the LIDC-IDRI were included. We searched a total of six databases: EMBASE, PubMed, Cochrane Library, the Institute of Electrical and Electronics Engineers, Inc. (IEEE), Scopus, and Web of Science. This resulted in 1782 studies after duplicates were removed, and a total of 26 studies were included in this systematic review. Three studies explored the performance of pulmonary nodule detection only, 16 studies explored the performance of pulmonary nodule classification only, and 7 studies had reports of both pulmonary nodule detection and classification. Three different deep learning architectures were mentioned amongst the included studies: convolutional neural network (CNN), massive training artificial neural network (MTANN), and deep stacked denoising autoencoder extreme learning machine (SDAE-ELM). The studies reached a classification accuracy between 68–99.6% and a detection accuracy between 80.6–94%. Performance of deep learning technology in studies using different test and training datasets was comparable to studies using same type of test and training datasets. In conclusion, deep learning was able to achieve high levels of accuracy, sensitivity, and/or specificity in detecting and/or classifying nodules when applied to pulmonary CT scans not from the LIDC-IDRI database.
Collapse
|
21
|
Huang W, Xue Y, Wu Y. A CAD system for pulmonary nodule prediction based on deep three-dimensional convolutional neural networks and ensemble learning. PLoS One 2019; 14:e0219369. [PMID: 31299053 PMCID: PMC6625700 DOI: 10.1371/journal.pone.0219369] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2018] [Accepted: 06/21/2019] [Indexed: 01/08/2023] Open
Abstract
Background Detection of pulmonary nodules is an important aspect of an automatic detection system. Incomputer-aided diagnosis (CAD) systems, the ability to detect pulmonary nodules is highly important, which plays an important role in the diagnosis and early treatment of lung cancer. Currently, the detection of pulmonary nodules depends mainly on doctor experience, which varies. This paper aims to address the challenge of pulmonary nodule detection more effectively. Methods A method for detecting pulmonary nodules based on an improved neural network is presented in this paper. Nodules are clusters of tissue with a diameter of 3 mm to 30 mm in the pulmonary parenchyma. Because pulmonary nodules are similar to other lung structures and have a low density, false positive nodules often occur. Thus, our team proposed an improved convolutional neural network (CNN) framework to detect nodules. First, a nonsharpening mask is used to enhance the nodules in computed tomography (CT) images; then, CT images of 512×512 pixels are segmented into smaller images of 96×96 pixels. Second, in the 96×96 pixel images which contain or exclude pulmonary nodules, the plaques corresponding to positive and negative samples are segmented. Third, CT images segmented into 96×96 pixels are down-sampled to 64×64 and 32×32 size respectively. Fourth, an improved fusion neural network structure is constructed that consists of three three-dimensional convolutional neural networks, designated as CNN-1, CNN-2, and CNN-3, to detect false positive pulmonary nodules. The networks’ input sizes are 32×32×32, 64×64×64, and 96×96×96 and include 5, 7, and 9 layers, respectively. Finally, we use the AdaBoost classifier to fuse the results of CNN-1, CNN-2, and CNN-3. We call this new neural network framework the Amalgamated-Convolutional Neural Network (A-CNN) and use it to detect pulmonary nodules. Findings Our team trained A-CNN using the LUNA16 and Ali Tianchi datasets and evaluated its performance using the LUNA16 dataset. We discarded nodules less than 5mm in diameter. When the average number of false positives per scan was 0.125 and 0.25, the sensitivity of A-CNN reached as high as 81.7% and 85.1%, respectively.
Collapse
Affiliation(s)
- Wenkai Huang
- Center for Research on Leading Technology of Special Equipment, School of Mechanical & Electrical Engineering, Guangzhou University, Guangzhou, P.R. China
| | - Yihao Xue
- School of Mechanical & Electrical Engineering, Guangzhou University, Guangzhou, P.R. China
| | - Yu Wu
- Laboratory Center, Guangzhou University, Guangzhou, P.R. China
- * E-mail:
| |
Collapse
|
22
|
Shaukat F, Raja G, Frangi AF. Computer-aided detection of lung nodules: a review. J Med Imaging (Bellingham) 2019. [DOI: 10.1117/1.jmi.6.2.020901] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Affiliation(s)
- Furqan Shaukat
- University of Engineering and Technology, Department of Electrical Engineering, Taxila
| | - Gulistan Raja
- University of Engineering and Technology, Department of Electrical Engineering, Taxila
| | - Alejandro F. Frangi
- University of Leeds Woodhouse Lane, School of Computing and School of Medicine, Leeds
| |
Collapse
|
23
|
Zarshenas A, Liu J, Forti P, Suzuki K. Separation of bones from soft tissue in chest radiographs: Anatomy-specific orientation-frequency-specific deep neural network convolution. Med Phys 2019; 46:2232-2242. [PMID: 30848498 DOI: 10.1002/mp.13468] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2018] [Revised: 02/25/2019] [Accepted: 02/27/2019] [Indexed: 01/02/2023] Open
Abstract
PURPOSE Lung nodules that are missed by radiologists as well as by computer-aided detection (CAD) systems mostly overlap with ribs and clavicles. Removing the bony structures would result in better visualization of undetectable lesions. Our purpose in this study was to develop a virtual dual-energy imaging system to separate ribs and clavicles from soft tissue in chest radiographs. METHODS We developed a mixture of anatomy-specific, orientation-frequency-specific (ASOFS) deep neural network convolution (NNC) experts. Anatomy-specific (AS) NNC was designed to separate the bony structures from soft tissue in different lung segments. While an AS design was proposed previously under our massive-training artificial neural networks (MTANN) framework, in this work, we newly mathematically defined an AS experts model as well as its learning and inference strategies in a probabilistic deep-learning framework. In addition, in combination with our AS experts design, we newly proposed the orientation-frequency-specific (OFS) NNC models to decompose bone and soft-tissue structures into specific orientation-frequency components of different scales using a multi-resolution decomposition technique. We trained multiple NNC models, each of which is an expert for a specific orientation-frequency component in a particular anatomic segment. Perfect reconstruction discrete wavelet transform was used for OFS decomposition/reconstruction, while we introduced a soft-gating layer to merge the predictions of AS NNC experts. To train our model, we used the bone images obtained from a dual-energy system as the target (or teaching) images while the standard chest radiographs were used as the input to our model. The training, validation, and test were performed in a nested two-fold cross-validation manner. RESULTS We used a database of 118 chest radiographs with pulmonary nodules to evaluate our NNC scheme. In order to evaluate our scheme, we performed quantitative and qualitative evaluation of the predicted bone and soft-tissue images from our model as well as the ones of a state-of-the-art technique where the "gold-standard" dual-energy bone and soft-tissue images were used as the reference images. Both quantitative and qualitative evaluations demonstrated that our ASOFS NNC was superior to the state-of-the-art bone-suppression technique. Particularly, our scheme was better able to maintain the conspicuity of nodules and lung vessels, comparing to the reference technique, while it separated ribs and clavicles from soft tissue. Comparing to a state-of-the-art bone suppression technique, our bone images had substantially higher (t-test; P < 0.01) similarity, in terms of structural similarity index (SSIM) and peak signal-to-noise ratio (PSNR), to the "gold-standard" dual-energy bone images. CONCLUSIONS Our deep ASOFS NNC scheme can decompose chest radiographs into their bone and soft-tissue images accurately, offering the improved conspicuity of lung nodules and vessels, and therefore would be useful for radiologists as well as CAD systems in detecting lung nodules in chest radiographs.
Collapse
Affiliation(s)
- Amin Zarshenas
- Medical Imaging Research Center & Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Junchi Liu
- Medical Imaging Research Center & Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Paul Forti
- Medical Imaging Research Center & Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Kenji Suzuki
- Medical Imaging Research Center & Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| |
Collapse
|
24
|
Kim BC, Yoon JS, Choi JS, Suk HI. Multi-scale gradual integration CNN for false positive reduction in pulmonary nodule detection. Neural Netw 2019; 115:1-10. [PMID: 30909118 DOI: 10.1016/j.neunet.2019.03.003] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Revised: 12/24/2018] [Accepted: 03/07/2019] [Indexed: 12/22/2022]
Abstract
Lung cancer is a global and dangerous disease, and its early detection is crucial for reducing the risks of mortality. In this regard, it has been of great interest in developing a computer-aided system for pulmonary nodules detection as early as possible on thoracic CT scans. In general, a nodule detection system involves two steps: (i) candidate nodule detection at a high sensitivity, which captures many false positives and (ii) false positive reduction from candidates. However, due to the high variation of nodule morphological characteristics and the possibility of mistaking them for neighboring organs, candidate nodule detection remains a challenge. In this study, we propose a novel Multi-scale Gradual Integration Convolutional Neural Network (MGI-CNN), designed with three main strategies: (1) to use multi-scale inputs with different levels of contextual information, (2) to use abstract information inherent in different input scales with gradual integration, and (3) to learn multi-stream feature integration in an end-to-end manner. To verify the efficacy of the proposed network, we conducted exhaustive experiments on the LUNA16 challenge datasets by comparing the performance of the proposed method with state-of-the-art methods in the literature. On two candidate subsets of the LUNA16 dataset, i.e., V1 and V2, our method achieved an average CPM of 0.908 (V1) and 0.942 (V2), outperforming comparable methods by a large margin. Our MGI-CNN is implemented in Python using TensorFlow and the source code is available from https://github.com/ku-milab/MGICNN.
Collapse
Affiliation(s)
- Bum-Chae Kim
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Jee Seok Yoon
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Jun-Sik Choi
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Heung-Il Suk
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea.
| |
Collapse
|
25
|
The Added Value of Computer-aided Detection of Small Pulmonary Nodules and Missed Lung Cancers. J Thorac Imaging 2019; 33:390-395. [PMID: 30239461 DOI: 10.1097/rti.0000000000000362] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Lung cancer at its earliest stage is typically manifested on computed tomography as a pulmonary nodule, which could be detected by low-dose multidetector computed tomography technology and the use of thinner collimation. Within the last 2 decades, computer-aided detection (CAD) of pulmonary nodules has been developed to meet the increasing demand for lung cancer screening computed tomography with a larger set of images per scan. This review introduced the basic techniques and then summarized the up-to-date applications of CAD systems in clinical and research programs and in the low-dose lung cancer screening trials, especially in the detection of small pulmonary nodules and missed lung cancers. Many studies have already shown that the CAD systems could increase the sensitivity and reduce the false-positive rate in the diagnosis of pulmonary nodules, especially for the small and isolated nodules. Further improvements to the current CAD schemes are needed to detect nodules accurately, particularly for subsolid nodules.
Collapse
|
26
|
Sahiner B, Pezeshk A, Hadjiiski LM, Wang X, Drukker K, Cha KH, Summers RM, Giger ML. Deep learning in medical imaging and radiation therapy. Med Phys 2019; 46:e1-e36. [PMID: 30367497 PMCID: PMC9560030 DOI: 10.1002/mp.13264] [Citation(s) in RCA: 379] [Impact Index Per Article: 75.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Revised: 09/18/2018] [Accepted: 10/09/2018] [Indexed: 12/15/2022] Open
Abstract
The goals of this review paper on deep learning (DL) in medical imaging and radiation therapy are to (a) summarize what has been achieved to date; (b) identify common and unique challenges, and strategies that researchers have taken to address these challenges; and (c) identify some of the promising avenues for the future both in terms of applications as well as technical innovations. We introduce the general principles of DL and convolutional neural networks, survey five major areas of application of DL in medical imaging and radiation therapy, identify common themes, discuss methods for dataset expansion, and conclude by summarizing lessons learned, remaining challenges, and future directions.
Collapse
Affiliation(s)
- Berkman Sahiner
- DIDSR/OSEL/CDRH U.S. Food and Drug AdministrationSilver SpringMD20993USA
| | - Aria Pezeshk
- DIDSR/OSEL/CDRH U.S. Food and Drug AdministrationSilver SpringMD20993USA
| | | | - Xiaosong Wang
- Imaging Biomarkers and Computer‐aided Diagnosis LabRadiology and Imaging SciencesNIH Clinical CenterBethesdaMD20892‐1182USA
| | - Karen Drukker
- Department of RadiologyUniversity of ChicagoChicagoIL60637USA
| | - Kenny H. Cha
- DIDSR/OSEL/CDRH U.S. Food and Drug AdministrationSilver SpringMD20993USA
| | - Ronald M. Summers
- Imaging Biomarkers and Computer‐aided Diagnosis LabRadiology and Imaging SciencesNIH Clinical CenterBethesdaMD20892‐1182USA
| | | |
Collapse
|
27
|
Dandıl E. A Computer-Aided Pipeline for Automatic Lung Cancer Classification on Computed Tomography Scans. JOURNAL OF HEALTHCARE ENGINEERING 2018; 2018:9409267. [PMID: 30515286 PMCID: PMC6236771 DOI: 10.1155/2018/9409267] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/28/2018] [Revised: 09/24/2018] [Accepted: 10/08/2018] [Indexed: 11/17/2022]
Abstract
Lung cancer is one of the most common cancer types. For the survival of the patient, early detection of lung cancer with the best treatment method is crucial. In this study, we propose a novel computer-aided pipeline on computed tomography (CT) scans for early diagnosis of lung cancer thanks to the classification of benign and malignant nodules. The proposed pipeline is composed of four stages. In preprocessing steps, CT images are enhanced, and lung volumes are extracted from the image with the help of a novel method called lung volume extraction method (LUVEM). The significance of the proposed pipeline is using LUVEM for extracting lung region. In nodule detection stage, candidate nodules are determined according to the circular Hough transform- (CHT-) based method. Then, lung nodules are segmented with self-organizing maps (SOM). In feature computation stage, intensity, shape, texture, energy, and combined features are used for feature extraction, and principal component analysis (PCA) is used for feature reduction step. In the final stage, probabilistic neural network (PNN) classifies benign and malign nodules. According to the experiments performed on our dataset, the proposed pipeline system can classify benign and malign nodules with 95.91% accuracy, 97.42% sensitivity, and 94.24% specificity. Even in cases of small-sized nodules (3-10 mm), the proposed system can determine the nodule type with 94.68% accuracy.
Collapse
Affiliation(s)
- Emre Dandıl
- Department of Computer Engineering, Faculty of Engineering, Bilecik Seyh Edebali University, Gulumbe Campus, 11210 Bilecik, Turkey
| |
Collapse
|
28
|
Aissa J, Schaarschmidt BM, Below J, Bethge OT, Böven J, Sawicki LM, Hoff NP, Kröpil P, Antoch G, Boos J. Performance and clinical impact of machine learning based lung nodule detection using vessel suppression in melanoma patients. Clin Imaging 2018; 52:328-333. [PMID: 30236779 DOI: 10.1016/j.clinimag.2018.09.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2018] [Revised: 08/14/2018] [Accepted: 09/04/2018] [Indexed: 11/21/2022]
Abstract
PURPOSE To evaluate performance and the clinical impact of a novel machine learning based vessel-suppressing computer-aided detection (CAD) software in chest computed tomography (CT) of patients with malignant melanoma. MATERIALS AND METHODS We retrospectively included consecutive malignant melanoma patients with a chest CT between 01/2015 and 01/2016. Machine learning based CAD software was used to reconstruct additional vessel-suppressed axial images. Three radiologists independently reviewed a maximum of 15 lung nodules per patient. Vessel-suppressed reconstructions were reviewed independently and results were compared. Follow-up CT examinations and clinical follow-up were used to assess the outcome. Impact of additional nodules on clinical management was assessed. RESULTS In 46 patients, vessel-suppressed axial images led to the detection of additional nodules in 25/46 (54.3%) patients. CT or clinical follow up was available in 25/25 (100%) patients with additionally detected nodules. 2/25 (8%) of these patients developed new pulmonary metastases. None of the additionally detected nodules were found to be metastases. None of the lung nodules detected by the radiologists was missed by the CAD software. The mean diameter of the 92 additional nodules was 1.5 ± 0.8 mm. The additional nodules did not affect therapeutic management. However, in 14/46 (30.4%) of patients the additional nodules might have had an impact on the radiological follow-up recommendations. CONCLUSION Machine learning based vessel suppression led to the detection of significantly more lung nodules in melanoma patients. Radiological follow-up recommendations were altered in 30% of the patients. However, all lung nodules turned out to be non-malignant on follow-up.
Collapse
Affiliation(s)
- Joel Aissa
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany.
| | | | - Janina Below
- University Dusseldorf, Medical Faculty, Clinic of Dermatology, Moorenstr. 5, D-40225 Dusseldorf, Germany
| | - Oliver Th Bethge
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany
| | - Judith Böven
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany
| | - Lino Morris Sawicki
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany
| | - Norman-Philipp Hoff
- University Dusseldorf, Medical Faculty, Clinic of Dermatology, Moorenstr. 5, D-40225 Dusseldorf, Germany
| | - Patric Kröpil
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany
| | - Gerald Antoch
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany
| | - Johannes Boos
- University Dusseldorf, Medical Faculty, Department of Diagnostic and Interventional Radiology, Germany
| |
Collapse
|
29
|
Eun H, Kim D, Jung C, Kim C. Single-view 2D CNNs with fully automatic non-nodule categorization for false positive reduction in pulmonary nodule detection. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 165:215-224. [PMID: 30337076 DOI: 10.1016/j.cmpb.2018.08.012] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2018] [Revised: 07/27/2018] [Accepted: 08/17/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVE In pulmonary nodule detection, the first stage, candidate detection, aims to detect suspicious pulmonary nodules. However, detected candidates include many false positives and thus in the following stage, false positive reduction, such false positives are reliably reduced. Note that this task is challenging due to 1) the imbalance between the numbers of nodules and non-nodules and 2) the intra-class diversity of non-nodules. Although techniques using 3D convolutional neural networks (CNNs) have shown promising performance, they suffer from high computational complexity which hinders constructing deep networks. To efficiently address these problems, we propose a novel framework using the ensemble of 2D CNNs using single views, which outperforms existing 3D CNN-based methods. METHODS Our ensemble of 2D CNNs utilizes single-view 2D patches to improve both computational and memory efficiency compared to previous techniques exploiting 3D CNNs. We first categorize non-nodules on the basis of features encoded by an autoencoder. Then, all 2D CNNs are trained by using the same nodule samples, but with different types of non-nodules. By extending the learning capability, this training scheme resolves difficulties of extracting representative features from non-nodules with large appearance variations. Note that, instead of manual categorization requiring the heavy workload of radiologists, we propose to automatically categorize non-nodules based on the autoencoder and k-means clustering. RESULTS We performed extensive experiments to validate the effectiveness of our framework based on the database of the lung nodule analysis 2016 challenge. The superiority of our framework is demonstrated through comparing the performance of five frameworks trained with differently constructed training sets. Our proposed framework achieved state-of-the-art performance (0.922 of the competition performance metric score) with low computational demands (789K of parameters and 1024M of floating point operations per second). CONCLUSION We presented a novel false positive reduction framework, the ensemble of single-view 2D CNNs with fully automatic non-nodule categorization, for pulmonary nodule detection. Unlike previous 3D CNN-based frameworks, we utilized 2D CNNs using 2D single views to improve computational efficiency. Also, our training scheme using categorized non-nodules, extends the learning capability of representative features of different non-nodules. Our framework achieved state-of-the-art performance with low computational complexity.
Collapse
Affiliation(s)
- Hyunjun Eun
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Republic of Korea
| | - Daeyeong Kim
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Republic of Korea
| | - Chanho Jung
- Department of Electrical Engineering, Hanbat National University, Republic of Korea
| | - Changick Kim
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Republic of Korea.
| |
Collapse
|
30
|
Fazal MI, Patel ME, Tye J, Gupta Y. The past, present and future role of artificial intelligence in imaging. Eur J Radiol 2018; 105:246-250. [DOI: 10.1016/j.ejrad.2018.06.020] [Citation(s) in RCA: 53] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2018] [Revised: 05/08/2018] [Accepted: 06/21/2018] [Indexed: 02/06/2023]
|
31
|
da Silva GLF, Valente TLA, Silva AC, de Paiva AC, Gattass M. Convolutional neural network-based PSO for lung nodule false positive reduction on CT images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 162:109-118. [PMID: 29903476 DOI: 10.1016/j.cmpb.2018.05.006] [Citation(s) in RCA: 50] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2017] [Revised: 09/15/2017] [Accepted: 05/03/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVE Detection of lung nodules is critical in CAD systems; this is because of their similar contrast with other structures and low density, which result in the generation of numerous false positives (FPs). Therefore, this study proposes a methodology to reduce the FP number using a deep learning technique in conjunction with an evolutionary technique. METHOD The particle swarm optimization (PSO) algorithm was used to optimize the network hyperparameters in the convolutional neural network (CNN) in order to enhance the network performance and eliminate the requirement of manual search. RESULTS The methodology was tested on computed tomography (CT) scans from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) with the highest accuracy of 97.62%, sensitivity of 92.20%, specificity of 98.64%, and area under the receiver operating characteristic (ROC) curve of 0.955. CONCLUSION The results demonstrate the high performance-potential of the PSO algorithm in the identification of optimal CNN hyperparameters for lung nodule candidate classification into nodules and non-nodules, increasing the sensitivity rates in the FP reduction step of CAD systems.
Collapse
Affiliation(s)
- Giovanni Lucca França da Silva
- Federal University of Maranhão - UFMA, Applied Computing Group - NCA Av. dos Portugueses, SN, Bacanga, São Luís, MA 65085-580, Brazil.
| | - Thales Levi Azevedo Valente
- Pontifical Catholic University of Rio de Janeiro - PUC - Rio R. São Vicente, 225, Gávea, Rio de Janeiro, RJ 22453-900, Brazil.
| | - Aristófanes Corrêa Silva
- Federal University of Maranhão - UFMA, Applied Computing Group - NCA Av. dos Portugueses, SN, Bacanga, São Luís, MA 65085-580, Brazil.
| | - Anselmo Cardoso de Paiva
- Federal University of Maranhão - UFMA, Applied Computing Group - NCA Av. dos Portugueses, SN, Bacanga, São Luís, MA 65085-580, Brazil.
| | - Marcelo Gattass
- Pontifical Catholic University of Rio de Janeiro - PUC - Rio R. São Vicente, 225, Gávea, Rio de Janeiro, RJ 22453-900, Brazil.
| |
Collapse
|
32
|
Murphy A, Skalski M, Gaillard F. The utilisation of convolutional neural networks in detecting pulmonary nodules: a review. Br J Radiol 2018; 91:20180028. [PMID: 29869919 DOI: 10.1259/bjr.20180028] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023] Open
Abstract
Lung cancer is one of the leading causes of cancer-related fatality in the world. Patients display few or even no signs or symptoms in the early stages, resulting in up to 75% of patients diagnosed in the later stages of the disease. Consequently, there has been a call for lung cancer screening amongst at-risk populations. The early detection of malignant pulmonary nodules in CT is one of the suggested methods proposed to diagnose early-stage lung cancer; however, the reported sensitivity of radiologists' ability to accurately detect pulmonary nodules ranges widely from 30 to 97%. 2012 saw Alex Krizhevsky present a paper titled "ImageNet Classification with Deep Convolutional Networks" in which a multilayered convolutional computational model known as a convolutional neural network (CNN) was confirmed competent in identifying and classifying 1.2 million images to a previously unseen level of accuracy. Since then, CNNs have gained attention as a potential tool in aiding radiologists' detection of pulmonary nodules in CT imaging. This review found the use of CNN is a viable strategy to increase the overall sensitivity of pulmonary nodule detection. Small, non-validated data sets, computational constraints, and incomparable studies are currently limited factors of the existing research.
Collapse
Affiliation(s)
- Andrew Murphy
- 1 Discipline of Medical Radiation Sciences, Faculty of Health Sciences, The University of Sydney , Sydney, NSW , Australia.,2 Department of Medical Imaging, Princess Alexandra Hospital , Brisbane, QLD , Australia
| | - Matthew Skalski
- 3 Department of Radiology, Southern California University of Health Sciences , Whittier, CA , USA
| | - Frank Gaillard
- 4 Department of Radiology, University of Melbourne , Parkville, VIC , Australia.,5 Department of Radiology, The Royal Melbourne Hospital , Parkville, VIC , Australia
| |
Collapse
|
33
|
Computerized Classification of Pneumoconiosis on Digital Chest Radiography Artificial Neural Network with Three Stages. J Digit Imaging 2018; 30:413-426. [PMID: 28108817 DOI: 10.1007/s10278-017-9942-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
Abstract
It is difficult for radiologists to classify pneumoconiosis from category 0 to category 3 on chest radiographs. Therefore, we have developed a computer-aided diagnosis (CAD) system based on a three-stage artificial neural network (ANN) method for classification based on four texture features. The image database consists of 36 chest radiographs classified as category 0 to category 3. Regions of interest (ROIs) with a matrix size of 32 × 32 were selected from chest radiographs. We obtained a gray-level histogram, histogram of gray-level difference, gray-level run-length matrix (GLRLM) feature image, and gray-level co-occurrence matrix (GLCOM) feature image in each ROI. For ROI-based classification, the first ANN was trained with each texture feature. Next, the second ANN was trained with output patterns obtained from the first ANN. Finally, we obtained a case-based classification for distinguishing among four categories with the third ANN method. We determined the performance of the third ANN by receiver operating characteristic (ROC) analysis. The areas under the ROC curve (AUC) of the highest category (severe pneumoconiosis) case and the lowest category (early pneumoconiosis) case were 0.89 ± 0.09 and 0.84 ± 0.12, respectively. The three-stage ANN with four texture features showed the highest performance for classification among the four categories. Our CAD system would be useful for assisting radiologists in classification of pneumoconiosis from category 0 to category 3.
Collapse
|
34
|
|
35
|
A Comparative Study of Modern Machine Learning Approaches for Focal Lesion Detection and Classification in Medical Images: BoVW, CNN and MTANN. INTELLIGENT SYSTEMS REFERENCE LIBRARY 2018. [DOI: 10.1007/978-3-319-68843-5_2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
|
36
|
Brown MS, Pais R, Qing P, Shah S, McNitt-Gray MF, Goldin JG, Petkovska I, Tran L, Aberle DR. An Architecture for Computer-Aided Detection and Radiologic Measurement of Lung Nodules in Clinical Trials. Cancer Inform 2017. [DOI: 10.1177/117693510700400001] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Computer tomography (CT) imaging plays an important role in cancer detection and quantitative assessment in clinical trials. High-resolution imaging studies on large cohorts of patients generate vast data sets, which are infeasible to analyze through manual interpretation. In this article we describe a comprehensive architecture for computer-aided detection (CAD) and surveillance on lung nodules in CT images. Central to this architecture are the analytic components: an automated nodule detection system, nodule tracking capabilities and volume measurement, which are integrated within a data management system that includes mechanisms for receiving and archiving images, a database for storing quantitative nodule measurements and visualization, and reporting tools. We describe two studies to evaluate CAD technology within this architecture, and the potential application in large clinical trials. The first study involves performance assessment of an automated nodule detection system and its ability to increase radiologist sensitivity when used to provide a second opinion. The second study investigates nodule volume measurements on CT made using a semi-automated technique and shows that volumetric analysis yields significantly different tumor response classifications than a 2D diameter approach. These studies demonstrate the potential of automated CAD tools to assist in quantitative image analysis for clinical trials.
Collapse
Affiliation(s)
- Matthew S. Brown
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Richard Pais
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Peiyuan Qing
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Sumit Shah
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Michael F. McNitt-Gray
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Jonathan G. Goldin
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Iva Petkovska
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Lien Tran
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| | - Denise R. Aberle
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, U.S.A
| |
Collapse
|
37
|
A unified methodology based on sparse field level sets and boosting algorithms for false positives reduction in lung nodules detection. Int J Comput Assist Radiol Surg 2017; 13:397-409. [DOI: 10.1007/s11548-017-1656-8] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2017] [Accepted: 07/31/2017] [Indexed: 01/15/2023]
|
38
|
Suzuki K. Overview of deep learning in medical imaging. Radiol Phys Technol 2017; 10:257-273. [PMID: 28689314 DOI: 10.1007/s12194-017-0406-5] [Citation(s) in RCA: 379] [Impact Index Per Article: 54.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Accepted: 06/29/2017] [Indexed: 02/07/2023]
Abstract
The use of machine learning (ML) has been increasing rapidly in the medical imaging field, including computer-aided diagnosis (CAD), radiomics, and medical image analysis. Recently, an ML area called deep learning emerged in the computer vision field and became very popular in many fields. It started from an event in late 2012, when a deep-learning approach based on a convolutional neural network (CNN) won an overwhelming victory in the best-known worldwide computer vision competition, ImageNet Classification. Since then, researchers in virtually all fields, including medical imaging, have started actively participating in the explosively growing field of deep learning. In this paper, the area of deep learning in medical imaging is overviewed, including (1) what was changed in machine learning before and after the introduction of deep learning, (2) what is the source of the power of deep learning, (3) two major deep-learning models: a massive-training artificial neural network (MTANN) and a convolutional neural network (CNN), (4) similarities and differences between the two models, and (5) their applications to medical imaging. This review shows that ML with feature input (or feature-based ML) was dominant before the introduction of deep learning, and that the major and essential difference between ML before and after deep learning is the learning of image data directly without object segmentation or feature extraction; thus, it is the source of the power of deep learning, although the depth of the model is an important attribute. The class of ML with image input (or image-based ML) including deep learning has a long history, but recently gained popularity due to the use of the new terminology, deep learning. There are two major models in this class of ML in medical imaging, MTANN and CNN, which have similarities as well as several differences. In our experience, MTANNs were substantially more efficient in their development, had a higher performance, and required a lesser number of training cases than did CNNs. "Deep learning", or ML with image input, in medical imaging is an explosively growing, promising field. It is expected that ML with image input will be the mainstream area in the field of medical imaging in the next few decades.
Collapse
Affiliation(s)
- Kenji Suzuki
- Medical Imaging Research Center and Department of Electrical and Computer Engineering, Illinois Institute of Technology, 3440 South Dearborn Street, Chicago, IL, 60616, USA. .,World Research Hub Initiative (WRHI), Tokyo Institute of Technology, Tokyo, Japan.
| |
Collapse
|
39
|
A review of lung cancer screening and the role of computer-aided detection. Clin Radiol 2017; 72:433-442. [DOI: 10.1016/j.crad.2017.01.002] [Citation(s) in RCA: 63] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2016] [Revised: 12/14/2016] [Accepted: 01/04/2017] [Indexed: 12/26/2022]
|
40
|
van Ginneken B. Fifty years of computer analysis in chest imaging: rule-based, machine learning, deep learning. Radiol Phys Technol 2017; 10:23-32. [PMID: 28211015 PMCID: PMC5337239 DOI: 10.1007/s12194-017-0394-5] [Citation(s) in RCA: 83] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2017] [Accepted: 02/08/2017] [Indexed: 02/06/2023]
Abstract
Half a century ago, the term "computer-aided diagnosis" (CAD) was introduced in the scientific literature. Pulmonary imaging, with chest radiography and computed tomography, has always been one of the focus areas in this field. In this study, I describe how machine learning became the dominant technology for tackling CAD in the lungs, generally producing better results than do classical rule-based approaches, and how the field is now rapidly changing: in the last few years, we have seen how even better results can be obtained with deep learning. The key differences among rule-based processing, machine learning, and deep learning are summarized and illustrated for various applications of CAD in the chest.
Collapse
Affiliation(s)
- Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands.
| |
Collapse
|
41
|
Cao P, Liu X, Zhang J, Li W, Zhao D, Huang M, Zaiane O. A ℓ 2, 1 norm regularized multi-kernel learning for false positive reduction in Lung nodule CAD. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 140:211-231. [PMID: 28254078 DOI: 10.1016/j.cmpb.2016.12.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2016] [Revised: 11/25/2016] [Accepted: 12/12/2016] [Indexed: 06/06/2023]
Abstract
OBJECTIVE The aim of this paper is to describe a novel algorithm for False Positive Reduction in lung nodule Computer Aided Detection(CAD). METHODS In this paper, we describes a new CT lung CAD method which aims to detect solid nodules. Specially, we proposed a multi-kernel classifier with a ℓ2, 1 norm regularizer for heterogeneous feature fusion and selection from the feature subset level, and designed two efficient strategies to optimize the parameters of kernel weights in non-smooth ℓ2, 1 regularized multiple kernel learning algorithm. The first optimization algorithm adapts a proximal gradient method for solving the ℓ2, 1 norm of kernel weights, and use an accelerated method based on FISTA; the second one employs an iterative scheme based on an approximate gradient descent method. RESULTS The results demonstrates that the FISTA-style accelerated proximal descent method is efficient for the ℓ2, 1 norm formulation of multiple kernel learning with the theoretical guarantee of the convergence rate. Moreover, the experimental results demonstrate the effectiveness of the proposed methods in terms of Geometric mean (G-mean) and Area under the ROC curve (AUC), and significantly outperforms the competing methods. CONCLUSIONS The proposed approach exhibits some remarkable advantages both in heterogeneous feature subsets fusion and classification phases. Compared with the fusion strategies of feature-level and decision level, the proposed ℓ2, 1 norm multi-kernel learning algorithm is able to accurately fuse the complementary and heterogeneous feature sets, and automatically prune the irrelevant and redundant feature subsets to form a more discriminative feature set, leading a promising classification performance. Moreover, the proposed algorithm consistently outperforms the comparable classification approaches in the literature.
Collapse
Affiliation(s)
- Peng Cao
- Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Medical Image Computing of Ministry of Education, Northeastern University, Shenyang, China.
| | - Xiaoli Liu
- Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Medical Image Computing of Ministry of Education, Northeastern University, Shenyang, China
| | - Jian Zhang
- School of Computer & Software, Nanjing University of Information Science & Technology, Nanjing, China
| | - Wei Li
- Key Laboratory of Medical Image Computing of Ministry of Education, Northeastern University, Shenyang, China
| | - Dazhe Zhao
- Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Medical Image Computing of Ministry of Education, Northeastern University, Shenyang, China
| | - Min Huang
- Information Science and Engineering, Northeastern University, Shenyang, China
| | - Osmar Zaiane
- Computing Science, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
42
|
Nogueira MA, Abreu PH, Martins P, Machado P, Duarte H, Santos J. An artificial neural networks approach for assessment treatment response in oncological patients using PET/CT images. BMC Med Imaging 2017; 17:13. [PMID: 28193201 PMCID: PMC5307785 DOI: 10.1186/s12880-017-0181-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2016] [Accepted: 01/15/2017] [Indexed: 11/10/2022] Open
Abstract
Background Positron Emission Tomography – Computed Tomography (PET/CT) imaging is the basis for the evaluation of response-to-treatment of several oncological diseases. In practice, such evaluation is manually performed by specialists, which is rather complex and time-consuming. Evaluation measures have been proposed, but with questionable reliability. The usage of before and after-treatment image descriptors of the lesions for treatment response evaluation is still a territory to be explored. Methods In this project, Artificial Neural Network approaches were implemented to automatically assess treatment response of patients suffering from neuroendocrine tumors and Hodgkyn lymphoma, based on image features extracted from PET/CT. Results The results show that the considered set of features allows for the achievement of very high classification performances, especially when data is properly balanced. Conclusions After synthetic data generation and PCA-based dimensionality reduction to only two components, LVQNN assured classification accuracies of 100%, 100%, 96.3% and 100% regarding the 4 response-to-treatment classes.
Collapse
Affiliation(s)
- Mariana A Nogueira
- CISUC - Department of Informatics Engineering - University of Coimbra, - Pólo II Pinhal de Marrocos, Coimbra, 3030-290, Portugal
| | - Pedro H Abreu
- CISUC - Department of Informatics Engineering - University of Coimbra, - Pólo II Pinhal de Marrocos, Coimbra, 3030-290, Portugal.
| | - Pedro Martins
- CISUC - Department of Informatics Engineering - University of Coimbra, - Pólo II Pinhal de Marrocos, Coimbra, 3030-290, Portugal
| | - Penousal Machado
- CISUC - Department of Informatics Engineering - University of Coimbra, - Pólo II Pinhal de Marrocos, Coimbra, 3030-290, Portugal
| | - Hugo Duarte
- IPO-Porto Research Centre (CI-IPOP), Rua Dr. António Bernardino de Almeida, Porto, 4200-072, Portugal
| | - João Santos
- IPO-Porto Research Centre (CI-IPOP), Rua Dr. António Bernardino de Almeida, Porto, 4200-072, Portugal
| |
Collapse
|
43
|
Pulmonary Nodule Classification with Deep Convolutional Neural Networks on Computed Tomography Images. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2016; 2016:6215085. [PMID: 28070212 PMCID: PMC5192289 DOI: 10.1155/2016/6215085] [Citation(s) in RCA: 104] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/04/2016] [Revised: 11/04/2016] [Accepted: 11/22/2016] [Indexed: 01/06/2023]
Abstract
Computer aided detection (CAD) systems can assist radiologists by offering a second opinion on early diagnosis of lung cancer. Classification and feature representation play critical roles in false-positive reduction (FPR) in lung nodule CAD. We design a deep convolutional neural networks method for nodule classification, which has an advantage of autolearning representation and strong generalization ability. A specified network structure for nodule images is proposed to solve the recognition of three types of nodules, that is, solid, semisolid, and ground glass opacity (GGO). Deep convolutional neural networks are trained by 62,492 regions-of-interest (ROIs) samples including 40,772 nodules and 21,720 nonnodules from the Lung Image Database Consortium (LIDC) database. Experimental results demonstrate the effectiveness of the proposed method in terms of sensitivity and overall accuracy and that it consistently outperforms the competing methods.
Collapse
|
44
|
Valente IRS, Cortez PC, Neto EC, Soares JM, de Albuquerque VHC, Tavares JMRS. Automatic 3D pulmonary nodule detection in CT images: A survey. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 124:91-107. [PMID: 26652979 DOI: 10.1016/j.cmpb.2015.10.006] [Citation(s) in RCA: 102] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2015] [Revised: 09/01/2015] [Accepted: 10/03/2015] [Indexed: 06/05/2023]
Abstract
This work presents a systematic review of techniques for the 3D automatic detection of pulmonary nodules in computerized-tomography (CT) images. Its main goals are to analyze the latest technology being used for the development of computational diagnostic tools to assist in the acquisition, storage and, mainly, processing and analysis of the biomedical data. Also, this work identifies the progress made, so far, evaluates the challenges to be overcome and provides an analysis of future prospects. As far as the authors know, this is the first time that a review is devoted exclusively to automated 3D techniques for the detection of pulmonary nodules from lung CT images, which makes this work of noteworthy value. The research covered the published works in the Web of Science, PubMed, Science Direct and IEEEXplore up to December 2014. Each work found that referred to automated 3D segmentation of the lungs was individually analyzed to identify its objective, methodology and results. Based on the analysis of the selected works, several studies were seen to be useful for the construction of medical diagnostic aid tools. However, there are certain aspects that still require attention such as increasing algorithm sensitivity, reducing the number of false positives, improving and optimizing the algorithm detection of different kinds of nodules with different sizes and shapes and, finally, the ability to integrate with the Electronic Medical Record Systems and Picture Archiving and Communication Systems. Based on this analysis, we can say that further research is needed to develop current techniques and that new algorithms are needed to overcome the identified drawbacks.
Collapse
Affiliation(s)
- Igor Rafael S Valente
- Instituto Federal do Ceará, Campus Maracanaú, Av. Parque Central, S/N, Distrito Industrial I, 61939-140 Maracanaú, Ceará, Brazil; Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - Paulo César Cortez
- Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - Edson Cavalcanti Neto
- Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - José Marques Soares
- Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - Victor Hugo C de Albuquerque
- Programa de Pós-Graduacão em Informática Aplicada, Universidade de Fortaleza, Av. Washington Soares, 1321, Edson Queiroz, 60811341, CEP 608113-41 Fortaleza, Ceará, Brazil
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovacão em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, S/N, 4200-465 Porto, Portugal.
| |
Collapse
|
45
|
Computer-aided detection (CADe) and diagnosis (CADx) system for lung cancer with likelihood of malignancy. Biomed Eng Online 2016; 15:2. [PMID: 26759159 PMCID: PMC5002110 DOI: 10.1186/s12938-015-0120-7] [Citation(s) in RCA: 102] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2015] [Accepted: 12/22/2015] [Indexed: 01/04/2023] Open
Abstract
Background CADe and CADx systems for the detection and diagnosis of lung cancer have been important areas of research in recent decades. However, these areas are being worked on separately. CADe systems do not present the radiological characteristics of tumors, and CADx systems do not detect nodules and do not have good levels of automation. As a result, these systems are not yet widely used in clinical settings. Methods The purpose of this article is to develop a new system for detection and diagnosis of pulmonary nodules on CT images, grouping them into a single system for the identification and characterization of the nodules to improve the level of automation. The article also presents as contributions: the use of Watershed and Histogram of oriented Gradients (HOG) techniques for distinguishing the possible nodules from other structures and feature extraction for pulmonary nodules, respectively. For the diagnosis, it is based on the likelihood of malignancy allowing more aid in the decision making by the radiologists. A rule-based classifier and Support Vector Machine (SVM) have been used to eliminate false positives. Results The database used in this research consisted of 420 cases obtained randomly from LIDC-IDRI. The segmentation method achieved an accuracy of 97 % and the detection system showed a sensitivity of 94.4 % with 7.04 false positives per case. Different types of nodules (isolated, juxtapleural, juxtavascular and ground-glass) with diameters between 3 mm and 30 mm have been detected. For the diagnosis of malignancy our system presented ROC curves with areas of: 0.91 for nodules highly unlikely of being malignant, 0.80 for nodules moderately unlikely of being malignant, 0.72 for nodules with indeterminate malignancy, 0.67 for nodules moderately suspicious of being malignant and 0.83 for nodules highly suspicious of being malignant. Conclusions From our preliminary results, we believe that our system is promising for clinical applications assisting radiologists in the detection and diagnosis of lung cancer.
Collapse
|
46
|
Cao P, Zhao D, Zaiane O. Measure oriented cost-sensitive SVM for 3D nodule detection. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2013:3981-4. [PMID: 24110604 DOI: 10.1109/embc.2013.6610417] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The class imbalance issue occurs when training a computer-aided detection (CAD) system for nodules. This imbalance causes poor prediction performance for true nodules. Moreover, the misclassification costs are different between two classes and high sensitivity of true nodules is essential in the detection. In order to eliminate or reduce the false positives while keeping high sensitivity, we present an effective wrapper framework incorporating the evaluation measure of imbalanced data into the objective function of cost sensitive SVM. We improve the performance of classification by simultaneously optimizing the best pair of misclassification cost parameter, feature subset and intrinsic parameters. We evaluated the method on a 3D Lung nodule dataset, showing that the proposed method outperforms many other exiting common methods, as well as specific imbalanced data learning methods, which indicates the effectiveness of our method on the imbalanced and unequal misclassification cost data classification.
Collapse
|
47
|
Pulmonary Nodule Detection from X-ray CT Images Based on Region Shape Analysis and Appearance-based Clustering. ALGORITHMS 2015. [DOI: 10.3390/a8020209] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
48
|
Akram S, Javed MY, Hussain A, Riaz F, Usman Akram M. Intensity-based statistical features for classification of lungs CT scan nodules using artificial intelligence techniques. J EXP THEOR ARTIF IN 2015. [DOI: 10.1080/0952813x.2015.1020526] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
49
|
Taşcı E, Uğur A. Shape and texture based novel features for automated juxtapleural nodule detection in lung CTs. J Med Syst 2015; 39:46. [PMID: 25732079 DOI: 10.1007/s10916-015-0231-5] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2014] [Accepted: 02/11/2015] [Indexed: 10/23/2022]
Abstract
Lung cancer is one of the types of cancer with highest mortality rate in the world. In case of early detection and diagnosis, the survival rate of patients significantly increases. In this study, a novel method and system that provides automatic detection of juxtapleural nodule pattern have been developed from cross-sectional images of lung CT (Computerized Tomography). Shape-based and both shape and texture based 7 features are contributed to the literature for lung nodules. System that we developed consists of six main stages called preprocessing, lung segmentation, detection of nodule candidate regions, feature extraction, feature selection (with five feature ranking criteria) and classification. LIDC dataset containing cross-sectional images of lung CT has been utilized, 1410 nodule candidate regions and 40 features have been extracted from 138 cross-sectional images for 24 patients. Experimental results for 10 classifiers are obtained and presented. Adding our derived features to known 33 features has increased nodule recognition performance from 0.9639 to 0.9679 AUC value on generalized linear model regression (GLMR) for 22 selected features and being reached one of the most successful results in the literature.
Collapse
Affiliation(s)
- Erdal Taşcı
- Department of Computer Engineering, Ege University, Izmir, Turkey,
| | | |
Collapse
|
50
|
Wang B, Tian X, Wang Q, Yang Y, Xie H, Zhang S, Gu L. Pulmonary nodule detection in CT images based on shape constraint CV model. Med Phys 2015; 42:1241-54. [DOI: 10.1118/1.4907961] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|