1
|
Nazir MI, Akter A, Hussen Wadud MA, Uddin MA. Utilizing customized CNN for brain tumor prediction with explainable AI. Heliyon 2024; 10:e38997. [PMID: 39449697 PMCID: PMC11497403 DOI: 10.1016/j.heliyon.2024.e38997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2024] [Revised: 08/28/2024] [Accepted: 10/04/2024] [Indexed: 10/26/2024] Open
Abstract
Timely diagnosis of brain tumors using MRI and its potential impact on patient survival are critical issues addressed in this study. Traditional DL models often lack transparency, leading to skepticism among medical experts owing to their "black box" nature. This study addresses this gap by presenting an innovative approach for brain tumor detection. It utilizes a customized Convolutional Neural Network (CNN) model empowered by three advanced explainable artificial intelligence (XAI) techniques: Shapley Additive Explana-tions (SHAP), Local Interpretable Model-agnostic Explanations (LIME), and Gradient-weighted Class Activation Mapping (Grad-CAM). The study utilized the BR35H dataset, which includes 3060 brain MRI images encompassing both tumorous and non-tumorous cases. The proposed model achieved a remarkable training accuracy of 100 % and validation accuracy of 98.67 %. Precision, recall, and F1 score metrics demonstrated exceptional performance at 98.50 %, confirming the accuracy of the model in tumor detection. Detailed result analysis, including a confusion matrix, comparison with existing models, and generalizability tests on other datasets, establishes the superiority of the proposed approach and sets a new benchmark for accuracy. By integrating a customized CNN model with XAI techniques, this research enhances trust in AI-driven medical diagnostics and offers a promising pathway for early tumor detection and potentially life-saving interventions.
Collapse
Affiliation(s)
- Md Imran Nazir
- Department of Computer Science & Engineering, Bangladesh University of Business & Technology, Dhaka, Bangladesh
| | - Afsana Akter
- Department of Computer Science & Engineering, Bangladesh University of Business & Technology, Dhaka, Bangladesh
| | - Md Anwar Hussen Wadud
- Department of Computer Science & Engineering, Sunamgonj Science and Technology University, Sunamganj, 3000, Bangladesh
| | - Md Ashraf Uddin
- Department of Computer Science & Engineering, Jagannath University, Dhaka, Bangladesh
| |
Collapse
|
2
|
Zhao L, Wang N, Zhu X, Wu Z, Shen A, Zhang L, Wang R, Wang D, Zhang S. Establishment and validation of an artificial intelligence-based model for real-time detection and classification of colorectal adenoma. Sci Rep 2024; 14:10750. [PMID: 38729988 PMCID: PMC11087479 DOI: 10.1038/s41598-024-61342-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 05/05/2024] [Indexed: 05/12/2024] Open
Abstract
Colorectal cancer (CRC) prevention requires early detection and removal of adenomas. We aimed to develop a computational model for real-time detection and classification of colorectal adenoma. Computationally constrained background based on real-time detection, we propose an improved adaptive lightweight ensemble model for real-time detection and classification of adenomas and other polyps. Firstly, we devised an adaptive lightweight network modification and effective training strategy to diminish the computational requirements for real-time detection. Secondly, by integrating the adaptive lightweight YOLOv4 with the single shot multibox detector network, we established the adaptive small object detection ensemble (ASODE) model, which enhances the precision of detecting target polyps without significantly increasing the model's memory footprint. We conducted simulated training using clinical colonoscopy images and videos to validate the method's performance, extracting features from 1148 polyps and employing a confidence threshold of 0.5 to filter out low-confidence sample predictions. Finally, compared to state-of-the-art models, our ASODE model demonstrated superior performance. In the test set, the sensitivity of images and videos reached 87.96% and 92.31%, respectively. Additionally, the ASODE model achieved an accuracy of 92.70% for adenoma detection with a false positive rate of 8.18%. Training results indicate the effectiveness of our method in classifying small polyps. Our model exhibits remarkable performance in real-time detection of colorectal adenomas, serving as a reliable tool for assisting endoscopists.
Collapse
Affiliation(s)
- Luqing Zhao
- Digestive Disease Center, Beijing Hospital of Traditional Chinese Medicine, Capital Medical University, No. 23, Back Street of Art Museum, Dongcheng District, Beijing, 100010, China
| | - Nan Wang
- School of Mathematics and Statistics, Beijing Institute of Technology, No. 5, South Street, Zhongguancun, Haidian District, Beijing, 100081, China
| | - Xihan Zhu
- Digestive Disease Center, Beijing Hospital of Traditional Chinese Medicine, Capital Medical University, No. 23, Back Street of Art Museum, Dongcheng District, Beijing, 100010, China
| | - Zhenyu Wu
- Digestive Disease Center, Beijing Hospital of Traditional Chinese Medicine, Capital Medical University, No. 23, Back Street of Art Museum, Dongcheng District, Beijing, 100010, China
| | - Aihua Shen
- Digestive Disease Center, Beijing Hospital of Traditional Chinese Medicine, Capital Medical University, No. 23, Back Street of Art Museum, Dongcheng District, Beijing, 100010, China
| | - Lihong Zhang
- Shunyi Hospital, Beijing Traditional Chinese Medicine Hospital, Beijing, China
| | - Ruixin Wang
- Digestive Disease Center, Beijing Hospital of Traditional Chinese Medicine, Capital Medical University, No. 23, Back Street of Art Museum, Dongcheng District, Beijing, 100010, China
| | - Dianpeng Wang
- School of Mathematics and Statistics, Beijing Institute of Technology, No. 5, South Street, Zhongguancun, Haidian District, Beijing, 100081, China.
| | - Shengsheng Zhang
- Digestive Disease Center, Beijing Hospital of Traditional Chinese Medicine, Capital Medical University, No. 23, Back Street of Art Museum, Dongcheng District, Beijing, 100010, China.
| |
Collapse
|
3
|
Houwen BBSL, Nass KJ, Vleugels JLA, Fockens P, Hazewinkel Y, Dekker E. Comprehensive review of publicly available colonoscopic imaging databases for artificial intelligence research: availability, accessibility, and usability. Gastrointest Endosc 2023; 97:184-199.e16. [PMID: 36084720 DOI: 10.1016/j.gie.2022.08.043] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 08/24/2022] [Accepted: 08/30/2022] [Indexed: 01/28/2023]
Abstract
BACKGROUND AND AIMS Publicly available databases containing colonoscopic imaging data are valuable resources for artificial intelligence (AI) research. Currently, little is known regarding the available number and content of these databases. This review aimed to describe the availability, accessibility, and usability of publicly available colonoscopic imaging databases, focusing on polyp detection, polyp characterization, and quality of colonoscopy. METHODS A systematic literature search was performed in MEDLINE and Embase to identify AI studies describing publicly available colonoscopic imaging databases published after 2010. Second, a targeted search using Google's Dataset Search, Google Search, GitHub, and Figshare was done to identify databases directly. Databases were included if they contained data about polyp detection, polyp characterization, or quality of colonoscopy. To assess accessibility of databases, the following categories were defined: open access, open access with barriers, and regulated access. To assess the potential usability of the included databases, essential details of each database were extracted using a checklist derived from the Checklist for Artificial Intelligence in Medical Imaging. RESULTS We identified 22 databases with open access, 3 databases with open access with barriers, and 15 databases with regulated access. The 22 open access databases contained 19,463 images and 952 videos. Nineteen of these databases focused on polyp detection, localization, and/or segmentation; 6 on polyp characterization, and 3 on quality of colonoscopy. Only half of these databases have been used by other researcher to develop, train, or benchmark their AI system. Although technical details were in general well reported, important details such as polyp and patient demographics and the annotation process were under-reported in almost all databases. CONCLUSIONS This review provides greater insight on public availability of colonoscopic imaging databases for AI research. Incomplete reporting of important details limits the ability of researchers to assess the usability of current databases.
Collapse
Affiliation(s)
- Britt B S L Houwen
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam University Medical Centres, location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Karlijn J Nass
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam University Medical Centres, location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Jasper L A Vleugels
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam University Medical Centres, location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Paul Fockens
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam University Medical Centres, location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Yark Hazewinkel
- Department of Gastroenterology and Hepatology, Radboud University Nijmegen Medical Center, Radboud University of Nijmegen, Nijmegen, the Netherlands
| | - Evelien Dekker
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam University Medical Centres, location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
4
|
Ramamurthy K, George TT, Shah Y, Sasidhar P. A Novel Multi-Feature Fusion Method for Classification of Gastrointestinal Diseases Using Endoscopy Images. Diagnostics (Basel) 2022; 12:2316. [PMID: 36292006 PMCID: PMC9600128 DOI: 10.3390/diagnostics12102316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 09/02/2022] [Accepted: 09/06/2022] [Indexed: 11/17/2022] Open
Abstract
The first step in the diagnosis of gastric abnormalities is the detection of various abnormalities in the human gastrointestinal tract. Manual examination of endoscopy images relies on a medical practitioner's expertise to identify inflammatory regions on the inner surface of the gastrointestinal tract. The length of the alimentary canal and the large volume of images obtained from endoscopic procedures make traditional detection methods time consuming and laborious. Recently, deep learning architectures have achieved better results in the classification of endoscopy images. However, visual similarities between different portions of the gastrointestinal tract pose a challenge for effective disease detection. This work proposes a novel system for the classification of endoscopy images by focusing on feature mining through convolutional neural networks (CNN). The model presented is built by combining a state-of-the-art architecture (i.e., EfficientNet B0) with a custom-built CNN architecture named Effimix. The proposed Effimix model employs a combination of squeeze and excitation layers and self-normalising activation layers for precise classification of gastrointestinal diseases. Experimental observations on the HyperKvasir dataset confirm the effectiveness of the proposed architecture for the classification of endoscopy images. The proposed model yields an accuracy of 97.99%, with an F1 score, precision, and recall of 97%, 97%, and 98%, respectively, which is significantly higher compared to the existing works.
Collapse
Affiliation(s)
- Karthik Ramamurthy
- Centre for Cyber Physical Systems, School of Electronics Engineering, Vellore Institute of Technology, Chennai 600127, India
| | - Timothy Thomas George
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai 600127, India
| | - Yash Shah
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai 600127, India
| | - Parasa Sasidhar
- School of Electronics Engineering, Vellore Institute of Technology, Chennai 600127, India
| |
Collapse
|
5
|
A deep ensemble learning method for colorectal polyp classification with optimized network parameters. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03689-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
AbstractColorectal Cancer (CRC), a leading cause of cancer-related deaths, can be abated by timely polypectomy. Computer-aided classification of polyps helps endoscopists to resect timely without submitting the sample for histology. Deep learning-based algorithms are promoted for computer-aided colorectal polyp classification. However, the existing methods do not accommodate any information on hyperparametric settings essential for model optimisation. Furthermore, unlike the polyp types, i.e., hyperplastic and adenomatous, the third type, serrated adenoma, is difficult to classify due to its hybrid nature. Moreover, automated assessment of polyps is a challenging task due to the similarities in their patterns; therefore, the strength of individual weak learners is combined to form a weighted ensemble model for an accurate classification model by establishing the optimised hyperparameters. In contrast to existing studies on binary classification, multiclass classification require evaluation through advanced measures. This study compared six existing Convolutional Neural Networks in addition to transfer learning and opted for optimum performing architecture only for ensemble models. The performance evaluation on UCI and PICCOLO dataset of the proposed method in terms of accuracy (96.3%, 81.2%), precision (95.5%, 82.4%), recall (97.2%, 81.1%), F1-score (96.3%, 81.3%) and model reliability using Cohen’s Kappa Coefficient (0.94, 0.62) shows the superiority over existing models. The outcomes of experiments by other studies on the same dataset yielded 82.5% accuracy with 72.7% recall by SVM and 85.9% accuracy with 87.6% recall by other deep learning methods. The proposed method demonstrates that a weighted ensemble of optimised networks along with data augmentation significantly boosts the performance of deep learning-based CAD.
Collapse
|
6
|
Pacal I, Karaman A, Karaboga D, Akay B, Basturk A, Nalbantoglu U, Coskun S. An efficient real-time colonic polyp detection with YOLO algorithms trained by using negative samples and large datasets. Comput Biol Med 2021; 141:105031. [PMID: 34802713 DOI: 10.1016/j.compbiomed.2021.105031] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 11/10/2021] [Accepted: 11/10/2021] [Indexed: 12/29/2022]
Abstract
Colorectal cancer (CRC) is one of the common types of cancer with a high mortality rate. Colonoscopy is the gold standard for CRC screening and significantly reduces CRC mortality. However, due to many factors, the rate of missed polyps, which are the precursors of colorectal cancer, is high in practice. Therefore, many artificial intelligence-based computer-aided diagnostic systems have been presented to increase the detection rate of missed polyps. In this article, we present deep learning-based methods for reliable computer-assisted polyp detection. The proposed methods differ from state-of-the-art methods as follows. First, we improved the performances of YOLOv3 and YOLOv4 object detection algorithms by integrating Cross Stage Partial Network (CSPNet) for real-time and high-performance automatic polyp detection. Then, we utilized advanced data augmentation techniques and transfer learning to improve the performance of polyp detection. Next, for further improving the performance of polyp detection using negative samples, we substituted the Sigmoid-weighted Linear Unit (SiLU) activation functions instead of the Leaky ReLU and Mish activation functions, and Complete Intersection over Union (CIoU) as the loss function. In addition, we present a comparative analysis of these activation functions for polyp detection. We applied the proposed methods on the recently published novel datasets, which are the SUN polyp database and the PICCOLO database. Additionally, we investigated the proposed models for MICCAI Sub-Challenge on Automatic Polyp Detection in Colonoscopy dataset. The proposed methods outperformed the other studies in both real-time performance and polyp detection accuracy.
Collapse
Affiliation(s)
- Ishak Pacal
- Computer Engineering Department, Engineering Faculty, Igdir University, Igdir, Turkey.
| | - Ahmet Karaman
- Gastroenterology Department, Acibadem Hospital, Kayseri, Turkey
| | - Dervis Karaboga
- Computer Engineering Department, Engineering Faculty, Erciyes University, Kayseri, Turkey
| | - Bahriye Akay
- Computer Engineering Department, Engineering Faculty, Erciyes University, Kayseri, Turkey
| | - Alper Basturk
- Computer Engineering Department, Engineering Faculty, Erciyes University, Kayseri, Turkey
| | - Ufuk Nalbantoglu
- Computer Engineering Department, Engineering Faculty, Erciyes University, Kayseri, Turkey
| | - Seymanur Coskun
- Gastroenterology Department, Acibadem Hospital, Kayseri, Turkey
| |
Collapse
|