1
|
Shah SA, Taj I, Usman SM, Hassan Shah SN, Imran AS, Khalid S. A hybrid approach of vision transformers and CNNs for detection of ulcerative colitis. Sci Rep 2024; 14:24771. [PMID: 39433818 PMCID: PMC11494132 DOI: 10.1038/s41598-024-75901-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Accepted: 10/09/2024] [Indexed: 10/23/2024] Open
Abstract
Ulcerative Colitis is an Inflammatory Bowel disease caused by a variety of factors that lead to a serious impact on the quality of life of the patients if left untreated. Due to complexities in the identification procedures of this disease, the treatment timeline and quality can be severely affected, leading to further consequences for the sufferer. The difficulties in identification are due to high patients to healthcare professionals ratio. Researchers have proposed variety of machine/deep learning methods for automated detection of ulcerative colitis, however, several challenges exists including class imbalance problem, comprehensive feature extraction and accurate classification. We propose a novel method for accurate detection of ulcerative colitis with augmentation techniques to overcome class imbalance issue, a comprehensive feature vector extraction using custom architecture of Vision Transformer (ViT) and accurate classification using customized Convolutional Neural Network (CNN). We used the TMC-UCM and LIMUC datasets in this research for training and testing of proposed method and achieved accuracy of 90% with AUC-ROC scores of 0.91, 0.81, 0.94, and 0.94 for the endoscopic classes of Mayo 0, Mayo 1, Mayo 2, and Mayo 3 respectively. We have compared the proposed method with existing state of the art methods and conclude that the proposed method outperforms the existing methods.
Collapse
Affiliation(s)
- Syed Abdullah Shah
- Department of Creative Technologies, Faculty of Computing and Artificial Intelligence, Air University, Islamabad, 44000, Pakistan
| | - Imran Taj
- College of Interdisciplinary Studies, Zayed University, 144534, Abu Dhabi, United Arab Emirates
| | - Syed Muhammad Usman
- Department of Computer Science, Bahria School of Engineering and Applied Sciences, Bahria University, Islamabad, 44000, Pakistan
| | - Syed Nehal Hassan Shah
- Department of Creative Technologies, Faculty of Computing and Artificial Intelligence, Air University, Islamabad, 44000, Pakistan
| | - Ali Shariq Imran
- Department of Computer Science, Norwegian University of Science and Technology, Gjøvik, 2815, Norway.
| | - Shehzad Khalid
- Department of Computer Engineering, Bahria School of Engineering and Applied Sciences, Bahria University, Islamabad, 44000, Pakistan
| |
Collapse
|
2
|
Carreras J. Celiac Disease Deep Learning Image Classification Using Convolutional Neural Networks. J Imaging 2024; 10:200. [PMID: 39194989 DOI: 10.3390/jimaging10080200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 08/09/2024] [Accepted: 08/10/2024] [Indexed: 08/29/2024] Open
Abstract
Celiac disease (CD) is a gluten-sensitive immune-mediated enteropathy. This proof-of-concept study used a convolutional neural network (CNN) to classify hematoxylin and eosin (H&E) CD histological images, normal small intestine control, and non-specified duodenal inflammation (7294, 11,642, and 5966 images, respectively). The trained network classified CD with high performance (accuracy 99.7%, precision 99.6%, recall 99.3%, F1-score 99.5%, and specificity 99.8%). Interestingly, when the same network (already trained for the 3 class images), analyzed duodenal adenocarcinoma (3723 images), the new images were classified as duodenal inflammation in 63.65%, small intestine control in 34.73%, and CD in 1.61% of the cases; and when the network was retrained using the 4 histological subtypes, the performance was above 99% for CD and 97% for adenocarcinoma. Finally, the model added 13,043 images of Crohn's disease to include other inflammatory bowel diseases; a comparison between different CNN architectures was performed, and the gradient-weighted class activation mapping (Grad-CAM) technique was used to understand why the deep learning network made its classification decisions. In conclusion, the CNN-based deep neural system classified 5 diagnoses with high performance. Narrow artificial intelligence (AI) is designed to perform tasks that typically require human intelligence, but it operates within limited constraints and is task-specific.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, School of Medicine, Tokai University, 143 Shimokasuya, Isehara 259-1193, Japan
| |
Collapse
|
3
|
Carreras J, Hamoudi R, Nakamura N. Artificial intelligence and classification of mature lymphoid neoplasms. EXPLORATION OF TARGETED ANTI-TUMOR THERAPY 2024; 5:332-348. [PMID: 38745770 PMCID: PMC11090685 DOI: 10.37349/etat.2024.00221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 09/07/2023] [Indexed: 05/16/2024] Open
Abstract
Hematologists, geneticists, and clinicians came to a multidisciplinary agreement on the classification of lymphoid neoplasms that combines clinical features, histological characteristics, immunophenotype, and molecular pathology analyses. The current classification includes the World Health Organization (WHO) Classification of tumours of haematopoietic and lymphoid tissues revised 4th edition, the International Consensus Classification (ICC) of mature lymphoid neoplasms (report from the Clinical Advisory Committee 2022), and the 5th edition of the proposed WHO Classification of haematolymphoid tumours (lymphoid neoplasms, WHO-HAEM5). This article revises the recent advances in the classification of mature lymphoid neoplasms. Artificial intelligence (AI) has advanced rapidly recently, and its role in medicine is becoming more important as AI integrates computer science and datasets to make predictions or classifications based on complex input data. Summarizing previous research, it is described how several machine learning and neural networks can predict the prognosis of the patients, and classified mature B-cell neoplasms. In addition, new analysis predicted lymphoma subtypes using cell-of-origin markers that hematopathologists use in the clinical routine, including CD3, CD5, CD19, CD79A, MS4A1 (CD20), MME (CD10), BCL6, IRF4 (MUM-1), BCL2, SOX11, MNDA, and FCRL4 (IRTA1). In conclusion, although most categories are similar in both classifications, there are also conceptual differences and differences in the diagnostic criteria for some diseases. It is expected that AI will be incorporated into the lymphoma classification as another bioinformatics tool.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, Tokai University School of Medicine, Isehara 259-1193, Japan
| | - Rifat Hamoudi
- Department of Clinical Sciences, College of Medicine, University of Sharjah, Sharjah P.O. Box 27272, United Arab Emirates
- Division of Surgery and Interventional Science, University College London, WC1E 6BT London, UK
| | - Naoya Nakamura
- Department of Pathology, Tokai University School of Medicine, Isehara 259-1193, Japan
| |
Collapse
|
4
|
Carreras J. The pathobiology of follicular lymphoma. J Clin Exp Hematop 2023; 63:152-163. [PMID: 37518274 PMCID: PMC10628832 DOI: 10.3960/jslrt.23014] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 06/10/2023] [Accepted: 06/15/2023] [Indexed: 08/01/2023] Open
Abstract
Follicular lymphoma is one of the most frequent lymphomas. Histologically, it is characterized by a follicular (nodular) growth pattern of centrocytes and centroblasts; mixed with variable immune microenvironment cells. Clinically, it is characterized by diffuse lymphadenopathy, bone marrow involvement, and splenomegaly. It is biologically and clinically heterogeneous. In most patients it is indolent, but others have a more aggressive evolution with relapses; and transformation to diffuse large B-cell lymphoma. Tumorigenesis includes an asymptomatic preclinical phase in which premalignant B-lymphocytes with the t(14;18) chromosomal translocation acquire additional genetic alterations in the germinal centers, and clonal evolution occurs, although not all the cells progress to the tumor stage. This manuscript reviews the pathobiology and clinicopathological characteristics of follicular lymphoma. It includes a description of the physiology of the germinal center, the genetic alterations of BCL2 and BCL6, the mutational profile, the immune checkpoint, precision medicine, and highlights in the lymphoma classification. In addition, a comment and review on artificial intelligence and machine (deep) learning are made.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, Tokai University, School of Medicine, Isehara, Kanagawa, Japan
| |
Collapse
|
5
|
Caliendo G, D'Elia G, Makker J, Passariello L, Albanese L, Molinari AM, Vietri MT. Biological, genetic and epigenetic markers in ulcerative colitis. Adv Med Sci 2023; 68:386-395. [PMID: 37813048 DOI: 10.1016/j.advms.2023.09.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 04/15/2023] [Accepted: 09/18/2023] [Indexed: 10/11/2023]
Abstract
In this review, we have summarized the existing knowledge of ulcerative colitis (UC) markers based on current literature, specifically, the roles of potential new biomarkers, such as circulating, fecal, genetic, and epigenetic alterations, in UC onset, disease activity, and in therapy response. UC is a complex multifactorial inflammatory disease. There are many invasive and non-invasive diagnostic methods in UC, including several laboratory markers which are employed in diagnosis and disease assessment; however, colonoscopy remains the most widely used method. Common laboratory abnormalities currently used in the clinical practice include inflammation-induced alterations, serum autoantibodies, and antibodies against bacterial antigens. Other new serum and fecal biomarkers are supportive in diagnosis and monitoring disease activity and therapy response; and potential salivary markers are currently being evaluated as well. Several UC-related genetic and epigenetic alterations are implied in its pathogenesis and therapeutic response. Moreover, the use of artificial intelligence in the integration of laboratory biomarkers and big data could potentially be useful in clinical translation and precision medicine in UC management.
Collapse
Affiliation(s)
- Gemma Caliendo
- Unity of Clinical and Molecular Pathology, AOU University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Giovanna D'Elia
- Unity of Clinical and Molecular Pathology, AOU University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Jasmine Makker
- Department of GKT School of Medical Education, King's College London, London, UK
| | - Luana Passariello
- Unity of Clinical and Molecular Pathology, AOU University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Luisa Albanese
- Unity of Clinical and Molecular Pathology, AOU University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Anna Maria Molinari
- Unity of Clinical and Molecular Pathology, AOU University of Campania "Luigi Vanvitelli", Naples, Italy; Department of Precision Medicine, University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Maria Teresa Vietri
- Unity of Clinical and Molecular Pathology, AOU University of Campania "Luigi Vanvitelli", Naples, Italy; Department of Precision Medicine, University of Campania "Luigi Vanvitelli", Naples, Italy.
| |
Collapse
|
6
|
Carreras J, Roncador G, Hamoudi R. Artificial Intelligence Predicted Overall Survival and Classified Mature B-Cell Neoplasms Based on Immuno-Oncology and Immune Checkpoint Panels. Cancers (Basel) 2022; 14:5318. [PMID: 36358737 PMCID: PMC9657332 DOI: 10.3390/cancers14215318] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 10/20/2022] [Accepted: 10/24/2022] [Indexed: 08/01/2023] Open
Abstract
Artificial intelligence (AI) can identify actionable oncology biomarkers. This research integrates our previous analyses of non-Hodgkin lymphoma. We used gene expression and immunohistochemical data, focusing on the immune checkpoint, and added a new analysis of macrophages, including 3D rendering. The AI comprised machine learning (C5, Bayesian network, C&R, CHAID, discriminant analysis, KNN, logistic regression, LSVM, Quest, random forest, random trees, SVM, tree-AS, and XGBoost linear and tree) and artificial neural networks (multilayer perceptron and radial basis function). The series included chronic lymphocytic leukemia, mantle cell lymphoma, follicular lymphoma, Burkitt, diffuse large B-cell lymphoma, marginal zone lymphoma, and multiple myeloma, as well as acute myeloid leukemia and pan-cancer series. AI classified lymphoma subtypes and predicted overall survival accurately. Oncogenes and tumor suppressor genes were highlighted (MYC, BCL2, and TP53), along with immune microenvironment markers of tumor-associated macrophages (M2-like TAMs), T-cells and regulatory T lymphocytes (Tregs) (CD68, CD163, MARCO, CSF1R, CSF1, PD-L1/CD274, SIRPA, CD85A/LILRB3, CD47, IL10, TNFRSF14/HVEM, TNFAIP8, IKAROS, STAT3, NFKB, MAPK, PD-1/PDCD1, BTLA, and FOXP3), apoptosis (BCL2, CASP3, CASP8, PARP, and pathway-related MDM2, E2F1, CDK6, MYB, and LMO2), and metabolism (ENO3, GGA3). In conclusion, AI with immuno-oncology markers is a powerful predictive tool. Additionally, a review of recent literature was made.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, School of Medicine, Tokai University, 143 Shimokasuya, Isehara 259-1193, Kanagawa, Japan
| | - Giovanna Roncador
- Monoclonal Antibodies Unit, Spanish National Cancer Research Center (Centro Nacional de Investigaciones Oncologicas, CNIO), Melchor Fernandez Almagro 3, 28029 Madrid, Spain
| | - Rifat Hamoudi
- Department of Clinical Sciences, College of Medicine, University of Sharjah, Sharjah P.O. Box 27272, United Arab Emirates
- Division of Surgery and Interventional Science, University College London, Gower Street, London WC1E 6BT, UK
| |
Collapse
|
7
|
Carreras J. Artificial Intelligence Analysis of Celiac Disease Using an Autoimmune Discovery Transcriptomic Panel Highlighted Pathogenic Genes including BTLA. Healthcare (Basel) 2022; 10:1550. [PMID: 36011206 PMCID: PMC9408070 DOI: 10.3390/healthcare10081550] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 08/09/2022] [Accepted: 08/14/2022] [Indexed: 12/18/2022] Open
Abstract
Celiac disease is a common immune-related inflammatory disease of the small intestine caused by gluten in genetically predisposed individuals. This research is a proof-of-concept exercise focused on using Artificial Intelligence (AI) and an autoimmune discovery gene panel to predict and model celiac disease. Conventional bioinformatics, gene set enrichment analysis (GSEA), and several machine learning and neural network techniques were used on a publicly available dataset (GSE164883). Machine learning and deep learning included C5, logistic regression, Bayesian network, discriminant analysis, KNN algorithm, LSVM, random trees, SVM, Tree-AS, XGBoost linear, XGBoost tree, CHAID, Quest, C&R tree, random forest, and neural network (multilayer perceptron). As a result, the gene panel predicted celiac disease with high accuracy (95-100%). Several pathogenic genes were identified, some of the immune checkpoint and immuno-oncology pathways. They included CASP3, CD86, CTLA4, FASLG, GZMB, IFNG, IL15RA, ITGAX, LAG3, MMP3, MUC1, MYD88, PRDM1, RGS1, etc. Among them, B and T lymphocyte associated (BTLA, CD272) was highlighted and validated at the protein level by immunohistochemistry in an independent series of cases. Celiac disease was characterized by high BTLA, expressed by inflammatory cells of the lamina propria. In conclusion, artificial intelligence predicted celiac disease using an autoimmune discovery gene panel.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, School of Medicine, Tokai University, 143 Shimokasuya, Isehara 259-1193, Japan
| |
Collapse
|