1
|
潘 兴, 童 珂, 鄢 成, 罗 金, 杨 华, 丁 菊. [Research progress on colorectal cancer identification based on convolutional neural network]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2024; 41:854-860. [PMID: 39218614 PMCID: PMC11366468 DOI: 10.7507/1001-5515.202310027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 05/24/2024] [Indexed: 09/04/2024]
Abstract
Colorectal cancer (CRC) is a common malignant tumor that seriously threatens human health. CRC presents a formidable challenge in terms of accurate identification due to its indistinct boundaries. With the widespread adoption of convolutional neural networks (CNNs) in image processing, leveraging CNNs for automatic classification and segmentation holds immense potential for enhancing the efficiency of colorectal cancer recognition and reducing treatment costs. This paper explores the imperative necessity for applying CNNs in clinical diagnosis of CRC. It provides an elaborate overview on research advancements pertaining to CNNs and their improved models in CRC classification and segmentation. Furthermore, this work summarizes the ideas and common methods for optimizing network performance and discusses the challenges faced by CNNs as well as future development trends in their application towards CRC classification and segmentation, thereby promoting their utilization within clinical diagnosis.
Collapse
Affiliation(s)
- 兴亮 潘
- 四川轻化工大学 自动化与信息工程学院(四川自贡 643000)The School of Automation and Information Engineering, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
- 四川轻化工大学 人工智能四川省重点实验室(四川自贡 643000)The Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
| | - 珂 童
- 四川轻化工大学 自动化与信息工程学院(四川自贡 643000)The School of Automation and Information Engineering, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
- 四川轻化工大学 人工智能四川省重点实验室(四川自贡 643000)The Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
| | - 成东 鄢
- 四川轻化工大学 自动化与信息工程学院(四川自贡 643000)The School of Automation and Information Engineering, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
- 四川轻化工大学 人工智能四川省重点实验室(四川自贡 643000)The Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
| | - 金龙 罗
- 四川轻化工大学 自动化与信息工程学院(四川自贡 643000)The School of Automation and Information Engineering, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
| | - 华 杨
- 四川轻化工大学 自动化与信息工程学院(四川自贡 643000)The School of Automation and Information Engineering, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
| | - 菊容 丁
- 四川轻化工大学 自动化与信息工程学院(四川自贡 643000)The School of Automation and Information Engineering, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
- 四川轻化工大学 人工智能四川省重点实验室(四川自贡 643000)The Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Zigong, Sichuan 643000, P. R. China
| |
Collapse
|
2
|
Lo CM, Jiang JK, Lin CC. Detecting microsatellite instability in colorectal cancer using Transformer-based colonoscopy image classification and retrieval. PLoS One 2024; 19:e0292277. [PMID: 38271352 PMCID: PMC10810505 DOI: 10.1371/journal.pone.0292277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Accepted: 09/15/2023] [Indexed: 01/27/2024] Open
Abstract
Colorectal cancer (CRC) is a major global health concern, with microsatellite instability-high (MSI-H) being a defining characteristic of hereditary nonpolyposis colorectal cancer syndrome and affecting 15% of sporadic CRCs. Tumors with MSI-H have unique features and better prognosis compared to MSI-L and microsatellite stable (MSS) tumors. This study proposed establishing a MSI prediction model using more available and low-cost colonoscopy images instead of histopathology. The experiment utilized a database of 427 MSI-H and 1590 MSS colonoscopy images and vision Transformer (ViT) with different feature training approaches to establish the MSI prediction model. The accuracy of combining pre-trained ViT features was 84% with an area under the receiver operating characteristic curve of 0.86, which was better than that of DenseNet201 (80%, 0.80) in the experiment with support vector machine. The content-based image retrieval (CBIR) approach showed that ViT features can obtain a mean average precision of 0.81 compared to 0.79 of DenseNet201. ViT reduced the issues that occur in convolutional neural networks, including limited receptive field and gradient disappearance, and may be better at interpreting diagnostic information around tumors and surrounding tissues. By using CBIR, the presentation of similar images with the same MSI status would provide more convincing deep learning suggestions for clinical use.
Collapse
Affiliation(s)
- Chung-Ming Lo
- Graduate Institute of Library, Information and Archival Studies, National Chengchi University, Taipei, Taiwan
| | - Jeng-Kai Jiang
- Department of Surgery, Division of Colon and Rectal Surgery, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chun-Chi Lin
- Department of Surgery, Division of Colon and Rectal Surgery, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| |
Collapse
|
3
|
Guitton T, Allaume P, Rabilloud N, Rioux-Leclercq N, Henno S, Turlin B, Galibert-Anne MD, Lièvre A, Lespagnol A, Pécot T, Kammerer-Jacquet SF. Artificial Intelligence in Predicting Microsatellite Instability and KRAS, BRAF Mutations from Whole-Slide Images in Colorectal Cancer: A Systematic Review. Diagnostics (Basel) 2023; 14:99. [PMID: 38201408 PMCID: PMC10795725 DOI: 10.3390/diagnostics14010099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 12/22/2023] [Accepted: 12/24/2023] [Indexed: 01/12/2024] Open
Abstract
Mismatch repair deficiency (d-MMR)/microsatellite instability (MSI), KRAS, and BRAF mutational status are crucial for treating advanced colorectal cancer patients. Traditional methods like immunohistochemistry or polymerase chain reaction (PCR) can be challenged by artificial intelligence (AI) based on whole slide images (WSI) to predict tumor status. In this systematic review, we evaluated the role of AI in predicting MSI status, KRAS, and BRAF mutations in colorectal cancer. Studies published in PubMed up to June 2023 were included (n = 17), and we reported the risk of bias and the performance for each study. Some studies were impacted by the reduced number of slides included in the data set and the lack of external validation cohorts. Deep learning models for the d-MMR/MSI status showed a good performance in training cohorts (mean AUC = 0.89, [0.74-0.97]) but slightly less than expected in the validation cohort when available (mean AUC = 0.82, [0.63-0.98]). Contrary to the MSI status, the prediction of KRAS and BRAF mutations was less explored with a less robust methodology. The performance was lower, with a maximum of 0.77 in the training cohort, 0.58 in the validation cohort for KRAS, and 0.82 AUC in the training cohort for BRAF.
Collapse
Affiliation(s)
- Theo Guitton
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (P.A.); (N.R.-L.); (S.-F.K.-J.)
| | - Pierre Allaume
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (P.A.); (N.R.-L.); (S.-F.K.-J.)
| | - Noémie Rabilloud
- Impact TEAM, Laboratoire Traitement du Signal et de l’Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, CEDEX 09, 35033 Rennes, France
| | - Nathalie Rioux-Leclercq
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (P.A.); (N.R.-L.); (S.-F.K.-J.)
| | - Sébastien Henno
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (P.A.); (N.R.-L.); (S.-F.K.-J.)
| | - Bruno Turlin
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (P.A.); (N.R.-L.); (S.-F.K.-J.)
| | - Marie-Dominique Galibert-Anne
- Department of Molecular Genetics and Medical Genomics CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (M.-D.G.-A.); (A.L.)
| | - Astrid Lièvre
- Department of Gastro-Entrology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France;
| | - Alexandra Lespagnol
- Department of Molecular Genetics and Medical Genomics CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (M.-D.G.-A.); (A.L.)
| | - Thierry Pécot
- Facility for Artificial Intelligence and Image Analysis (FAIIA), Biosit UAR 3480 CNRS-US18 INSERM, Rennes University, 2 Avenue du Professeur Léon Bernard, 35042 Rennes, France
| | - Solène-Florence Kammerer-Jacquet
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 Rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France; (P.A.); (N.R.-L.); (S.-F.K.-J.)
- Impact TEAM, Laboratoire Traitement du Signal et de l’Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, CEDEX 09, 35033 Rennes, France
| |
Collapse
|
4
|
Zhang C, Xu J, Tang R, Yang J, Wang W, Yu X, Shi S. Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment. J Hematol Oncol 2023; 16:114. [PMID: 38012673 PMCID: PMC10680201 DOI: 10.1186/s13045-023-01514-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2023] [Accepted: 11/20/2023] [Indexed: 11/29/2023] Open
Abstract
Research into the potential benefits of artificial intelligence for comprehending the intricate biology of cancer has grown as a result of the widespread use of deep learning and machine learning in the healthcare sector and the availability of highly specialized cancer datasets. Here, we review new artificial intelligence approaches and how they are being used in oncology. We describe how artificial intelligence might be used in the detection, prognosis, and administration of cancer treatments and introduce the use of the latest large language models such as ChatGPT in oncology clinics. We highlight artificial intelligence applications for omics data types, and we offer perspectives on how the various data types might be combined to create decision-support tools. We also evaluate the present constraints and challenges to applying artificial intelligence in precision oncology. Finally, we discuss how current challenges may be surmounted to make artificial intelligence useful in clinical settings in the future.
Collapse
Affiliation(s)
- Chaoyi Zhang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Jin Xu
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Rong Tang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Jianhui Yang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Wei Wang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Xianjun Yu
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China.
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China.
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China.
| | - Si Shi
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China.
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China.
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China.
| |
Collapse
|
5
|
Wahab N, Toss M, Miligy IM, Jahanifar M, Atallah NM, Lu W, Graham S, Bilal M, Bhalerao A, Lashen AG, Makhlouf S, Ibrahim AY, Snead D, Minhas F, Raza SEA, Rakha E, Rajpoot N. AI-enabled routine H&E image based prognostic marker for early-stage luminal breast cancer. NPJ Precis Oncol 2023; 7:122. [PMID: 37968376 PMCID: PMC10651910 DOI: 10.1038/s41698-023-00472-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 10/24/2023] [Indexed: 11/17/2023] Open
Abstract
Breast cancer (BC) grade is a well-established subjective prognostic indicator of tumour aggressiveness. Tumour heterogeneity and subjective assessment result in high degree of variability among observers in BC grading. Here we propose an objective Haematoxylin & Eosin (H&E) image-based prognostic marker for early-stage luminal/Her2-negative BReAst CancEr that we term as the BRACE marker. The proposed BRACE marker is derived from AI based assessment of heterogeneity in BC at a detailed level using the power of deep learning. The prognostic ability of the marker is validated in two well-annotated cohorts (Cohort-A/Nottingham: n = 2122 and Cohort-B/Coventry: n = 311) on early-stage luminal/HER2-negative BC patients treated with endocrine therapy and with long-term follow-up. The BRACE marker is able to stratify patients for both distant metastasis free survival (p = 0.001, C-index: 0.73) and BC specific survival (p < 0.0001, C-index: 0.84) showing comparable prediction accuracy to Nottingham Prognostic Index and Magee scores, which are both derived from manual histopathological assessment, to identify luminal BC patients that may be likely to benefit from adjuvant chemotherapy.
Collapse
Affiliation(s)
- Noorul Wahab
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Michael Toss
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
- Department of Histopathology, Sheffield Teaching Hospitals NHS Trust, Sheffield, UK
| | - Islam M Miligy
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
- Department of Pathology, Faculty of Medicine, Menoufia University, Shebin El-Koum, Egypt
| | - Mostafa Jahanifar
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Nehal M Atallah
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
- Department of Pathology, Faculty of Medicine, Menoufia University, Shebin El-Koum, Egypt
| | - Wenqi Lu
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Simon Graham
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
- Histofy Ltd, Birmingham, UK
| | - Mohsin Bilal
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Abhir Bhalerao
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Ayat G Lashen
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
- Department of Pathology, Faculty of Medicine, Menoufia University, Shebin El-Koum, Egypt
| | - Shorouk Makhlouf
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
- Department of Pathology, Faculty of Medicine, Assiut University, Asyut, Egypt
| | - Asmaa Y Ibrahim
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
| | - David Snead
- Histofy Ltd, Birmingham, UK
- The Alan Turing Institute, London, UK
| | - Fayyaz Minhas
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Shan E Ahmed Raza
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK
| | - Emad Rakha
- Academic Unit for Translational Medical Sciences, School of Medicine, University of Nottingham, Nottingham, UK
| | - Nasir Rajpoot
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry, UK.
- Histofy Ltd, Birmingham, UK.
- The Alan Turing Institute, London, UK.
| |
Collapse
|