1
|
Wu F, Cao G, Lu J, Ye S, Tang X. Correlation between 18 F-FDG PET/CT metabolic parameters and microvascular invasion before liver transplantation in patients with hepatocellular carcinoma. Nucl Med Commun 2024; 45:1033-1038. [PMID: 39267532 PMCID: PMC11537472 DOI: 10.1097/mnm.0000000000001897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Accepted: 08/30/2024] [Indexed: 09/17/2024]
Abstract
BACKGROUND Microvascular infiltration (MVI) before liver transplantation (LT) in patients with hepatocellular carcinoma (HCC) is associated with postoperative tumor recurrence and survival. MVI is mainly assessed by pathological analysis of tissue samples, which is invasive and heterogeneous. PET/computed tomography (PET/CT) with 18 F-labeled fluorodeoxyglucose ( 18 F-FDG) as a tracer has been widely used in the examination of malignant tumors. This study investigated the association between 18 F-FDG PET/CT metabolic parameters and MVI before LT in HCC patients. METHODS About 124 HCC patients who had 18 F-FDG PET/CT examination before LT were included. The patients' clinicopathological features and 18 F-FDG PET/CT metabolic parameters were recorded. Correlations between clinicopathological features, 18 F-FDG PET/CT metabolic parameters, and MVI were analyzed. ROC curve was used to determine the optimal diagnostic cutoff value, area under the curve (AUC), sensitivity, and specificity for predictors of MVI. RESULT In total 72 (58.06%) patients were detected with MVI among the 124 HCC patients. Univariate analysis showed that tumor size ( P = 0.001), T stage ( P < 0.001), maximum standardized uptake value (SUV max ) ( P < 0.001), minimum standardized uptake value (SUV min ) ( P = 0.031), mean standardized uptake value (SUV mean ) ( P = 0.001), peak standardized uptake value (SUV peak ) ( P = 0.001), tumor-to-liver ratio (SUV ratio ) ( P = 0.010), total lesion glycolysis (TLG) ( P = 0.006), metabolic tumor volume (MTV) ( P = 0.011) and MVI were significantly different. Multivariate logistic regression showed that tumor size ( P = 0.018), T stage ( P = 0.017), TLG ( P = 0.023), and MTV ( P = 0.015) were independent predictors of MVI. In the receiver operating characteristic curve, TLG predicted MVI with an AUC value of 0.645. MTV predicted MVI with an AUC value of 0.635. Patients with tumor size ≥5 cm, T3-4, TLG > 400.67, and MTV > 80.58 had a higher incidence of MVI. CONCLUSION 18 F-FDG PET/CT metabolic parameters correlate with MVI and may be used as a noninvasive technique to predict MVI before LT in HCC patients.
Collapse
Affiliation(s)
- Fan Wu
- Department of Nuclear Medicine and Radiology, Shulan (Hangzhou) Hospital, Shulan International Medical College, Zhejiang Shuren University
| | - Guohong Cao
- Department of Nuclear Medicine and Radiology, Shulan (Hangzhou) Hospital, Shulan International Medical College, Zhejiang Shuren University
| | - Jinlan Lu
- Department of Radiology, The Cancer Hospital of the University of Chinese Academy of Sciences, Zhejiang Cancer Hospital
| | - Shengli Ye
- Department of Nuclear Medicine and Radiology, Shulan (Hangzhou) Hospital, Shulan International Medical College, Zhejiang Shuren University
| | - Xin Tang
- Department of Radiology, Hangzhou Wuyunshan Hospital, Hangzhou Health Promotion Research Institute, Hangzhou, China
| |
Collapse
|
2
|
Lobanova OA, Kolesnikova AO, Ponomareva VA, Vekhova KA, Shaginyan AL, Semenova AB, Nekhoroshkov DP, Kochetkova SE, Kretova NV, Zanozin AS, Peshkova MA, Serezhnikova NB, Zharkov NV, Kogan EA, Biryukov AA, Rudenko EE, Demura TA. Artificial intelligence (AI) for tumor microenvironment (TME) and tumor budding (TB) identification in colorectal cancer (CRC) patients: A systematic review. J Pathol Inform 2024; 15:100353. [PMID: 39712977 PMCID: PMC11662261 DOI: 10.1016/j.jpi.2023.100353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 09/19/2023] [Accepted: 11/16/2023] [Indexed: 12/24/2024] Open
Abstract
Evaluation of the parameters such as tumor microenvironment (TME) and tumor budding (TB) is one of the most important steps in colorectal cancer (CRC) diagnosis and cancer development prognosis. In recent years, artificial intelligence (AI) has been successfully used to solve such problems. In this paper, we summarize the latest data on the use of artificial intelligence to predict tumor microenvironment and tumor budding in histological scans of patients with colorectal cancer. We performed a systematic literature search using 2 databases (Medline and Scopus) with the following search terms: ("tumor microenvironment" OR "tumor budding") AND ("colorectal cancer" OR CRC) AND ("artificial intelligence" OR "machine learning " OR "deep learning"). During the analysis, we gathered from the articles performance scores such as sensitivity, specificity, and accuracy of identifying TME and TB using artificial intelligence. The systematic review showed that machine learning and deep learning successfully cope with the prediction of these parameters. The highest accuracy values in TB and TME prediction were 97.7% and 97.3%, respectively. This review led us to the conclusion that AI platforms can already be used as diagnostic aids, which will greatly facilitate the work of pathologists in detection and estimation of TB and TME as instruments and second-opinion services. A key limitation in writing this systematic review was the heterogeneous use of performance metrics for machine learning models by different authors, as well as relatively small datasets used in some studies.
Collapse
Affiliation(s)
- Olga Andreevna Lobanova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Anastasia Olegovna Kolesnikova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | | | - Ksenia Andreevna Vekhova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Anaida Lusparonovna Shaginyan
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Alisa Borisovna Semenova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | | | - Svetlana Evgenievna Kochetkova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Natalia Valeryevna Kretova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Alexander Sergeevich Zanozin
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Maria Alekseevna Peshkova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Natalia Borisovna Serezhnikova
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Nikolay Vladimirovich Zharkov
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Evgeniya Altarovna Kogan
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Alexander Alekseevich Biryukov
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Ekaterina Evgenievna Rudenko
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| | - Tatiana Alexandrovna Demura
- I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Trubetskaya street, 8, p. 2, 119991 Moscow, Russia
| |
Collapse
|
3
|
Song JH, Kim ER, Hong Y, Sohn I, Ahn S, Kim SH, Jang KT. Prediction of Lymph Node Metastasis in T1 Colorectal Cancer Using Artificial Intelligence with Hematoxylin and Eosin-Stained Whole-Slide-Images of Endoscopic and Surgical Resection Specimens. Cancers (Basel) 2024; 16:1900. [PMID: 38791978 PMCID: PMC11119228 DOI: 10.3390/cancers16101900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2024] [Revised: 05/08/2024] [Accepted: 05/13/2024] [Indexed: 05/26/2024] Open
Abstract
According to the current guidelines, additional surgery is performed for endoscopically resected specimens of early colorectal cancer (CRC) with a high risk of lymph node metastasis (LNM). However, the rate of LNM is 2.1-25.0% in cases treated endoscopically followed by surgery, indicating a high rate of unnecessary surgeries. Therefore, this study aimed to develop an artificial intelligence (AI) model using H&E-stained whole slide images (WSIs) without handcrafted features employing surgically and endoscopically resected specimens to predict LNM in T1 CRC. To validate with an independent cohort, we developed a model with four versions comprising various combinations of training and test sets using H&E-stained WSIs from endoscopically (400 patients) and surgically resected specimens (881 patients): Version 1, Train and Test: surgical specimens; Version 2, Train and Test: endoscopic and surgically resected specimens; Version 3, Train: endoscopic and surgical specimens and Test: surgical specimens; Version 4, Train: endoscopic and surgical specimens and Test: endoscopic specimens. The area under the curve (AUC) of the receiver operating characteristic curve was used to determine the accuracy of the AI model for predicting LNM with a 5-fold cross-validation in the training set. Our AI model with H&E-stained WSIs and without annotations showed good performance power with the validation of an independent cohort in a single center. The AUC of our model was 0.758-0.830 in the training set and 0.781-0.824 in the test set, higher than that of previous AI studies with only WSI. Moreover, the AI model with Version 4, which showed the highest sensitivity (92.9%), reduced unnecessary additional surgery by 14.2% more than using the current guidelines (68.3% vs. 82.5%). This revealed the feasibility of using an AI model with only H&E-stained WSIs to predict LNM in T1 CRC.
Collapse
Affiliation(s)
- Joo Hye Song
- Department of Internal Medicine, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul 05030, Republic of Korea;
| | - Eun Ran Kim
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea
| | - Yiyu Hong
- Department of R&D Center, Arontier Co., Ltd., Seoul 06735, Republic of Korea;
| | - Insuk Sohn
- Department of R&D Center, Arontier Co., Ltd., Seoul 06735, Republic of Korea;
| | - Soomin Ahn
- Department of Pathology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea; (S.A.); (S.-H.K.); (K.-T.J.)
| | - Seok-Hyung Kim
- Department of Pathology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea; (S.A.); (S.-H.K.); (K.-T.J.)
| | - Kee-Taek Jang
- Department of Pathology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea; (S.A.); (S.-H.K.); (K.-T.J.)
| |
Collapse
|
4
|
Norton EJ, Bateman AC. Risk assessment in pT1 colorectal cancer. J Clin Pathol 2024; 77:225-232. [PMID: 37985141 DOI: 10.1136/jcp-2023-208803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 11/10/2023] [Indexed: 11/22/2023]
Abstract
Colorectal cancer (CRC) is a common malignancy worldwide and tumour stage is closely related to clinical outcome. A small but significant proportion of submucosal-invasive (ie, pT1) CRC are associated with regional lymph node metastases (LNM) and a worse prognosis. The likelihood of LNM in pT1 CRC needs to be balanced against the operative risk and costs of surgical resection when determining the best patient management. A wide range of histopathological and clinical factors may affect LNM risk in this setting. This script provides a comprehensive overview of the tumour and patient-associated features that have been linked to LNM risk in pT1 CRC. Some of the features are well established within the literature and are included in published guidelines, while others are novel and emerging in nature. Odds ratios for LNM that are associated with key predictive features are provided where appropriate, and published models developed as an aid to the calculation of LNM risk are discussed.
Collapse
Affiliation(s)
- Emma Jane Norton
- Cellular Pathology, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Adrian C Bateman
- Cellular Pathology, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| |
Collapse
|
5
|
Thompson N, Morley-Bunker A, McLauchlan J, Glyn T, Eglinton T. Use of artificial intelligence for the prediction of lymph node metastases in early-stage colorectal cancer: systematic review. BJS Open 2024; 8:zrae033. [PMID: 38637299 PMCID: PMC11026097 DOI: 10.1093/bjsopen/zrae033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 03/02/2024] [Accepted: 03/04/2024] [Indexed: 04/20/2024] Open
Abstract
BACKGROUND Risk evaluation of lymph node metastasis for early-stage (T1 and T2) colorectal cancers is critical for determining therapeutic strategies. Traditional methods of lymph node metastasis prediction have limited accuracy. This systematic review aimed to review the potential of artificial intelligence in predicting lymph node metastasis in early-stage colorectal cancers. METHODS A comprehensive search was performed of papers that evaluated the potential of artificial intelligence in predicting lymph node metastasis in early-stage colorectal cancers. Studies were appraised using the Joanna Briggs Institute tools. The primary outcome was summarizing artificial intelligence models and their accuracy. Secondary outcomes included influential variables and strategies to address challenges. RESULTS Of 3190 screened manuscripts, 11 were included, involving 8648 patients from 1996 to 2023. Due to diverse artificial intelligence models and varied metrics, no data synthesis was performed. Models included random forest algorithms, support vector machine, deep learning, artificial neural network, convolutional neural network and least absolute shrinkage and selection operator regression. Artificial intelligence models' area under the curve values ranged from 0.74 to 0.9993 (slide level) and 0.9476 to 0.9956 (single-node level), outperforming traditional clinical guidelines. CONCLUSION Artificial intelligence models show promise in predicting lymph node metastasis in early-stage colorectal cancers, potentially refining clinical decisions and improving outcomes. PROSPERO REGISTRATION NUMBER CRD42023409094.
Collapse
Affiliation(s)
- Nasya Thompson
- Department of Surgery, University of Otago, Christchurch, New Zealand
| | - Arthur Morley-Bunker
- Department of Pathology and Biomedical Science, University of Otago, Christchurch, New Zealand
| | - Jared McLauchlan
- Department of Surgery, Te Whatu Ora – Health New Zealand Waitaha Canterbury, Christchurch, New Zealand
| | - Tamara Glyn
- Department of Surgery, University of Otago, Christchurch, New Zealand
- Department of Surgery, Te Whatu Ora – Health New Zealand Waitaha Canterbury, Christchurch, New Zealand
| | - Tim Eglinton
- Department of Surgery, University of Otago, Christchurch, New Zealand
- Department of Surgery, Te Whatu Ora – Health New Zealand Waitaha Canterbury, Christchurch, New Zealand
| |
Collapse
|
6
|
Yang J, Huang J, Han D, Ma X. Artificial Intelligence Applications in the Treatment of Colorectal Cancer: A Narrative Review. Clin Med Insights Oncol 2024; 18:11795549231220320. [PMID: 38187459 PMCID: PMC10771756 DOI: 10.1177/11795549231220320] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 11/26/2023] [Indexed: 01/09/2024] Open
Abstract
Colorectal cancer is the third most prevalent cancer worldwide, and its treatment has been a demanding clinical problem. Beyond traditional surgical therapy and chemotherapy, newly revealed molecular mechanisms diversify therapeutic approaches for colorectal cancer. However, the selection of personalized treatment among multiple treatment options has become another challenge in the era of precision medicine. Artificial intelligence has recently been increasingly investigated in the treatment of colorectal cancer. This narrative review mainly discusses the applications of artificial intelligence in the treatment of colorectal cancer patients. A comprehensive literature search was conducted in MEDLINE, EMBASE, and Web of Science to identify relevant papers, resulting in 49 articles being included. The results showed that, based on different categories of data, artificial intelligence can predict treatment outcomes and essential guidance information of traditional and novel therapies, thus enabling individualized treatment strategy selection for colorectal cancer patients. Some frequently implemented machine learning algorithms and deep learning frameworks have also been employed for long-term prognosis prediction in patients with colorectal cancer. Overall, artificial intelligence shows encouraging results in treatment strategy selection and prognosis evaluation for colorectal cancer patients.
Collapse
Affiliation(s)
- Jiaqing Yang
- Department of Biotherapy, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, Chengdu, China
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Jing Huang
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu, China
| | - Deqian Han
- Department of Oncology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China
| | - Xuelei Ma
- Department of Biotherapy, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, Chengdu, China
| |
Collapse
|
7
|
Li JW, Wang LM, Ichimasa K, Lin KW, Ngu JCY, Ang TL. Use of artificial intelligence in the management of T1 colorectal cancer: a new tool in the arsenal or is deep learning out of its depth? Clin Endosc 2024; 57:24-35. [PMID: 37743068 PMCID: PMC10834280 DOI: 10.5946/ce.2023.036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 05/11/2023] [Indexed: 09/26/2023] Open
Abstract
The field of artificial intelligence is rapidly evolving, and there has been an interest in its use to predict the risk of lymph node metastasis in T1 colorectal cancer. Accurately predicting lymph node invasion may result in fewer patients undergoing unnecessary surgeries; conversely, inadequate assessments will result in suboptimal oncological outcomes. This narrative review aims to summarize the current literature on deep learning for predicting the probability of lymph node metastasis in T1 colorectal cancer, highlighting areas of potential application and barriers that may limit its generalizability and clinical utility.
Collapse
Affiliation(s)
- James Weiquan Li
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore Health Services, Singapore
- Academic Medicine Center, Duke-NUS Medical School, Singapore
| | - Lai Mun Wang
- Department of Laboratory Medicine, Changi General Hospital, Singapore Health Services, Singapore
| | - Katsuro Ichimasa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Kenneth Weicong Lin
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore Health Services, Singapore
- Academic Medicine Center, Duke-NUS Medical School, Singapore
| | - James Chi-Yong Ngu
- Department of General Surgery, Changi General Hospital, Singapore Health Services, Singapore
| | - Tiing Leong Ang
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore Health Services, Singapore
- Academic Medicine Center, Duke-NUS Medical School, Singapore
| |
Collapse
|
8
|
Jing Y, Li C, Du T, Jiang T, Sun H, Yang J, Shi L, Gao M, Grzegorzek M, Li X. A comprehensive survey of intestine histopathological image analysis using machine vision approaches. Comput Biol Med 2023; 165:107388. [PMID: 37696178 DOI: 10.1016/j.compbiomed.2023.107388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 08/06/2023] [Accepted: 08/25/2023] [Indexed: 09/13/2023]
Abstract
Colorectal Cancer (CRC) is currently one of the most common and deadly cancers. CRC is the third most common malignancy and the fourth leading cause of cancer death worldwide. It ranks as the second most frequent cause of cancer-related deaths in the United States and other developed countries. Histopathological images contain sufficient phenotypic information, they play an indispensable role in the diagnosis and treatment of CRC. In order to improve the objectivity and diagnostic efficiency for image analysis of intestinal histopathology, Computer-aided Diagnosis (CAD) methods based on machine learning (ML) are widely applied in image analysis of intestinal histopathology. In this investigation, we conduct a comprehensive study on recent ML-based methods for image analysis of intestinal histopathology. First, we discuss commonly used datasets from basic research studies with knowledge of intestinal histopathology relevant to medicine. Second, we introduce traditional ML methods commonly used in intestinal histopathology, as well as deep learning (DL) methods. Then, we provide a comprehensive review of the recent developments in ML methods for segmentation, classification, detection, and recognition, among others, for histopathological images of the intestine. Finally, the existing methods have been studied, and the application prospects of these methods in this field are given.
Collapse
Affiliation(s)
- Yujie Jing
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Chen Li
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China.
| | - Tianming Du
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Tao Jiang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, China; International Joint Institute of Robotics and Intelligent Systems, Chengdu University of Information Technology, Chengdu, China
| | - Hongzan Sun
- Shengjing Hospital of China Medical University, Shenyang, China
| | - Jinzhu Yang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Liyu Shi
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Minghe Gao
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Marcin Grzegorzek
- Institute for Medical Informatics, University of Luebeck, Luebeck, Germany; Department of Knowledge Engineering, University of Economics in Katowice, Katowice, Poland
| | - Xiaoyan Li
- Cancer Hospital of China Medical University, Liaoning Cancer Hospital, Shenyang, China.
| |
Collapse
|
9
|
Spinelli A, Carrano FM, Laino ME, Andreozzi M, Koleth G, Hassan C, Repici A, Chand M, Savevski V, Pellino G. Artificial intelligence in colorectal surgery: an AI-powered systematic review. Tech Coloproctol 2023; 27:615-629. [PMID: 36805890 DOI: 10.1007/s10151-023-02772-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 02/07/2023] [Indexed: 02/23/2023]
Abstract
Artificial intelligence (AI) has the potential to revolutionize surgery in the coming years. Still, it is essential to clarify what the meaningful current applications are and what can be reasonably expected. This AI-powered review assessed the role of AI in colorectal surgery. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-compliant systematic search of PubMed, Embase, Scopus, Cochrane Library databases, and gray literature was conducted on all available articles on AI in colorectal surgery (from January 1 1997 to March 1 2021), aiming to define the perioperative applications of AI. Potentially eligible studies were identified using novel software powered by natural language processing (NLP) and machine learning (ML) technologies dedicated to systematic reviews. Out of 1238 articles identified, 115 were included in the final analysis. Available articles addressed the role of AI in several areas of interest. In the preoperative phase, AI can be used to define tailored treatment algorithms, support clinical decision-making, assess the risk of complications, and predict surgical outcomes and survival. Intraoperatively, AI-enhanced surgery and integration of AI in robotic platforms have been suggested. After surgery, AI can be implemented in the Enhanced Recovery after Surgery (ERAS) pathway. Additional areas of applications included the assessment of patient-reported outcomes, automated pathology assessment, and research. Available data on these aspects are limited, and AI in colorectal surgery is still in its infancy. However, the rapid evolution of technologies makes it likely that it will increasingly be incorporated into everyday practice.
Collapse
Affiliation(s)
- A Spinelli
- IRCCS Humanitas Research Hospital, via Manzoni 56, 20089, Rozzano, MI, Italy.
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20090, Pieve Emanuele, MI, Italy.
| | - F M Carrano
- IRCCS Humanitas Research Hospital, via Manzoni 56, 20089, Rozzano, MI, Italy
| | - M E Laino
- Artificial Intelligence Center, Humanitas Clinical and Research Center-IRCCS, Via A. Manzoni 56, 20089, Rozzano, MI, Italy
| | - M Andreozzi
- Department of Clinical Medicine and Surgery, University "Federico II" of Naples, Naples, Italy
| | - G Koleth
- Department of Gastroenterology and Hepatology, Hospital Selayang, Selangor, Malaysia
| | - C Hassan
- IRCCS Humanitas Research Hospital, via Manzoni 56, 20089, Rozzano, MI, Italy
| | - A Repici
- IRCCS Humanitas Research Hospital, via Manzoni 56, 20089, Rozzano, MI, Italy
| | - M Chand
- Wellcome EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK
| | - V Savevski
- Artificial Intelligence Center, Humanitas Clinical and Research Center-IRCCS, Via A. Manzoni 56, 20089, Rozzano, MI, Italy
| | - G Pellino
- Department of Advanced Medical and Surgical Sciences, Università degli Studi della Campania "Luigi Vanvitelli", Naples, Italy
- Colorectal Surgery, Vall d'Hebron University Hospital, Universitat Autonoma de Barcelona UAB, Barcelona, Spain
| |
Collapse
|
10
|
Chen S, Xiang J, Wang X, Zhang J, Yang S, Yang W, Zheng J, Han X. Deep learning-based pathology signature could reveal lymph node status and act as a novel prognostic marker across multiple cancer types. Br J Cancer 2023; 129:46-53. [PMID: 37137998 PMCID: PMC10307798 DOI: 10.1038/s41416-023-02262-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 03/22/2023] [Accepted: 03/24/2023] [Indexed: 05/05/2023] Open
Abstract
BACKGROUND Identifying lymph node metastasis (LNM) relies mainly on indirect radiology. Current studies omitted the quantified associations with traits beyond cancer types, failing to provide generalisation performance across various tumour types. METHODS 4400 whole slide images across 11 cancer types were collected for training, cross-verification, and external validation of the pan-cancer lymph node metastasis (PC-LNM) model. We proposed an attention-based weakly supervised neural network based on self-supervised cancer-invariant features for the prediction task. RESULTS PC-LNM achieved a test area under the curve (AUC) of 0.732 (95% confidence interval: 0.717-0.746, P < 0.0001) in fivefold cross-validation of multiple cancer types, which also demonstrated good generalisation in the external validation cohort with AUC of 0.699 (95% confidence interval: 0.658-0.737, P < 0.0001). The interpretability results derived from PC-LNM revealed that the regions with the highest attention scores identified by the model generally correspond to tumours with poorly differentiated morphologies. PC-LNM achieved superior performance over previously reported methods and could also act as an independent prognostic factor for patients across multiple tumour types. DISCUSSION We presented an automated pan-cancer model for predicting the LNM status from primary tumour histology, which could act as a novel prognostic marker across multiple cancer types.
Collapse
Affiliation(s)
- Siteng Chen
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, 200135, Shanghai, China
| | | | - Xiyue Wang
- College of Computer Science, Sichuan University, 610065, Chengdu, China
| | - Jun Zhang
- Tencent AI Lab, 518057, Shenzhen, China.
| | - Sen Yang
- Tencent AI Lab, 518057, Shenzhen, China
| | - Wei Yang
- Tencent AI Lab, 518057, Shenzhen, China
| | - Junhua Zheng
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, 200135, Shanghai, China.
| | - Xiao Han
- Tencent AI Lab, 518057, Shenzhen, China.
| |
Collapse
|
11
|
Khazaee Fadafen M, Rezaee K. Ensemble-based multi-tissue classification approach of colorectal cancer histology images using a novel hybrid deep learning framework. Sci Rep 2023; 13:8823. [PMID: 37258631 DOI: 10.1038/s41598-023-35431-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 05/17/2023] [Indexed: 06/02/2023] Open
Abstract
Colorectal cancer (CRC) is the second leading cause of cancer death in the world, so digital pathology is essential for assessing prognosis. Due to the increasing resolution and quantity of whole slide images (WSIs), as well as the lack of annotated information, previous methodologies cannot be generalized as effective decision-making systems. Since deep learning (DL) methods can handle large-scale applications, they can provide a viable alternative to histopathology image (HI) analysis. DL architectures, however, may not be sufficient to classify CRC tissues based on anatomical histopathology data. A dilated ResNet (dResNet) structure and attention module are used to generate deep feature maps in order to classify multiple tissues in HIs. In addition, neighborhood component analysis (NCA) overcomes the constraint of computational complexity. Data is fed into a deep support vector machine (SVM) based on an ensemble learning algorithm called DeepSVM after the features have been selected. CRC-5000 and NCT-CRC-HE-100 K datasets were analyzed to validate and test the hybrid procedure. We demonstrate that the hybrid model achieves 98.75% and 99.76% accuracy on CRC datasets. The results showed that only pathologists' labels could successfully classify unseen WSIs. Furthermore, the hybrid deep learning method outperforms state-of-the-art approaches in terms of computational efficiency and time. Using the proposed mechanism for tissue analysis, it will be possible to correctly predict CRC based on accurate pathology image classification.
Collapse
Affiliation(s)
- Masoud Khazaee Fadafen
- Department of Electrical Engineering, Technical and Vocational University (TVU), Tehran, Iran
| | - Khosro Rezaee
- Department of Biomedical Engineering, Meybod University, Meybod, Iran.
| |
Collapse
|
12
|
Sharma A, Kumar R, Yadav G, Garg P. Artificial intelligence in intestinal polyp and colorectal cancer prediction. Cancer Lett 2023; 565:216238. [PMID: 37211068 DOI: 10.1016/j.canlet.2023.216238] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 05/17/2023] [Accepted: 05/17/2023] [Indexed: 05/23/2023]
Abstract
Artificial intelligence (AI) algorithms and their application to disease detection and decision support for healthcare professions have greatly evolved in the recent decade. AI has been widely applied and explored in gastroenterology for endoscopic analysis to diagnose intestinal cancers, premalignant polyps, gastrointestinal inflammatory lesions, and bleeding. Patients' responses to treatments and prognoses have both been predicted using AI by combining multiple algorithms. In this review, we explored the recent applications of AI algorithms in the identification and characterization of intestinal polyps and colorectal cancer predictions. AI-based prediction models have the potential to help medical practitioners diagnose, establish prognoses, and find accurate conclusions for the treatment of patients. With the understanding that rigorous validation of AI approaches using randomized controlled studies is solicited before widespread clinical use by health authorities, the article also discusses the limitations and challenges associated with deploying AI systems to diagnose intestinal malignancies and premalignant lesions.
Collapse
Affiliation(s)
- Anju Sharma
- Department of Pharmacoinformatics, National Institute of Pharmaceutical Education and Research, S.A.S Nagar, 160062, Punjab, India
| | - Rajnish Kumar
- Amity Institute of Biotechnology, Amity University Uttar Pradesh, Lucknow Campus, Uttar Pradesh, 226010, India; Department of Veterinary Medicine and Surgery, College of Veterinary Medicine, University of Missouri, Columbia, MO, USA
| | - Garima Yadav
- Amity Institute of Biotechnology, Amity University Uttar Pradesh, Lucknow Campus, Uttar Pradesh, 226010, India
| | - Prabha Garg
- Department of Pharmacoinformatics, National Institute of Pharmaceutical Education and Research, S.A.S Nagar, 160062, Punjab, India.
| |
Collapse
|
13
|
Krogue JD, Azizi S, Tan F, Flament-Auvigne I, Brown T, Plass M, Reihs R, Müller H, Zatloukal K, Richeson P, Corrado GS, Peng LH, Mermel CH, Liu Y, Chen PHC, Gombar S, Montine T, Shen J, Steiner DF, Wulczyn E. Predicting lymph node metastasis from primary tumor histology and clinicopathologic factors in colorectal cancer using deep learning. COMMUNICATIONS MEDICINE 2023; 3:59. [PMID: 37095223 PMCID: PMC10125969 DOI: 10.1038/s43856-023-00282-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 03/29/2023] [Indexed: 04/26/2023] Open
Abstract
BACKGROUND Presence of lymph node metastasis (LNM) influences prognosis and clinical decision-making in colorectal cancer. However, detection of LNM is variable and depends on a number of external factors. Deep learning has shown success in computational pathology, but has struggled to boost performance when combined with known predictors. METHODS Machine-learned features are created by clustering deep learning embeddings of small patches of tumor in colorectal cancer via k-means, and then selecting the top clusters that add predictive value to a logistic regression model when combined with known baseline clinicopathological variables. We then analyze performance of logistic regression models trained with and without these machine-learned features in combination with the baseline variables. RESULTS The machine-learned extracted features provide independent signal for the presence of LNM (AUROC: 0.638, 95% CI: [0.590, 0.683]). Furthermore, the machine-learned features add predictive value to the set of 6 clinicopathologic variables in an external validation set (likelihood ratio test, p < 0.00032; AUROC: 0.740, 95% CI: [0.701, 0.780]). A model incorporating these features can also further risk-stratify patients with and without identified metastasis (p < 0.001 for both stage II and stage III). CONCLUSION This work demonstrates an effective approach to combine deep learning with established clinicopathologic factors in order to identify independently informative features associated with LNM. Further work building on these specific results may have important impact in prognostication and therapeutic decision making for LNM. Additionally, this general computational approach may prove useful in other contexts.
Collapse
Affiliation(s)
| | | | - Fraser Tan
- Google Health, Palo Alto, California, USA
| | | | | | | | | | | | | | - Pema Richeson
- Department of Pathology, Stanford University School of Medicine, Stanford, California, USA
| | | | | | | | - Yun Liu
- Google Health, Palo Alto, California, USA
| | | | - Saurabh Gombar
- Department of Pathology, Stanford University School of Medicine, Stanford, California, USA
| | - Thomas Montine
- Department of Pathology, Stanford University School of Medicine, Stanford, California, USA
| | - Jeanne Shen
- Department of Pathology, Stanford University School of Medicine, Stanford, California, USA
| | | | | |
Collapse
|
14
|
Kumar A, Vishwakarma A, Bajaj V. CRCCN-Net: Automated framework for classification of colorectal tissue using histopathological images. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
15
|
Yavuz A, Alpsoy A, Gedik EO, Celik MY, Bassorgun CI, Unal B, Elpek GO. Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology. Artif Intell Gastroenterol 2022; 3:142-162. [DOI: 10.35712/aig.v3.i5.142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 11/25/2022] [Accepted: 12/14/2022] [Indexed: 12/28/2022] Open
Abstract
Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.
Collapse
Affiliation(s)
- Aysen Yavuz
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | - Anil Alpsoy
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | - Elif Ocak Gedik
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | | | | | - Betul Unal
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | - Gulsum Ozlem Elpek
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| |
Collapse
|
16
|
Pham TD, Ravi V, Fan C, Luo B, Sun XF. Classification of IHC Images of NATs With ResNet-FRP-LSTM for Predicting Survival Rates of Rectal Cancer Patients. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2022; 11:87-95. [PMID: 36704244 PMCID: PMC9870269 DOI: 10.1109/jtehm.2022.3229561] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Revised: 11/06/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022]
Abstract
BACKGROUND Over a decade, tissues dissected adjacent to primary tumors have been considered "normal" or healthy samples (NATs). However, NATs have recently been discovered to be distinct from both tumorous and normal tissues. The ability to predict the survival rate of cancer patients using NATs can open a new door to selecting optimal treatments for cancer and discovering biomarkers. METHODS This paper introduces an artificial intelligence (AI) approach that uses NATs for predicting the 5-year survival of pre-operative radiotherapy patients with rectal cancer. The new approach combines pre-trained deep learning, nonlinear dynamics, and long short-term memory to classify immunohistochemical images of RhoB protein expression on NATs. RESULTS Ten-fold cross-validation results show 88% accuracy of prediction obtained from the new approach, which is also higher than those provided from baseline methods. CONCLUSION Preliminary results not only add objective evidence to recent findings of NATs' molecular characteristics using state-of-the-art AI methods, but also contribute to the discovery of RhoB expression on NATs in rectal-cancer patients. CLINICAL IMPACT The ability to predict the survival rate of cancer patients is extremely important for clinical decision-making. The proposed AI tool is promising for assisting oncologists in their treatments of rectal cancer patients.
Collapse
Affiliation(s)
- Tuan D Pham
- Center for Artificial IntelligencePrince Mohammad Bin Fahd University Khobar 31952 Saudi Arabia
| | - Vinayakumar Ravi
- Center for Artificial IntelligencePrince Mohammad Bin Fahd University Khobar 31952 Saudi Arabia
| | - Chuanwen Fan
- Department of OncologyLinkoping University 58185 Linkoping Sweden
- Department of Biomedical and Clinical SciencesLinkoping University 58185 Linkoping Sweden
| | - Bin Luo
- Department of OncologyLinkoping University 58185 Linkoping Sweden
- Department of Biomedical and Clinical SciencesLinkoping University 58185 Linkoping Sweden
- Department of Gastrointestinal SurgerySichuan Provincial People's Hospital Chengdu 610032 China
| | - Xiao-Feng Sun
- Department of OncologyLinkoping University 58185 Linkoping Sweden
- Department of Biomedical and Clinical SciencesLinkoping University 58185 Linkoping Sweden
| |
Collapse
|
17
|
Qiao Y, Zhao L, Luo C, Luo Y, Wu Y, Li S, Bu D, Zhao Y. Multi-modality artificial intelligence in digital pathology. Brief Bioinform 2022; 23:6702380. [PMID: 36124675 PMCID: PMC9677480 DOI: 10.1093/bib/bbac367] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/27/2022] [Accepted: 08/05/2022] [Indexed: 12/14/2022] Open
Abstract
In common medical procedures, the time-consuming and expensive nature of obtaining test results plagues doctors and patients. Digital pathology research allows using computational technologies to manage data, presenting an opportunity to improve the efficiency of diagnosis and treatment. Artificial intelligence (AI) has a great advantage in the data analytics phase. Extensive research has shown that AI algorithms can produce more up-to-date and standardized conclusions for whole slide images. In conjunction with the development of high-throughput sequencing technologies, algorithms can integrate and analyze data from multiple modalities to explore the correspondence between morphological features and gene expression. This review investigates using the most popular image data, hematoxylin-eosin stained tissue slide images, to find a strategic solution for the imbalance of healthcare resources. The article focuses on the role that the development of deep learning technology has in assisting doctors' work and discusses the opportunities and challenges of AI.
Collapse
Affiliation(s)
- Yixuan Qiao
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Lianhe Zhao
- Corresponding authors: Yi Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences; Shandong First Medical University & Shandong Academy of Medical Sciences. Tel.: +86 10 6260 0822; Fax: +86 10 6260 1356; E-mail: ; Lianhe Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences. Tel.: +86 18513983324; E-mail:
| | - Chunlong Luo
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yufan Luo
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yang Wu
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China
| | - Shengtong Li
- Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Dechao Bu
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China
| | - Yi Zhao
- Corresponding authors: Yi Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences; Shandong First Medical University & Shandong Academy of Medical Sciences. Tel.: +86 10 6260 0822; Fax: +86 10 6260 1356; E-mail: ; Lianhe Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences. Tel.: +86 18513983324; E-mail:
| |
Collapse
|
18
|
Coggan H, Andres Terre H, Liò P. A novel interpretable machine learning algorithm to identify optimal parameter space for cancer growth. Front Big Data 2022; 5:941451. [PMID: 36172548 PMCID: PMC9510846 DOI: 10.3389/fdata.2022.941451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Accepted: 08/17/2022] [Indexed: 11/13/2022] Open
Abstract
Recent years have seen an increase in the application of machine learning to the analysis of physical and biological systems, including cancer progression. A fundamental downside to these tools is that their complexity and nonlinearity makes it almost impossible to establish a deterministic, a priori relationship between their input and output, and thus their predictions are not wholly accountable. We begin with a series of proofs establishing that this holds even for the simplest possible model of a neural network; the effects of specific loss functions are explored more fully in Appendices. We return to first principles and consider how to construct a physics-inspired model of tumor growth without resorting to stochastic gradient descent or artificial nonlinearities. We derive an algorithm which explores the space of possible parameters in a model of tumor growth and identifies candidate equations much faster than a simulated annealing approach. We test this algorithm on synthetic tumor-growth trajectories and show that it can efficiently and reliably narrow down the area of parameter space where the correct values are located. This approach has the potential to greatly improve the speed and reliability with which patient-specific models of cancer growth can be identified in a clinical setting.
Collapse
Affiliation(s)
- Helena Coggan
- Department of Mathematics, University College London, London, United Kingdom
- *Correspondence: Helena Coggan
| | - Helena Andres Terre
- Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom
| | - Pietro Liò
- Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
19
|
Orsulic S, John J, Walts AE, Gertych A. Computational pathology in ovarian cancer. Front Oncol 2022; 12:924945. [PMID: 35965569 PMCID: PMC9372445 DOI: 10.3389/fonc.2022.924945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Accepted: 06/27/2022] [Indexed: 11/30/2022] Open
Abstract
Histopathologic evaluations of tissue sections are key to diagnosing and managing ovarian cancer. Pathologists empirically assess and integrate visual information, such as cellular density, nuclear atypia, mitotic figures, architectural growth patterns, and higher-order patterns, to determine the tumor type and grade, which guides oncologists in selecting appropriate treatment options. Latent data embedded in pathology slides can be extracted using computational imaging. Computers can analyze digital slide images to simultaneously quantify thousands of features, some of which are visible with a manual microscope, such as nuclear size and shape, while others, such as entropy, eccentricity, and fractal dimensions, are quantitatively beyond the grasp of the human mind. Applications of artificial intelligence and machine learning tools to interpret digital image data provide new opportunities to explore and quantify the spatial organization of tissues, cells, and subcellular structures. In comparison to genomic, epigenomic, transcriptomic, and proteomic patterns, morphologic and spatial patterns are expected to be more informative as quantitative biomarkers of complex and dynamic tumor biology. As computational pathology is not limited to visual data, nuanced subvisual alterations that occur in the seemingly “normal” pre-cancer microenvironment could facilitate research in early cancer detection and prevention. Currently, efforts to maximize the utility of computational pathology are focused on integrating image data with other -omics platforms that lack spatial information, thereby providing a new way to relate the molecular, spatial, and microenvironmental characteristics of cancer. Despite a dire need for improvements in ovarian cancer prevention, early detection, and treatment, the ovarian cancer field has lagged behind other cancers in the application of computational pathology. The intent of this review is to encourage ovarian cancer research teams to apply existing and/or develop additional tools in computational pathology for ovarian cancer and actively contribute to advancing this important field.
Collapse
Affiliation(s)
- Sandra Orsulic
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA, United States
- Department of Obstetrics and Gynecology, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, United States
- Jonsson Comprehensive Cancer Center, University of California Los Angeles, Los Angeles, CA, United States
- *Correspondence: Sandra Orsulic,
| | - Joshi John
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA, United States
- Department of Psychiatry, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, United States
| | - Ann E. Walts
- Department of Pathology and Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, United States
| | - Arkadiusz Gertych
- Department of Pathology and Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, United States
- Department of Surgery, Cedars-Sinai Medical Center, Los Angeles, CA, United States
- Faculty of Biomedical Engineering, Silesian University of Technology, Zabrze, Poland
| |
Collapse
|
20
|
Chen Q, Xiao H, Gu Y, Weng Z, Wei L, Li B, Liao B, Li J, Lin J, Hei M, Peng S, Wang W, Kuang M, Chen S. Deep learning for evaluation of microvascular invasion in hepatocellular carcinoma from tumor areas of histology images. Hepatol Int 2022; 16:590-602. [PMID: 35349075 PMCID: PMC9174315 DOI: 10.1007/s12072-022-10323-w] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Accepted: 02/16/2022] [Indexed: 11/23/2022]
Abstract
BACKGROUND Microvascular invasion (MVI) is essential for the management of hepatocellular carcinoma (HCC). However, MVI is hard to evaluate in patients without sufficient peri-tumoral tissue samples, which account for over a half of HCC patients. METHODS We established an MVI deep-learning (MVI-DL) model with a weakly supervised multiple-instance learning framework, to evaluate MVI status using only tumor tissues from the histological whole slide images (WSIs). A total of 350 HCC patients (2917 WSIs) from the First Affiliated Hospital of Sun Yat-sen University (FAHSYSU cohort) were divided into a training and test set. One hundred and twenty patients (504 WSIs) from Dongguan People's Hospital and Shunde Hospital of Southern Medical University (DG-SD cohort) formed an external test set. Unsupervised clustering and class activation mapping were applied to visualize the key histological features. RESULTS In the FAHSYSU and DG-SD test set, the MVI-DL model achieved an AUC of 0.904 (95% CI 0.888-0.920) and 0.871 (95% CI 0.837-0.905), respectively. Visualization results showed that macrotrabecular architecture with rich blood sinus, rich tumor stroma and high intratumor heterogeneity were identified as the key features associated with MVI ( +), whereas severe immune infiltration and highly differentiated tumor cells were associated with MVI (-). In the simulation of patients with only one WSI or biopsies only, the AUC of the MVI-DL model reached 0.875 (95% CI 0.855-0.895) and 0.879 (95% CI 0.853-0.906), respectively. CONCLUSION The effective, interpretable MVI-DL model has potential as an important tool with practical clinical applicability in evaluating MVI status from the tumor areas on the histological slides.
Collapse
Affiliation(s)
- Qiaofeng Chen
- Department of Gastroenterology, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Han Xiao
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, the First Affiliated Hospital of Sun Yat-Sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Yunquan Gu
- Clinical Trials Unit, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Zongpeng Weng
- Clinical Trials Unit, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Lihong Wei
- Department of Pathology, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Bin Li
- Clinical Trials Unit, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Bing Liao
- Department of Pathology, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Jiali Li
- Department of Liver and Pancreatobiliary Surgery, Dongguan People's Hospital, Dongguan, Guangdong, China
| | - Jie Lin
- Department of Liver and Pancreatobiliary Surgery, Shunde Hospital of Southern Medical University, Shunde, Guangdong, China
| | - Mengying Hei
- Department of Pathology, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Sui Peng
- Department of Gastroenterology, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
- Clinical Trials Unit, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Wei Wang
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, the First Affiliated Hospital of Sun Yat-Sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China.
| | - Ming Kuang
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, the First Affiliated Hospital of Sun Yat-Sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China.
- Department of Liver Surgery, Cancer Center, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-Sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China.
| | - Shuling Chen
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, the First Affiliated Hospital of Sun Yat-Sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China.
| |
Collapse
|
21
|
Dong H, Wang X. Identification of Signature Genes and Construction of an Artificial Neural Network Model of Prostate Cancer. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:1562511. [PMID: 35432828 PMCID: PMC9010146 DOI: 10.1155/2022/1562511] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Revised: 03/21/2022] [Accepted: 03/23/2022] [Indexed: 11/22/2022]
Abstract
This study aimed to establish an artificial neural network (ANN) model based on prostate cancer signature genes (PCaSGs) to predict the patients with prostate cancer (PCa). In the present study, 270 differentially expressed genes (DEGs) were identified between PCa and normal prostate (NP) groups by differential gene expression analysis. Next, we performed Metascape gene annotation, pathway and process enrichment analysis, and PPI enrichment analysis on all 270 DEGs. Then, we identified and screened out 30 PCaSGs based on the random forest analysis and constructed an ANN model based on the gene score matrix consisting of 30 PCaSGs. Lastly, analysis of microarray dataset GSE46602 showed that the accuracy of this model for predicating PCa and NP samples was 88.9 and 78.6%, respectively. Our results suggested that the ANN model based on PCaSGs can be used for effectively predicting the patients with PCa and will be helpful for early PCa diagnosis and treatment.
Collapse
Affiliation(s)
- Hongye Dong
- Department of Kidney Disease and Blood Purifification Center, The Second Hospital of Tianjin Medical University, Tianjin 300211, China
| | - Xu Wang
- Department of Urology, Tianjin Institute of Urology, The Second Hospital of Tianjin Medical University, Tianjin 300211, China
| |
Collapse
|
22
|
Deep Learning on Histopathological Images for Colorectal Cancer Diagnosis: A Systematic Review. Diagnostics (Basel) 2022; 12:diagnostics12040837. [PMID: 35453885 PMCID: PMC9028395 DOI: 10.3390/diagnostics12040837] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 03/22/2022] [Accepted: 03/25/2022] [Indexed: 02/04/2023] Open
Abstract
Colorectal cancer (CRC) is the second most common cancer in women and the third most common in men, with an increasing incidence. Pathology diagnosis complemented with prognostic and predictive biomarker information is the first step for personalized treatment. The increased diagnostic load in the pathology laboratory, combined with the reported intra- and inter-variability in the assessment of biomarkers, has prompted the quest for reliable machine-based methods to be incorporated into the routine practice. Recently, Artificial Intelligence (AI) has made significant progress in the medical field, showing potential for clinical applications. Herein, we aim to systematically review the current research on AI in CRC image analysis. In histopathology, algorithms based on Deep Learning (DL) have the potential to assist in diagnosis, predict clinically relevant molecular phenotypes and microsatellite instability, identify histological features related to prognosis and correlated to metastasis, and assess the specific components of the tumor microenvironment.
Collapse
|
23
|
Chen K, Li H, Pan Z, Wu Z, Song E. Insights into artificial intelligence in clinical oncology: opportunities and challenges. SCIENCE CHINA. LIFE SCIENCES 2022; 65:643-647. [PMID: 34846642 DOI: 10.1007/s11427-021-2010-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 09/18/2021] [Indexed: 06/13/2023]
Affiliation(s)
- Kai Chen
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Breast Tumor Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Hanwei Li
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Zhanpeng Pan
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Zhuo Wu
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Department of Radiology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Erwei Song
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China.
- Breast Tumor Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China.
- Fountain-Valley Institute for Life Sciences, Guangzhou Institute of Biomedicine and Health, Chinese Academy of Sciences, Guangzhou, 510530, China.
- Bioland Laboratory, Guangzhou, 510005, China.
| |
Collapse
|
24
|
Barbulescu GI, Buica TP, Goje ID, Bojin FM, Ordodi VL, Olteanu GE, Heredea RE, Paunescu V. Optimization of Complete Rat Heart Decellularization Using Artificial Neural Networks. MICROMACHINES 2022; 13:mi13010079. [PMID: 35056244 PMCID: PMC8778756 DOI: 10.3390/mi13010079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Revised: 12/30/2021] [Accepted: 12/31/2021] [Indexed: 02/01/2023]
Abstract
Whole organ decellularization techniques have facilitated the fabrication of extracellular matrices (ECMs) for engineering new organs. Unfortunately, there is no objective gold standard evaluation of the scaffold without applying a destructive method such as histological analysis or DNA removal quantification of the dry tissue. Our proposal is a software application using deep convolutional neural networks (DCNN) to distinguish between different stages of decellularization, determining the exact moment of completion. Hearts from male Sprague Dawley rats (n = 10) were decellularized using 1% sodium dodecyl sulfate (SDS) in a modified Langendorff device in the presence of an alternating rectangular electric field. Spectrophotometric measurements of deoxyribonucleic acid (DNA) and total proteins concentration from the decellularization solution were taken every 30 min. A monitoring system supervised the sessions, collecting a large number of photos saved in corresponding folders. This system aimed to prove a strong correlation between the data gathered by spectrophotometry and the state of the heart that could be visualized with an OpenCV-based spectrometer. A decellularization completion metric was built using a DCNN based classifier model trained using an image set comprising thousands of photos. Optimizing the decellularization process using a machine learning approach launches exponential progress in tissue bioengineering research.
Collapse
Affiliation(s)
- Greta Ionela Barbulescu
- Immuno-Physiology and Biotechnologies Center (CIFBIOTEH), Department of Functional Sciences, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania; (F.M.B.); (V.P.)
- Department of Clinical Practical Skills, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania;
- Center for Gene and Cellular Therapies in the Treatment of Cancer Timisoara-OncoGen, Clinical Emergency County Hospital “Pius Brinzeu” Timisoara, No. 156 Liviu Rebreanu, 300723 Timisoara, Romania; (T.P.B.); (V.L.O.)
- Correspondence: (G.I.B.); (I.D.G.); Tel.: +40-733177583 (G.-I.B.)
| | - Taddeus Paul Buica
- Center for Gene and Cellular Therapies in the Treatment of Cancer Timisoara-OncoGen, Clinical Emergency County Hospital “Pius Brinzeu” Timisoara, No. 156 Liviu Rebreanu, 300723 Timisoara, Romania; (T.P.B.); (V.L.O.)
| | - Iacob Daniel Goje
- Department of Medical Semiology I, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania
- Advanced Cardiology and Hemostaseology Research Center, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania
- Correspondence: (G.I.B.); (I.D.G.); Tel.: +40-733177583 (G.-I.B.)
| | - Florina Maria Bojin
- Immuno-Physiology and Biotechnologies Center (CIFBIOTEH), Department of Functional Sciences, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania; (F.M.B.); (V.P.)
- Center for Gene and Cellular Therapies in the Treatment of Cancer Timisoara-OncoGen, Clinical Emergency County Hospital “Pius Brinzeu” Timisoara, No. 156 Liviu Rebreanu, 300723 Timisoara, Romania; (T.P.B.); (V.L.O.)
| | - Valentin Laurentiu Ordodi
- Center for Gene and Cellular Therapies in the Treatment of Cancer Timisoara-OncoGen, Clinical Emergency County Hospital “Pius Brinzeu” Timisoara, No. 156 Liviu Rebreanu, 300723 Timisoara, Romania; (T.P.B.); (V.L.O.)
- Department of Applied Chemistry, Organic and Natural Compounds Engineering, Faculty of Industrial Chemistry and Environmental Engineering, “Politehnica” University Timisoara, No. 2 Victoriei Square, 300006 Timisoara, Romania
| | - Gheorghe Emilian Olteanu
- Department of Pathology, “Dr Victor Babes” Clinical Hospital of Infectious Disease and Pneumophysiology, 300041 Timisoara, Romania;
| | - Rodica Elena Heredea
- Department of Clinical Practical Skills, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania;
- Advanced Cardiology and Hemostaseology Research Center, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania
- Department of Pathology, “Louis Turcanu” Children’s Clinical Emergency Hospital, 300041 Timisoara, Romania
| | - Virgil Paunescu
- Immuno-Physiology and Biotechnologies Center (CIFBIOTEH), Department of Functional Sciences, “Victor Babes” University of Medicine and Pharmacy, No. 2 Eftimie Murgu Square, 300041 Timisoara, Romania; (F.M.B.); (V.P.)
- Center for Gene and Cellular Therapies in the Treatment of Cancer Timisoara-OncoGen, Clinical Emergency County Hospital “Pius Brinzeu” Timisoara, No. 156 Liviu Rebreanu, 300723 Timisoara, Romania; (T.P.B.); (V.L.O.)
| |
Collapse
|
25
|
Automated Detection and Characterization of Colon Cancer with Deep Convolutional Neural Networks. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5269913. [PMID: 36704098 PMCID: PMC9873459 DOI: 10.1155/2022/5269913] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 06/22/2022] [Accepted: 07/14/2022] [Indexed: 01/31/2023]
Abstract
Colon cancer is a momentous reason for illness and death in people. The conclusive diagnosis of colon cancer is made through histological examination. Convolutional neural networks are being used to analyze colon cancer via digital image processing with the introduction of whole-slide imaging. Accurate categorization of colon cancers is necessary for capable analysis. Our objective is to promote a system for detecting and classifying colon adenocarcinomas by applying a deep convolutional neural network (DCNN) model with some preprocessing techniques on digital histopathology images. It is a leading cause of cancer-related death, despite the fact that both traditional and modern methods are capable of comparing images that may encompass cancer regions of various sorts after looking at a significant number of colon cancer images. The fundamental problem for colon histopathologists is differentiating benign from malignant illnesses to having some complicated factors. A cancer diagnosis can be automated through artificial intelligence (AI), enabling us to appraise more patients in less time and at a decreased cost. Modern deep learning (MDL) and digital image processing (DIP) approaches are used to accomplish this. The results indicate that the proposed structure can accurately analyze cancer tissues to a maximum of 99.80%. By implementing this approach, medical practitioners will establish an automated and reliable system for detecting various forms of colon cancer. Moreover, CAD systems will be built in the near future to extract numerous aspects from colonoscopic images for use as a preprocessing module for colon cancer diagnosis.
Collapse
|
26
|
Zhuang H, Zhang J, Liao F. A systematic review on application of deep learning in digestive system image processing. THE VISUAL COMPUTER 2021; 39:2207-2222. [PMID: 34744231 PMCID: PMC8557108 DOI: 10.1007/s00371-021-02322-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/30/2021] [Indexed: 05/07/2023]
Abstract
With the advent of the big data era, the application of artificial intelligence represented by deep learning in medicine has become a hot topic. In gastroenterology, deep learning has accomplished remarkable accomplishments in endoscopy, imageology, and pathology. Artificial intelligence has been applied to benign gastrointestinal tract lesions, early cancer, tumors, inflammatory bowel diseases, livers, pancreas, and other diseases. Computer-aided diagnosis significantly improve diagnostic accuracy and reduce physicians' workload and provide a shred of evidence for clinical diagnosis and treatment. In the near future, artificial intelligence will have high application value in the field of medicine. This paper mainly summarizes the latest research on artificial intelligence in diagnosing and treating digestive system diseases and discussing artificial intelligence's future in digestive system diseases. We sincerely hope that our work can become a stepping stone for gastroenterologists and computer experts in artificial intelligence research and facilitate the application and development of computer-aided image processing technology in gastroenterology.
Collapse
Affiliation(s)
- Huangming Zhuang
- Gastroenterology Department, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Jixiang Zhang
- Gastroenterology Department, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Fei Liao
- Gastroenterology Department, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| |
Collapse
|
27
|
Kiehl L, Kuntz S, Höhn J, Jutzi T, Krieghoff-Henning E, Kather JN, Holland-Letz T, Kopp-Schneider A, Chang-Claude J, Brobeil A, von Kalle C, Fröhling S, Alwers E, Brenner H, Hoffmeister M, Brinker TJ. Deep learning can predict lymph node status directly from histology in colorectal cancer. Eur J Cancer 2021; 157:464-473. [PMID: 34649117 DOI: 10.1016/j.ejca.2021.08.039] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 08/23/2021] [Accepted: 08/30/2021] [Indexed: 12/11/2022]
Abstract
BACKGROUND Lymph node status is a prognostic marker and strongly influences therapeutic decisions in colorectal cancer (CRC). OBJECTIVES The objective of the study is to investigate whether image features extracted by a deep learning model from routine histological slides and/or clinical data can be used to predict CRC lymph node metastasis (LNM). METHODS Using histological whole slide images (WSIs) of primary tumours of 2431 patients in the DACHS cohort, we trained a convolutional neural network to predict LNM. In parallel, we used clinical data derived from the same cases in logistic regression analyses. Subsequently, the slide-based artificial intelligence predictor (SBAIP) score was included in the regression. WSIs and data from 582 patients of the TCGA cohort were used as the external test set. RESULTS On the internal test set, the SBAIP achieved an area under receiver operating characteristic (AUROC) of 71.0%, the clinical classifier achieved an AUROC of 67.0% and a combination of the two classifiers yielded an improvement to 74.1%. Whereas the clinical classifier's performance remained stable on the TCGA set, performance of the SBAIP dropped to an AUROC of 61.2%. Performance of the clinical classifier depended strongly on the T stage. CONCLUSION Deep learning-based image analysis may help predict LNM of patients with CRC using routine histological slides. Combination with clinical data such as T stage might be useful. Strategies to increase performance of the SBAIP on external images should be investigated.
Collapse
Affiliation(s)
- Lennard Kiehl
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Sara Kuntz
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Julia Höhn
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Tanja Jutzi
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Eva Krieghoff-Henning
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Jakob N Kather
- Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
| | - Tim Holland-Letz
- Division of Biostatistics, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | | | - Jenny Chang-Claude
- Division of Cancer Epidemiology, German Cancer Research Center (DKFZ), Heidelberg, Germany; Cancer Epidemiology Group, University Cancer Center Hamburg (UCCH), University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany
| | - Alexander Brobeil
- Institute of Pathology, University of Heidelberg, Heidelberg, Germany; Tissue Bank of the National Center for Tumor Diseases (NCT), Heidelberg, Germany
| | - Christof von Kalle
- Berlin Institute of Health (BIH) and Charité University Medicine, Berlin, Germany
| | - Stefan Fröhling
- Department of Translational Medical Oncology, National Center for Tumor Diseases (NCT), Heidelberg, Germany
| | - Elizabeth Alwers
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Hermann Brenner
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany; Division of Preventive Oncology, German Cancer Research Center (DKFZ) and National Center for Tumor Diseases (NCT), Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Michael Hoffmeister
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Titus J Brinker
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Heidelberg, Germany.
| |
Collapse
|
28
|
Cao B, Zhang KC, Wei B, Chen L. Status quo and future prospects of artificial neural network from the perspective of gastroenterologists. World J Gastroenterol 2021; 27:2681-2709. [PMID: 34135549 PMCID: PMC8173384 DOI: 10.3748/wjg.v27.i21.2681] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 03/29/2021] [Accepted: 04/22/2021] [Indexed: 02/06/2023] Open
Abstract
Artificial neural networks (ANNs) are one of the primary types of artificial intelligence and have been rapidly developed and used in many fields. In recent years, there has been a sharp increase in research concerning ANNs in gastrointestinal (GI) diseases. This state-of-the-art technique exhibits excellent performance in diagnosis, prognostic prediction, and treatment. Competitions between ANNs and GI experts suggest that efficiency and accuracy might be compatible in virtue of technique advancements. However, the shortcomings of ANNs are not negligible and may induce alterations in many aspects of medical practice. In this review, we introduce basic knowledge about ANNs and summarize the current achievements of ANNs in GI diseases from the perspective of gastroenterologists. Existing limitations and future directions are also proposed to optimize ANN’s clinical potential. In consideration of barriers to interdisciplinary knowledge, sophisticated concepts are discussed using plain words and metaphors to make this review more easily understood by medical practitioners and the general public.
Collapse
Affiliation(s)
- Bo Cao
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Ke-Cheng Zhang
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Bo Wei
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Lin Chen
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| |
Collapse
|
29
|
Mungenast F, Fernando A, Nica R, Boghiu B, Lungu B, Batra J, Ecker RC. Next-Generation Digital Histopathology of the Tumor Microenvironment. Genes (Basel) 2021; 12:538. [PMID: 33917241 PMCID: PMC8068063 DOI: 10.3390/genes12040538] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Revised: 03/30/2021] [Accepted: 04/01/2021] [Indexed: 12/11/2022] Open
Abstract
Progress in cancer research is substantially dependent on innovative technologies that permit a concerted analysis of the tumor microenvironment and the cellular phenotypes resulting from somatic mutations and post-translational modifications. In view of a large number of genes, multiplied by differential splicing as well as post-translational protein modifications, the ability to identify and quantify the actual phenotypes of individual cell populations in situ, i.e., in their tissue environment, has become a prerequisite for understanding tumorigenesis and cancer progression. The need for quantitative analyses has led to a renaissance of optical instruments and imaging techniques. With the emergence of precision medicine, automated analysis of a constantly increasing number of cellular markers and their measurement in spatial context have become increasingly necessary to understand the molecular mechanisms that lead to different pathways of disease progression in individual patients. In this review, we summarize the joint effort that academia and industry have undertaken to establish methods and protocols for molecular profiling and immunophenotyping of cancer tissues for next-generation digital histopathology-which is characterized by the use of whole-slide imaging (brightfield, widefield fluorescence, confocal, multispectral, and/or multiplexing technologies) combined with state-of-the-art image cytometry and advanced methods for machine and deep learning.
Collapse
Affiliation(s)
- Felicitas Mungenast
- Institute of Pathophysiology and Allergy Research, Center for Pathophysiology, Infectiology and Immunology, Medical University of Vienna, 1090 Vienna, Austria
- TissueGnostics GmbH, 1020 Vienna, Austria;
| | - Achala Fernando
- Translational Research Institute, 37 Kent Street, Woolloongabba, QLD 4102, Australia; (A.F.); (J.B.)
- School of Biomedical Sciences, Faculty of Health, Queensland University of Technology, Brisbane, QLD 4059, Australia
| | | | - Bogdan Boghiu
- TissueGnostics SRL, 700028 Iasi, Romania; (B.B.); (B.L.)
| | - Bianca Lungu
- TissueGnostics SRL, 700028 Iasi, Romania; (B.B.); (B.L.)
| | - Jyotsna Batra
- Translational Research Institute, 37 Kent Street, Woolloongabba, QLD 4102, Australia; (A.F.); (J.B.)
- School of Biomedical Sciences, Faculty of Health, Queensland University of Technology, Brisbane, QLD 4059, Australia
| | - Rupert C. Ecker
- TissueGnostics GmbH, 1020 Vienna, Austria;
- Translational Research Institute, 37 Kent Street, Woolloongabba, QLD 4102, Australia; (A.F.); (J.B.)
- School of Biomedical Sciences, Faculty of Health, Queensland University of Technology, Brisbane, QLD 4059, Australia
| |
Collapse
|