1
|
Ahmad F, Muhmood T. Clinical translation of nanomedicine with integrated digital medicine and machine learning interventions. Colloids Surf B Biointerfaces 2024; 241:114041. [PMID: 38897022 DOI: 10.1016/j.colsurfb.2024.114041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Revised: 06/11/2024] [Accepted: 06/13/2024] [Indexed: 06/21/2024]
Abstract
Nanomaterials based therapeutics transform the ways of disease prevention, diagnosis and treatment with increasing sophistications in nanotechnology at a breakneck pace, but very few could reach to the clinic due to inconsistencies in preclinical studies followed by regulatory hinderances. To tackle this, integrating the nanomedicine discovery with digital medicine provide technologies as tools of specific biological activity measurement. Hence, overcome the redundancies in nanomedicine discovery by the on-site data acquisition and analytics through integrating intelligent sensors and artificial intelligence (AI) or machine learning (ML). Integrated AI/ML wearable sensors directly gather clinically relevant biochemical information from the subject's body and process data for physicians to make right clinical decision(s) in a time and cost-effective way. This review summarizes insights and recommend the infusion of actionable big data computation enabled sensors in burgeoning field of nanomedicine at academia, research institutes, and pharmaceutical industries, with a potential of clinical translation. Furthermore, many blind spots are present in modern clinically relevant computation, one of which could prevent ML-guided low-cost new nanomedicine development from being successfully translated into the clinic was also discussed.
Collapse
Affiliation(s)
- Farooq Ahmad
- State Key Laboratory of Chemistry and Utilization of Carbon Based Energy Resources, College of Chemistry, Xinjiang University, Urumqi 830017, China.
| | - Tahir Muhmood
- International Iberian Nanotechnology Laboratory (INL), Avenida Mestre José Veiga, Braga 4715-330, Portugal.
| |
Collapse
|
2
|
Lu W, Wang Q, Liu L, Luo W. Exploring the mystery of colon cancer from the perspective of molecular subtypes and treatment. Sci Rep 2024; 14:10883. [PMID: 38740818 DOI: 10.1038/s41598-024-60495-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Accepted: 04/23/2024] [Indexed: 05/16/2024] Open
Abstract
The molecular categorization of colon cancer patients remains elusive. Gene set enrichment analysis (GSEA), which investigates the dysregulated genes among tumor and normal samples, has revealed the pivotal role of epithelial-to-mesenchymal transition (EMT) in colon cancer pathogenesis. In this study, we employed multi-clustering method for grouping data, resulting in the identification of two clusters characterized by varying prognostic outcomes. These two subgroups not only displayed disparities in overall survival (OS) but also manifested variations in clinical variables, genetic mutation, and gene expression profiles. Using the nearest template prediction (NTP) method, we were able to replicate the molecular classification effectively within the original dataset and validated it across multiple independent datasets, underscoring its robust repeatability. Furthermore, we constructed two prognostic signatures tailored to each of these subgroups. Our molecular classification, centered on EMT, hold promise in offering fresh insights into the therapy strategies and prognosis assessment for colon cancer.
Collapse
Affiliation(s)
- Wenhong Lu
- The Second Affiliated Hospital of Hunan University of Chinese Medicine, Changsha, 410005, Hunan, People's Republic of China
| | - Qiwei Wang
- Hunan Provincial Rehabilitation Hospital, Changsha, 410007, Hunan, People's Republic of China
| | - Lifang Liu
- The First Affiliated Hospital of Hunan University of Chinese Medicine, Changsha, 410007, Hunan, People's Republic of China
| | - Wenpeng Luo
- The Second Affiliated Hospital of Hunan University of Chinese Medicine, Changsha, 410005, Hunan, People's Republic of China.
| |
Collapse
|
3
|
Lee JH, Song G, Lee J, Kang S, Moon KM, Choi Y, Shen J, Noh M, Yang D. Prediction of immunochemotherapy response for diffuse large B-cell lymphoma using artificial intelligence digital pathology. J Pathol Clin Res 2024; 10:e12370. [PMID: 38584594 PMCID: PMC10999948 DOI: 10.1002/2056-4538.12370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 02/13/2024] [Accepted: 03/04/2024] [Indexed: 04/09/2024]
Abstract
Diffuse large B-cell lymphoma (DLBCL) is a heterogeneous and prevalent subtype of aggressive non-Hodgkin lymphoma that poses diagnostic and prognostic challenges, particularly in predicting drug responsiveness. In this study, we used digital pathology and deep learning to predict responses to immunochemotherapy in patients with DLBCL. We retrospectively collected 251 slide images from 216 DLBCL patients treated with rituximab, cyclophosphamide, doxorubicin, vincristine, and prednisone (R-CHOP), with their immunochemotherapy response labels. The digital pathology images were processed using contrastive learning for feature extraction. A multi-modal prediction model was developed by integrating clinical data and pathology image features. Knowledge distillation was employed to mitigate overfitting on gigapixel histopathology images to create a model that predicts responses based solely on pathology images. Based on the importance derived from the attention mechanism of the model, we extracted histological features that were considered key textures associated with drug responsiveness. The multi-modal prediction model achieved an impressive area under the ROC curve of 0.856, demonstrating significant associations with clinical variables such as Ann Arbor stage, International Prognostic Index, and bulky disease. Survival analyses indicated their effectiveness in predicting relapse-free survival. External validation using TCGA datasets supported the model's ability to predict survival differences. Additionally, pathology-based predictions show promise as independent prognostic indicators. Histopathological analysis identified centroblastic and immunoblastic features to be associated with treatment response, aligning with previous morphological classifications and highlighting the objectivity and reproducibility of artificial intelligence-based diagnosis. This study introduces a novel approach that combines digital pathology and clinical data to predict the response to immunochemotherapy in patients with DLBCL. This model shows great promise as a diagnostic and prognostic tool for clinical management of DLBCL. Further research and genomic data integration hold the potential to enhance its impact on clinical practice, ultimately improving patient outcomes.
Collapse
Affiliation(s)
- Jeong Hoon Lee
- Department of RadiologyStanford University School of MedicineStanfordCAUSA
| | - Ga‐Young Song
- Department of Hematology‐OncologyChonnam National University Hwasun HospitalHwasunRepublic of Korea
| | - Jonghyun Lee
- Department of Medical and Digital EngineeringHanyang University College of EngineeringSeoulRepublic of Korea
| | - Sae‐Ryung Kang
- Department of Nuclear MedicineChonnam National University Hwasun Hospital and Medical SchoolHwasun‐gunRepublic of Korea
| | - Kyoung Min Moon
- Division of Pulmonary and Allergy Medicine, Department of Internal MedicineChung‐Ang University Hospital, Chung‐Ang University College of MedicineSeoulRepublic of Korea
- Artificial Intelligence, Ziovision Co., Ltd.ChuncheonRepublic of Korea
| | - Yoo‐Duk Choi
- Department of PathologyChonnam National University Medical SchoolGwangjuRepublic of Korea
| | - Jeanne Shen
- Department of Pathology and Center for Artificial Intelligence in Medicine & ImagingStanford University School of MedicineStanfordCAUSA
| | - Myung‐Giun Noh
- Department of PathologyChonnam National University Medical SchoolGwangjuRepublic of Korea
- Department of PathologySchool of Medicine, Ajou UniversitySuwonRepublic of Korea
| | - Deok‐Hwan Yang
- Department of Hematology‐OncologyChonnam National University Hwasun HospitalHwasunRepublic of Korea
| |
Collapse
|
4
|
Li B, Qin W, Yang L, Li H, Jiang C, Yao Y, Cheng S, Zou B, Fan B, Dong T, Wang L. From pixels to patient care: deep learning-enabled pathomics signature offers precise outcome predictions for immunotherapy in esophageal squamous cell cancer. J Transl Med 2024; 22:195. [PMID: 38388379 PMCID: PMC10885627 DOI: 10.1186/s12967-024-04997-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Accepted: 02/12/2024] [Indexed: 02/24/2024] Open
Abstract
BACKGROUND Immunotherapy has significantly improved survival of esophageal squamous cell cancer (ESCC) patients, however the clinical benefit was limited to only a small portion of patients. This study aimed to perform a deep learning signature based on H&E-stained pathological specimens to accurately predict the clinical benefit of PD-1 inhibitors in ESCC patients. METHODS ESCC patients receiving PD-1 inhibitors from Shandong Cancer Hospital were included. WSI images of H&E-stained histological specimens of included patients were collected, and randomly divided into training (70%) and validation (30%) sets. The labels of images were defined by the progression-free survival (PFS) with the interval of 4 months. The pretrained ViT model was used for patch-level model training, and all patches were projected into probabilities after linear classifier. Then the most predictive patches were passed to RNN for final patient-level prediction to construct ESCC-pathomics signature (ESCC-PS). Accuracy rate and survival analysis were performed to evaluate the performance of ViT-RNN survival model in validation cohort. RESULTS 163 ESCC patients receiving PD-1 inhibitors were included for model training. There were 486,188 patches of 1024*1024 pixels from 324 WSI images of H&E-stained histological specimens after image pre-processing. There were 120 patients with 227 images in training cohort and 43 patients with 97 images in validation cohort, with balanced baseline characteristics between two groups. The ESCC-PS achieved an accuracy of 84.5% in the validation cohort, and could distinguish patients into three risk groups with the median PFS of 2.6, 4.5 and 12.9 months (P < 0.001). The multivariate cox analysis revealed ESCC-PS could act as an independent predictor of survival from PD-1 inhibitors (P < 0.001). A combined signature incorporating ESCC-PS and expression of PD-L1 shows significantly improved accuracy in outcome prediction of PD-1 inhibitors compared to ESCC-PS and PD-L1 anlone, with the area under curve value of 0.904, 0.924, 0.610 for 6-month PFS and C-index of 0.814, 0.806, 0.601, respectively. CONCLUSIONS The outcome supervised pathomics signature based on deep learning has the potential to enable superior prognostic stratification of ESCC patients receiving PD-1 inhibitors, which convert the images pixels to an effective and labour-saving tool to optimize clinical management of ESCC patients.
Collapse
Affiliation(s)
- Butuo Li
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Wenru Qin
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Linlin Yang
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Haoqian Li
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Chao Jiang
- Department of Otorhinolaryngology Head and Neck Surgery, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Shandong Provincial Hospital, Cheeloo College of Medicine, Shandong University, Jinan, 250021, Shandong, China
| | - Yueyuan Yao
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Shuping Cheng
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Bing Zou
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Bingjie Fan
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China
| | - Taotao Dong
- Department of Obstetrics and Gynecology, Qilu Hospital of Shandong University, 107 West Wenhua Road, Jinan, 250063, Shandong, China.
| | - Linlin Wang
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, 440 Jiyan Road, Jinan, 250117, Shandong, China.
| |
Collapse
|
5
|
Laohawetwanit T, Namboonlue C, Apornvirat S. Accuracy of GPT-4 in histopathological image detection and classification of colorectal adenomas. J Clin Pathol 2024:jcp-2023-209304. [PMID: 38199797 DOI: 10.1136/jcp-2023-209304] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 01/03/2024] [Indexed: 01/12/2024]
Abstract
AIMS To evaluate the accuracy of Chat Generative Pre-trained Transformer (ChatGPT) powered by GPT-4 in histopathological image detection and classification of colorectal adenomas using the diagnostic consensus provided by pathologists as a reference standard. METHODS A study was conducted with 100 colorectal polyp photomicrographs, comprising an equal number of adenomas and non-adenomas, classified by two pathologists. These images were analysed by classic GPT-4 for 1 time in October 2023 and custom GPT-4 for 20 times in December 2023. GPT-4's responses were compared against the reference standard through statistical measures to evaluate its proficiency in histopathological diagnosis, with the pathologists further assessing the model's descriptive accuracy. RESULTS GPT-4 demonstrated a median sensitivity of 74% and specificity of 36% for adenoma detection. The median accuracy of polyp classification varied, ranging from 16% for non-specific changes to 36% for tubular adenomas. Its diagnostic consistency, indicated by low kappa values ranging from 0.06 to 0.11, suggested only poor to slight agreement. All of the microscopic descriptions corresponded with their diagnoses. GPT-4 also commented about the limitations in its diagnoses (eg, slide diagnosis best done by pathologists, the inadequacy of single-image diagnostic conclusions, the need for clinical data and a higher magnification view). CONCLUSIONS GPT-4 showed high sensitivity but low specificity in detecting adenomas and varied accuracy for polyp classification. However, its diagnostic consistency was low. This artificial intelligence tool acknowledged its diagnostic limitations, emphasising the need for a pathologist's expertise and additional clinical context.
Collapse
Affiliation(s)
- Thiyaphat Laohawetwanit
- Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand
- Division of Pathology, Thammasat University Hospital, Pathum Thani, Thailand
| | | | - Sompon Apornvirat
- Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand
- Division of Pathology, Thammasat University Hospital, Pathum Thani, Thailand
| |
Collapse
|
6
|
Adiwinata R, Tandarto K, Arifputra J, Waleleng BJ, Gosal F, Rotty L, Winarta J, Waleleng A, Simadibrata P, Simadibrata M. The Impact of Artificial Intelligence in Improving Polyp and Adenoma Detection Rate During Colonoscopy: Systematic-Review and Meta-Analysis. Asian Pac J Cancer Prev 2023; 24:3655-3663. [PMID: 38019222 PMCID: PMC10772777 DOI: 10.31557/apjcp.2023.24.11.3655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Accepted: 11/10/2023] [Indexed: 11/30/2023] Open
Abstract
INTRODUCTION Colonoscopy may detect colorectal polyp and facilitate its removal in order to prevent colorectal cancer. However, substantial miss rate for colorectal adenomas detection still occurred during screening colonoscopy procedure. Nowadays, artificial intelligence (AI) have been employed in trials to improve polyp detection rate (PDR) and adenoma detection rate (ADR). Therefore, we would like to determine the impact of AI in increasing PDR and ADR. METHODS The present study adhered to the guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-analyses 2020 (PRISMA 2020) statement. To identify relevant literature, comprehensive searches were conducted on major scientific databases, including Pubmed, EBSCO-host, and Proquest. The search was limited to articles published up to November 30, 2022. Inclusion criteria for the study encompassed full-text accessibility, articles written in the English language, and randomized controlled trials (RCTs) that reported both ADR and PDR values, comparing conventional diagnostic methods with AI-aided approaches. To synthesize the data, we computed the combined pooled odds ratio (OR) using a random-effects model. This model was chosen due to the expectation of considerable heterogeneity among the selected studies. To evaluate potential publication bias, the Begg's funnel diagram was employed. RESULTS A total of 13 studies were included in this study. Colonoscopy with AI had significantly higher PDR compared to without AI (pooled OR 1.46, 95% CI 1.13-1.89, p = 0.003) and higher ADR (pooled OR 1.58, 95% CI 1.37-1.82, p < 0.00001). PDR analysis showed moderate heterogeneity between included studies (p = 0.004; I2=63%). Furthermore, ADR analysis showed moderate heterogeneity (p < 0.007; I2 = 57%). Additionally, the funnels plot of ADR and PDR analysis showed an asymmetry plot and low publication bias. CONCLUSION AI may improve colonoscopy result quality through improving PDR and ADR.
Collapse
Affiliation(s)
- Randy Adiwinata
- Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Kevin Tandarto
- S.K Lerik Regional Public Hospital, Kupang, East Nusa Tenggara, Indonesia.
| | - Jonathan Arifputra
- Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Bradley Jimmy Waleleng
- Division of Gastroenterology-Hepatology, Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Fandy Gosal
- Division of Gastroenterology-Hepatology, Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Luciana Rotty
- Division of Gastroenterology-Hepatology, Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Jeanne Winarta
- Division of Gastroenterology-Hepatology, Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Andrew Waleleng
- Division of Gastroenterology-Hepatology, Department of Internal Medicine, Faculty of Medicine, Universitas Sam Ratulangi/Prof. dr. R. D. Kandou Hospital, Manado, Indonesia.
| | - Paulus Simadibrata
- Department of Internal Medicine, Abdi Waluyo Hospital, Jakarta, Indonesia.
| | - Marcellus Simadibrata
- Division of Gastroenterology, Pancreatobiliary and Digestive Endoscopy, Department of Internal Medicine, Faculty of Medicine, Universitas Indonesia, Cipto Mangunkusumo General Hospital, Jakarta, Indonesia.
| |
Collapse
|
7
|
Bostanci E, Kocak E, Unal M, Guzel MS, Acici K, Asuroglu T. Machine Learning Analysis of RNA-seq Data for Diagnostic and Prognostic Prediction of Colon Cancer. SENSORS (BASEL, SWITZERLAND) 2023; 23:3080. [PMID: 36991790 PMCID: PMC10052105 DOI: 10.3390/s23063080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 03/09/2023] [Accepted: 03/11/2023] [Indexed: 06/19/2023]
Abstract
Data from omics studies have been used for prediction and classification of various diseases in biomedical and bioinformatics research. In recent years, Machine Learning (ML) algorithms have been used in many different fields related to healthcare systems, especially for disease prediction and classification tasks. Integration of molecular omics data with ML algorithms has offered a great opportunity to evaluate clinical data. RNA sequence (RNA-seq) analysis has been emerged as the gold standard for transcriptomics analysis. Currently, it is being used widely in clinical research. In our present work, RNA-seq data of extracellular vesicles (EV) from healthy and colon cancer patients are analyzed. Our aim is to develop models for prediction and classification of colon cancer stages. Five different canonical ML and Deep Learning (DL) classifiers are used to predict colon cancer of an individual with processed RNA-seq data. The classes of data are formed on the basis of both colon cancer stages and cancer presence (healthy or cancer). The canonical ML classifiers, which are k-Nearest Neighbor (kNN), Logistic Model Tree (LMT), Random Tree (RT), Random Committee (RC), and Random Forest (RF), are tested with both forms of the data. In addition, to compare the performance with canonical ML models, One-Dimensional Convolutional Neural Network (1-D CNN), Long Short-Term Memory (LSTM), and Bidirectional LSTM (BiLSTM) DL models are utilized. Hyper-parameter optimizations of DL models are constructed by using genetic meta-heuristic optimization algorithm (GA). The best accuracy in cancer prediction is obtained with RC, LMT, and RF canonical ML algorithms as 97.33%. However, RT and kNN show 95.33% performance. The best accuracy in cancer stage classification is achieved with RF as 97.33%. This result is followed by LMT, RC, kNN, and RT with 96.33%, 96%, 94.66%, and 94%, respectively. According to the results of the experiments with DL algorithms, the best accuracy in cancer prediction is obtained with 1-D CNN as 97.67%. BiLSTM and LSTM show 94.33% and 93.67% performance, respectively. In classification of the cancer stages, the best accuracy is achieved with BiLSTM as 98%. 1-D CNN and LSTM show 97% and 94.33% performance, respectively. The results reveal that both canonical ML and DL models may outperform each other for different numbers of features.
Collapse
Affiliation(s)
- Erkan Bostanci
- Department of Computer Engineering, Faculty of Engineering, Ankara University, 06830 Ankara, Turkey
| | - Engin Kocak
- Department of Analytical Chemistry, Faculty of Gülhane Pharmacy, University of Health Sciences, 06018 Ankara, Turkey
| | - Metehan Unal
- Department of Computer Engineering, Faculty of Engineering, Ankara University, 06830 Ankara, Turkey
| | - Mehmet Serdar Guzel
- Department of Computer Engineering, Faculty of Engineering, Ankara University, 06830 Ankara, Turkey
| | - Koray Acici
- Department of Artificial Intelligence and Data Engineering, Faculty of Engineering, Ankara University, 06830 Ankara, Turkey
| | - Tunc Asuroglu
- Faculty of Medicine and Health Technology, Tampere University, 33720 Tampere, Finland
| |
Collapse
|
8
|
Leveraging Marine Predators Algorithm with Deep Learning for Lung and Colon Cancer Diagnosis. Cancers (Basel) 2023; 15:cancers15051591. [PMID: 36900381 PMCID: PMC10001330 DOI: 10.3390/cancers15051591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 02/04/2023] [Accepted: 02/08/2023] [Indexed: 03/08/2023] Open
Abstract
Cancer is a deadly disease caused by various biochemical abnormalities and genetic diseases. Colon and lung cancer have developed as two major causes of disability and death in human beings. The histopathological detection of these malignancies is a vital element in determining the optimal solution. Timely and initial diagnosis of the sickness on either front diminishes the possibility of death. Deep learning (DL) and machine learning (ML) methods are used to hasten such cancer recognition, allowing the research community to examine more patients in a much shorter period and at a less cost. This study introduces a marine predator's algorithm with deep learning as a lung and colon cancer classification (MPADL-LC3) technique. The presented MPADL-LC3 technique aims to properly discriminate different types of lung and colon cancer on histopathological images. To accomplish this, the MPADL-LC3 technique employs CLAHE-based contrast enhancement as a pre-processing step. In addition, the MPADL-LC3 technique applies MobileNet to derive feature vector generation. Meanwhile, the MPADL-LC3 technique employs MPA as a hyperparameter optimizer. Furthermore, deep belief networks (DBN) can be applied for lung and color classification. The simulation values of the MPADL-LC3 technique were examined on benchmark datasets. The comparison study highlighted the enhanced outcomes of the MPADL-LC3 system in terms of different measures.
Collapse
|
9
|
Reis HC, Turk V. Transfer Learning Approach and Nucleus Segmentation with MedCLNet Colon Cancer Database. J Digit Imaging 2023; 36:306-325. [PMID: 36127531 PMCID: PMC9984669 DOI: 10.1007/s10278-022-00701-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Revised: 09/07/2022] [Accepted: 09/08/2022] [Indexed: 11/30/2022] Open
Abstract
Machine learning has been recently used especially in the medical field. In the diagnosis of serious diseases such as cancer, deep learning techniques can be used to reduce the workload of experts and to produce quick solutions. The nuclei found in the histopathology dataset are an essential parameter in disease detection. The nucleus segmentation was performed using the colorectal histology MNIST dataset for nucleus detection in this study. The graph theory, PSO, watershed, and random walker algorithms were used for the segmentation process. In addition, we present the 10-class MedCLNet visual dataset consisting of the NCT-CRC-HE-100 K dataset, LC25000 dataset, and GlaS dataset that can be used in transfer learning studies from deep learning techniques. The study proposes a transfer learning technique using the MedCLNet database. Deep neural networks pre-trained with the proposed transfer learning method were used in the classification with the colorectal histology MNIST dataset in the experimental process. DenseNet201, DenseNet169, InceptionResNetV2, InceptionV3, ResNet152V2, ResNet101V2, and Xception deep learning algorithms were used in transfer learning and the classification studies. The proposed approach was analyzed before and after transfer learning with different methods (DenseNet169 + SVM, DenseNet169 + GRU). In the performance measurement, using the colorectal histology MNIST dataset, 94.29% accuracy was obtained in the DenseNet169 model, which was initiated with random weights in the multi-classification study, and 95.00% accuracy after transfer learning was applied. In comparison with the results obtained from empirical studies, it was demonstrated that the proposed method produced satisfactory outcomes. The application is expected to provide a secondary evaluation for physicians in colon cancer detection and the segmentation.
Collapse
Affiliation(s)
- Hatice Catal Reis
- Department of Geomatics Engineering, Gumushane University, Gumushane, 2900, Turkey.
| | - Veysel Turk
- Department of Computer Engineering, University of Harran, Sanliurfa, Turkey
| |
Collapse
|
10
|
Yavuz A, Alpsoy A, Gedik EO, Celik MY, Bassorgun CI, Unal B, Elpek GO. Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology. Artif Intell Gastroenterol 2022; 3:142-162. [DOI: 10.35712/aig.v3.i5.142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 11/25/2022] [Accepted: 12/14/2022] [Indexed: 12/28/2022] Open
Abstract
Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.
Collapse
Affiliation(s)
- Aysen Yavuz
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | - Anil Alpsoy
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | - Elif Ocak Gedik
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | | | | | - Betul Unal
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| | - Gulsum Ozlem Elpek
- Department of Pathology, Akdeniz University Medical School, Antalya 07070, Turkey
| |
Collapse
|
11
|
Zhou B, Yu J, Cai X, Wu S. Constructing a molecular subtype model of colon cancer using machine learning. Front Pharmacol 2022; 13:1008207. [PMID: 36188575 PMCID: PMC9523145 DOI: 10.3389/fphar.2022.1008207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Accepted: 08/26/2022] [Indexed: 11/21/2022] Open
Abstract
Background: Colon cancer (CRC) is one of the malignant tumors with a high incidence in the world. Many previous studies on CRC have focused on clinical research. With the in-depth study of CRC, the role of molecular mechanisms in CRC has become increasingly important. Currently, machine learning is widely used in medicine. By combining machine learning with molecular mechanisms, we can better understand CRC’s pathogenesis and develop new treatments for it. Methods and materials: We used the R language to construct molecular subtypes of colon cancer and subsequently explored prognostic genes with GEPIA2. Enrichment analysis is used by WebGestalt to obtain differential genes. Protein–protein interaction networks of differential genes were constructed using the STRING database and the Cytoscape tool. TIMER2.0 and TISIDB databases were used to investigate the correlation of these genes with immune-infiltrating cells and immune targets. The cBioportal database was used to explore genomic alterations. Results: In our study, the molecular prognostic model of CRC was constructed to study the prognostic factors of CRC, and finally, it was found that Charcot–Leyden crystal galectin (CLC), zymogen granule protein 16 (ZG16), leucine-rich repeat-containing protein 26 (LRRC26), intelectin 1 (ITLN1), UDP-GlcNAc: betaGal beta-1,3-N-acetylglucosaminyltransferase 6 (B3GNT6), chloride channel accessory 1 (CLCA1), growth factor independent 1 transcriptional repressor (GFI1), aquaporin 8 (AQP8), HEPACAM family member 2 (HEPACAM2), and UDP glucuronosyltransferase family 2 member B15 (UGT2B15) were correlated with the subtype model of CRC prognosis. Enrichment analysis shows that differential genes were mainly associated with immune-inflammatory pathways. GFI1 and CLC were associated with immune cells, immunoinhibitors, and immunostimulator. Genomic analysis shows that there were no significant changes in differential genes. Conclusion: By constructing molecular subtypes of colon cancer, we discovered new colon cancer prognostic markers, which can provide direction for new treatments in the future.
Collapse
Affiliation(s)
- Bo Zhou
- Department of General Surgery, Ningbo Medical Center Lihuili Hospital, Ningbo University, Ningbo, China
| | - Jiazi Yu
- Department of General Surgery, Ningbo Medical Center Lihuili Hospital, Ningbo University, Ningbo, China
| | - Xingchen Cai
- Medical School, Ningbo University, Ningbo, China
| | - Shugeng Wu
- Medical School, Ningbo University, Ningbo, China
- *Correspondence: Shugeng Wu,
| |
Collapse
|
12
|
Wong ANN, He Z, Leung KL, To CCK, Wong CY, Wong SCC, Yoo JS, Chan CKR, Chan AZ, Lacambra MD, Yeung MHY. Current Developments of Artificial Intelligence in Digital Pathology and Its Future Clinical Applications in Gastrointestinal Cancers. Cancers (Basel) 2022; 14:3780. [PMID: 35954443 PMCID: PMC9367360 DOI: 10.3390/cancers14153780] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 07/27/2022] [Accepted: 08/01/2022] [Indexed: 02/05/2023] Open
Abstract
The implementation of DP will revolutionize current practice by providing pathologists with additional tools and algorithms to improve workflow. Furthermore, DP will open up opportunities for development of AI-based tools for more precise and reproducible diagnosis through computational pathology. One of the key features of AI is its capability to generate perceptions and recognize patterns beyond the human senses. Thus, the incorporation of AI into DP can reveal additional morphological features and information. At the current rate of AI development and adoption of DP, the interest in computational pathology is expected to rise in tandem. There have already been promising developments related to AI-based solutions in prostate cancer detection; however, in the GI tract, development of more sophisticated algorithms is required to facilitate histological assessment of GI specimens for early and accurate diagnosis. In this review, we aim to provide an overview of the current histological practices in AP laboratories with respect to challenges faced in image preprocessing, present the existing AI-based algorithms, discuss their limitations and present clinical insight with respect to the application of AI in early detection and diagnosis of GI cancer.
Collapse
Affiliation(s)
- Alex Ngai Nick Wong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| | - Zebang He
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| | - Ka Long Leung
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| | - Curtis Chun Kit To
- Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Prince of Wales Hospital, Shatin, Hong Kong SAR, China; (C.C.K.T.); (C.K.R.C.); (M.D.L.)
| | - Chun Yin Wong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| | - Sze Chuen Cesar Wong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| | - Jung Sun Yoo
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| | - Cheong Kin Ronald Chan
- Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Prince of Wales Hospital, Shatin, Hong Kong SAR, China; (C.C.K.T.); (C.K.R.C.); (M.D.L.)
| | - Angela Zaneta Chan
- Department of Anatomical and Cellular Pathology, Prince of Wales Hospital, Shatin, Hong Kong SAR, China;
| | - Maribel D. Lacambra
- Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Prince of Wales Hospital, Shatin, Hong Kong SAR, China; (C.C.K.T.); (C.K.R.C.); (M.D.L.)
| | - Martin Ho Yin Yeung
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China; (A.N.N.W.); (Z.H.); (K.L.L.); (C.Y.W.); (S.C.C.W.); (J.S.Y.)
| |
Collapse
|
13
|
Qiu H, Ding S, Liu J, Wang L, Wang X. Applications of Artificial Intelligence in Screening, Diagnosis, Treatment, and Prognosis of Colorectal Cancer. Curr Oncol 2022; 29:1773-1795. [PMID: 35323346 PMCID: PMC8947571 DOI: 10.3390/curroncol29030146] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 02/28/2022] [Accepted: 03/03/2022] [Indexed: 12/29/2022] Open
Abstract
Colorectal cancer (CRC) is one of the most common cancers worldwide. Accurate early detection and diagnosis, comprehensive assessment of treatment response, and precise prediction of prognosis are essential to improve the patients’ survival rate. In recent years, due to the explosion of clinical and omics data, and groundbreaking research in machine learning, artificial intelligence (AI) has shown a great application potential in clinical field of CRC, providing new auxiliary approaches for clinicians to identify high-risk patients, select precise and personalized treatment plans, as well as to predict prognoses. This review comprehensively analyzes and summarizes the research progress and clinical application value of AI technologies in CRC screening, diagnosis, treatment, and prognosis, demonstrating the current status of the AI in the main clinical stages. The limitations, challenges, and future perspectives in the clinical implementation of AI are also discussed.
Collapse
Affiliation(s)
- Hang Qiu
- Big Data Research Center, University of Electronic Science and Technology of China, Chengdu 611731, China;
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
- Correspondence: (H.Q.); (X.W.)
| | - Shuhan Ding
- School of Electrical and Computer Engineering, Cornell University, Ithaca, NY 14853, USA;
| | - Jianbo Liu
- West China School of Medicine, Sichuan University, Chengdu 610041, China;
- Department of Gastrointestinal Surgery, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Liya Wang
- Big Data Research Center, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Xiaodong Wang
- West China School of Medicine, Sichuan University, Chengdu 610041, China;
- Department of Gastrointestinal Surgery, West China Hospital, Sichuan University, Chengdu 610041, China
- Correspondence: (H.Q.); (X.W.)
| |
Collapse
|
14
|
Takamatsu M, Yamamoto N, Kawachi H, Nakano K, Saito S, Fukunaga Y, Takeuchi K. Prediction of lymph node metastasis in early colorectal cancer based on histologic images by artificial intelligence. Sci Rep 2022; 12:2963. [PMID: 35194184 PMCID: PMC8863850 DOI: 10.1038/s41598-022-07038-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Accepted: 02/08/2022] [Indexed: 12/13/2022] Open
Abstract
Risk evaluation of lymph node metastasis (LNM) for endoscopically resected submucosal invasive (T1) colorectal cancers (CRC) is critical for determining therapeutic strategies, but interobserver variability for histologic evaluation remains a major problem. To address this issue, we developed a machine-learning model for predicting LNM of T1 CRC without histologic assessment. A total of 783 consecutive T1 CRC cases were randomly split into 548 training and 235 validation cases. First, we trained convolutional neural networks (CNN) to extract cancer tile images from whole-slide images, then re-labeled these cancer tiles with LNM status for re-training. Statistical parameters of the tile images based on the probability of primary endpoints were assembled to predict LNM in cases with a random forest algorithm, and defined its predictive value as random forest score. We evaluated the performance of case-based prediction models for both training and validation datasets with area under the receiver operating characteristic curves (AUC). The accuracy for classifying cancer tiles was 0.980. Among cancer tiles, the accuracy for classifying tiles that were LNM-positive or LNM-negative was 0.740. The AUCs of the prediction models in the training and validation sets were 0.971 and 0.760, respectively. CNN judged the LNM probability by considering histologic tumor grade.
Collapse
Affiliation(s)
- Manabu Takamatsu
- Division of Pathology, Cancer Institute, Japanese Foundation for Cancer Research, 3-8-31, Ariake, Ko-to-ku, Tokyo, 135-8550, Japan. .,Department of Pathology, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan.
| | - Noriko Yamamoto
- Division of Pathology, Cancer Institute, Japanese Foundation for Cancer Research, 3-8-31, Ariake, Ko-to-ku, Tokyo, 135-8550, Japan.,Department of Pathology, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan
| | - Hiroshi Kawachi
- Division of Pathology, Cancer Institute, Japanese Foundation for Cancer Research, 3-8-31, Ariake, Ko-to-ku, Tokyo, 135-8550, Japan.,Department of Pathology, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan
| | - Kaoru Nakano
- Division of Pathology, Cancer Institute, Japanese Foundation for Cancer Research, 3-8-31, Ariake, Ko-to-ku, Tokyo, 135-8550, Japan.,Department of Pathology, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan
| | - Shoichi Saito
- Department of Endoscopy, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan
| | - Yosuke Fukunaga
- Department of Colorectal Surgery, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan
| | - Kengo Takeuchi
- Division of Pathology, Cancer Institute, Japanese Foundation for Cancer Research, 3-8-31, Ariake, Ko-to-ku, Tokyo, 135-8550, Japan.,Department of Pathology, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan.,Pathology Project for Molecular Targets, Cancer Institute, Japanese Foundation for Cancer Research, Tokyo, Japan
| |
Collapse
|
15
|
Liu X, Lei S, Wei Q, Wang Y, Liang H, Chen L. Machine Learning-based Correlation Study between Perioperative Immunonutritional Index and Postoperative Anastomotic Leakage in Patients with Gastric Cancer. Int J Med Sci 2022; 19:1173-1183. [PMID: 35919820 PMCID: PMC9339417 DOI: 10.7150/ijms.72195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Accepted: 06/18/2022] [Indexed: 11/23/2022] Open
Abstract
Backgrounds: The immunonutritional index showed great potential for predicting postoperative complications in various malignant diseases, while risk assessment based on machine learning (ML) methods is becoming popular in clinical practice. Early detection and prevention for postoperative anastomotic leakage (AL) play an important role in prognosis improvement among patients with gastric cancer (GC). Methods: This retrospective study included 297 patients with gastric cancer receiving gastrectomy between 2018 and 2021 in general surgery department of Xinhua Hospital. Perioperative clinical variables were collected to evaluate the predictive value for postoperative AL with 5 ML models. Then, AUROC was applied to identify the optimal perioperative clinical index and ML model for predicting postoperative AL. Results: The incidence of postoperative AL was 6.1% (n=18). After the training of 5 ML classification models, we found that immunonutritional index had significantly better classification ability than inflammatory or nutritional index alone separately (AUROC=0.87 vs. 0.83, P=0.01; AUROC=0.87 vs. 0.68, P<0.01). Next, we found that support vector machine (SVM), one of the ML methods, with selected immunonutritional index showed significantly greater classification ability than optimal univariant parameter [CRP on postoperative day 4 (AUROC=0.89 vs.0.86, P=0.02)]. Also, statistical analysis revealed multiple variables with significant relevance to postoperative AL, including serum CRP and albumin on postoperative day 4, NLR and SII etc. Conclusion: This study showed that perioperative immunonutritional index could act as an indicator for postoperative AL. Also, ML methods could significantly enhance the classification ability, and therefore, could be applied as a powerful tool for postoperative risk assessment for patients with GC.
Collapse
Affiliation(s)
- Xuanyu Liu
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, No. 1665 Kongjiang Road, Shanghai 200092, China
| | - Su Lei
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, No. 1665 Kongjiang Road, Shanghai 200092, China
| | - Qi Wei
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, No. 1665 Kongjiang Road, Shanghai 200092, China
| | - Yizhou Wang
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, No. 1665 Kongjiang Road, Shanghai 200092, China
| | - Haibin Liang
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, No. 1665 Kongjiang Road, Shanghai 200092, China
| | - Lei Chen
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, No. 1665 Kongjiang Road, Shanghai 200092, China
| |
Collapse
|
16
|
Neuroblastoma GD2 Expression and Computational Analysis of Aptamer-Based Bioaffinity Targeting. Int J Mol Sci 2021; 22:ijms22169101. [PMID: 34445807 PMCID: PMC8396649 DOI: 10.3390/ijms22169101] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 08/10/2021] [Accepted: 08/11/2021] [Indexed: 02/08/2023] Open
Abstract
Neuroblastoma (NB) is a neuroectodermal embryonic cancer that originates from primordial neural crest cells, and amongst pediatric cancers with high mortality rates. NB is categorized into high-, intermediate-, and low-risk cases. A significant proportion of high-risk patients who achieve remission have a minimal residual disease (MRD) that causes relapse. Whilst there exists a myriad of advanced treatment options for NB, it is still characterized by a high relapse rate, resulting in a reduced chance of survival. Disialoganglioside (GD2) is a lipo-ganglioside containing a fatty acid derivative of sphingosine that is coupled to a monosaccharide and a sialic acid. Amongst pediatric solid tumors, NB tumor cells are known to express GD2; hence, it represents a unique antigen for subclinical NB MRD detection and analysis with implications in determining a response for treatment. This article discusses NB MRD expression and analytical assays for GD2 detection and quantification as well as computational approaches for GD2 characterization based on high-throughput image processing and genomic data analysis.
Collapse
|
17
|
Kuntz S, Krieghoff-Henning E, Kather JN, Jutzi T, Höhn J, Kiehl L, Hekler A, Alwers E, von Kalle C, Fröhling S, Utikal JS, Brenner H, Hoffmeister M, Brinker TJ. Gastrointestinal cancer classification and prognostication from histology using deep learning: Systematic review. Eur J Cancer 2021; 155:200-215. [PMID: 34391053 DOI: 10.1016/j.ejca.2021.07.012] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Accepted: 07/06/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Gastrointestinal cancers account for approximately 20% of all cancer diagnoses and are responsible for 22.5% of cancer deaths worldwide. Artificial intelligence-based diagnostic support systems, in particular convolutional neural network (CNN)-based image analysis tools, have shown great potential in medical computer vision. In this systematic review, we summarise recent studies reporting CNN-based approaches for digital biomarkers for characterization and prognostication of gastrointestinal cancer pathology. METHODS Pubmed and Medline were screened for peer-reviewed papers dealing with CNN-based gastrointestinal cancer analyses from histological slides, published between 2015 and 2020.Seven hundred and ninety titles and abstracts were screened, and 58 full-text articles were assessed for eligibility. RESULTS Sixteen publications fulfilled our inclusion criteria dealing with tumor or precursor lesion characterization or prognostic and predictive biomarkers: 14 studies on colorectal or rectal cancer, three studies on gastric cancer and none on esophageal cancer. These studies were categorised according to their end-points: polyp characterization, tumor characterization and patient outcome. Regarding the translation into clinical practice, we identified several studies demonstrating generalization of the classifier with external tests and comparisons with pathologists, but none presenting clinical implementation. CONCLUSIONS Results of recent studies on CNN-based image analysis in gastrointestinal cancer pathology are promising, but studies were conducted in observational and retrospective settings. Large-scale trials are needed to assess performance and predict clinical usefulness. Furthermore, large-scale trials are required for approval of CNN-based prediction models as medical devices.
Collapse
Affiliation(s)
- Sara Kuntz
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Eva Krieghoff-Henning
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Jakob N Kather
- Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
| | - Tanja Jutzi
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Julia Höhn
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Lennard Kiehl
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Achim Hekler
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Elizabeth Alwers
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Christof von Kalle
- Department of Clinical-Translational Sciences, Charité University Medicine and Berlin Institute of Health (BIH), Berlin, Germany
| | - Stefan Fröhling
- Department of Translational Medical Oncology, National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Jochen S Utikal
- Department of Dermatology, Heidelberg University, Mannheim, Germany; Skin Cancer Unit, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Hermann Brenner
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany; Division of Preventive Oncology, German Cancer Research Center (DKFZ), National Center for Tumor Diseases (NCT), Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Michael Hoffmeister
- Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Titus J Brinker
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
| |
Collapse
|
18
|
Deshmukh PR, Phalnikar R. Information extraction for prognostic stage prediction from breast cancer medical records using NLP and ML. Med Biol Eng Comput 2021; 59:1751-1772. [PMID: 34297300 DOI: 10.1007/s11517-021-02399-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Accepted: 07/01/2021] [Indexed: 11/24/2022]
Abstract
For cancer prediction, the prognostic stage is the main factor that helps medical experts to decide the optimal treatment for a patient. Specialists study prognostic stage information from medical reports, often in an unstructured form, and take a larger review time. The main objective of this study is to suggest a generic clinical decision-unifying staging method to extract the most reliable prognostic stage information of breast cancer from medical records of various health institutions. Additional prognostic elements should be extracted from medical reports to identify the cancer stage for getting an exact measure of cancer and improving care quality. This study has collected 465 pathological and clinical reports of breast cancer sufferers from India's reputed medical institutions. The unstructured records were found distinct from each institute. Anatomic and biologic factors are extracted from medical records using the natural language processing, machine learning and rule-based method for prognostic stage detection. This study has extracted anatomic stage, grade, estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor 2 (HER2) from medical reports with high accuracy and predicted prognostic stage for both regions. The prognostic stage prediction's average accuracy is found 92% and 82% in rural and urban areas, respectively. It was essential to combine biological and anatomical elements under a single prognostic staging method. A generic clinical decision-unifying staging method for prognostic stage detection with great accuracy in various institutions of different regional areas suggests that the proposed research improves the prognosis of breast cancer.
Collapse
Affiliation(s)
- Pratiksha R Deshmukh
- School of Computer Engineering and Technology, MIT World Peace University, Pune, India, 411029. .,Department of Computer Engineering and Information Technology, College of Engineering, Pune, 411005, India.
| | - Rashmi Phalnikar
- School of Computer Engineering and Technology, MIT World Peace University, Pune, India, 411029
| |
Collapse
|
19
|
Howard FM, Dolezal J, Kochanny S, Schulte J, Chen H, Heij L, Huo D, Nanda R, Olopade OI, Kather JN, Cipriani N, Grossman RL, Pearson AT. The impact of site-specific digital histology signatures on deep learning model accuracy and bias. Nat Commun 2021; 12:4423. [PMID: 34285218 PMCID: PMC8292530 DOI: 10.1038/s41467-021-24698-1] [Citation(s) in RCA: 88] [Impact Index Per Article: 29.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 07/01/2021] [Indexed: 12/20/2022] Open
Abstract
The Cancer Genome Atlas (TCGA) is one of the largest biorepositories of digital histology. Deep learning (DL) models have been trained on TCGA to predict numerous features directly from histology, including survival, gene expression patterns, and driver mutations. However, we demonstrate that these features vary substantially across tissue submitting sites in TCGA for over 3,000 patients with six cancer subtypes. Additionally, we show that histologic image differences between submitting sites can easily be identified with DL. Site detection remains possible despite commonly used color normalization and augmentation methods, and we quantify the image characteristics constituting this site-specific digital histology signature. We demonstrate that these site-specific signatures lead to biased accuracy for prediction of features including survival, genomic mutations, and tumor stage. Furthermore, ethnicity can also be inferred from site-specific signatures, which must be accounted for to ensure equitable application of DL. These site-specific signatures can lead to overoptimistic estimates of model performance, and we propose a quadratic programming method that abrogates this bias by ensuring models are not trained and validated on samples from the same site.
Collapse
Affiliation(s)
- Frederick M Howard
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA
| | - James Dolezal
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA
| | - Sara Kochanny
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA
| | - Jefree Schulte
- Department of Pathology, University of Chicago, Chicago, IL, USA
| | - Heather Chen
- Department of Pathology, University of Chicago, Chicago, IL, USA
| | - Lara Heij
- Department of Surgery and Transplantation, University Hospital RWTH Aachen, Aachen, Germany
- Institute of Pathology, University Hospital RWTH Aachen, Aachen, Germany
| | - Dezheng Huo
- Department of Public Health Sciences, University of Chicago, Chicago, IL, USA
- University of Chicago Comprehensive Cancer Center, Chicago, IL, USA
| | - Rita Nanda
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA
- University of Chicago Comprehensive Cancer Center, Chicago, IL, USA
| | - Olufunmilayo I Olopade
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA
- University of Chicago Comprehensive Cancer Center, Chicago, IL, USA
| | - Jakob N Kather
- Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
- Pathology and Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, UK
- Medical Oncology, National Center for Tumor Diseases, University Hospital Heidelberg, Heidelberg, Germany
| | - Nicole Cipriani
- Department of Pathology, University of Chicago, Chicago, IL, USA
- University of Chicago Comprehensive Cancer Center, Chicago, IL, USA
| | - Robert L Grossman
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.
- University of Chicago Comprehensive Cancer Center, Chicago, IL, USA.
| | - Alexander T Pearson
- Section of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.
- University of Chicago Comprehensive Cancer Center, Chicago, IL, USA.
| |
Collapse
|
20
|
Kobayashi S, Saltz JH, Yang VW. State of machine and deep learning in histopathological applications in digestive diseases. World J Gastroenterol 2021; 27:2545-2575. [PMID: 34092975 PMCID: PMC8160628 DOI: 10.3748/wjg.v27.i20.2545] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Revised: 03/27/2021] [Accepted: 04/29/2021] [Indexed: 02/06/2023] Open
Abstract
Machine learning (ML)- and deep learning (DL)-based imaging modalities have exhibited the capacity to handle extremely high dimensional data for a number of computer vision tasks. While these approaches have been applied to numerous data types, this capacity can be especially leveraged by application on histopathological images, which capture cellular and structural features with their high-resolution, microscopic perspectives. Already, these methodologies have demonstrated promising performance in a variety of applications like disease classification, cancer grading, structure and cellular localizations, and prognostic predictions. A wide range of pathologies requiring histopathological evaluation exist in gastroenterology and hepatology, indicating these as disciplines highly targetable for integration of these technologies. Gastroenterologists have also already been primed to consider the impact of these algorithms, as development of real-time endoscopic video analysis software has been an active and popular field of research. This heightened clinical awareness will likely be important for future integration of these methods and to drive interdisciplinary collaborations on emerging studies. To provide an overview on the application of these methodologies for gastrointestinal and hepatological histopathological slides, this review will discuss general ML and DL concepts, introduce recent and emerging literature using these methods, and cover challenges moving forward to further advance the field.
Collapse
Affiliation(s)
- Soma Kobayashi
- Department of Biomedical Informatics, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, United States
| | - Joel H Saltz
- Department of Biomedical Informatics, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, United States
| | - Vincent W Yang
- Department of Medicine, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, United States
- Department of Physiology and Biophysics, Renaissance School of Medicine, Stony Brook University, Stony Brook , NY 11794, United States
| |
Collapse
|
21
|
Suvarna K, Biswas D, Pai MGJ, Acharjee A, Bankar R, Palanivel V, Salkar A, Verma A, Mukherjee A, Choudhury M, Ghantasala S, Ghosh S, Singh A, Banerjee A, Badaya A, Bihani S, Loya G, Mantri K, Burli A, Roy J, Srivastava A, Agrawal S, Shrivastav O, Shastri J, Srivastava S. Proteomics and Machine Learning Approaches Reveal a Set of Prognostic Markers for COVID-19 Severity With Drug Repurposing Potential. Front Physiol 2021; 12:652799. [PMID: 33995121 PMCID: PMC8120435 DOI: 10.3389/fphys.2021.652799] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Accepted: 03/12/2021] [Indexed: 12/13/2022] Open
Abstract
The pestilential pathogen SARS-CoV-2 has led to a seemingly ceaseless pandemic of COVID-19. The healthcare sector is under a tremendous burden, thus necessitating the prognosis of COVID-19 severity. This in-depth study of plasma proteome alteration provides insights into the host physiological response towards the infection and also reveals the potential prognostic markers of the disease. Using label-free quantitative proteomics, we performed deep plasma proteome analysis in a cohort of 71 patients (20 COVID-19 negative, 18 COVID-19 non-severe, and 33 severe) to understand the disease dynamics. Of the 1200 proteins detected in the patient plasma, 38 proteins were identified to be differentially expressed between non-severe and severe groups. The altered plasma proteome revealed significant dysregulation in the pathways related to peptidase activity, regulated exocytosis, blood coagulation, complement activation, leukocyte activation involved in immune response, and response to glucocorticoid biological processes in severe cases of SARS-CoV-2 infection. Furthermore, we employed supervised machine learning (ML) approaches using a linear support vector machine model to identify the classifiers of patients with non-severe and severe COVID-19. The model used a selected panel of 20 proteins and classified the samples based on the severity with a classification accuracy of 0.84. Putative biomarkers such as angiotensinogen and SERPING1 and ML-derived classifiers including the apolipoprotein B, SERPINA3, and fibrinogen gamma chain were validated by targeted mass spectrometry-based multiple reaction monitoring (MRM) assays. We also employed an in silico screening approach against the identified target proteins for the therapeutic management of COVID-19. We shortlisted two FDA-approved drugs, namely, selinexor and ponatinib, which showed the potential of being repurposed for COVID-19 therapeutics. Overall, this is the first most comprehensive plasma proteome investigation of COVID-19 patients from the Indian population, and provides a set of potential biomarkers for the disease severity progression and targets for therapeutic interventions.
Collapse
Affiliation(s)
- Kruthi Suvarna
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Deeptarup Biswas
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Medha Gayathri J. Pai
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Arup Acharjee
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Renuka Bankar
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Viswanthram Palanivel
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Akanksha Salkar
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Ayushi Verma
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Amrita Mukherjee
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Manisha Choudhury
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Saicharan Ghantasala
- Centre for Research in Nanotechnology and Sciences, Indian Institute of Technology Bombay, Mumbai, India
| | - Susmita Ghosh
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Avinash Singh
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Arghya Banerjee
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Apoorva Badaya
- Department of Chemistry, Indian Institute of Technology Bombay, Mumbai, India
| | - Surbhi Bihani
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Gaurish Loya
- Department of Chemical Engineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Krishi Mantri
- Department of Chemical Engineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Ananya Burli
- Department of Chemical Engineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Jyotirmoy Roy
- Department of Chemical Engineering, Indian Institute of Technology Bombay, Mumbai, India
| | - Alisha Srivastava
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
- Department of Genetics, University of Delhi, New Delhi, India
| | - Sachee Agrawal
- Kasturba Hospital for Infectious Diseases, Mumbai, India
| | - Om Shrivastav
- Kasturba Hospital for Infectious Diseases, Mumbai, India
| | | | - Sanjeeva Srivastava
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, India
| |
Collapse
|
22
|
Schiele S, Arndt TT, Martin B, Miller S, Bauer S, Banner BM, Brendel EM, Schenkirsch G, Anthuber M, Huss R, Märkl B, Müller G. Deep Learning Prediction of Metastasis in Locally Advanced Colon Cancer Using Binary Histologic Tumor Images. Cancers (Basel) 2021; 13:2074. [PMID: 33922988 PMCID: PMC8123276 DOI: 10.3390/cancers13092074] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 04/15/2021] [Accepted: 04/21/2021] [Indexed: 12/12/2022] Open
Abstract
In this study, we developed the Binary ImaGe Colon Metastasis classifier (BIg-CoMet), a semi-guided approach for the stratification of colon cancer patients into two risk groups for the occurrence of distant metastasis, using an InceptionResNetV2-based deep learning model trained on binary images. We enrolled 291 colon cancer patients with pT3 and pT4 adenocarcinomas and converted one cytokeratin-stained representative tumor section per case into a binary image. Image augmentation and dropout layers were incorporated to avoid overfitting. In a validation collective (n = 128), BIg-CoMet was able to discriminate well between patients with and without metastasis (AUC: 0.842, 95% CI: 0.774-0.911). Further, the Kaplan-Meier curves of the metastasis-free survival showed a highly significant worse clinical course for the high-risk group (log-rank test: p < 0.001), and we demonstrated superiority over other established risk factors. A multivariable Cox regression analysis adjusted for confounders supported the use of risk groups as a prognostic factor for the occurrence of metastasis (hazard ratio (HR): 5.4, 95% CI: 2.5-11.7, p < 0.001). BIg-CoMet achieved good performance for both UICC subgroups, especially for UICC III (n = 53), with a positive predictive value of 80%. Our study demonstrates the ability to stratify colon cancer patients via a semi-guided process on images that primarily reflect tumor architecture.
Collapse
Affiliation(s)
- Stefan Schiele
- Institute of Mathematics, Augsburg University, 86159 Augsburg, Germany; (T.T.A.); (G.M.)
| | - Tim Tobias Arndt
- Institute of Mathematics, Augsburg University, 86159 Augsburg, Germany; (T.T.A.); (G.M.)
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Benedikt Martin
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Silvia Miller
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Svenja Bauer
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Bettina Monika Banner
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Eva-Maria Brendel
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Gerhard Schenkirsch
- Tumor Data Management, University Hospital of Augsburg, 86156 Augsburg, Germany;
| | - Matthias Anthuber
- General, Visceral, and Transplantation Surgery, University Hospital of Augsburg, 86156 Augsburg, Germany;
| | - Ralf Huss
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Bruno Märkl
- General Pathology and Molecular Diagnostics, Medical Faculty, 86156 Augsburg, Germany; (B.M.); (S.M.); (S.B.); (B.M.B.); (E.-M.B.); (R.H.); (B.M.)
| | - Gernot Müller
- Institute of Mathematics, Augsburg University, 86159 Augsburg, Germany; (T.T.A.); (G.M.)
| |
Collapse
|
23
|
Cirillo D, Núñez‐Carpintero I, Valencia A. Artificial intelligence in cancer research: learning at different levels of data granularity. Mol Oncol 2021; 15:817-829. [PMID: 33533192 PMCID: PMC8024732 DOI: 10.1002/1878-0261.12920] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 12/20/2020] [Accepted: 01/10/2021] [Indexed: 02/06/2023] Open
Abstract
From genome-scale experimental studies to imaging data, behavioral footprints, and longitudinal healthcare records, the convergence of big data in cancer research and the advances in Artificial Intelligence (AI) is paving the way to develop a systems view of cancer. Nevertheless, this biomedical area is largely characterized by the co-existence of big data and small data resources, highlighting the need for a deeper investigation about the crosstalk between different levels of data granularity, including varied sample sizes, labels, data types, and other data descriptors. This review introduces the current challenges, limitations, and solutions of AI in the heterogeneous landscape of data granularity in cancer research. Such a variety of cancer molecular and clinical data calls for advancing the interoperability among AI approaches, with particular emphasis on the synergy between discriminative and generative models that we discuss in this work with several examples of techniques and applications.
Collapse
Affiliation(s)
| | | | - Alfonso Valencia
- Barcelona Supercomputing Center (BSC)BarcelonaSpain
- ICREABarcelonaSpain
| |
Collapse
|
24
|
van den Bosch T, Warps ALK, de Nerée tot Babberich MPM, Stamm C, Geerts BF, Vermeulen L, Wouters MWJM, Dekker JWT, Tollenaar RAEM, Tanis PJ, Miedema DM. Predictors of 30-Day Mortality Among Dutch Patients Undergoing Colorectal Cancer Surgery, 2011-2016. JAMA Netw Open 2021; 4:e217737. [PMID: 33900400 PMCID: PMC8076964 DOI: 10.1001/jamanetworkopen.2021.7737] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
IMPORTANCE Quality improvement programs for colorectal cancer surgery have been introduced with benchmarking based on quality indicators, such as mortality. Detailed (pre)operative characteristics may offer relevant information for proper case-mix correction. OBJECTIVE To investigate the added value of machine learning to predict quality indicators for colorectal cancer surgery and identify previously unrecognized predictors of 30-day mortality based on a large, nationwide colorectal cancer registry that collected extensive data on comorbidities. DESIGN, SETTING, AND PARTICIPANTS All patients who underwent resection for primary colorectal cancer registered in the Dutch ColoRectal Audit between January 1, 2011, and December 31, 2016, were included. Multiple machine learning models (multivariable logistic regression, elastic net regression, support vector machine, random forest, and gradient boosting) were made to predict quality indicators. Model performance was compared with conventionally used scores. Risk factors were identified by logistic regression analyses and Shapley additive explanations (ie, SHAP values). Statistical analysis was performed between March 1 and September 30, 2020. MAIN OUTCOMES AND MEASURES The primary outcome of this cohort study was 30-day mortality. Prediction models were trained on a training set by performing 5-fold cross-validation, and outcomes were measured by the area under the receiver operating characteristic curve on the test set. Machine learning was further used to identify risk factors, measured by odds ratios and SHAP values. RESULTS This cohort study included 62 501 records, most patients were male (35 116 [56.2%]), were aged 61 to 80 years (41 560 [66.5%]), and had an American Society of Anesthesiology score of II (35 679 [57.1%]). A 30-day mortality rate of 2.7% (n = 1693) was found. The area under the curve of the best machine learning model for 30-day mortality (0.82; 95% CI, 0.79-0.85) was significantly higher than the American Society of Anesthesiology score (0.74; 95% CI, 0.71-0.77; P < .001), Charlson Comorbidity Index (0.66; 95% CI, 0.63-0.70; P < .001), and preoperative score to predict postoperative mortality (0.73; 95% CI, 0.70-0.77; P < .001). Hypertension, myocardial infarction, chronic obstructive pulmonary disease, and asthma were comorbidities with a high risk for increased mortality. Machine learning identified specific risk factors for a complicated course, intensive care unit admission, prolonged hospital stay, and readmission. Laparoscopic surgery was associated with a decreased risk for all adverse outcomes. CONCLUSIONS AND RELEVANCE This study found that machine learning methods outperformed conventional scores to predict 30-day mortality after colorectal cancer surgery, identified specific patient groups at risk for adverse outcomes, and provided directions to optimize benchmarking in clinical audits.
Collapse
Affiliation(s)
- Tom van den Bosch
- Laboratory for Experimental Oncology and Radiobiology, Center for Experimental and Molecular Medicine, Cancer Center Amsterdam and Amsterdam Gastroenterology and Metabolism, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
- Oncode Institute, Utrecht, the Netherlands
| | - Anne-Loes K. Warps
- Department of Surgery, Leiden University Medical Center, Leiden, the Netherlands
- Dutch Institute for Clinical Auditing, Leiden, the Netherlands
| | | | | | | | - Louis Vermeulen
- Laboratory for Experimental Oncology and Radiobiology, Center for Experimental and Molecular Medicine, Cancer Center Amsterdam and Amsterdam Gastroenterology and Metabolism, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
- Oncode Institute, Utrecht, the Netherlands
| | - Michel W. J. M. Wouters
- Dutch Institute for Clinical Auditing, Leiden, the Netherlands
- Department of Surgical Oncology, Antoni van Leeuwenhoek Hospital, Amsterdam, the Netherlands
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, the Netherlands
- Department of Surgery, Reinier de Graaf Groep, Delft, the Netherlands
| | - Jan-Willem T. Dekker
- Dutch Institute for Clinical Auditing, Leiden, the Netherlands
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, the Netherlands
- Department of Surgery, Reinier de Graaf Groep, Delft, the Netherlands
| | - Rob A. E. M. Tollenaar
- Department of Surgery, Leiden University Medical Center, Leiden, the Netherlands
- Dutch Institute for Clinical Auditing, Leiden, the Netherlands
| | - Pieter J. Tanis
- Amsterdam University Medical Centers, Department of Surgery, University of Amsterdam, Cancer Center Amsterdam, Amsterdam, the Netherlands
| | - Daniël M. Miedema
- Laboratory for Experimental Oncology and Radiobiology, Center for Experimental and Molecular Medicine, Cancer Center Amsterdam and Amsterdam Gastroenterology and Metabolism, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
- Oncode Institute, Utrecht, the Netherlands
| |
Collapse
|
25
|
Kwak MS, Lee HH, Yang JM, Cha JM, Jeon JW, Yoon JY, Kim HI. Deep Convolutional Neural Network-Based Lymph Node Metastasis Prediction for Colon Cancer Using Histopathological Images. Front Oncol 2021; 10:619803. [PMID: 33520727 PMCID: PMC7838556 DOI: 10.3389/fonc.2020.619803] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Accepted: 11/30/2020] [Indexed: 12/24/2022] Open
Abstract
Background Human evaluation of pathological slides cannot accurately predict lymph node metastasis (LNM), although accurate prediction is essential to determine treatment and follow-up strategies for colon cancer. We aimed to develop accurate histopathological features for LNM in colon cancer. Methods We developed a deep convolutional neural network model to distinguish the cancer tissue component of colon cancer using data from the tissue bank of the National Center for Tumor Diseases and the pathology archive at the University Medical Center Mannheim, Germany. This model was applied to whole-slide pathological images of colon cancer patients from The Cancer Genome Atlas (TCGA). The predictive value of the peri-tumoral stroma (PTS) score for LNM was assessed. Results A total of 164 patients with stages I, II, and III colon cancer from TCGA were analyzed. The mean PTS score was 0.380 (± SD = 0.285), and significantly higher PTS scores were observed in patients in the LNM-positive group than those in the LNM-negative group (P < 0.001). In the univariate analyses, the PTS scores for the LNM-positive group were significantly higher than those for the LNM-negative group (P < 0.001). Further, the PTS scores in lymphatic invasion and any one of perineural, lymphatic, or venous invasion were significantly increased in the LNM-positive group (P < 0.001 and P < 0.001). Conclusion We established the PTS score, a simplified reproducible parameter, for predicting LNM in colon cancer using computer-based analysis that could be used to guide treatment decisions. These findings warrant further confirmation through large-scale prospective clinical trials.
Collapse
Affiliation(s)
- Min Seob Kwak
- Department of Internal Medicine, Kyung Hee University Hospital at Gangdong, Kyung Hee University College of Medicine, Seoul, South Korea
| | - Hun Hee Lee
- Department of Internal Medicine, Kyung Hee University Hospital at Gangdong, Kyung Hee University College of Medicine, Seoul, South Korea
| | - Jae Min Yang
- Department of Computer Science and Engineering, Konkuk University, Seoul, South Korea
| | - Jae Myung Cha
- Department of Internal Medicine, Kyung Hee University Hospital at Gangdong, Kyung Hee University College of Medicine, Seoul, South Korea
| | - Jung Won Jeon
- Department of Internal Medicine, Kyung Hee University Hospital at Gangdong, Kyung Hee University College of Medicine, Seoul, South Korea
| | - Jin Young Yoon
- Department of Internal Medicine, Kyung Hee University Hospital at Gangdong, Kyung Hee University College of Medicine, Seoul, South Korea
| | - Ha Il Kim
- Department of Internal Medicine, Kyung Hee University Hospital at Gangdong, Kyung Hee University College of Medicine, Seoul, South Korea
| |
Collapse
|
26
|
Bianconi F, Kather JN, Reyes-Aldasoro CC. Experimental Assessment of Color Deconvolution and Color Normalization for Automated Classification of Histology Images Stained with Hematoxylin and Eosin. Cancers (Basel) 2020; 12:cancers12113337. [PMID: 33187299 PMCID: PMC7697346 DOI: 10.3390/cancers12113337] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Accepted: 11/04/2020] [Indexed: 02/06/2023] Open
Abstract
Histological evaluation plays a major role in cancer diagnosis and treatment. The appearance of H&E-stained images can vary significantly as a consequence of differences in several factors, such as reagents, staining conditions, preparation procedure and image acquisition system. Such potential sources of noise can all have negative effects on computer-assisted classification. To minimize such artefacts and their potentially negative effects several color pre-processing methods have been proposed in the literature-for instance, color augmentation, color constancy, color deconvolution and color transfer. Still, little work has been done to investigate the efficacy of these methods on a quantitative basis. In this paper, we evaluated the effects of color constancy, deconvolution and transfer on automated classification of H&E-stained images representing different types of cancers-specifically breast, prostate, colorectal cancer and malignant lymphoma. Our results indicate that in most cases color pre-processing does not improve the classification accuracy, especially when coupled with color-based image descriptors. Some pre-processing methods, however, can be beneficial when used with some texture-based methods like Gabor filters and Local Binary Patterns.
Collapse
Affiliation(s)
- Francesco Bianconi
- Department of Engineering, Università degli Studi di Perugia, Via Goffredo Duranti 93, 06125 Perugia, Italy
- giCentre, School of Mathematics, Computer Science & Engineering, City, University of London, Northampton Square, London EC1V 0HB, UK;
- Correspondence: ; Tel.: +39-075-585-3706
| | - Jakob N. Kather
- Department of Medical Oncology and Internal Medicine VI, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany;
| | - Constantino Carlos Reyes-Aldasoro
- giCentre, School of Mathematics, Computer Science & Engineering, City, University of London, Northampton Square, London EC1V 0HB, UK;
| |
Collapse
|
27
|
Li Y, Eresen A, Shangguan J, Yang J, Benson AB, Yaghmai V, Zhang Z. Preoperative prediction of perineural invasion and KRAS mutation in colon cancer using machine learning. J Cancer Res Clin Oncol 2020; 146:3165-3174. [PMID: 32779023 DOI: 10.1007/s00432-020-03354-z] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Accepted: 08/05/2020] [Indexed: 12/27/2022]
Abstract
PURPOSE Preoperative prediction of perineural invasion (PNI) and Kirsten RAS (KRAS) mutation in colon cancer is critical for treatment planning and patient management. We developed machine learning models for diagnosis of PNI and KRAS mutation in colon cancer patients by interpreting preoperative CT. METHODS This retrospective study included 207 patients who received surgical resection in our institution. The underlying tumor characteristics were described by analyzing CT image texture quantitatively. The key radiomics features were determined with similarity analysis followed by RELIEFF method among 306 CT imaging features. Eight kernel-based support vector machines classifiers were constructed using individual (II, III, or IV) or multi-stage (II + III + IV) patient cohorts for predicting PNI and KRAS mutation. The model performances were evaluated using accuracy, receiver operating curve, and decision curve analyses. RESULTS Multi-stage classifiers obtained AUC of 0.793 and 0.862 for detecting PNI and KRAS mutation for test cohort. Moreover, individual-stage classifiers demonstrated significantly improved diagnostic performance at all stages (IIAUC: [0.86; 0.99], IIIAUC: [0.99; 0.99], and IVAUC: [1.00; 1.00], respectively, for PNI and KRAS mutation in test cohort). Besides, stage II tumor is better described with coarse texture features while more detailed features are required for better characterization of advanced-stage tumors (III and IV) for diagnoses of PNI or KRAS mutation. CONCLUSION Machine learning models developed using preoperative CT data can predict PNI and KRAS mutation in colon cancer patients with satisfactory performance. Individual-stage models better-characterized the relationship between CT features and PNI or KRAS mutation than multi-stage models and demonstrated good prediction scores.
Collapse
Affiliation(s)
- Yu Li
- Department of Gastrointestinal Surgery, Affiliated Hospital of Qingdao University, Qingdao, Shandong, China.,Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago, IL, 60611, USA
| | - Aydin Eresen
- Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago, IL, 60611, USA.
| | - Junjie Shangguan
- Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago, IL, 60611, USA
| | - Jia Yang
- Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago, IL, 60611, USA
| | - Al B Benson
- Division of Hematology and Oncology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.,Robert Lurie Comprehensive Cancer Center of Northwestern University, Chicago, IL, USA
| | - Vahid Yaghmai
- Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago, IL, 60611, USA.,Robert Lurie Comprehensive Cancer Center of Northwestern University, Chicago, IL, USA.,Department of Radiological Sciences, University of California, Orange, Irvine, CA, USA
| | - Zhuoli Zhang
- Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago, IL, 60611, USA.,Robert Lurie Comprehensive Cancer Center of Northwestern University, Chicago, IL, USA
| |
Collapse
|