Histopathological image and gene expression pattern analysis for predicting molecular features and prognosis of head and neck squamous cell carcinoma

Computer Vision-Radiomics & Pathognomics

The role of computer vision in extracting radiographic (radiomics) and histopathologic (pathognomics) features is an extension of molecular biomarkers that have been foundational to our understanding across the spectrum of head and neck disorders. Especially within head and neck cancers, machine learning and deep learning applications have yielded advances in the characterization of tumor features, nodal features, and various outcomes. This review aims to overview the landscape of radiomic and pathognomic applications, informing future work to address gaps. Novel methodologies will be needed to potentially engineer ways of integrating multidimensional data inputs to examine disease features to guide prognosis comprehensively and ultimately clinical management.

Construction of a pathomics model for predicting mRNAsi in lung adenocarcinoma and exploration of biological mechanism

Objective

This study aimed to predict the level of stemness index (mRNAsi) and survival prognosis of lung adenocarcinoma (LUAD) using pathomics model.

Methods

From The Cancer Genome Atlas (TCGA) database, 327 LUAD patients were randomly assigned to a training set (n = 229) and a validation set (n = 98) for pathomics model development and evaluation. PyRadiomics was used to extract pathomics features, followed by feature selection using the mRMR-RFE algorithm. In the training set, Gradient Boosting Machine (GBM) was utilized to establish a model for predicting mRNAsi in LUAD. The model's predictive performance was evaluated using ROC curves, calibration curves, and decision curve analysis (DCA). Prognostic analysis was conducted using Kaplan-Meier curves and cox regression. Additionally, gene enrichment analysis, tumor microenvironment analysis, and tumor mutational burden (TMB) analysis were performed to explore the biological mechanisms underlying the pathomics prediction model.

Results

Multivariable cox analysis (HR = 1.488, 95 % CI 1.012-2.187, P = 0.043) identified mRNAsi as a prognostic risk factor for LUAD. A total of 465 pathomics features were extracted from TCGA-LUAD histopathological images, and ultimately, the most representative 8 features were selected to construct the predictive model. ROC curves demonstrated the significant predictive value of the model for mRNAsi in both the training set (AUC = 0.769) and the validation set (AUC = 0.757). Calibration curves and Hosmer-Lemeshow goodness-of-fit test showed good consistency between the model's prediction of mRNAsi levels and the actual values. DCA indicated a good net benefit of the model. The prediction of mRNAsi levels by the pathomics model is represented using the pathomics score (PS). PS was strongly associated with the prognosis of LUAD (HR = 1.496, 95 % CI 1.008-2.222, P = 0.046). Signaling pathways related to DNA replication and damage repair were significantly enriched in the high PS group. Prediction of immune therapy response indicated significantly reduced Dysfunction in the high PS group (P < 0.001). The high PS group exhibited higher TMB values (P < 0.001).

Conclusions

The predictive model constructed based on pathomics features can forecast the mRNAsi and survival risk of LUAD. This model holds promise to aid clinical practitioners in identifying high-risk patients and devising more optimized treatment plans for patients by jointly employing therapeutic strategies targeting cancer stem cells (CSCs).

Predicting CTLA4 expression and prognosis in clear cell renal cell carcinoma using a pathomics signature of histopathological images and machine learning

Background

CTLA4, an immune checkpoint, plays an important role in tumor immunotherapy. The purpose of this study was to develop a pathomics signature to evaluate CTLA4 expression and predict clinical outcomes in clear cell renal cell carcinoma (ccRCC) patients.

Methods

A total of 354 patients from the TCGA-KIRC dataset were enrolled in this study. The patients were stratified into two groups based on the level of CTLA4 expression, and overall survival rates were analyzed between groups. Pathological features were identified using machine learning algorithms, and a gradient boosting machine (GBM) was employed to construct the pathomics signatures for predicting prognosis and CTLA4 expression. The predictive performance of the model was subsequently assessed. Enrichment analysis was performed on diferentially expressed genes related to the pathomics score (PS). Additionally, correlations between PS and TMB, as well as immune infiltration profiles associated with different PS values, were explored. In vitro experiments, CTLA4 knockdown was performed to investigate its impact on cell proliferation, migration, invasion, TGF-β signaling pathway, and macrophage polarization.

Results

High expression of CTLA4 was associated with an unfavorable prognosis in ccRCC patients. The pathomics signature displayed good performance in the validation set (AUC = 0.737; P < 0.001 in the log-rank test). The PS was positively correlated with CTLA4 expression. We next explored the underlying mechanism and found the associations between the pathomics signature and TGF-β signaling pathways, TMB, and Tregs. Further in vitro experiments demonstrated that CTLA4 knockdown inhibited cell proliferation, migration, invasion, TGF-β expression, and macrophage M2 polarization.

Conclusion

High expression of CTLA4 was found to correlate with poor prognosis in ccRCC patients. The pathomics signature established by our group using machine learning effectively predicted both patient prognosis and CTLA4 expression levels in ccRCC cases.

Matrix metalloproteinase 9 expression and glioblastoma survival prediction using machine learning on digital pathological images

This study aimed to apply pathomics to predict Matrix metalloproteinase 9 (MMP9) expression in glioblastoma (GBM) and investigate the underlying molecular mechanisms associated with pathomics. Here, we included 127 GBM patients, 78 of whom were randomly allocated to the training and test cohorts for pathomics modeling. The prognostic significance of MMP9 was assessed using Kaplan-Meier and Cox regression analyses. PyRadiomics was used to extract the features of H&E-stained whole slide images. Feature selection was performed using the maximum relevance and minimum redundancy (mRMR) and recursive feature elimination (RFE) algorithms. Prediction models were created using support vector machines (SVM) and logistic regression (LR). The performance was assessed using ROC analysis, calibration curve assessment, and decision curve analysis. MMP9 expression was elevated in patients with GBM. This was an independent prognostic factor for GBM. Six features were selected for the pathomics model. The area under the curves (AUCs) of the training and test subsets were 0.828 and 0.808, respectively, for the SVM model and 0.778 and 0.754, respectively, for the LR model. The C-index and calibration plots exhibited effective estimation abilities. The pathomics score calculated using the SVM model was highly correlated with overall survival time. These findings indicate that MMP9 plays a crucial role in GBM development and prognosis. Our pathomics model demonstrated high efficacy for predicting MMP9 expression levels and prognosis of patients with GBM.

Assessment of AURKA expression and prognosis prediction in lung adenocarcinoma using machine learning-based pathomics signature

Objective

This study aimed to develop quantitative feature-based models from histopathological images to assess aurora kinase A (AURKA) expression and predict the prognosis of patients with lung adenocarcinoma (LUAD).

Methods

A dataset of patients with LUAD was derived from the cancer genome atlas (TCGA) with information on clinical characteristics, RNA sequencing and histopathological images. The TCGA-LUAD cohort was randomly divided into training (n = 229) and testing (n = 98) sets. We extracted quantitative image features from histopathological slides of patients with LUAD using computational approaches, constructed a predictive model for AURKA expression in the training set, and estimated their predictive performance in the test set. A Cox proportional hazards model was used to assess whether the pathomic scores (PS) generated by the model independently predicted LUAD survival.

Results

High AURKA expression was an independent risk factor for overall survival (OS) in patients with LUAD (hazard ratio = 1.816, 95 % confidence intervals = 1.257-2.623, P = 0.001). The model based on histopathological image features had significant predictive value for AURKA expression: the area under the curve of the receiver operating characteristic curve in the training set and validation set was 0.809 and 0.739, respectively. Decision curve analysis showed that the model had clinical utility. Patients with high PS and low PS had different survival rates (P = 0.019). Multivariate analysis suggested that PS was an independent prognostic factor for LUAD (hazard ratio = 1.615, 95 % confidence intervals = 1.071-2.438, P = 0.022).

Conclusion

Pathomics models based on machine learning can accurately predict AURKA expression and the PS generated by the model can predict LUAD prognosis.

Prognostic significance of TNFRSF4 expression and development of a pathomics model to predict expression in hepatocellular carcinoma

Background

TNFRSF4 plays a significant role in cancer progression, especially in hepatocellular carcinoma (HCC). This study aims to investigate the prognostic value of TNFRSF4 expression in patients with HCC and to develop a predictive pathomics model for its expression.

Methods

A cohort of patients with HCC retrieved from the TCGA database was analyzed using RNA-seq analysis to determine TNFRSF4 expression and its impact on overall survival (OS). Additionally, hematoxylin-eosin staining analysis was performed to construct a pathomics model for predicting TNFRSF4 expression. Then, pathway enrichment analysis was conducted, immune checkpoint markers were investigated, and immune cell infiltration was examined to explore the underlying biological mechanism of the pathomics score.

Results

TNFRSF4 expression was significantly higher in tumor tissues than in normal tissues. TNFRSF4 expression also exhibited significant correlations with various clinical variables, including pathologic stage III/IV and R1/R2/RX residual tumor. Furthermore, elevated TNFRSF4 expression was associated with unfavorable OS. Interestingly, in the subgroup analysis, elevated TNFRSF4 expression was identified as a significant risk factor for OS in male patients. The newly developed pathomics model successfully predicted TNFRSF4 expression with good performance and revealed a significant association between high pathomics scores and worse OS. In male patients, high pathomics scores were also associated with a higher risk of mortality. Moreover, pathomics scores were also involved in specific hallmarks, immune-related characteristics, and apoptosis-related genes in HCC, such as epithelial-mesenchymal transition, Tregs, and BAX expression.

Conclusions

Our findings suggest that TNFRSF4 expression and the newly devised pathomics scores hold potential as prognostic markers for OS in patients with HCC. Additionally, gender influenced the association between these markers and patient outcomes.

Insights into metastatic roadmap of head and neck cancer squamous cell carcinoma based on clinical, histopathological and molecular profiles

The incidence of head and neck cancer (HNC), constituting approximately one in ten cancer cases worldwide, affects approximately 644,000 individuals annually. Managing this complex disease involves various treatment modalities such as systemic therapy, radiation, and surgery, particularly for patients with locally advanced disease. HNC treatment necessitates a multidisciplinary approach due to alterations in patients' genomes affecting their functionality. Predominantly, squamous cell carcinomas (SCCs), the majority of HNCs, arise from the upper aerodigestive tract epithelium. The epidemiology, staging, diagnosis, and management techniques of head and neck squamous cell carcinoma (HNSCC), encompassing clinical, image-based, histopathological and molecular profiling, have been extensively reviewed. Lymph node metastasis (LNM) is a well-known predictive factor for HNSCC that initiates metastasis and significantly impacts HNSCC prognosis. Distant metastasis (DM) in HNSCC has been correlated to aberrant expression of cancer cell-derived cytokines and growth factors triggering abnormal activation of several signaling pathways that boost cancer cell aggressiveness. Recent advances in genetic profiling, understanding tumor microenvironment, oligometastatic disease, and immunotherapy have revolutionized treatment strategies and disease control. Future research may leverage genomics and proteomics to identify biomarkers aiding individualized HNSCC treatment. Understanding the molecular basis, genetic landscape, atypical signaling pathways, and tumor microenvironment have enhanced the comprehension of HNSCC molecular etiology. This critical review sheds light on regional and distant metastases in HNSCC, presenting major clinical and laboratory features, predictive biomarkers, and available therapeutic approaches.

Promoter DNA methylation patterns in oral, laryngeal and oropharyngeal anatomical regions are associated with tumor differentiation, nodal involvement and survival

Differentially methylated regions (DMRs) can be used as head and neck squamous cell carcinoma (HNSCC) diagnostic, prognostic and therapeutic targets in precision medicine workflows. DNA from 21 HNSCC and 10 healthy oral tissue samples was hybridized to a genome-wide tiling array to identify DMRs in a discovery cohort. Downstream analyses identified differences in promoter DNA methylation patterns in oral, laryngeal and oropharyngeal anatomical regions associated with tumor differentiation, nodal involvement and survival. Genome-wide DMR analysis showed 2,565 DMRs common to the three subsites. A total of 738 DMRs were unique to laryngeal cancer (n=7), 889 DMRs were unique to oral cavity cancer (n=10) and 363 DMRs were unique to pharyngeal cancer (n=6). Based on the genome-wide analysis and a Gene Ontology analysis, 10 candidate genes were selected to test for prognostic value and association with clinicopathological features. TIMP3 was associated with tumor differentiation in oral cavity cancer (P=0.039), DAPK1 was associated with nodal involvement in pharyngeal cancer (P=0.017) and PAX1 was associated with tumor differentiation in laryngeal cancer (P=0.040). A total of five candidate genes were selected, DAPK1, CDH1, PAX1, CALCA and TIMP3, for a prevalence study in a larger validation cohort: Oral cavity cancer samples (n=42), pharyngeal cancer tissues (n=25) and laryngeal cancer samples (n=52). PAX1 hypermethylation differed across HNSCC anatomic subsites (P=0.029), and was predominantly detected in laryngeal cancer. Kaplan-Meier survival analysis (P=0.043) and Cox regression analysis of overall survival (P=0.001) showed that DAPK1 methylation is associated with better prognosis in HNSCC. The findings of the present study showed that the HNSCC subsites oral cavity, pharynx and larynx display substantial differences in aberrant DNA methylation patterns, which may serve as prognostic biomarkers and therapeutic targets.

Development and Validation of a Pathomics Model Using Machine Learning to Predict CXCL8 Expression and Prognosis in Head and Neck Cancer

OBJECTIVES

The necessity to develop a method for prognostication and to identify novel biomarkers for personalized medicine in patients with head and neck squamous cell carcinoma (HNSCC) cannot be overstated. Recently, pathomics, which relies on quantitative analysis of medical imaging, has come to the forefront. CXCL8, an essential inflammatory cytokine, has been shown to correlate with overall survival (OS). This study examined the relationship between CXCL8 mRNA expression and pathomics features and aimed to explore the biological underpinnings of CXCL8.

METHODS

Clinical information and transcripts per million mRNA sequencing data were obtained from The Cancer Genome Atlas (TCGA)-HNSCC dataset. We identified correlations between CXCL8 mRNA expression and patient survival rates using a Kaplan-Meier survival curve. A retrospective analysis of 313 samples diagnosed with HNSCC in the TCGA database was conducted. Pathomics features were extracted from hematoxylin and eosin-stained images, and then the minimum redundancy maximum relevance, with recursive feature elimination (mRMR-RFE) method was applied, followed by screening with the logistic regression algorithm.

RESULTS

Kaplan-Meier curves indicated that high expression of CXCL8 was significantly associated with decreased OS. The logistic regression pathomics model incorporated 16 radiomics features identified by the mRMR-RFE method in the training set and demonstrated strong performance in the testing set. Calibration plots showed that the probability of high gene expression predicted by the pathomics model was in good agreement with actual observations, suggesting the model's high clinical applicability.

CONCLUSION

The pathomics model of CXCL8 mRNA expression serves as an effective tool for predicting prognosis in patients with HNSCC and can aid in clinical decision-making. Elevated levels of CXCL8 expression may lead to reduced DNA damage and are associated with a pro-inflammatory tumor microenvironment, offering a potential therapeutic target.

Establishment of a pathomic-based machine learning model to predict CD276 (B7-H3) expression in colon cancer

CD276 is a promising prognostic indicator and an attractive therapeutic target in various malignancies. However, current methods for CD276 detection are time-consuming and expensive, limiting extensive studies and applications of CD276. We aimed to develop a pathomic model for CD276 prediction from H&E-stained pathological images, and explore the underlying mechanism of the pathomic features by associating the pathomic model with transcription profiles. A dataset of colon adenocarcinoma (COAD) patients was retrieved from the Cancer Genome Atlas (TCGA) database. The dataset was divided into the training and validation sets according to the ratio of 8:2 by a stratified sampling method. Using the gradient boosting machine (GBM) algorithm, we established a pathomic model to predict CD276 expression in COAD. Univariate and multivariate Cox regression analyses were conducted to assess the predictive performance of the pathomic model for overall survival in COAD. Gene Set Enrichment Analysis (GESA) was performed to explore the underlying biological mechanisms of the pathomic model. The pathomic model formed by three pathomic features for CD276 prediction showed an area under the curve (AUC) of 0.833 (95%CI: 0.784-0.882) in the training set and 0.758 (95%CI: 0.637-0.878) in the validation set, respectively. The calibration curves and Hosmer-Lemeshow goodness of fit test showed that the prediction probability of high/low expression of CD276 was in favorable agreement with the real situation in both the training and validation sets (P=0.176 and 0.255, respectively). The DCA curves suggested that the pathomic model acquired high clinical benefit. All the subjects were categorized into high pathomic score (PS) (PS-H) and low PS (PS-L) groups according to the cutoff value of PS. Univariate and multivariate Cox regression analysis indicated that PS was a risk factor for overall survival in COAD. Furthermore, through GESA analysis, we found several immune and inflammatory-related pathways and genes were associated with the pathomic model. We constructed a pathomics-based machine learning model for CD276 prediction directly from H&E-stained images in COAD. Through integrated analysis of the pathomic model and transcriptomics, the interpretability of the pathomic model provide a theoretical basis for further hypothesis and experimental research.

Deep learning integrates histopathology and proteogenomics at a pan-cancer level

We introduce a pioneering approach that integrates pathology imaging with transcriptomics and proteomics to identify predictive histology features associated with critical clinical outcomes in cancer. We utilize 2,755 H&E-stained histopathological slides from 657 patients across 6 cancer types from CPTAC. Our models effectively recapitulate distinctions readily made by human pathologists: tumor vs. normal (AUROC = 0.995) and tissue-of-origin (AUROC = 0.979). We further investigate predictive power on tasks not normally performed from H&E alone, including TP53 prediction and pathologic stage. Importantly, we describe predictive morphologies not previously utilized in a clinical setting. The incorporation of transcriptomics and proteomics identifies pathway-level signatures and cellular processes driving predictive histology features. Model generalizability and interpretability is confirmed using TCGA. We propose a classification system for these tasks, and suggest potential clinical applications for this integrated human and machine learning approach. A publicly available web-based platform implements these models.

A Review of Fusion Methods for Omics and Imaging Data

The development of omics data and biomedical images has greatly advanced the progress of precision medicine in diagnosis, treatment, and prognosis. The fusion of omics and imaging data, i.e., omics-imaging fusion, offers a new strategy for understanding complex diseases. However, due to a variety of issues such as the limited number of samples, high dimensionality of features, and heterogeneity of different data types, efficiently learning complementary or associated discriminative fusion information from omics and imaging data remains a challenge. Recently, numerous machine learning methods have been proposed to alleviate these problems. In this review, from the perspective of fusion levels and fusion methods, we first provide an overview of preprocessing and feature extraction methods for omics and imaging data, and comprehensively analyze and summarize the basic forms and variations of commonly used and newly emerging fusion methods, along with their advantages, disadvantages and the applicable scope. We then describe public datasets and compare experimental results of various fusion methods on the ADNI and TCGA datasets. Finally, we discuss future prospects and highlight remaining challenges in the field.

Accuracy of artificial intelligence-assisted detection of Oral Squamous Cell Carcinoma: A systematic review and meta-analysis

Oral Squamous Cell Carcinoma (OSCC) is an aggressive tumor with a poor prognosis. Accurate and timely diagnosis is therefore essential for reducing the burden of advanced disease and improving outcomes. In this meta-analysis, we evaluated the accuracy of artificial intelligence (AI)-assisted technologies in detecting OSCC. We included studies that validated any diagnostic modality that used AI to detect OSCC. A search was performed in six databases: PubMed, Embase, Scopus, Cochrane Library, ProQuest, and Web of Science up to 15 Mar 2022. The Quality Assessment Tool for Diagnostic Accuracy Studies was used to evaluate the included studies' quality, while the Split Component Synthesis method was utilized to quantitatively synthesize the pooled diagnostic efficacy estimates. We considered 16 out of the 566 yielded studies, which included twelve different AI models with a total of 6606 samples. The summary sensitivity, summary specificity, positive and negative likelihood ratios as well as the pooled diagnostic odds ratio were 92.0 % (95 % confidence interval [CI] 86.7-95.4 %), 91.9 % (95 % CI 86.5-95.3 %), 11.4 (95 % CI 6.74-19.2), 0.087 (95 % CI 0.051-0.146) and 132 (95 % CI 62.6-277), respectively. Our findings support the capability of AI-assisted systems to detect OSCC with high accuracy, potentially aiding the histopathological examination in early diagnosis, yet more prospective studies are needed to justify their use in the real population.

The state of the art for artificial intelligence in lung digital pathology

Lung diseases carry a significant burden of morbidity and mortality worldwide. The advent of digital pathology (DP) and an increase in computational power have led to the development of artificial intelligence (AI)-based tools that can assist pathologists and pulmonologists in improving clinical workflow and patient management. While previous works have explored the advances in computational approaches for breast, prostate, and head and neck cancers, there has been a growing interest in applying these technologies to lung diseases as well. The application of AI tools on radiology images for better characterization of indeterminate lung nodules, fibrotic lung disease, and lung cancer risk stratification has been well documented. In this article, we discuss methodologies used to build AI tools in lung DP, describing the various hand-crafted and deep learning-based unsupervised feature approaches. Next, we review AI tools across a wide spectrum of lung diseases including cancer, tuberculosis, idiopathic pulmonary fibrosis, and COVID-19. We discuss the utility of novel imaging biomarkers for different types of clinical problems including quantification of biomarkers like PD-L1, lung disease diagnosis, risk stratification, and prediction of response to treatments such as immune checkpoint inhibitors. We also look briefly at some emerging applications of AI tools in lung DP such as multimodal data analysis, 3D pathology, and transplant rejection. Lastly, we discuss the future of DP-based AI tools, describing the challenges with regulatory approval, developing reimbursement models, planning clinical deployment, and addressing AI biases. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Events prediction after treatment in HPV-driven oropharyngeal carcinoma using machine learning

OBJECTIVES

Our objective was to develop a predictive model using a machine learning signature to identify patients at high risk of relapse or death after treatment for HPV-positive oropharyngeal carcinoma.

MATERIALS AND METHODS

Pre-treatment variables of 450 patients with HPV-positive oropharyngeal carcinoma treated with a curative intent comprised clinical items, imaging parameters and histological findings. The events considered were progression or residual disease after treatment, the recurrent disease after a disease-free interval and death. The endpoints were the prediction of events and progression-free survival. After feature Z-score normalisation and selection, random forest classifier models were trained. The best models were evaluated on recall, the F-score, and the ROC AUC metric. The clinical relevance of the best prediction model was evaluated using Kaplan-Meier analysis with a log-rank test.

RESULTS

The best random forest model predicted the 5-year risk of relapse-free survival with a recall of 79.1%, an F1-score of 81.08%, and an AUC of the ROC curve of 0.89. The models performed poorly for the prediction of specific events of progression only, recurrence only or death only. The clinical relevance of the model was validated with a 5-year relapse-free survival of high-risk patients versus low-risk patients of 23.5% and 80%, respectively (p < 0.0001).

CONCLUSION

Patients with HPV-driven oropharyngeal carcinoma at high risk of relapse-free survival could be identified with a predictive machine learning model using patient data before treatment.