Machine learning-based pathomics signature could act as a novel prognostic marker for patients with clear cell renal cell carcinoma

Matrix metalloproteinase 9 expression and glioblastoma survival prediction using machine learning on digital pathological images

This study aimed to apply pathomics to predict Matrix metalloproteinase 9 (MMP9) expression in glioblastoma (GBM) and investigate the underlying molecular mechanisms associated with pathomics. Here, we included 127 GBM patients, 78 of whom were randomly allocated to the training and test cohorts for pathomics modeling. The prognostic significance of MMP9 was assessed using Kaplan-Meier and Cox regression analyses. PyRadiomics was used to extract the features of H&E-stained whole slide images. Feature selection was performed using the maximum relevance and minimum redundancy (mRMR) and recursive feature elimination (RFE) algorithms. Prediction models were created using support vector machines (SVM) and logistic regression (LR). The performance was assessed using ROC analysis, calibration curve assessment, and decision curve analysis. MMP9 expression was elevated in patients with GBM. This was an independent prognostic factor for GBM. Six features were selected for the pathomics model. The area under the curves (AUCs) of the training and test subsets were 0.828 and 0.808, respectively, for the SVM model and 0.778 and 0.754, respectively, for the LR model. The C-index and calibration plots exhibited effective estimation abilities. The pathomics score calculated using the SVM model was highly correlated with overall survival time. These findings indicate that MMP9 plays a crucial role in GBM development and prognosis. Our pathomics model demonstrated high efficacy for predicting MMP9 expression levels and prognosis of patients with GBM.

A dynamic online nomogram for predicting renal outcomes of idiopathic membranous nephropathy

BACKGROUND

Because spontaneous remission is common in IMN, and there are adverse effects of immunosuppressive therapy, it is important to assess the risk of progressive loss of renal function before deciding whether and when to initiate immunosuppressive therapy. Therefore, this study aimed to establish a risk prediction model to predict patient prognosis and treatment response to help clinicians evaluate patient prognosis and decide on the best treatment regimen.

METHODS

From September 2019 to December 2020, a total of 232 newly diagnosed IMN patients from three hospitals in Liaoning Province were enrolled. Logistic regression analysis selected the risk factors affecting the prognosis, and a dynamic online nomogram prognostic model was constructed based on extreme gradient boost, random forest, logistic regression machine learning algorithms. Receiver operating characteristic and calibration curves and decision curve analysis were utilized to assess the performance and clinical utility of the developed model.

RESULTS

A total of 130 patients were in the training cohort and 102 patients in the validation cohort. Logistic regression analysis identified four risk factors: course ≥ 6 months, UTP, D-dimer and sPLA2R-Ab. The random forest algorithm showed the best performance with the highest AUROC (0.869). The nomogram had excellent discrimination ability, calibration ability and clinical practicability in both the training cohort and the validation cohort.

CONCLUSIONS

The dynamic online nomogram model can effectively assess the prognosis and treatment response of IMN patients. This will help clinicians assess the patient's prognosis more accurately, communicate with the patient in advance, and jointly select the most appropriate treatment plan.

Deep learning-based pathological prediction of lymph node metastasis for patient with renal cell carcinoma from primary whole slide images

BACKGROUND

Metastasis renal cell carcinoma (RCC) patients have extremely high mortality rate. A predictive model for RCC micrometastasis based on pathomics could be beneficial for clinicians to make treatment decisions.

METHODS

A total of 895 formalin-fixed and paraffin-embedded whole slide images (WSIs) derived from three cohorts, including Shanghai General Hospital (SGH), Clinical Proteomic Tumor Analysis Consortium (CPTAC) and Cancer Genome Atlas (TCGA) cohorts, and another 588 frozen section WSIs from TCGA dataset were involved in the study. The deep learning-based strategy for predicting lymphatic metastasis was developed based on WSIs through clustering-constrained-attention multiple-instance learning method and verified among the three cohorts. The performance of the model was further verified in frozen-pathological sections. In addition, the model was also tested the prognosis prediction of patients with RCC in multi-source patient cohorts.

RESULTS

The AUC of the lymphatic metastasis prediction performance was 0.836, 0.865 and 0.812 in TCGA, SGH and CPTAC cohorts, respectively. The performance on frozen section WSIs was with the AUC of 0.801. Patients with high deep learning-based prediction of lymph node metastasis values showed worse prognosis.

CONCLUSIONS

In this study, we developed and verified a deep learning-based strategy for predicting lymphatic metastasis from primary RCC WSIs, which could be applied in frozen-pathological sections and act as a prognostic factor for RCC to distinguished patients with worse survival outcomes.

Dynamic changes of SCGN expression imply different phases of clear cell renal cell carcinoma progression

The secretagogin (SCGN) was originally identified as a secreted calcium-binding protein present in the cytoplasm. Recent studies have found that SCGN has a close relationship with cancer. However, its role in the occurrence, progression, and prognosis of clear cell renal cell carcinoma (ccRCC) remains unclear. In this study, we utilized a mutual authentication method based on public databases and clinical samples to determine the role of SCGN in the progression and prognosis of ccRCC. Firstly, we comprehensively analyzed the expression characteristics of SCGN in ccRCC in several public databases. Subsequently, we systematically evaluated SCGN expression on 252 microarrays of ccRCC tissues from different grades. It was found that SCGN was absent in all the normal kidney tissues and significantly overexpressed in ccRCC tumor tissues. In addition, the expression level of SCGN gradually decreased with an increase in tumor grade, and the percentage of SCGN staining positivity over 50% was 86.7% (13/15) and 73.4% (58/79) in Grade1 and Grade2, respectively, while it was only 8.3% (12/144) in Grade3, and the expression of SCGN was completely absent in Grade4 (0/14) and distant metastasis group (0/4). Additionally, the expression of SCGN was strongly correlated with the patient's prognosis, with the higher the expression levels of SCGN being associated with longer overall survival and disease-free survival of patients. In conclusion, our results suggest that reduced expression of SCGN in cancer cells is correlated with the progression and prognosis of ccRCC.

Clinical Application of Digital and Computational Pathology in Renal Cell Carcinoma: A Systematic Review

CONTEXT

Computational pathology is a new interdisciplinary field that combines traditional pathology with modern technologies such as digital imaging and machine learning to better understand the diagnosis, prognosis, and natural history of many diseases.

OBJECTIVE

To provide an overview of digital and computational pathology and its current and potential applications in renal cell carcinoma (RCC).

EVIDENCE ACQUISITION

A systematic review of the English-language literature was conducted using the PubMed, Web of Science, and Scopus databases in December 2022 according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines (PROSPERO ID: CRD42023389282). Risk of bias was assessed according to the Prediction Model Study Risk of Bias Assessment Tool.

EVIDENCE SYNTHESIS

In total, 20 articles were included in the review. All the studies used a retrospective design, and all digital pathology techniques were implemented retrospectively. The studies were classified according to their primary objective: detection, tumor characterization, and patient outcome. Regarding the transition to clinical practice, several studies showed promising potential. However, none presented a comprehensive assessment of clinical utility and implementation. Notably, there was substantial heterogeneity for both the strategies used for model building and the performance metrics reported.

CONCLUSIONS

This review highlights the vast potential of digital and computational pathology for the detection, classification, and assessment of oncological outcomes in RCC. Preliminary work in this field has yielded promising results. However, these models have not yet reached a stage where they can be integrated into routine clinical practice.

PATIENT SUMMARY

Computational pathology combines traditional pathology and technologies such as digital imaging and artificial intelligence to improve diagnosis of disease and identify prognostic factors and new biomarkers. The number of studies exploring its potential in kidney cancer is rapidly increasing. However, despite the surge in research activity, computational pathology is not yet ready for widespread routine use.

Pathomics Signature for Prognosis and Chemotherapy Benefits in Stage III Colon Cancer

Importance

The current TNM staging system may not provide adequate information for prognostic purposes and to assess the potential benefits of chemotherapy for patients with stage III colon cancer.

Objective

To develop and validate a pathomics signature to estimate prognosis and benefit from chemotherapy using hematoxylin-eosin (H-E)-stained slides.

Design, Setting, and Participants

This retrospective prognostic study used data from consecutive patients with histologically confirmed stage III colon cancer at 2 medical centers between January 2012 and December 2015. A total of 114 pathomics features were extracted from digital H-E-stained images from Nanfang Hospital of Southern Medical University, Guangzhou, China, and a pathomics signature was constructed using a least absolute shrinkage and selection operator Cox regression model in the training cohort. The associations of the pathomics signature with disease-free survival (DFS) and overall survival (OS) were evaluated. Patients at the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China, formed the validation cohort. Data analysis was conducted from September 2022 to March 2023.

Main Outcomes and Measures

The prognostic accuracy of the pathomics signature as well as its association with chemotherapy response were evaluated.

Results

This study included 785 patients (mean [SD] age, 62.7 [11.1] years; 437 [55.7%] male). A pathomics signature was constructed based on 4 features. Multivariable analysis revealed that the pathomics signature was an independent factor associated with DFS (hazard ratio [HR], 2.46 [95% CI, 2.89-4.13]; P < .001) and OS (HR, 2.78 [95% CI, 2.34-3.31]; P < .001) in the training cohort. Incorporating the pathomics signature into pathomics nomograms resulted in better performance for the estimation of prognosis than the traditional model in a concordance index comparison in the training cohort (DFS: HR, 0.88 [95% CI, 0.86-0.89] vs HR, 0.73 [95% CI, 0.71-0.75]; P < .001; OS: HR, 0.85 [95% CI, 0.84-0.86] vs HR, 0.74 [95% CI, 0.72-0.76]; P < .001) and validation cohort (DFS: HR, 0.83 [95% CI, 0.82-0.85] vs HR, 0.70 [95% CI, 0.67-0.72]; P < .001; OS: HR, 0.80 [95% CI, 0.78-0.82] vs HR, 0.69 [0.67-0.72]; P < .001). Further analysis revealed that patients with a low pathomics signature were more likely to benefit from chemotherapy (eg, combined cohort: DFS: HR, 0.44 [95% CI, 0.28-0.69]; P = .001; OS: HR, 0.43 [95% CI, 0.29-0.64]; P < .001).

Conclusions and Relevance

These findings suggest that a pathomics signature could help identify patients most likely to benefit from chemotherapy in stage III colon cancer.

Deep learning-based multi-model prediction for disease-free survival status of patients with clear cell renal cell carcinoma after surgery: a multicenter cohort study

BACKGROUND

Although separate analysis of individual factor can somewhat improve the prognostic performance, integration of multimodal information into a single signature is necessary to stratify patients with clear cell renal cell carcinoma (ccRCC) for adjuvant therapy after surgery.

METHODS

A total of 414 patients with whole slide images, computed tomography images, and clinical data from three patient cohorts were retrospectively analyzed. The authors performed deep learning and machine learning algorithm to construct three single-modality prediction models for disease-free survival of ccRCC based on whole slide images, cell segmentation, and computed tomography images, respectively. A multimodel prediction signature (MMPS) for disease-free survival were further developed by combining three single-modality prediction models and tumor stage/grade system. Prognostic performance of the prognostic model was also verified in two independent validation cohorts.

RESULTS

Single-modality prediction models performed well in predicting the disease-free survival status of ccRCC. The MMPS achieved higher area under the curve value of 0.742, 0.917, and 0.900 in three independent patient cohorts, respectively. MMPS could distinguish patients with worse disease-free survival, with HR of 12.90 (95% CI: 2.443-68.120, P <0.0001), 11.10 (95% CI: 5.467-22.520, P <0.0001), and 8.27 (95% CI: 1.482-46.130, P <0.0001) in three different patient cohorts. In addition, MMPS outperformed single-modality prediction models and current clinical prognostic factors, which could also provide complements to current risk stratification for adjuvant therapy of ccRCC.

CONCLUSION

Our novel multimodel prediction analysis for disease-free survival exhibited significant improvements in prognostic prediction for patients with ccRCC. After further validation in multiple centers and regions, the multimodal system could be a potential practical tool for clinicians in the treatment for ccRCC patients.

Applying image features of proximal paracancerous tissues in predicting prognosis of patients with hepatocellular carcinoma

BACKGROUND

Most of the methods using digital pathological image for predicting Hepatocellular carcinoma (HCC) prognosis have not considered paracancerous tissue microenvironment (PTME), which are potentially important for tumour initiation and metastasis. This study aimed to identify roles of image features of PTME in predicting prognosis and tumour recurrence of HCC patients.

METHODS

We collected whole slide images (WSIs) of 146 HCC patients from Sun Yat-sen Memorial Hospital (SYSM dataset). For each WSI, five types of regions of interests (ROIs) in PTME and tumours were manually annotated. These ROIs were used to construct a Lasso Cox survival model for predicting the prognosis of HCC patients. To make the model broadly useful, we established a deep learning method to automatically segment WSIs, and further used it to construct a prognosis prediction model. This model was tested by the samples of 225 HCC patients from the Cancer Genome Atlas Liver Hepatocellular Carcinoma (TCGA-LIHC).

RESULTS

In predicting prognosis of the HCC patients, using the image features of manually annotated ROIs in PTME achieved C-index 0.668 in the SYSM testing dataset, which is higher than the C-index 0.648 reached by the model only using image features of tumours. Integrating ROIs of PTME and tumours achieved C-index 0.693 in the SYSM testing dataset. The model using automatically segmented ROIs of PTME and tumours achieved C-index of 0.665 (95% CI: 0.556-0.774) in the TCGA-LIHC samples, which is better than the widely used methods, WSISA (0.567), DeepGraphSurv (0.593), and SeTranSurv (0.642). Finally, we found the Texture SumAverage Skew HV on immune cell infiltration and Texture related features on desmoplastic reaction are the most important features of PTME in predicting HCC prognosis. We additionally used the model in prediction HCC recurrence for patients from SYSM-training, SYSM-testing, and TCGA-LIHC datasets, indicating the important roles of PTME in the prediction.

CONCLUSIONS

Our results indicate image features of PTME is critical for improving the prognosis prediction of HCC. Moreover, the image features related with immune cell infiltration and desmoplastic reaction of PTME are the most important factors associated with prognosis of HCC.

Demographic bias in misdiagnosis by computational pathology models

Despite increasing numbers of regulatory approvals, deep learning-based computational pathology systems often overlook the impact of demographic factors on performance, potentially leading to biases. This concern is all the more important as computational pathology has leveraged large public datasets that underrepresent certain demographic groups. Using publicly available data from The Cancer Genome Atlas and the EBRAINS brain tumor atlas, as well as internal patient data, we show that whole-slide image classification models display marked performance disparities across different demographic groups when used to subtype breast and lung carcinomas and to predict IDH1 mutations in gliomas. For example, when using common modeling approaches, we observed performance gaps (in area under the receiver operating characteristic curve) between white and Black patients of 3.0% for breast cancer subtyping, 10.9% for lung cancer subtyping and 16.0% for IDH1 mutation prediction in gliomas. We found that richer feature representations obtained from self-supervised vision foundation models reduce performance variations between groups. These representations provide improvements upon weaker models even when those weaker models are combined with state-of-the-art bias mitigation strategies and modeling choices. Nevertheless, self-supervised vision foundation models do not fully eliminate these discrepancies, highlighting the continuing need for bias mitigation efforts in computational pathology. Finally, we demonstrate that our results extend to other demographic factors beyond patient race. Given these findings, we encourage regulatory and policy agencies to integrate demographic-stratified evaluation into their assessment guidelines.

Artificial Intelligence in Pathomics and Genomics of Renal Cell Carcinoma

The integration of artificial intelligence (AI) with histopathology images and gene expression patterns has led to the emergence of the dynamic fields of pathomics and genomics. These fields have revolutionized renal cell carcinoma (RCC) diagnosis and subtyping and improved survival prediction models. Machine learning has identified unique gene patterns across RCC subtypes and grades, providing insights into RCC origins and potential treatments, as targeted therapies. The combination of pathomics and genomics using AI opens new avenues in RCC research, promising future breakthroughs and innovations that patients and physicians can anticipate.

The Molecular Twin artificial-intelligence platform integrates multi-omic data to predict outcomes for pancreatic adenocarcinoma patients

Contemporary analyses focused on a limited number of clinical and molecular biomarkers have been unable to accurately predict clinical outcomes in pancreatic ductal adenocarcinoma. Here we describe a precision medicine platform known as the Molecular Twin consisting of advanced machine-learning models and use it to analyze a dataset of 6,363 clinical and multi-omic molecular features from patients with resected pancreatic ductal adenocarcinoma to accurately predict disease survival (DS). We show that a full multi-omic model predicts DS with the highest accuracy and that plasma protein is the top single-omic predictor of DS. A parsimonious model learning only 589 multi-omic features demonstrated similar predictive performance as the full multi-omic model. Our platform enables discovery of parsimonious biomarker panels and performance assessment of outcome prediction models learning from resource-intensive panels. This approach has considerable potential to impact clinical care and democratize precision cancer medicine worldwide.

Multiparametric MRI-based radiomics combined with pathomics features for prediction of the efficacy of neoadjuvant chemotherapy in breast cancer

Purpose

The aim of this study is to investigate a new method that combines radiological and pathological breast cancer information to predict discrepancies in pathological responses for individualized treatment planning. We used baseline multiparametric magnetic resonance imaging and hematoxylin and eosin-stained biopsy slides to extract quantitative feature information and predict the pathological response to neoadjuvant chemotherapy in breast cancer patients.

Methods

We retrospectively collected data from breast cancer patients who received neoadjuvant chemotherapy in our hospital from August 2016 to January 2018; multiparametric magnetic resonance imaging (contrast-enhanced T1-weighted imaging and diffusion-weighted imaging) and whole slide image of hematoxylin and eosin-stained biopsy sections were collected. Quantitative imaging features were extracted from the multiparametric magnetic resonance imaging and the whole slide image were used to construct a radiopathomics signature model powered by machine learning methods. Models based on multiparametric magnetic resonance imaging or whole slide image alone were also constructed for comparison and referred to as the radiomics signature and pathomics signature models, respectively. Four modeling methods were used to establish prediction models. Model performances were evaluated using receiver operating characteristic curve analysis and the area under the curve, accuracy, sensitivity, specificity, positive predictive value, and negative predictive value.

Results

The radiopathomics signature model had favourable performance for the prediction of pathological complete response in the training set (the best value: area under the curve 0.83, accuracy 0.84, and sensitivity 0.87), and in the test set (the best value: area under the curve 0.91, accuracy 0.90, and sensitivity 0.88). In the test set, the radiopathomics signature model also significantly outperformed the radiomics signature (the best value: area under the curve 0.83, accuracy 0.64, and sensitivity 0.62), pathomics signature (the best value: area under the curve 0.60, accuracy 0.74, and sensitivity 0.62) (p > 0.05). Decision curve analysis and calibration curves confirmed the excellent performance of these prediction models in discrimination, calibration, and clinical usefulness.

Conclusions

The results of this study suggest that radiopathomics, the combination of both radiological information regarding the whole tumor and pathological information at the cellular level, could potentially predict discrepancies in pathological response and provide evidence for rational treatment plans.

Association of the pathomics-collagen signature with lymph node metastasis in colorectal cancer: a retrospective multicenter study

BACKGROUND

Lymph node metastasis (LNM) is a prognostic biomarker and affects therapeutic selection in colorectal cancer (CRC). Current evaluation methods are not adequate for estimating LNM in CRC. H&E images contain much pathological information, and collagen also affects the biological behavior of tumor cells. Hence, the objective of the study is to investigate whether a fully quantitative pathomics-collagen signature (PCS) in the tumor microenvironment can be used to predict LNM.

METHODS

Patients with histologically confirmed stage I-III CRC who underwent radical surgery were included in the training cohort (n = 329), the internal validation cohort (n = 329), and the external validation cohort (n = 315). Fully quantitative pathomics features and collagen features were extracted from digital H&E images and multiphoton images of specimens, respectively. LASSO regression was utilized to develop the PCS. Then, a PCS-nomogram was constructed incorporating the PCS and clinicopathological predictors for estimating LNM in the training cohort. The performance of the PCS-nomogram was evaluated via calibration, discrimination, and clinical usefulness. Furthermore, the PCS-nomogram was tested in internal and external validation cohorts.

RESULTS

By LASSO regression, the PCS was developed based on 11 pathomics and 9 collagen features. A significant association was found between the PCS and LNM in the three cohorts (P < 0.001). Then, the PCS-nomogram based on PCS, preoperative CEA level, lymphadenectasis on CT, venous emboli and/or lymphatic invasion and/or perineural invasion (VELIPI), and pT stage achieved AUROCs of 0.939, 0.895, and 0.893 in the three cohorts. The calibration curves identified good agreement between the nomogram-predicted and actual outcomes. Decision curve analysis indicated that the PCS-nomogram was clinically useful. Moreover, the PCS was still an independent predictor of LNM at station Nos. 1, 2, and 3. The PCS nomogram displayed AUROCs of 0.849-0.939 for the training cohort, 0.837-0.902 for the internal validation cohort, and 0.851-0.895 for the external validation cohorts in the three nodal stations.

CONCLUSIONS

This study proposed that PCS integrating pathomics and collagen features was significantly associated with LNM, and the PCS-nomogram has the potential to be a useful tool for predicting individual LNM in CRC patients.

Machine Learning-Based Integration Develops a Macrophage-Related Index for Predicting Prognosis and Immunotherapy Response in Lung Adenocarcinoma

BACKGROUND

Macrophages play a critical role in tumor immune microenvironment (TIME) formation and cancer progression in lung adenocarcinoma (LUAD). However, few studies have comprehensively and systematically described the characteristics of macrophages in LUAD.

METHODS

This study identified macrophage-related markers with single-cell RNA sequencing data from the GSE189487 dataset. An integrative machine learning-based procedure based on 10 algorithms was developed to construct a macrophage-related index (MRI) in The Cancer Genome Atlas (TCGA), GSE30219, GSE31210, and GSE72094 datasets. Several algorithms were used to evaluate the associations of MRI with TIME and immunotherapy-related biomarkers. The role of MRI in predicting the immunotherapy response was evaluated with the GSE91061 dataset.

RESULTS

The optimal MRI constructed by the combination of the Lasso algorithm and plsRCox was an independent risk factor in LUAD and showed a stable and powerful performance in predicting the overall survival rate of patients with LUAD. Those with low MRI scores had a higher TIME score, a higher level of immune cells, a higher immunophenoscore, and a lower Tumor Immune Dysfunction and Exclusion (TIDE) score, indicating a better response to immunotherapy. The IC50 value of common drugs for chemotherapy and target therapy with low MRI scores was higher compared to high MRI scores. Moreover, the survival prediction nomogram, developed from MRI, had good potential for clinical application in predicting the 1-, 3-, and 5-year overall survival rate of LUAD.

CONCLUSION

Our study constructed for the first time a consensus MRI for LUAD with 10 machine learning algorithms. The MRI could be helpful for risk stratification, prognosis, and selection of treatment approach in LUAD.

Empowering Renal Cancer Management with AI and Digital Pathology: Pathology, Diagnostics and Prognosis

Renal cell carcinoma is a significant health burden worldwide, necessitating accurate and efficient diagnostic methods to guide treatment decisions. Traditional pathology practices have limitations, including interobserver variability and time-consuming evaluations. In recent years, digital pathology tools emerged as a promising solution to enhance the diagnosis and management of renal cancer. This review aims to provide a comprehensive overview of the current state and potential of digital pathology in the context of renal cell carcinoma. Through advanced image analysis algorithms, artificial intelligence (AI) technologies facilitate quantification of cellular and molecular markers, leading to improved accuracy and reproducibility in renal cancer diagnosis. Digital pathology platforms empower remote collaboration between pathologists and help with the creation of comprehensive databases for further research and machine learning applications. The integration of digital pathology tools with other diagnostic modalities, such as radiology and genomics, enables a novel multimodal characterization of different types of renal cell carcinoma. With continuous advancements and refinement, AI technologies are expected to play an integral role in diagnostics and clinical decision-making, improving patient outcomes. In this article, we explored the digital pathology instruments available for clear cell, papillary and chromophobe renal cancers from pathologist and data analyst perspectives.

Multiphase CT radiomics nomogram for preoperatively predicting the WHO/ISUP nuclear grade of small (< 4 cm) clear cell renal cell carcinoma

BACKGROUND

Small (< 4 cm) clear cell renal cell carcinoma (ccRCC) is the most common type of small renal cancer and its prognosis is poor. However, conventional radiological characteristics obtained by computed tomography (CT) are not sufficient to predict the nuclear grade of small ccRCC before surgery.

METHODS

A total of 113 patients with histologically confirmed ccRCC were randomly assigned to the training set (n = 67) and the testing set (n = 46). The baseline and CT imaging data of the patients were evaluated statistically to develop a clinical model. A radiomics model was created, and the radiomics score (Rad-score) was calculated by extracting radiomics features from the CT images. Then, a clinical radiomics nomogram was developed using multivariate logistic regression analysis by combining the Rad-score and critical clinical characteristics. The receiver operating characteristic (ROC) curve was used to evaluate the discrimination of small ccRCC in both the training and testing sets.

RESULTS

The radiomics model was constructed using six features obtained from the CT images. The shape and relative enhancement value of the nephrographic phase (REV of the NP) were found to be independent risk factors in the clinical model. The area under the curve (AUC) values for the training and testing sets for the clinical radiomics nomogram were 0.940 and 0.902, respectively. Decision curve analysis (DCA) revealed that the radiomics nomogram model was a better predictor, with the highest degree of coincidence.

CONCLUSION

The CT-based radiomics nomogram has the potential to be a noninvasive and preoperative method for predicting the WHO/ISUP grade of small ccRCC.

Application of radiomics-based multiomics combinations in the tumor microenvironment and cancer prognosis

The advent of immunotherapy, a groundbreaking advancement in cancer treatment, has given rise to the prominence of the tumor microenvironment (TME) as a critical area of research. The clinical implications of an improved understanding of the TME are significant and far-reaching. Radiomics has been increasingly utilized in the comprehensive assessment of the TME and cancer prognosis. Similarly, the advancement of pathomics, which is based on pathological images, can offer additional insights into the panoramic view and microscopic information of tumors. The combination of pathomics and radiomics has revolutionized the concept of a "digital biopsy". As genomics and transcriptomics continue to evolve, integrating radiomics with genomic and transcriptomic datasets can offer further insights into tumor and microenvironment heterogeneity and establish correlations with biological significance. Therefore, the synergistic analysis of digital image features (radiomics, pathomics) and genetic phenotypes (genomics) can comprehensively decode and characterize the heterogeneity of the TME as well as predict cancer prognosis. This review presents a comprehensive summary of the research on important radiomics biomarkers for predicting the TME, emphasizing the interplay between radiomics, genomics, transcriptomics, and pathomics, as well as the application of multiomics in decoding the TME and predicting cancer prognosis. Finally, we discuss the challenges and opportunities in multiomics research. In conclusion, this review highlights the crucial role of radiomics and multiomics associations in the assessment of the TME and cancer prognosis. The combined analysis of radiomics, pathomics, genomics, and transcriptomics is a promising research direction with substantial research significance and value for comprehensive TME evaluation and cancer prognosis assessment.

Immune modulation during anti-cancer radio(immuno)therapy

Cancer can affect all human organs and tissues and ranks as a prominent cause of death as well as an obstruction to increasing life expectancy. A notable breakthrough in oncology has been the inclusion of the immune system in fighting cancer, potentially prolonging life and providing long-term benefits. The concept of "immunotherapy" has been discussed from the 19th and early 20th centuries by Wilhelm Busch, William B. Coley and Paul Ehrlich. This involves distinct approaches, including vaccines, non-specific cytokines and adoptive cell therapies. However, despite the advances made in recent years, questions on how to select the best therapeutic options or how to select the best combinations to improve clinical outcomes are still relevant for scientists and clinicians. More than half of cancer patients receive radiotherapy (RT) as part of their treatment. With the advances in RT and immunotherapy approaches, it is reasonable to consider how to enhance immunotherapy with radiation and vice versa, and to investigate whether combinations of these therapies would be beneficial. In this chapter, we will discuss how the immune system responds to cancer cells and different cancer therapies with a focus on combination of RT and immunotherapy (radioimmunotherapy, RIT).

Artificial Intelligence in Renal Cell Carcinoma Histopathology: Current Applications and Future Perspectives

Renal cell carcinoma (RCC) is characterized by its diverse histopathological features, which pose possible challenges to accurate diagnosis and prognosis. A comprehensive literature review was conducted to explore recent advancements in the field of artificial intelligence (AI) in RCC pathology. The aim of this paper is to assess whether these advancements hold promise in improving the precision, efficiency, and objectivity of histopathological analysis for RCC, while also reducing costs and interobserver variability and potentially alleviating the labor and time burden experienced by pathologists. The reviewed AI-powered approaches demonstrate effective identification and classification abilities regarding several histopathological features associated with RCC, facilitating accurate diagnosis, grading, and prognosis prediction and enabling precise and reliable assessments. Nevertheless, implementing AI in renal cell carcinoma generates challenges concerning standardization, generalizability, benchmarking performance, and integration of data into clinical workflows. Developing methodologies that enable pathologists to interpret AI decisions accurately is imperative. Moreover, establishing more robust and standardized validation workflows is crucial to instill confidence in AI-powered systems' outcomes. These efforts are vital for advancing current state-of-the-art practices and enhancing patient care in the future.

Stimulated Raman histology as a method to determine the adequacy of renal mass biopsy and identify malignant subtypes of renal cell carcinoma

INTRODUCTION

Renal tumor biopsy requires adequate tissue sampling to aid in the investigation of small renal masses. In some centers the contemporary nondiagnostic renal mass biopsy rate may be as high as 22% and may be as high as 42% in challenging cases. Stimulated Raman Histology (SRH) is a novel microscopic technique which has created the possibility for rapid, label-free, high-resolution images of unprocessed tissue which may be viewed on standard radiology viewing platforms. The application of SRH to renal biopsy may provide the benefits of routine pathologic evaluation during the procedure, thereby reducing nondiagnostic results. We conducted a pilot feasibility study, to assess if renal cell carcinoma (RCC) subtypes may be imaged and to see if high-quality hematoxylin and eosin (H&E) could subsequently be generated.

METHODS/MATERIALS

An 18-gauge core needle biopsy was taken from a series of 25 ex vivo radical or partial nephrectomy specimens. Histologic images of the fresh, unstained biopsy samples were obtained using a SRH microscope using 2 Raman shifts: 2,845 cm-1 and 2,930 cm-1. The cores were then processed as per routine pathologic protocols. The SRH images and hematoxylin and eosin (H&E) slides were then viewed by a genitourinary pathologist.

RESULTS

The SRH microscope took 8 to 11 minutes to produce high-quality images of the renal biopsies. Total of 25 renal tumors including 1 oncocytoma, 3 chromophobe RCC, 16 clear cells RCC, 4 papillary RCC, and 1 medullary RCC were included. All renal tumor subtypes were captured, and the SRH images were easily differentiated from adjacent normal renal parenchyma. High quality H&E slides were produced from each of the renal biopsies after SRH was completed. Immunostains were performed on selected cases and the staining was not affected by the SRH image process.

CONCLUSION

SRH produces high quality images of all renal cell subtypes that can be rapidly produced and easily interpreted to determine renal mass biopsy adequacy, and on occasion, may allow renal tumor subtype identification. Renal biopsies remained available to produce high quality H&E slides and immunostains for confirmation of diagnosis. Procedural application has promise to decrease the known rate of renal mass nondiagnostic biopsies, and application of convolutional neural network methodology may further improve diagnostic capability and increase utilization of renal mass biopsy among urologists.

Screening and identification of prognostic genes associated with eosinophilic features of clear cell renal cell carcinoma

Clear cell renal cell carcinoma (ccRCC) is the most common subtype of renal cell carcinoma, which is characterized by transparent cytoplasm. However, some ccRCC also show eosinophilic cytoplasm, and the molecular difference between eosinophilic and clear subtypes is unclear. In this study, we uncovered that under an optical microscope ccRCC with eosinophilic features has a poor prognosis. Eosinophilic ccRCC tends to have a higher histologic grade. Eosinophilic ccRCC has 16 genes significantly up-regulated compared with ccRCC, of which seven genes have multi-cohort validation prognostic value. Immune infiltration analysis suggested a low number of M1 macrophages and NK tissue-resident cells in eosinophilic ccRCC. Enrichment analysis suggests that ccRCC with eosinophilic features may be closely associated with the transport and metabolism of many substances. The findings of this study have important implications for the study of the malignant transformation of ccRCC.

Development and validation of a radiopathomic model for predicting pathologic complete response to neoadjuvant chemotherapy in breast cancer patients

BACKGROUND

Neoadjuvant chemotherapy (NAC) has become the standard therapeutic option for early high-risk and locally advanced breast cancer. However, response rates to NAC vary between patients, causing delays in treatment and affecting the prognosis for patients who do not sensitive to NAC.

MATERIALS AND METHODS

In total, 211 breast cancer patients who completed NAC (training set: 155, validation set: 56) were retrospectively enrolled. we developed a deep learning radiopathomics model(DLRPM) by Support Vector Machine (SVM) method based on clinicopathological features, radiomics features, and pathomics features. Furthermore, we comprehensively validated the DLRPM and compared it with three single-scale signatures.

RESULTS

DLRPM had favourable performance for the prediction of pathological complete response (pCR) in the training set (AUC 0.933[95% CI 0.895-0.971]), and in the validation set (AUC 0.927 [95% CI 0.858-0.996]). In the validation set, DLRPM also significantly outperformed the radiomics signature (AUC 0.821[0.700-0.942]), pathomics signature (AUC 0.766[0.629-0.903]), and deep learning pathomics signature (AUC 0.804[0.683-0.925]) (all p < 0.05). The calibration curves and decision curve analysis also indicated the clinical effectiveness of the DLRPM.

CONCLUSIONS

DLRPM can help clinicians accurately predict the efficacy of NAC before treatment, highlighting the potential of artificial intelligence to improve the personalized treatment of breast cancer patients.

A domain knowledge enhanced yield based deep learning classifier identifies perineural invasion in oral cavity squamous cell carcinoma

BACKGROUND

Perineural invasion (PNI), a form of local invasion defined as the ability of cancer cells to invade in, around, and through nerves, has a negative prognostic impact in oral cavity squamous cell carcinoma (OCSCC). Unfortunately, the diagnosis of PNI suffers from a significant degree of intra- and interobserver variability. The aim of this pilot study was to develop a deep learning-based human-enhanced tool, termed domain knowledge enhanced yield (Domain-KEY) algorithm, for identifying PNI in digital slides.

METHODS

Hematoxylin and eosin (H&E)-stained whole-slide images (WSIs, n = 85) were obtained from 80 patients with OCSCC. The model structure consisted of two parts to simulate human decision-making skills in diagnostic pathology. To this aim, two semantic segmentation models were constructed (i.e., identification of nerve fibers followed by the diagnosis of PNI). The inferred results were subsequently subjected to post-processing of generated decision rules for diagnostic labeling. Ten H&E-stained WSIs not previously used in the study were read and labeled by the Domain-KEY algorithm. Thereafter, labeling correctness was visually inspected by two independent pathologists.

RESULTS

The Domain-KEY algorithm was found to outperform the ResnetV2_50 classifier for the detection of PNI (diagnostic accuracy: 89.01% and 61.94%, respectively). On analyzing WSIs, the algorithm achieved a mean diagnostic accuracy as high as 97.50% versus traditional pathology. The observed accuracy in a validation dataset of 25 WSIs obtained from seven patients with oropharyngeal (cancer of the tongue base, n = 1; tonsil cancer, n = 1; soft palate cancer, n = 1) and hypopharyngeal (cancer of posterior wall, n = 2; pyriform sinus cancer, n = 2) malignancies was 96%. Notably, the algorithm was successfully applied in the analysis of WSIs to shorten the time required to reach a diagnosis. The addition of the hybrid intelligence model decreased the mean time required to reach a diagnosis by 15.0% and 23.7% for the first and second pathologists, respectively. On analyzing digital slides, the tool was effective in supporting human diagnostic thinking.

CONCLUSIONS

The Domain-KEY algorithm successfully mimicked human decision-making skills and supported expert pathologists in the routine diagnosis of PNI.

Machine learning approaches for biomolecular, biophysical, and biomaterials research

A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.