Artificial intelligence in histopathology: enhancing cancer research and clinical oncology

Classifying breast cancer and fibroadenoma tissue biopsies from paraffined stain-free slides by fractal biomarkers in Fourier Ptychographic Microscopy

Breast cancer is one of the most spread and monitored pathologies in high-income countries. After breast biopsy, histological tissue is stored in paraffin, sectioned and mounted. Conventional inspection of tissue slides under benchtop light microscopes involves paraffin removal and staining, typically with H&E. Then, expert pathologists are called to judge the stained slides. However, paraffin removal and staining are operator-dependent, time and resources consuming processes that can generate ambiguities due to non-uniform staining. Here we propose a novel method that can work directly on paraffined stain-free slides. We use Fourier Ptychography as a quantitative phase-contrast microscopy method, which allows accessing a very wide field of view (i.e., mm2) in one single image while guaranteeing high lateral resolution (i.e., 0.5 µm). This imaging method is multi-scale, since it enables looking at the big picture, i.e. the complex tissue structure and connections, with the possibility to zoom-in up to the single-cell level. To handle this informative image content, we introduce elements of fractal geometry as multi-scale analysis method. We show the effectiveness of fractal features in describing and classifying fibroadenoma and breast cancer tissue slides from ten patients with very high accuracy. We reach 94.0 ± 4.2% test accuracy in classifying single images. Above all, we show that combining the decisions of the single images, each patient's slide can be classified with no error. Besides, fractal geometry returns a guide map to help pathologist to judge the different tissue portions based on the likelihood these can be associated to a breast cancer or fibroadenoma biomarker. The proposed automatic method could significantly simplify the steps of tissue analysis and make it independent from the sample preparation, the skills of the lab operator and the pathologist.

External validation of a deep learning-based algorithm for detection of tall cells in papillary thyroid carcinoma: A multicenter study

The tall cell subtype (TC-PTC) is an aggressive subtype of papillary thyroid carcinoma (PTC). The TC-PTC is defined as a PTC comprising at least 30% epithelial cells that are three times as tall as they are wide. In practice, this definition is difficult to adhere to, resulting in high inter-observer variability. In this multicenter study, we validated a previously trained deep learning (DL)-based algorithm for detection of tall cells on 160 externally collected hematoxylin and eosin (HE)-stained PTC whole-slide images. In a test set of 360 manual annotations of regions of interest from 18 separate tissue sections in the external dataset, the DL-based algorithm detected TCs with a sensitivity of 90.6% and a specificity of 88.5%. The DL algorithm detected non-TC areas with a sensitivity of 81.6% and a specificity of 92.9%. In the validation datasets, 20% and 30% TC thresholds correlated with a significantly shorter relapse-free survival. In conclusion, the DL algorithm detected TCs in unseen, external scanned HE tissue slides with high sensitivity and specificity without any retraining.

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities

This paper discusses some overlooked challenges faced when working with machine learning models for histopathology and presents a novel opportunity to support "Learning Health Systems" with them. Initially, the authors elaborate on these challenges after separating them according to their mitigation strategies: those that need innovative approaches, time, or future technological capabilities and those that require a conceptual reappraisal from a critical perspective. Then, a novel opportunity to support "Learning Health Systems" by integrating hidden information extracted by ML models from digitalized histopathology slides with other healthcare big data is presented.

Harnessing Artificial Intelligence for the Detection and Management of Colorectal Cancer Treatment

Currently, eight million people in the United States suffer from cancer and it is a major global health concern. Early detection and interventions are urgently needed for all cancers, including colorectal cancer. Colorectal cancer is the third most common type of cancer worldwide. Based on the diagnostic efforts to general awareness and lifestyle choices, it is understandable why colorectal cancer is so prevalent today. There is a notable lack of awareness concerning the impact of this cancer and its connection to lifestyle elements, as well as people sometimes mistaking symptoms for a different gastrointestinal condition. Artificial intelligence (AI) may assist in the early detection of all cancers, including colorectal cancer. The usage of AI has exponentially grown in healthcare through extensive research, and since clinical implementation, it has succeeded in improving patient lifestyles, modernizing diagnostic processes, and innovating current treatment strategies. Numerous challenges arise for patients with colorectal cancer and oncologists alike during treatment. For initial screening phases, conventional methods often result in misdiagnosis. Moreover, after detection, determining the course of which colorectal cancer can sometimes contribute to treatment delays. This article touches on recent advancements in AI and its clinical application while shedding light on why this disease is so common today.

Aggregation-Induced Emission Luminogen: Role in Biopsy for Precision Medicine

Biopsy, including tissue and liquid biopsy, offers comprehensive and real-time physiological and pathological information for disease detection, diagnosis, and monitoring. Fluorescent probes are frequently selected to obtain adequate information on pathological processes in a rapid and minimally invasive manner based on their advantages for biopsy. However, conventional fluorescent probes have been found to show aggregation-caused quenching (ACQ) properties, impeding greater progresses in this area. Since the discovery of aggregation-induced emission luminogen (AIEgen) have promoted rapid advancements in molecular bionanomaterials owing to their unique properties, including high quantum yield (QY) and signal-to-noise ratio (SNR), etc. This review seeks to present the latest advances in AIEgen-based biofluorescent probes for biopsy in real or artificial samples, and also the key properties of these AIE probes. This review is divided into: (i) tissue biopsy based on smart AIEgens, (ii) blood sample biopsy based on smart AIEgens, (iii) urine sample biopsy based on smart AIEgens, (iv) saliva sample biopsy based on smart AIEgens, (v) biopsy of other liquid samples based on smart AIEgens, and (vi) perspectives and conclusion. This review could provide additional guidance to motivate interest and bolster more innovative ideas for further exploring the applications of various smart AIEgens in precision medicine.

Role of artificial intelligence in haematolymphoid diagnostics

The advent of digital pathology and the deployment of high-throughput molecular techniques are generating an unprecedented mass of data. Thanks to advances in computational sciences, artificial intelligence (AI) approaches represent a promising avenue for extracting relevant information from complex data structures. From diagnostic assistance to powerful research tools, the potential fields of application of machine learning techniques in pathology are vast and constitute the subject of considerable research work. The aim of this article is to provide an overview of the potential applications of AI in the field of haematopathology and to define the role that these emerging technologies could play in our laboratories in the short to medium term.

Artificial intelligence enhances the management of esophageal squamous cell carcinoma in the precision oncology era

Esophageal squamous cell carcinoma (ESCC) is the most common histological type of esophageal cancer with a poor prognosis. Early diagnosis and prognosis assessment are crucial for improving the survival rate of ESCC patients. With the advancement of artificial intelligence (AI) technology and the proliferation of medical digital information, AI has demonstrated promising sensitivity and accuracy in assisting precise detection, treatment decision-making, and prognosis assessment of ESCC. It has become a unique opportunity to enhance comprehensive clinical management of ESCC in the era of precision oncology. This review examines how AI is applied to the diagnosis, treatment, and prognosis assessment of ESCC in the era of precision oncology, and analyzes the challenges and potential opportunities that AI faces in clinical translation. Through insights into future prospects, it is hoped that this review will contribute to the real-world application of AI in future clinical settings, ultimately alleviating the disease burden caused by ESCC.

Prediction of homologous recombination deficiency from routine histology with attention-based multiple instance learning in nine different tumor types

BACKGROUND

Homologous recombination deficiency (HRD) is recognized as a pan-cancer predictive biomarker that potentially indicates who could benefit from treatment with PARP inhibitors (PARPi). Despite its clinical significance, HRD testing is highly complex. Here, we investigated in a proof-of-concept study whether Deep Learning (DL) can predict HRD status solely based on routine hematoxylin & eosin (H&E) histology images across nine different cancer types.

METHODS

We developed a deep learning pipeline with attention-weighted multiple instance learning (attMIL) to predict HRD status from histology images. As part of our approach, we calculated a genomic scar HRD score by combining loss of heterozygosity (LOH), telomeric allelic imbalance (TAI), and large-scale state transitions (LST) from whole genome sequencing (WGS) data of n = 5209 patients across two independent cohorts. The model's effectiveness was evaluated using the area under the receiver operating characteristic curve (AUROC), focusing on its accuracy in predicting genomic HRD against a clinically recognized cutoff value.

RESULTS

Our study demonstrated the predictability of genomic HRD status in endometrial, pancreatic, and lung cancers reaching cross-validated AUROCs of 0.79, 0.58, and 0.66, respectively. These predictions generalized well to an external cohort, with AUROCs of 0.93, 0.81, and 0.73. Moreover, a breast cancer-trained image-based HRD classifier yielded an AUROC of 0.78 in the internal validation cohort and was able to predict HRD in endometrial, prostate, and pancreatic cancer with AUROCs of 0.87, 0.84, and 0.67, indicating that a shared HRD-like phenotype occurs across these tumor entities.

CONCLUSIONS

This study establishes that HRD can be directly predicted from H&E slides using attMIL, demonstrating its applicability across nine different tumor types.

Designing nanotheranostics with machine learning

The inherent limits of traditional diagnoses and therapies have driven the development and application of emerging nanotechnologies for more effective and safer management of diseases, herein referred to as 'nanotheranostics'. Although many important technological successes have been achieved in this field, widespread adoption of nanotheranostics as a new paradigm is hindered by specific obstacles, including time-consuming synthesis of nanoparticles, incomplete understanding of nano-bio interactions, and challenges regarding chemistry, manufacturing and the controls required for clinical translation and commercialization. As a key branch of artificial intelligence, machine learning (ML) provides a set of tools capable of performing time-consuming and result-perception tasks, thus offering unique opportunities for nanotheranostics. This Review summarizes the progress and challenges in this emerging field of ML-aided nanotheranostics, and discusses the opportunities in developing next-generation nanotheranostics with reliable datasets and advanced ML models to offer better clinical benefits to patients.

A multimodal generative AI copilot for human pathology

Computational pathology1,2 has witnessed considerable progress in the development of both task-specific predictive models and task-agnostic self-supervised vision encoders3,4. However, despite the explosive growth of generative artificial intelligence (AI), there have been few studies on building general-purpose multimodal AI assistants and copilots5 tailored to pathology. Here we present PathChat, a vision-language generalist AI assistant for human pathology. We built PathChat by adapting a foundational vision encoder for pathology, combining it with a pretrained large language model and fine-tuning the whole system on over 456,000 diverse visual-language instructions consisting of 999,202 question and answer turns. We compare PathChat with several multimodal vision-language AI assistants and GPT-4V, which powers the commercially available multimodal general-purpose AI assistant ChatGPT-4 (ref. 6). PathChat achieved state-of-the-art performance on multiple-choice diagnostic questions from cases with diverse tissue origins and disease models. Furthermore, using open-ended questions and human expert evaluation, we found that overall PathChat produced more accurate and pathologist-preferable responses to diverse queries related to pathology. As an interactive vision-language AI copilot that can flexibly handle both visual and natural language inputs, PathChat may potentially find impactful applications in pathology education, research and human-in-the-loop clinical decision-making.

A pathology foundation model for cancer diagnosis and prognosis prediction

Histopathology image evaluation is indispensable for cancer diagnoses and subtype classification. Standard artificial intelligence methods for histopathology image analyses have focused on optimizing specialized models for each diagnostic task1,2. Although such methods have achieved some success, they often have limited generalizability to images generated by different digitization protocols or samples collected from different populations3. Here, to address this challenge, we devised the Clinical Histopathology Imaging Evaluation Foundation (CHIEF) model, a general-purpose weakly supervised machine learning framework to extract pathology imaging features for systematic cancer evaluation. CHIEF leverages two complementary pretraining methods to extract diverse pathology representations: unsupervised pretraining for tile-level feature identification and weakly supervised pretraining for whole-slide pattern recognition. We developed CHIEF using 60,530 whole-slide images spanning 19 anatomical sites. Through pretraining on 44 terabytes of high-resolution pathology imaging datasets, CHIEF extracted microscopic representations useful for cancer cell detection, tumour origin identification, molecular profile characterization and prognostic prediction. We successfully validated CHIEF using 19,491 whole-slide images from 32 independent slide sets collected from 24 hospitals and cohorts internationally. Overall, CHIEF outperformed the state-of-the-art deep learning methods by up to 36.1%, showing its ability to address domain shifts observed in samples from diverse populations and processed by different slide preparation methods. CHIEF provides a generalizable foundation for efficient digital pathology evaluation for patients with cancer.

Specifics of spinal neuropathology in the molecular age

Tumors located in the spinal cord and its coverings can be diagnostically challenging and require special consideration regarding treatment options. During the last decade, important advances regarding the molecular characterization of central and peripheral nervous system tumors were achieved, resulting in improved diagnostic precision, and understanding of the tumor spectrum of this compartment. In particular, array-based global DNA methylation profiling has emerged as a valuable tool to delineate biologically and clinically relevant tumor subgroups and has been incorporated in the current WHO classification for central nervous system tumors of 2021. In addition, several genetic drivers have been described, which may also help to define distinct tumor types and subtypes. Importantly, the current molecular understanding not only sharpens diagnostic precision but also provides the opportunity to investigate both targeted therapies as well as risk-adapted changes in treatment intensity. Here, we discuss the current knowledge and the clinical relevance of molecular neuropathology in spinal tumor entities.

Leveraging State-of-the-Art AI Algorithms in Personalized Oncology: From Transcriptomics to Treatment

BACKGROUND

Continuous breakthroughs in computational algorithms have positioned AI-based models as some of the most sophisticated technologies in the healthcare system. AI shows dynamic contributions in advancing various medical fields involving data interpretation and monitoring, imaging screening and diagnosis, and treatment response and survival prediction. Despite advances in clinical oncology, more effort must be employed to tailor therapeutic plans based on each patient's unique transcriptomic profile within the precision/personalized oncology frame. Furthermore, the standard analysis method is not compatible with the comprehensive deciphering of significant data streams, thus precluding the prediction of accurate treatment options.

METHODOLOGY

We proposed a novel approach that includes obtaining different tumour tissues and preparing RNA samples for comprehensive transcriptomic interpretation using specifically trained, programmed, and optimized AI-based models for extracting large data volumes, refining, and analyzing them. Next, the transcriptomic results will be scanned against an expansive drug library to predict the response of each target to the tested drugs. The obtained target-drug combination/s will be then validated using in vitro and in vivo experimental models. Finally, the best treatment combination option/s will be introduced to the patient. We also provided a comprehensive review discussing AI models' recent innovations and implementations to aid in molecular diagnosis and treatment planning.

RESULTS

The expected transcriptomic analysis generated by the AI-based algorithms will provide an inclusive genomic profile for each patient, containing statistical and bioinformatics analyses, identification of the dysregulated pathways, detection of the targeted genes, and recognition of molecular biomarkers. Subjecting these results to the prediction and pairing AI-based processes will result in statistical graphs presenting each target's likely response rate to various treatment options. Different in vitro and in vivo investigations will further validate the selection of the target drug/s pairs.

CONCLUSIONS

Leveraging AI models will provide more rigorous manipulation of large-scale datasets on specific cancer care paths. Such a strategy would shape treatment according to each patient's demand, thus fortifying the avenue of personalized/precision medicine. Undoubtedly, this will assist in improving the oncology domain and alleviate the burden of clinicians in the coming decade.

Multimodal contrastive learning for spatial gene expression prediction using histology images

In recent years, the advent of spatial transcriptomics (ST) technology has unlocked unprecedented opportunities for delving into the complexities of gene expression patterns within intricate biological systems. Despite its transformative potential, the prohibitive cost of ST technology remains a significant barrier to its widespread adoption in large-scale studies. An alternative, more cost-effective strategy involves employing artificial intelligence to predict gene expression levels using readily accessible whole-slide images stained with Hematoxylin and Eosin (H&E). However, existing methods have yet to fully capitalize on multimodal information provided by H&E images and ST data with spatial location. In this paper, we propose mclSTExp, a multimodal contrastive learning with Transformer and Densenet-121 encoder for Spatial Transcriptomics Expression prediction. We conceptualize each spot as a "word", integrating its intrinsic features with spatial context through the self-attention mechanism of a Transformer encoder. This integration is further enriched by incorporating image features via contrastive learning, thereby enhancing the predictive capability of our model. We conducted an extensive evaluation of highly variable genes in two breast cancer datasets and a skin squamous cell carcinoma dataset, and the results demonstrate that mclSTExp exhibits superior performance in predicting spatial gene expression. Moreover, mclSTExp has shown promise in interpreting cancer-specific overexpressed genes, elucidating immune-related genes, and identifying specialized spatial domains annotated by pathologists. Our source code is available at https://github.com/shizhiceng/mclSTExp.

Deep learning applications in breast cancer histopathological imaging: diagnosis, treatment, and prognosis

Breast cancer is the most common malignant tumor among women worldwide and remains one of the leading causes of death among women. Its incidence and mortality rates are continuously rising. In recent years, with the rapid advancement of deep learning (DL) technology, DL has demonstrated significant potential in breast cancer diagnosis, prognosis evaluation, and treatment response prediction. This paper reviews relevant research progress and applies DL models to image enhancement, segmentation, and classification based on large-scale datasets from TCGA and multiple centers. We employed foundational models such as ResNet50, Transformer, and Hover-net to investigate the performance of DL models in breast cancer diagnosis, treatment, and prognosis prediction. The results indicate that DL techniques have significantly improved diagnostic accuracy and efficiency, particularly in predicting breast cancer metastasis and clinical prognosis. Furthermore, the study emphasizes the crucial role of robust databases in developing highly generalizable models. Future research will focus on addressing challenges related to data management, model interpretability, and regulatory compliance, ultimately aiming to provide more precise clinical treatment and prognostic evaluation programs for breast cancer patients.

Privacy-preserving large language models for structured medical information retrieval

Most clinical information is encoded as free text, not accessible for quantitative analysis. This study presents an open-source pipeline using the local large language model (LLM) "Llama 2" to extract quantitative information from clinical text and evaluates its performance in identifying features of decompensated liver cirrhosis. The LLM identified five key clinical features in a zero- and one-shot manner from 500 patient medical histories in the MIMIC IV dataset. We compared LLMs of three sizes and various prompt engineering approaches, with predictions compared against ground truth from three blinded medical experts. Our pipeline achieved high accuracy, detecting liver cirrhosis with 100% sensitivity and 96% specificity. High sensitivities and specificities were also yielded for detecting ascites (95%, 95%), confusion (76%, 94%), abdominal pain (84%, 97%), and shortness of breath (87%, 97%) using the 70 billion parameter model, which outperformed smaller versions. Our study successfully demonstrates the capability of locally deployed LLMs to extract clinical information from free text with low hardware requirements.

Construction of a pathomics model for predicting mRNAsi in lung adenocarcinoma and exploration of biological mechanism

Objective

This study aimed to predict the level of stemness index (mRNAsi) and survival prognosis of lung adenocarcinoma (LUAD) using pathomics model.

Methods

From The Cancer Genome Atlas (TCGA) database, 327 LUAD patients were randomly assigned to a training set (n = 229) and a validation set (n = 98) for pathomics model development and evaluation. PyRadiomics was used to extract pathomics features, followed by feature selection using the mRMR-RFE algorithm. In the training set, Gradient Boosting Machine (GBM) was utilized to establish a model for predicting mRNAsi in LUAD. The model's predictive performance was evaluated using ROC curves, calibration curves, and decision curve analysis (DCA). Prognostic analysis was conducted using Kaplan-Meier curves and cox regression. Additionally, gene enrichment analysis, tumor microenvironment analysis, and tumor mutational burden (TMB) analysis were performed to explore the biological mechanisms underlying the pathomics prediction model.

Results

Multivariable cox analysis (HR = 1.488, 95 % CI 1.012-2.187, P = 0.043) identified mRNAsi as a prognostic risk factor for LUAD. A total of 465 pathomics features were extracted from TCGA-LUAD histopathological images, and ultimately, the most representative 8 features were selected to construct the predictive model. ROC curves demonstrated the significant predictive value of the model for mRNAsi in both the training set (AUC = 0.769) and the validation set (AUC = 0.757). Calibration curves and Hosmer-Lemeshow goodness-of-fit test showed good consistency between the model's prediction of mRNAsi levels and the actual values. DCA indicated a good net benefit of the model. The prediction of mRNAsi levels by the pathomics model is represented using the pathomics score (PS). PS was strongly associated with the prognosis of LUAD (HR = 1.496, 95 % CI 1.008-2.222, P = 0.046). Signaling pathways related to DNA replication and damage repair were significantly enriched in the high PS group. Prediction of immune therapy response indicated significantly reduced Dysfunction in the high PS group (P < 0.001). The high PS group exhibited higher TMB values (P < 0.001).

Conclusions

The predictive model constructed based on pathomics features can forecast the mRNAsi and survival risk of LUAD. This model holds promise to aid clinical practitioners in identifying high-risk patients and devising more optimized treatment plans for patients by jointly employing therapeutic strategies targeting cancer stem cells (CSCs).

Illuminating the future of precision cancer surgery with fluorescence imaging and artificial intelligence convergence

Real-time and accurate guidance for tumor resection has long been anticipated by surgeons. In the past decade, the flourishing material science has made impressive progress in near-infrared fluorophores that may fulfill this purpose. Fluorescence imaging-guided surgery shows great promise for clinical application and has undergone widespread evaluations, though it still requires continuous improvements to transition this technique from bench to bedside. Concurrently, the rapid progress of artificial intelligence (AI) has revolutionized medicine, aiding in the screening, diagnosis, and treatment of human doctors. Incorporating AI helps enhance fluorescence imaging and is poised to bring major innovations to surgical guidance, thereby realizing precision cancer surgery. This review provides an overview of the principles and clinical evaluations of fluorescence-guided surgery. Furthermore, recent endeavors to synergize AI with fluorescence imaging were presented, and the benefits of this interdisciplinary convergence were discussed. Finally, several implementation strategies to overcome technical hurdles were proposed to encourage and inspire future research to expedite the clinical application of these revolutionary technologies.

Attitudes and perceptions of Chinese oncologists towards artificial intelligence in healthcare: a cross-sectional survey

Background

Artificial intelligence (AI) is transforming healthcare, yet little is known about Chinese oncologists' attitudes towards AI. This study investigated oncologists' knowledge, perceptions, and acceptance of AI in China.

Methods

A cross-sectional online survey was conducted among 228 oncologists across China. The survey examined demographics, AI exposure, knowledge and attitudes using 5-point Likert scales, and factors influencing AI adoption. Data were analyzed using descriptive statistics and chi-square tests.

Results

Respondents showed moderate understanding of AI concepts (mean 3.39/5), with higher knowledge among younger oncologists. Only 12.8% used ChatGPT. Most (74.13%) agreed AI is beneficial and could innovate healthcare, 52.19% respondents expressed trust in AI technology. Acceptance was cautiously optimistic (mean 3.57/5). Younger respondents (∼30) show significantly higher trust (p = 0.004) and acceptance (p = 0.009) of AI compared to older respondents, while trust is significantly higher among those with master's or doctorate vs. bachelor's degrees (p = 0.032), and acceptance is higher for those with prior IT experience (p = 0.035).Key drivers for AI adoption were improving efficiency (85.09%), quality (85.53%), reducing errors (84.65%), and enabling new approaches (73.25%).

Conclusions

Chinese oncologists are open to healthcare AI but remain prudently optimistic given limitations. Targeted education, especially for older oncologists, can facilitate AI implementation. AI is largely welcomed for its potential to augment human roles in enhancing efficiency, quality, safety, and innovations in oncology practice.

Increasing Power in Phase III Oncology Trials With Multivariable Regression: An Empirical Assessment of 535 Primary End Point Analyses

PURPOSE

A previous study demonstrated that power against the (unobserved) true effect for the primary end point (PEP) of most phase III oncology trials is low, suggesting an increased risk of false-negative findings in the field of late-phase oncology. Fitting models with prognostic covariates is a potential solution to improve power; however, the extent to which trials leverage this approach, and its impact on trial interpretation at scale, is unknown. To that end, we hypothesized that phase III trials using multivariable PEP analyses are more likely to demonstrate superiority versus trials with univariable analyses.

METHODS

PEP analyses were reviewed from trials registered on ClinicalTrials.gov. Adjusted odds ratios (aORs) were calculated by logistic regressions.

RESULTS

Of the 535 trials enrolling 454,824 patients, 69% (n = 368) used a multivariable PEP analysis. Trials with multivariable PEP analyses were more likely to demonstrate PEP superiority (57% [209 of 368] v 42% [70 of 167]; aOR, 1.78 [95% CI, 1.18 to 2.72]; P = .007). Among trials with a multivariable PEP model, 16 conditioned on covariates and 352 stratified by covariates. However, 108 (35%) of 312 trials with stratified analyses lost power by categorizing a continuous variable, which was especially common among immunotherapy trials (aOR, 2.45 [95% CI, 1.23 to 4.92]; P = .01).

CONCLUSION

Trials increasing power by fitting multivariable models were more likely to demonstrate PEP superiority than trials with unadjusted analysis. Underutilization of conditioning models and empirical power loss associated with covariate categorization required by stratification were identified as barriers to power gains. These findings underscore the opportunity to increase power in phase III trials with conventional methodology and improve patient access to effective novel therapies.

Diagnosis of Hirschsprung disease by analyzing acetylcholinesterase staining using artificial intelligence

OBJECTIVES

Classical Hirschsprung disease (HD) is defined by the absence of ganglion cells in the rectosigmoid colon. The diagnosis is made from rectal biopsy, which reveals the aganglionosis and the presence of cholinergic hyperinnervation. However, depending on the method of rectal biopsy, the quality of the specimens and the related diagnostic accuracy varies substantially. To facilitate and objectify the diagnosis of HD, we investigated whether software-based identification of cholinergic hyperinnervation in digitalized histopathology slides is suitable for distinguishing healthy individuals from affected individuals.

METHODS

N = 190 samples of 112 patients who underwent open surgical rectal biopsy at our pediatric surgery center between 2009 and 2019 were included in this study. Acetylcholinesterase (AChE) stained slides of these samples were collected and digitalized via slide scanning and analyzed using two digital imaging software programs (HALO, QuPath). The AChE-positive staining area in the mucosal layers of the intestinal wall was determined. In the next step machine learning was employed to identify patterns of cholinergic hyperinnervation.

RESULTS

The area of AChE-positive staining was greater in HD patients compared to healthy individuals (p < 0.0001). Artificial intelligence-based assessment of parasympathetic hyperinnervation identified HD with a high precision (area under the curve [AUC] 0.96). The accuracy of the prediction model increased when nonrectal samples were excluded (AUC 0.993).

CONCLUSIONS

Software-assisted machine-learning analysis of AChE staining is suitable to improve the diagnostic accuracy of HD.

Artificial intelligence in pathologic diagnosis, prognosis and prediction of prostate cancer

Histopathology, which is the gold-standard for prostate cancer diagnosis, faces significant challenges. With prostate cancer ranking among the most common cancers in the United States and worldwide, pathologists experience an increased number for prostate biopsies. At the same time, precise pathological assessment and classification are necessary for risk stratification and treatment decisions in prostate cancer care, adding to the challenge to pathologists. Recent advancement in digital pathology makes artificial intelligence and learning tools adopted in histopathology feasible. In this review, we introduce the concept of AI and its various techniques in the field of histopathology. We summarize the clinical applications of AI pathology for prostate cancer, including pathological diagnosis, grading, prognosis evaluation, and treatment options. We also discuss how AI applications can be integrated into the routine pathology workflow. With these rapid advancements, it is evident that AI applications in prostate cancer go beyond the initial goal of being tools for diagnosis and grading. Instead, pathologists can provide additional information to improve long-term patient outcomes by assessing detailed histopathologic features at pixel level using digital pathology and AI. Our review not only provides a comprehensive summary of the existing research but also offers insights for future advancements.

Current HRD assays in ovarian cancer: differences, pitfalls, limitations, and novel approaches

Ovarian carcinoma (OC) still represents an insidious and fatal malignancy, and few significant results have been obtained in the last two decades to improve patient survival. Novel targeted therapies such as poly (ADP-ribose) polymerase inhibitors (PARPi) have been successfully introduced in the clinical management of OC, but not all patients will benefit, and drug resistance almost inevitably occurs. The identification of patients who are likely to respond to PARPi-based therapies relies on homologous recombination deficiency (HRD) tests, as this condition is associated with response to these treatments. This review summarizes the genomic and functional HRD assays currently used in clinical practice and those under evaluation, the clinical implications of HRD testing in OC, and their current pitfalls and limitations. Special emphasis will be placed on the functional HRD assays under development and the use of machine learning and artificial intelligence technologies as novel strategies to overcome the current limitations of HRD tests for a better-personalized treatment to improve patient outcomes.

Performance of machine learning algorithms for lung cancer prediction: a comparative approach

Due to the excessive growth of PM 2.5 in aerosol, the cases of lung cancer are increasing rapidly and are most severe among other types as the highest mortality rate. In most of the cases, lung cancer is detected with least symptoms at its later stage. Hence, clinical records may play a vital role to diagnose this disease at the correct stage for suitable medication to cure it. To detect lung cancer an accurate prediction method is needed which is significantly reliable. In the digital clinical record era with advancement in computing algorithms including machine learning techniques opens an opportunity to ease the process. Various machine learning algorithms may be applied over realistic clinical data but the predictive power is yet to be comprehended for accurate results. This paper envisages to compare twelve potential machine learning algorithms over clinical data with eleven symptoms of lung cancer along with two major habits of patients to predict a positive case accurately. The result has been found based on classification and heat map correlation. K-Nearest Neighbor Model and Bernoulli Naive Bayes Model are found most significant methods for early lung cancer prediction.

Decoding pathology: the role of computational pathology in research and diagnostics

Traditional histopathology, characterized by manual quantifications and assessments, faces challenges such as low-throughput and inter-observer variability that hinder the introduction of precision medicine in pathology diagnostics and research. The advent of digital pathology allowed the introduction of computational pathology, a discipline that leverages computational methods, especially based on deep learning (DL) techniques, to analyze histopathology specimens. A growing body of research shows impressive performances of DL-based models in pathology for a multitude of tasks, such as mutation prediction, large-scale pathomics analyses, or prognosis prediction. New approaches integrate multimodal data sources and increasingly rely on multi-purpose foundation models. This review provides an introductory overview of advancements in computational pathology and discusses their implications for the future of histopathology in research and diagnostics.

Artificial intelligence in liver cancer - new tools for research and patient management

Liver cancer has high incidence and mortality globally. Artificial intelligence (AI) has advanced rapidly, influencing cancer care. AI systems are already approved for clinical use in some tumour types (for example, colorectal cancer screening). Crucially, research demonstrates that AI can analyse histopathology, radiology and natural language in liver cancer, and can replace manual tasks and access hidden information in routinely available clinical data. However, for liver cancer, few of these applications have translated into large-scale clinical trials or clinically approved products. Here, we advocate for the incorporation of AI in all stages of liver cancer management. We present a taxonomy of AI approaches in liver cancer, highlighting areas with academic and commercial potential, and outline a policy for AI-based liver cancer management, including interdisciplinary training of researchers, clinicians and patients. The potential of AI in liver cancer is immense, but effort is required to ensure that AI can fulfil expectations.

Predicting tumor mutation burden and VHL mutation from renal cancer pathology slides with self-supervised deep learning

BACKGROUND

Tumor mutation burden (TMB) and VHL mutation play a crucial role in the management of patients with clear cell renal cell carcinoma (ccRCC), such as guiding adjuvant chemotherapy and improving clinical outcomes. However, the time-consuming and expensive high-throughput sequencing methods severely limit their clinical applicability. Predicting intratumoral heterogeneity poses significant challenges in biology and clinical settings. Our aimed to develop a self-supervised attention-based multiple instance learning (SSL-ABMIL) model to predict TMB and VHL mutation status from hematoxylin and eosin-stained histopathological images.

METHODS

We obtained whole slide images (WSIs) and somatic mutation data of 350 ccRCC patients from The Cancer Genome Atlas for developing SSL-ABMIL model. In parallel, 163 ccRCC patients from Clinical Proteomic Tumor Analysis Consortium cohort was used as independent external validation set. We systematically compared three different models (Wang-ABMIL, Ciga-ABMIL, and ImageNet-MIL) for their ability to predict TMB and VHL alterations.

RESULTS

We first identified two groups of populations with high- and low-TMB (cut-off point = 0.9). In two independent cohorts, the Wang-ABMIL model achieved the highest performance with decent generalization performance (AUROC = 0.83 ± 0.02 and 0.8 ± 0.04 in predicting TMB and VHL, respectively). Attention heatmaps revealed that the Wang-ABMIL model paid the highest attention to tumor regions in high-TMB patients, while in VHL mutation prediction, non-tumor regions were also assigned high attention, particularly the stromal regions infiltrated by lymphocytes.

CONCLUSIONS

Our results indicated that SSL-ABMIL can effectively extract histological features for predicting TMB and VHL mutation, demonstrating promising results in linking tumor morphology and molecular biology.

Deep Learning-based Modeling for Preclinical Drug Safety Assessment

In drug development, assessing the toxicity of candidate compounds is crucial for successfully transitioning from preclinical research to early-stage clinical trials. Drug safety is typically assessed using animal models with a manual histopathological examination of tissue sections to characterize the dose-response relationship of the compound - a time-intensive process prone to inter-observer variability and predominantly involving tedious review of cases without abnormalities. Artificial intelligence (AI) methods in pathology hold promise to accelerate this assessment and enhance reproducibility and objectivity. Here, we introduce TRACE, a model designed for toxicologic liver histopathology assessment capable of tackling a range of diagnostic tasks across multiple scales, including situations where labeled data is limited. TRACE was trained on 15 million histopathology images extracted from 46,734 digitized tissue sections from 157 preclinical studies conducted on Rattus norvegicus. We show that TRACE can perform various downstream toxicology tasks spanning histopathological response assessment, lesion severity scoring, morphological retrieval, and automatic dose-response characterization. In an independent reader study, TRACE was evaluated alongside ten board-certified veterinary pathologists and achieved higher concordance with the consensus opinion than the average of the pathologists. Our study represents a substantial leap over existing computational models in toxicology by offering the first framework for accelerating and automating toxicological pathology assessment, promoting significant progress with faster, more consistent, and reliable diagnostic processes.

Multi-omics based artificial intelligence for cancer research

With significant advancements of next generation sequencing technologies, large amounts of multi-omics data, including genomics, epigenomics, transcriptomics, proteomics, and metabolomics, have been accumulated, offering an unprecedented opportunity to explore the heterogeneity and complexity of cancer across various molecular levels and scales. One of the promising aspects of multi-omics lies in its capacity to offer a holistic view of the biological networks and pathways underpinning cancer, facilitating a deeper understanding of its development, progression, and response to treatment. However, the exponential growth of data generated by multi-omics studies present significant analytical challenges. Processing, analyzing, integrating, and interpreting these multi-omics datasets to extract meaningful insights is an ambitious task that stands at the forefront of current cancer research. The application of artificial intelligence (AI) has emerged as a powerful solution to these challenges, demonstrating exceptional capabilities in deciphering complex patterns and extracting valuable information from large-scale, intricate omics datasets. This review delves into the synergy of AI and multi-omics, highlighting its revolutionary impact on oncology. We dissect how this confluence is reshaping the landscape of cancer research and clinical practice, particularly in the realms of early detection, diagnosis, prognosis, treatment and pathology. Additionally, we elaborate the latest AI methods for multi-omics integration to provide a comprehensive insight of the complex biological mechanisms and inherent heterogeneity of cancer. Finally, we discuss the current challenges of data harmonization, algorithm interpretability, and ethical considerations. Addressing these challenges necessitates a multidisciplinary collaboration, paving the promising way for more precise, personalized, and effective treatments for cancer patients.

A Deep Learning-Based Assessment Pipeline for Intraepithelial and Stromal Tumor-Infiltrating Lymphocytes in High-Grade Serous Ovarian Carcinoma

Tumor-infiltrating lymphocytes (TILs) are associated with improved survival in patients with epithelial ovarian cancer. However, TIL evaluation has not been used in routine clinical practice because of reproducibility issues. The current study developed two convolutional neural network models to detect TILs and to determine their spatial location in whole slide images, and established a spatial assessment pipeline to objectively quantify intraepithelial and stromal TILs in patients with high-grade serous ovarian carcinoma. The predictions of the established models showed a significant positive correlation with the number of CD8+ T cells and immune gene expressions. Patients with a higher density of intraepithelial TILs had a significantly prolonged overall survival and progression-free survival in multiple cohorts. On the basis of the density of intraepithelial and stromal TILs, patients were classified into three immunophenotypes: immune inflamed, excluded, and desert. The immune-desert subgroup showed the worst prognosis. Gene expression analysis showed that the immune-desert subgroup had lower immune cytolytic activity and T-cell-inflamed gene-expression profile scores, whereas the immune-excluded subgroup had higher expression of interferon-γ and programmed death 1 receptor signaling pathway. The established evaluation method provided detailed and comprehensive quantification of intraepithelial and stromal TILs throughout hematoxylin and eosin-stained slides. It has potential for clinical application for personalized treatment of patients with ovarian cancer.

AI-based histopathology image analysis reveals a distinct subset of endometrial cancers

Endometrial cancer (EC) has four molecular subtypes with strong prognostic value and therapeutic implications. The most common subtype (NSMP; No Specific Molecular Profile) is assigned after exclusion of the defining features of the other three molecular subtypes and includes patients with heterogeneous clinical outcomes. In this study, we employ artificial intelligence (AI)-powered histopathology image analysis to differentiate between p53abn and NSMP EC subtypes and consequently identify a sub-group of NSMP EC patients that has markedly inferior progression-free and disease-specific survival (termed 'p53abn-like NSMP'), in a discovery cohort of 368 patients and two independent validation cohorts of 290 and 614 from other centers. Shallow whole genome sequencing reveals a higher burden of copy number abnormalities in the 'p53abn-like NSMP' group compared to NSMP, suggesting that this group is biologically distinct compared to other NSMP ECs. Our work demonstrates the power of AI to detect prognostically different and otherwise unrecognizable subsets of EC where conventional and standard molecular or pathologic criteria fall short, refining image-based tumor classification. This study's findings are applicable exclusively to females.

Translational Frontiers and Clinical Opportunities of Immunologically Fitted Radiotherapy

Ionizing radiation can have a wide range of impacts on tumor-immune interactions, which are being studied with the greatest interest and at an accelerating pace by the medical community. Despite its undeniable immunostimulatory potential, it clearly appears that radiotherapy as it is prescribed and delivered nowadays often alters the host's immunity toward a suboptimal state. This may impair the full recovery of a sustained and efficient antitumor immunosurveillance posttreatment. An emerging concept is arising from this awareness and consists of reconsidering the way of designing radiation treatment planning, notably by taking into account the individualized risks of deleterious radio-induced immune alteration that can be deciphered from the planned beam trajectory through lymphocyte-rich organs. In this review, we critically appraise key aspects to consider while planning immunologically fitted radiotherapy, including the challenges linked to the identification of new dose constraints to immune-rich structures. We also discuss how pharmacologic immunomodulation could be advantageously used in combination with radiotherapy to compensate for the radio-induced loss, for example, with (i) agonists of interleukin (IL)2, IL4, IL7, IL9, IL15, or IL21, similarly to G-CSF being used for the prophylaxis of severe chemo-induced neutropenia, or with (ii) myeloid-derived suppressive cell blockers.

A guide to artificial intelligence for cancer researchers

Artificial intelligence (AI) has been commoditized. It has evolved from a specialty resource to a readily accessible tool for cancer researchers. AI-based tools can boost research productivity in daily workflows, but can also extract hidden information from existing data, thereby enabling new scientific discoveries. Building a basic literacy in these tools is useful for every cancer researcher. Researchers with a traditional biological science focus can use AI-based tools through off-the-shelf software, whereas those who are more computationally inclined can develop their own AI-based software pipelines. In this article, we provide a practical guide for non-computational cancer researchers to understand how AI-based tools can benefit them. We convey general principles of AI for applications in image analysis, natural language processing and drug discovery. In addition, we give examples of how non-computational researchers can get started on the journey to productively use AI in their own work.

The current use of proteomics and metabolomics in glomerulonephritis: a systematic literature review

BACKGROUND

Glomerulonephritis inherently leads to the development of chronic kidney disease. It is the second most common diagnosis in patients requiring renal replacement therapy in the United Kingdom. Metabolomics and proteomics can characterise, identify and quantify an individual's protein and metabolite make-up. These techniques have been optimised and can be performed on samples including kidney tissue, blood and urine. Utilising omic techniques in nephrology can uncover disease pathophysiology and transform the diagnostics and treatment options for glomerulonephritis.

OBJECTIVES

To evaluate the utility of metabolomics and proteomics using mass spectrometry and nuclear magnetic resonance in glomerulonephritis.

METHODS

The systematic review was registered on PROSPERO (CRD42023442092). Standard and extensive Cochrane search methods were used. The latest search date was March 2023. Participants were of any age with a histological diagnosis of glomerulonephritis. Descriptive analysis was performed, and data presented in tabular form. An area under the curve or p-value was presented for potential biomarkers discovered.

RESULTS

Twenty-seven studies were included (metabolomics (n = 9)), and (proteomics (n = 18)) with 1818 participants. The samples analysed were urine (n = 19) blood (n = 4) and biopsy (n = 6). The typical outcome themes were potential biomarkers, disease phenotype, risk of progression and treatment response.

CONCLUSION

This review shows the potential of metabolomic and proteomic analysis to discover new disease biomarkers that may influence diagnostics and disease management. Further larger-scale research is required to establish the validity of the study outcomes, including the several proposed biomarkers.

A whole-slide foundation model for digital pathology from real-world data

Digital pathology poses unique computational challenges, as a standard gigapixel slide may comprise tens of thousands of image tiles1-3. Prior models have often resorted to subsampling a small portion of tiles for each slide, thus missing the important slide-level context4. Here we present Prov-GigaPath, a whole-slide pathology foundation model pretrained on 1.3 billion 256 × 256 pathology image tiles in 171,189 whole slides from Providence, a large US health network comprising 28 cancer centres. The slides originated from more than 30,000 patients covering 31 major tissue types. To pretrain Prov-GigaPath, we propose GigaPath, a novel vision transformer architecture for pretraining gigapixel pathology slides. To scale GigaPath for slide-level learning with tens of thousands of image tiles, GigaPath adapts the newly developed LongNet5 method to digital pathology. To evaluate Prov-GigaPath, we construct a digital pathology benchmark comprising 9 cancer subtyping tasks and 17 pathomics tasks, using both Providence and TCGA data6. With large-scale pretraining and ultra-large-context modelling, Prov-GigaPath attains state-of-the-art performance on 25 out of 26 tasks, with significant improvement over the second-best method on 18 tasks. We further demonstrate the potential of Prov-GigaPath on vision-language pretraining for pathology7,8 by incorporating the pathology reports. In sum, Prov-GigaPath is an open-weight foundation model that achieves state-of-the-art performance on various digital pathology tasks, demonstrating the importance of real-world data and whole-slide modelling.

Multi-Instance Multi-Task Learning for Joint Clinical Outcome and Genomic Profile Predictions From the Histopathological Images

With the remarkable success of digital histopathology and the deep learning technology, many whole-slide pathological images (WSIs) based deep learning models are designed to help pathologists diagnose human cancers. Recently, rather than predicting categorical variables as in cancer diagnosis, several deep learning studies are also proposed to estimate the continuous variables such as the patients' survival or their transcriptional profile. However, most of the existing studies focus on conducting these predicting tasks separately, which overlooks the useful intrinsic correlation among them that can boost the prediction performance of each individual task. In addition, it is sill challenge to design the WSI-based deep learning models, since a WSI is with huge size but annotated with coarse label. In this study, we propose a general multi-instance multi-task learning framework (HistMIMT) for multi-purpose prediction from WSIs. Specifically, we firstly propose a novel multi-instance learning module (TMICS) considering both common and specific task information across different tasks to generate bag representation for each individual task. Then, a soft-mask based fusion module with channel attention (SFCA) is developed to leverage useful information from the related tasks to help improve the prediction performance on target task. We evaluate our method on three cancer cohorts derived from the Cancer Genome Atlas (TCGA). For each cohort, our multi-purpose prediction tasks range from cancer diagnosis, survival prediction and estimating the transcriptional profile of gene TP53. The experimental results demonstrated that HistMIMT can yield better outcome on all clinical prediction tasks than its competitors.

Automated curation of large-scale cancer histopathology image datasets using deep learning

BACKGROUND

Artificial intelligence (AI) has numerous applications in pathology, supporting diagnosis and prognostication in cancer. However, most AI models are trained on highly selected data, typically one tissue slide per patient. In reality, especially for large surgical resection specimens, dozens of slides can be available for each patient. Manually sorting and labelling whole-slide images (WSIs) is a very time-consuming process, hindering the direct application of AI on the collected tissue samples from large cohorts. In this study we addressed this issue by developing a deep-learning (DL)-based method for automatic curation of large pathology datasets with several slides per patient.

METHODS

We collected multiple large multicentric datasets of colorectal cancer histopathological slides from the United Kingdom (FOXTROT, N = 21,384 slides; CR07, N = 7985 slides) and Germany (DACHS, N = 3606 slides). These datasets contained multiple types of tissue slides, including bowel resection specimens, endoscopic biopsies, lymph node resections, immunohistochemistry-stained slides, and tissue microarrays. We developed, trained, and tested a deep convolutional neural network model to predict the type of slide from the slide overview (thumbnail) image. The primary statistical endpoint was the macro-averaged area under the receiver operating curve (AUROCs) for detection of the type of slide.

RESULTS

In the primary dataset (FOXTROT), with an AUROC of 0.995 [95% confidence interval [CI]: 0.994-0.996] the algorithm achieved a high classification performance and was able to accurately predict the type of slide from the thumbnail image alone. In the two external test cohorts (CR07, DACHS) AUROCs of 0.982 [95% CI: 0.979-0.985] and 0.875 [95% CI: 0.864-0.887] were observed, which indicates the generalizability of the trained model on unseen datasets. With a confidence threshold of 0.95, the model reached an accuracy of 94.6% (7331 classified cases) in CR07 and 85.1% (2752 classified cases) for the DACHS cohort.

CONCLUSION

Our findings show that using the low-resolution thumbnail image is sufficient to accurately classify the type of slide in digital pathology. This can support researchers to make the vast resource of existing pathology archives accessible to modern AI models with only minimal manual annotations.

Benchmarking Deep Learning-Based Image Retrieval of Oral Tumor Histology

INTRODUCTION

 Oral tumors necessitate a dependable computer-assisted pathological diagnosis system considering their rarity and diversity. A content-based image retrieval (CBIR) system using deep neural networks has been successfully devised for digital pathology. No CBIR system for oral pathology has been investigated because of the lack of an extensive image database and feature extractors tailored to oral pathology.

MATERIALS AND METHODS

This study uses a large CBIR database constructed from 30 categories of oral tumors to compare deep learning methods as feature extractors.

RESULTS

The highest average area under the receiver operating characteristic curve (AUC) was achieved by models trained on database images using self-supervised learning (SSL) methods (0.900 with SimCLR and 0.897 with TiCo). The generalizability of the models was validated using query images from the same cases taken with smartphones. When smartphone images were tested as queries, both models yielded the highest mean AUC (0.871 with SimCLR and 0.857 with TiCo). We ensured the retrieved image result would be easily observed by evaluating the top 10 mean accuracies and checking for an exact diagnostic category and its differential diagnostic categories.

CONCLUSION

Training deep learning models with SSL methods using image data specific to the target site is beneficial for CBIR tasks in oral tumor histology to obtain histologically meaningful results and high performance. This result provides insight into the effective development of a CBIR system to help improve the accuracy and speed of histopathology diagnosis and advance oral tumor research in the future.

Potential clinical application of microRNAs in bladder cancer

Bladder cancer (BC) is the tenth most prevalent malignancy globally, presenting significant clinical and societal challenges because of its high incidence, rapid progression, and frequent recurrence. Presently, cystoscopy and urine cytology serve as the established diagnostic methods for BC. However, their efficacy is limited by their invasive nature and low sensitivity. Therefore, the development of highly specific biomarkers and effective non-invasive detection strategies is imperative for achieving a precise and timely diagnosis of BC, as well as for facilitating an optimal tumor treatment and an improved prognosis. microRNAs (miRNAs), short noncoding RNA molecules spanning around 20-25 nucleotides, are implicated in the regulation of diverse carcinogenic pathways. Substantially altered miRNAs form robust functional regulatory networks that exert a notable influence on the tumorigenesis and progression of BC. Investigations into aberrant miRNAs derived from blood, urine, or extracellular vesicles indicate their potential roles as diagnostic biomarkers and prognostic indicators in BC, enabling miRNAs to monitor the progression and predict the recurrence of the disease. Simultaneously, the investigation centered on miRNA as a potential therapeutic agent presents a novel approach for the treatment of BC. This review comprehensively analyzes biological roles of miRNAs in tumorigenesis and progression, and systematically summarizes their potential as diagnostic and prognostic biomarkers, as well as therapeutic targets for BC. Additionally, we evaluate the progress made in laboratory techniques within this field and discuss the prospects.

Analysis of 3D pathology samples using weakly supervised AI

Human tissue, which is inherently three-dimensional (3D), is traditionally examined through standard-of-care histopathology as limited two-dimensional (2D) cross-sections that can insufficiently represent the tissue due to sampling bias. To holistically characterize histomorphology, 3D imaging modalities have been developed, but clinical translation is hampered by complex manual evaluation and lack of computational platforms to distill clinical insights from large, high-resolution datasets. We present TriPath, a deep-learning platform for processing tissue volumes and efficiently predicting clinical outcomes based on 3D morphological features. Recurrence risk-stratification models were trained on prostate cancer specimens imaged with open-top light-sheet microscopy or microcomputed tomography. By comprehensively capturing 3D morphologies, 3D volume-based prognostication achieves superior performance to traditional 2D slice-based approaches, including clinical/histopathological baselines from six certified genitourinary pathologists. Incorporating greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, further emphasizing the value of capturing larger extents of heterogeneous morphology.

Accuracy and usability of artificial intelligence chatbot generated chemotherapy protocols

Background: Medical practitioners are increasingly using artificial intelligence (AI) chatbots for easier and faster access to information. To our knowledge, the accuracy and availability of AI-generated chemotherapy protocols has not yet been studied. Methods: Nine simulated cancer patient cases were designed and AI chatbots, ChatGPT version 3.5 (OpenAI) and Bing (Microsoft), were used to generate chemotherapy protocols for each case. Results: Generated chemotherapy protocols were compared with the original protocols for nine simulated cancer patients. ChatGPT's overall performance was 5 out of 9 on protocol generation, and Bing's was 4 out of 9; this was statistically nonsignificant (p = 1). Conclusion: AI chatbots show both potential and limitations in generating chemotherapy protocols. The overall performance is low, and they should be used carefully in oncological practice.

Harnessing artificial intelligence for prostate cancer management

Prostate cancer (PCa) is a common malignancy in males. The pathology review of PCa is crucial for clinical decision-making, but traditional pathology review is labor intensive and subjective to some extent. Digital pathology and whole-slide imaging enable the application of artificial intelligence (AI) in pathology. This review highlights the success of AI in detecting and grading PCa, predicting patient outcomes, and identifying molecular subtypes. We propose that AI-based methods could collaborate with pathologists to reduce workload and assist clinicians in formulating treatment recommendations. We also introduce the general process and challenges in developing AI pathology models for PCa. Importantly, we summarize publicly available datasets and open-source codes to facilitate the utilization of existing data and the comparison of the performance of different models to improve future studies.

Teacher-student collaborated multiple instance learning for pan-cancer PDL1 expression prediction from histopathology slides

Programmed cell death ligand 1 (PDL1), as an important biomarker, is quantified by immunohistochemistry (IHC) with few established histopathological patterns. Deep learning aids in histopathological assessment, yet heterogeneity and lacking spatially resolved annotations challenge precise analysis. Here, we present a weakly supervised learning approach using bulk RNA sequencing for PDL1 expression prediction from hematoxylin and eosin (H&E) slides. Our method extends the multiple instance learning paradigm with the teacher-student framework, which assigns dynamic pseudo-labels for intra-slide heterogeneity and retrieves unlabeled instances using temporal ensemble model distillation. The approach, evaluated on 12,299 slides across 20 solid tumor types, achieves a weighted average area under the curve of 0.83 on fresh-frozen and 0.74 on formalin-fixed specimens for 9 tumors with PDL1 as an established biomarker. Our method predicts PDL1 expression patterns, validated by IHC on 20 slides, offering insights into histologies relevant to PDL1. This demonstrates the potential of deep learning in identifying diverse histological patterns for molecular changes from H&E images.

Morphological diversity of cancer cells predicts prognosis across tumor types

BACKGROUND

Intratumor heterogeneity drives disease progression and treatment resistance, which can lead to poor patient outcomes. Here, we present a computational approach for quantification of cancer cell diversity in routine hematoxylin-eosin-stained histopathology images.

METHODS

We analyzed publicly available digitized whole-slide hematoxylin-eosin images for 2000 patients. Four tumor types were included: lung, head and neck, colon, and rectal cancers, representing major histology subtypes (adenocarcinomas and squamous cell carcinomas). We performed single-cell analysis on hematoxylin-eosin images and trained a deep convolutional autoencoder to automatically learn feature representations of individual cancer nuclei. We then computed features of intranuclear variability and internuclear diversity to quantify tumor heterogeneity. Finally, we used these features to build a machine-learning model to predict patient prognosis.

RESULTS

A total of 68 million cancer cells were segmented and analyzed for nuclear image features. We discovered multiple morphological subtypes of cancer cells (range = 15-20) that co-exist within the same tumor, each with distinct phenotypic characteristics. Moreover, we showed that a higher morphological diversity is associated with chromosome instability and genomic aneuploidy. A machine-learning model based on morphological diversity demonstrated independent prognostic values across tumor types (hazard ratio range = 1.62-3.23, P < .035) in validation cohorts and further improved prognostication when combined with clinical risk factors.

CONCLUSIONS

Our study provides a practical approach for quantifying intratumor heterogeneity based on routine histopathology images. The cancer cell diversity score can be used to refine risk stratification and inform personalized treatment strategies.

Accelerating Drug Development Using Spatial Multi-omics

SUMMARY

Spatial biology approaches enabled by innovations in imaging biomarker platforms and artificial intelligence-enabled data integration and analysis provide an assessment of patient and disease heterogeneity at ever-increasing resolution. The utility of spatial biology data in accelerating drug programs, however, requires balancing exploratory discovery investigations against scalable and clinically applicable spatial biomarker analysis.

Semi-Supervised, Attention-Based Deep Learning for Predicting TMPRSS2:ERG Fusion Status in Prostate Cancer Using Whole Slide Images

IMPLICATIONS

Our study illuminates the potential of deep learning in effectively inferring key prostate cancer genetic alterations from the tissue morphology depicted in routinely available histology slides, offering a cost-effective method that could revolutionize diagnostic strategies in oncology.

Integrating AI-Powered Digital Pathology and Imaging Mass Cytometry Identifies Key Classifiers of Tumor Cells, Stroma, and Immune Cells in Non-Small Cell Lung Cancer

Artificial intelligence (AI)-powered approaches are becoming increasingly used as histopathologic tools to extract subvisual features and improve diagnostic workflows. On the other hand, hi-plex approaches are widely adopted to analyze the immune ecosystem in tumor specimens. Here, we aimed at combining AI-aided histopathology and imaging mass cytometry (IMC) to analyze the ecosystem of non-small cell lung cancer (NSCLC). An AI-based approach was used on hematoxylin and eosin (H&E) sections from 158 NSCLC specimens to accurately identify tumor cells, both adenocarcinoma and squamous carcinoma cells, and to generate a classifier of tumor cell spatial clustering. Consecutive tissue sections were stained with metal-labeled antibodies and processed through the IMC workflow, allowing quantitative detection of 24 markers related to tumor cells, tissue architecture, CD45+ myeloid and lymphoid cells, and immune activation. IMC identified 11 macrophage clusters that mainly localized in the stroma, except for S100A8+ cells, which infiltrated tumor nests. T cells were preferentially localized in peritumor areas or in tumor nests, the latter being associated with better prognosis, and they were more abundant in highly clustered tumors. Integrated tumor and immune classifiers were validated as prognostic on whole slides. In conclusion, integration of AI-powered H&E and multiparametric IMC allows investigation of spatial patterns and reveals tissue relevant features with clinical relevance.

SIGNIFICANCE

Leveraging artificial intelligence-powered H&E analysis integrated with hi-plex imaging mass cytometry provides insights into the tumor ecosystem and can translate tumor features into classifiers to predict prognosis, genotype, and therapy response.