Deep learning identifies morphological patterns of homologous recombination deficiency in luminal breast cancers from whole slide images

Homologous recombination deficiency (HRD) testing landscape: clinical applications and technical validation for routine diagnostics

The use of poly(ADP-ribose) polymerase inhibitors (PARPi) revolutionized the treatment of BRCA-mutated cancers. Identifying patients exhibiting homologous recombination deficiency (HRD) has been proved useful to predict PARPi efficacy. However, obtaining HRD status remains an arduous task due to its evolution over the time. This causes HRD status to become obsolete when obtained from genomic scars, rendering PARPi ineffective for these patients. Only two HRD tests are currently FDA-approved, both based on genomic scars detection and BRCA mutations testing. Nevertheless, new technologies for obtaining an increasingly reliable HRD status continue to evolve. Application of these tests in clinical practice is an additional challenge due to the need for lower costs and shorter time to results delay.In this review, we describe the currently available methods for HRD testing, including the methodologies and corresponding tests for assessing HRD status, and discuss the clinical routine application of these tests and their technical validation.

Histopathology and proteomics are synergistic for high-grade serous ovarian cancer platinum response prediction

Patients with High-Grade Serous Ovarian Cancer (HGSOC) exhibit varied responses to treatment, with 20-30% showing de novo resistance to platinum-based chemotherapy. While hematoxylin-eosin (H&E)-stained pathological slides are used for routine diagnosis of cancer type, they may also contain diagnostically useful information about treatment response. Our study demonstrates that combining H&E-stained whole slide images (WSIs) with proteomic signatures using a multimodal deep learning framework significantly improves the prediction of platinum response in both discovery and validation cohorts. This method outperforms the Homologous Recombination Deficiency (HRD) score in predicting platinum response and overall patient survival. Our study suggests that histology and proteomics contain complementary information about biological processes determining response to first line platinum treatment in HGSOC. This integrative approach has the potential to improve personalized treatment and provide insights into the therapeutic vulnerabilities of HGSOC.

Molecular Basis of Breast Tumor Heterogeneity

Breast cancer (BC) is a profoundly heterogenous disease, with diverse molecular, histological, and clinical variations. The intricate molecular landscape of BC is evident even at early stages, illustrated by the complexity of the evolution from precursor lesions to invasive carcinoma. The key for therapeutic decision-making is the dynamic assessment of BC receptor status and clinical subtyping. Hereditary BC adds an additional layer of complexity to the disease, given that different cancer susceptibility genes contribute to distinct phenotypes and genomic features. Furthermore, the various BC subtypes display distinct metabolic demands and immune microenvironments. Finally, genotypic-phenotypic correlations in special histologic subtypes of BC inform diagnostic and therapeutic approaches, highlighting the significance of thoroughly comprehending BC heterogeneity.

Publicly available datasets of breast histopathology H&E whole-slide images: A scoping review

Advancements in digital pathology and computing resources have made a significant impact in the field of computational pathology for breast cancer diagnosis and treatment. However, access to high-quality labeled histopathological images of breast cancer is a big challenge that limits the development of accurate and robust deep learning models. In this scoping review, we identified the publicly available datasets of breast H&E-stained whole-slide images (WSIs) that can be used to develop deep learning algorithms. We systematically searched 9 scientific literature databases and 9 research data repositories and found 17 publicly available datasets containing 10 385 H&E WSIs of breast cancer. Moreover, we reported image metadata and characteristics for each dataset to assist researchers in selecting proper datasets for specific tasks in breast cancer computational pathology. In addition, we compiled 2 lists of breast H&E patches and private datasets as supplementary resources for researchers. Notably, only 28% of the included articles utilized multiple datasets, and only 14% used an external validation set, suggesting that the performance of other developed models may be susceptible to overestimation. The TCGA-BRCA was used in 52% of the selected studies. This dataset has a considerable selection bias that can impact the robustness and generalizability of the trained algorithms. There is also a lack of consistent metadata reporting of breast WSI datasets that can be an issue in developing accurate deep learning models, indicating the necessity of establishing explicit guidelines for documenting breast WSI dataset characteristics and metadata.

Generative adversarial networks accurately reconstruct pan-cancer histology from pathologic, genomic, and radiographic latent features

Artificial intelligence models have been increasingly used in the analysis of tumor histology to perform tasks ranging from routine classification to identification of molecular features. These approaches distill cancer histologic images into high-level features, which are used in predictions, but understanding the biologic meaning of such features remains challenging. We present and validate a custom generative adversarial network-HistoXGAN-capable of reconstructing representative histology using feature vectors produced by common feature extractors. We evaluate HistoXGAN across 29 cancer subtypes and demonstrate that reconstructed images retain information regarding tumor grade, histologic subtype, and gene expression patterns. We leverage HistoXGAN to illustrate the underlying histologic features for deep learning models for actionable mutations, identify model reliance on histologic batch effect in predictions, and demonstrate accurate reconstruction of tumor histology from radiographic imaging for a "virtual biopsy."

Deep Learning Artificial Intelligence Predicts Homologous Recombination Deficiency and Platinum Response From Histologic Slides

PURPOSE

Cancers with homologous recombination deficiency (HRD) can benefit from platinum salts and poly(ADP-ribose) polymerase inhibitors. Standard diagnostic tests for detecting HRD require molecular profiling, which is not universally available.

METHODS

We trained DeepHRD, a deep learning platform for predicting HRD from hematoxylin and eosin (H&E)-stained histopathological slides, using primary breast (n = 1,008) and ovarian (n = 459) cancers from The Cancer Genome Atlas (TCGA). DeepHRD was compared with four standard HRD molecular tests using breast (n = 349) and ovarian (n = 141) cancers from multiple independent data sets, including platinum-treated clinical cohorts with RECIST progression-free survival (PFS), complete response (CR), and overall survival (OS) endpoints.

RESULTS

DeepHRD predicted HRD from held-out H&E-stained breast cancer slides in TCGA with an AUC of 0.81 (95% CI, 0.77 to 0.85). This performance was confirmed in two independent primary breast cancer cohorts (AUC, 0.76 [95% CI, 0.71 to 0.82]). In an external platinum-treated metastatic breast cancer cohort, samples predicted as HRD had higher complete CR (AUC, 0.76 [95% CI, 0.54 to 0.93]) with 3.7-fold increase in median PFS (14.4 v 3.9 months; P = .0019) and hazard ratio (HR) of 0.45 (P = .0047). There were no significant differences in nonplatinum treatment outcome by predicted HRD status in three breast cancer cohorts, including CR (AUC, 0.39) and PFS (HR, 0.98, P = .95) in taxane-treated metastatic breast cancer. Through transfer learning to high-grade serous ovarian cancer, DeepHRD-predicted HRD samples had better OS after first-line (HR, 0.46; P = .030) and neoadjuvant (HR, 0.49; P = .015) platinum therapy in two cohorts.

CONCLUSION

DeepHRD can predict HRD in breast and ovarian cancers directly from routine H&E slides across multiple external cohorts, slide scanners, and tissue fixation variables. When compared with molecular testing, DeepHRD classified 1.8- to 3.1-fold more patients with HRD, which exhibited better OS in high-grade serous ovarian cancer and platinum-specific PFS in metastatic breast cancer.

Prediction of homologous recombination deficiency from routine histology with attention-based multiple instance learning in nine different tumor types

BACKGROUND

Homologous recombination deficiency (HRD) is recognized as a pan-cancer predictive biomarker that potentially indicates who could benefit from treatment with PARP inhibitors (PARPi). Despite its clinical significance, HRD testing is highly complex. Here, we investigated in a proof-of-concept study whether Deep Learning (DL) can predict HRD status solely based on routine hematoxylin & eosin (H&E) histology images across nine different cancer types.

METHODS

We developed a deep learning pipeline with attention-weighted multiple instance learning (attMIL) to predict HRD status from histology images. As part of our approach, we calculated a genomic scar HRD score by combining loss of heterozygosity (LOH), telomeric allelic imbalance (TAI), and large-scale state transitions (LST) from whole genome sequencing (WGS) data of n = 5209 patients across two independent cohorts. The model's effectiveness was evaluated using the area under the receiver operating characteristic curve (AUROC), focusing on its accuracy in predicting genomic HRD against a clinically recognized cutoff value.

RESULTS

Our study demonstrated the predictability of genomic HRD status in endometrial, pancreatic, and lung cancers reaching cross-validated AUROCs of 0.79, 0.58, and 0.66, respectively. These predictions generalized well to an external cohort, with AUROCs of 0.93, 0.81, and 0.73. Moreover, a breast cancer-trained image-based HRD classifier yielded an AUROC of 0.78 in the internal validation cohort and was able to predict HRD in endometrial, prostate, and pancreatic cancer with AUROCs of 0.87, 0.84, and 0.67, indicating that a shared HRD-like phenotype occurs across these tumor entities.

CONCLUSIONS

This study establishes that HRD can be directly predicted from H&E slides using attMIL, demonstrating its applicability across nine different tumor types.

DNA damage response in breast cancer and its significant role in guiding novel precise therapies

DNA damage response (DDR) deficiency has been one of the emerging targets in treating breast cancer in recent years. On the one hand, DDR coordinates cell cycle and signal transduction, whose dysfunction may lead to cell apoptosis, genomic instability, and tumor development. Conversely, DDR deficiency is an intrinsic feature of tumors that underlies their response to treatments that inflict DNA damage. In this review, we systematically explore various mechanisms of DDR, the rationale and research advances in DDR-targeted drugs in breast cancer, and discuss the challenges in its clinical applications. Notably, poly (ADP-ribose) polymerase (PARP) inhibitors have demonstrated favorable efficacy and safety in breast cancer with high homogenous recombination deficiency (HRD) status in a series of clinical trials. Moreover, several studies on novel DDR-related molecules are actively exploring to target tumors that become resistant to PARP inhibition. Before further clinical application of new regimens or drugs, novel and standardized biomarkers are needed to develop for accurately characterizing the benefit population and predicting efficacy. Despite the promising efficacy of DDR-related treatments, challenges of off-target toxicity and drug resistance need to be addressed. Strategies to overcome drug resistance await further exploration on DDR mechanisms, and combined targeted drugs or immunotherapy will hopefully provide more precise or combined strategies and expand potential responsive populations.

Deep learning applications in breast cancer histopathological imaging: diagnosis, treatment, and prognosis

Breast cancer is the most common malignant tumor among women worldwide and remains one of the leading causes of death among women. Its incidence and mortality rates are continuously rising. In recent years, with the rapid advancement of deep learning (DL) technology, DL has demonstrated significant potential in breast cancer diagnosis, prognosis evaluation, and treatment response prediction. This paper reviews relevant research progress and applies DL models to image enhancement, segmentation, and classification based on large-scale datasets from TCGA and multiple centers. We employed foundational models such as ResNet50, Transformer, and Hover-net to investigate the performance of DL models in breast cancer diagnosis, treatment, and prognosis prediction. The results indicate that DL techniques have significantly improved diagnostic accuracy and efficiency, particularly in predicting breast cancer metastasis and clinical prognosis. Furthermore, the study emphasizes the crucial role of robust databases in developing highly generalizable models. Future research will focus on addressing challenges related to data management, model interpretability, and regulatory compliance, ultimately aiming to provide more precise clinical treatment and prognostic evaluation programs for breast cancer patients.

Weakly-supervised deep learning models enable HER2-low prediction from H &E stained slides

BACKGROUND

Human epidermal growth factor receptor 2 (HER2)-low breast cancer has emerged as a new subtype of tumor, for which novel antibody-drug conjugates have shown beneficial effects. Assessment of HER2 requires several immunohistochemistry tests with an additional in situ hybridization test if a case is classified as HER2 2+. Therefore, novel cost-effective methods to speed up the HER2 assessment are highly desirable.

METHODS

We used a self-supervised attention-based weakly supervised method to predict HER2-low directly from 1437 histopathological images from 1351 breast cancer patients. We built six distinct models to explore the ability of classifiers to distinguish between the HER2-negative, HER2-low, and HER2-high classes in different scenarios. The attention-based model was used to comprehend the decision-making process aimed at relevant tissue regions.

RESULTS

Our results indicate that the effectiveness of classification models hinges on the consistency and dependability of assay-based tests for HER2, as the outcomes from these tests are utilized as the baseline truth for training our models. Through the use of explainable AI, we reveal histologic patterns associated with the HER2 subtypes.

CONCLUSION

Our findings offer a demonstration of how deep learning technologies can be applied to identify HER2 subgroup statuses, potentially enriching the toolkit available for clinical decision-making in oncology.

Current HRD assays in ovarian cancer: differences, pitfalls, limitations, and novel approaches

Ovarian carcinoma (OC) still represents an insidious and fatal malignancy, and few significant results have been obtained in the last two decades to improve patient survival. Novel targeted therapies such as poly (ADP-ribose) polymerase inhibitors (PARPi) have been successfully introduced in the clinical management of OC, but not all patients will benefit, and drug resistance almost inevitably occurs. The identification of patients who are likely to respond to PARPi-based therapies relies on homologous recombination deficiency (HRD) tests, as this condition is associated with response to these treatments. This review summarizes the genomic and functional HRD assays currently used in clinical practice and those under evaluation, the clinical implications of HRD testing in OC, and their current pitfalls and limitations. Special emphasis will be placed on the functional HRD assays under development and the use of machine learning and artificial intelligence technologies as novel strategies to overcome the current limitations of HRD tests for a better-personalized treatment to improve patient outcomes.

PhiHER2: phenotype-informed weakly supervised model for HER2 status prediction from pathological images

MOTIVATION

Human epidermal growth factor receptor 2 (HER2) status identification enables physicians to assess the prognosis risk and determine the treatment schedule for patients. In clinical practice, pathological slides serve as the gold standard, offering morphological information on cellular structure and tumoral regions. Computational analysis of pathological images has the potential to discover morphological patterns associated with HER2 molecular targets and achieve precise status prediction. However, pathological images are typically equipped with high-resolution attributes, and HER2 expression in breast cancer (BC) images often manifests the intratumoral heterogeneity.

RESULTS

We present a phenotype-informed weakly supervised multiple instance learning architecture (PhiHER2) for the prediction of the HER2 status from pathological images of BC. Specifically, a hierarchical prototype clustering module is designed to identify representative phenotypes across whole slide images. These phenotype embeddings are then integrated into a cross-attention module, enhancing feature interaction and aggregation on instances. This yields a phenotype-based feature space that leverages the intratumoral morphological heterogeneity for HER2 status prediction. Extensive results demonstrate that PhiHER2 captures a better WSI-level representation by the typical phenotype guidance and significantly outperforms existing methods on real-world datasets. Additionally, interpretability analyses of both phenotypes and WSIs provide explicit insights into the heterogeneity of morphological patterns associated with molecular HER2 status.

AVAILABILITY AND IMPLEMENTATION

Our model is available at https://github.com/lyotvincent/PhiHER2.

AI powered quantification of nuclear morphology in cancers enables prediction of genome instability and prognosis

While alterations in nucleus size, shape, and color are ubiquitous in cancer, comprehensive quantification of nuclear morphology across a whole-slide histologic image remains a challenge. Here, we describe the development of a pan-tissue, deep learning-based digital pathology pipeline for exhaustive nucleus detection, segmentation, and classification and the utility of this pipeline for nuclear morphologic biomarker discovery. Manually-collected nucleus annotations were used to train an object detection and segmentation model for identifying nuclei, which was deployed to segment nuclei in H&E-stained slides from the BRCA, LUAD, and PRAD TCGA cohorts. Interpretable features describing the shape, size, color, and texture of each nucleus were extracted from segmented nuclei and compared to measurements of genomic instability, gene expression, and prognosis. The nuclear segmentation and classification model trained herein performed comparably to previously reported models. Features extracted from the model revealed differences sufficient to distinguish between BRCA, LUAD, and PRAD. Furthermore, cancer cell nuclear area was associated with increased aneuploidy score and homologous recombination deficiency. In BRCA, increased fibroblast nuclear area was indicative of poor progression-free and overall survival and was associated with gene expression signatures related to extracellular matrix remodeling and anti-tumor immunity. Thus, we developed a powerful pan-tissue approach for nucleus segmentation and featurization, enabling the construction of predictive models and the identification of features linking nuclear morphology with clinically-relevant prognostic biomarkers across multiple cancer types.

Histopathology and proteomics are synergistic for High-Grade Serous Ovarian Cancer platinum response prediction

Patients with High-Grade Serous Ovarian Cancer (HGSOC) exhibit varied responses to treatment, with 20-30% showing de novo resistance to platinum-based chemotherapy. While hematoxylin-eosin (H&E) pathological slides are used for routine diagnosis of cancer type, they may also contain diagnostically useful information about treatment response. Our study demonstrates that combining H&E-stained Whole Slide Images (WSIs) with proteomic signatures using a multimodal deep learning framework significantly improves the prediction of platinum response in both discovery and validation cohorts. This method outperforms the Homologous Recombination Deficiency (HRD) score in predicting platinum response and overall patient survival. The study sets new performance benchmarks and explores the intersection of histology and proteomics, highlighting phenotypes related to treatment response pathways, including homologous recombination, DNA damage response, nucleotide synthesis, apoptosis, and ER stress. This integrative approach has the potential to improve personalized treatment and provide insights into the therapeutic vulnerabilities of HGSOC.

Early Breast Cancer Risk Assessment: Integrating Histopathology with Artificial Intelligence

Effective risk assessment in early breast cancer is essential for informed clinical decision-making, yet consensus on defining risk categories remains challenging. This paper explores evolving approaches in risk stratification, encompassing histopathological, immunohistochemical, and molecular biomarkers alongside cutting-edge artificial intelligence (AI) techniques. Leveraging machine learning, deep learning, and convolutional neural networks, AI is reshaping predictive algorithms for recurrence risk, thereby revolutionizing diagnostic accuracy and treatment planning. Beyond detection, AI applications extend to histological subtyping, grading, lymph node assessment, and molecular feature identification, fostering personalized therapy decisions. With rising cancer rates, it is crucial to implement AI to accelerate breakthroughs in clinical practice, benefiting both patients and healthcare providers. However, it is important to recognize that while AI offers powerful automation and analysis tools, it lacks the nuanced understanding, clinical context, and ethical considerations inherent to human pathologists in patient care. Hence, the successful integration of AI into clinical practice demands collaborative efforts between medical experts and computational pathologists to optimize patient outcomes.

Immune-tumor interaction dictates spatially directed evolution of esophageal squamous cell carcinoma

Esophageal squamous cell carcinoma (ESCC) is a poor-prognostic cancer type with extensive intra- and inter-patient heterogeneity in both genomic variations and tumor microenvironment (TME). However, the patterns and drivers of spatial genomic and microenvironmental heterogeneity of ESCC remain largely unknown. Here, we generated a spatial multi-omic atlas by whole-exome, transcriptome, and methylome sequencing of 507 tumor samples from 103 patients. We identified a novel tumor suppressor PREX2, accounting for 22% of ESCCs with frequent somatic mutations or hyper-methylation, which promoted migration and invasion of ESCC cells in vitro. Analysis of the TME and quantification of subclonal expansion indicated that ESCCs undergo spatially directed evolution, where subclones mostly originated from the tumor center but had a biased clonal expansion to the upper direction of the esophagus. Interestingly, we found upper regions of ESCCs often underwent stronger immunoediting with increased selective fitness, suggesting more stringent immune selection. In addition, distinct TMEs were associated with variable genomic and clinical outcomes. Among them, hot TME was associated with high immune evasion and subclonal heterogeneity. We also found that immunoediting, instead of CD8+ T cell abundance, acts as an independent prognostic factor of ESCCs. Importantly, we found significant heterogeneity in previously considered potential therapeutic targets, as well as BRCAness characteristics in a subset of patients, emphasizing the importance of focusing on heterogeneity in ESCC targeted therapy. Collectively, these findings provide novel insights into the mechanisms of the spatial evolution of ESCC and inform precision therapeutic strategies.

Artificial intelligence in digital histopathology for predicting patient prognosis and treatment efficacy in breast cancer

INTRODUCTION

Histological images contain phenotypic information predictive of patient outcomes. Due to the heavy workload of pathologists, the time-consuming nature of quantitatively assessing histological features, and human eye limitations to recognize spatial patterns, manually extracting prognostic information in routine pathological workflows remains challenging. Digital pathology has facilitated the mining and quantification of these features utilizing whole-slide image (WSI) scanners and artificial intelligence (AI) algorithms. AI algorithms to identify image-based biomarkers from the tumor microenvironment (TME) have the potential to revolutionize the field of oncology, reducing delays between diagnosis and prognosis determination, allowing for rapid stratification of patients and prescription of optimal treatment regimes, thereby improving patient outcomes.

AREAS COVERED

In this review, the authors discuss how AI algorithms and digital pathology can predict breast cancer patient prognosis and treatment outcomes using image-based biomarkers, along with the challenges of adopting this technology in clinical settings.

EXPERT OPINION

The integration of AI and digital pathology presents significant potential for analyzing the TME and its diagnostic, prognostic, and predictive value in breast cancer patients. Widespread clinical adoption of AI faces ethical, regulatory, and technical challenges, although prospective trials may offer reassurance and promote uptake, ultimately improving patient outcomes by reducing diagnosis-to-prognosis delivery delays.

Generative Adversarial Networks Accurately Reconstruct Pan-Cancer Histology from Pathologic, Genomic, and Radiographic Latent Features

Artificial intelligence models have been increasingly used in the analysis of tumor histology to perform tasks ranging from routine classification to identification of novel molecular features. These approaches distill cancer histologic images into high-level features which are used in predictions, but understanding the biologic meaning of such features remains challenging. We present and validate a custom generative adversarial network - HistoXGAN - capable of reconstructing representative histology using feature vectors produced by common feature extractors. We evaluate HistoXGAN across 29 cancer subtypes and demonstrate that reconstructed images retain information regarding tumor grade, histologic subtype, and gene expression patterns. We leverage HistoXGAN to illustrate the underlying histologic features for deep learning models for actionable mutations, identify model reliance on histologic batch effect in predictions, and demonstrate accurate reconstruction of tumor histology from radiographic imaging for a 'virtual biopsy'.

Tumor Mutation Burden-Related Histopathologic Features for Predicting Overall Survival in Gliomas Using Graph Deep Learning

Tumor mutation burden (TMB) is a potential biomarker for evaluating the prognosis and response to immune checkpoint inhibitors, but its costly and time-consuming method of measurement limits its widespread application. This study aimed to identify the TMB-related histopathologic features from hematoxylin and eosin slides and explore their prognostic value in gliomas. TMB-related features were detected using a graph convolutional neural network from whole-slide images of patients from The Cancer Genome Atlas data set (619 patients), and the correlation between features and TMB was evaluated in an external validation set (237 patients). TMB-related features were used for predicting overall survival (OS) of patients to investigate whether these features have potential for prognostic prediction. Moreover, biological pathways underlying the prognostic value of the features were further explored. Histopathologic features derived from whole-slide images were significantly associated with patient TMB (P = 0.007 in the external validation set). TMB-related features showed excellent performance for OS prediction, and patients with lower-grade gliomas could be further stratified into different risk groups according to the features (P = 0.00013; hazard ratio, 4.004). Pathways involved in the cell cycle and execution of immune response were enriched in patients with higher OS risk. The TMB-related features could be used to estimate TMB and aid in prognostic risk stratification of patients with glioma with dysregulated biological pathways.

AI diagnosis of Bethesda category IV thyroid nodules

Thyroid nodules are a common disease, and fine needle aspiration cytology (FNAC) is the primary method to assess their malignancy. For the diagnosis of follicular thyroid nodules, however, FNAC has limitations. FNAC can classify them only as Bethesda IV nodules, leaving their exact malignant status and pathological type undetermined. This imprecise diagnosis creates difficulties in selecting the follow-up treatment. In this retrospective study, we collected ultrasound (US) image data of Bethesda IV thyroid nodules from 2006 to 2022 from five hospitals. Then, US image-based artificial intelligence (AI) models were trained to identify the specific category of Bethesda IV thyroid nodules. We tested the models using two independent datasets, and the best AI model achieved an area under the curve (AUC) between 0.90 and 0.95, demonstrating its potential value for clinical application. Our research findings indicate that AI could change the diagnosis and management process of Bethesda IV thyroid nodules.

AI-enabled routine H&E image based prognostic marker for early-stage luminal breast cancer

Breast cancer (BC) grade is a well-established subjective prognostic indicator of tumour aggressiveness. Tumour heterogeneity and subjective assessment result in high degree of variability among observers in BC grading. Here we propose an objective Haematoxylin & Eosin (H&E) image-based prognostic marker for early-stage luminal/Her2-negative BReAst CancEr that we term as the BRACE marker. The proposed BRACE marker is derived from AI based assessment of heterogeneity in BC at a detailed level using the power of deep learning. The prognostic ability of the marker is validated in two well-annotated cohorts (Cohort-A/Nottingham: n = 2122 and Cohort-B/Coventry: n = 311) on early-stage luminal/HER2-negative BC patients treated with endocrine therapy and with long-term follow-up. The BRACE marker is able to stratify patients for both distant metastasis free survival (p = 0.001, C-index: 0.73) and BC specific survival (p < 0.0001, C-index: 0.84) showing comparable prediction accuracy to Nottingham Prognostic Index and Magee scores, which are both derived from manual histopathological assessment, to identify luminal BC patients that may be likely to benefit from adjuvant chemotherapy.

Artificial intelligence in ovarian cancer histopathology: a systematic review

This study evaluates the quality of published research using artificial intelligence (AI) for ovarian cancer diagnosis or prognosis using histopathology data. A systematic search of PubMed, Scopus, Web of Science, Cochrane CENTRAL, and WHO-ICTRP was conducted up to May 19, 2023. Inclusion criteria required that AI was used for prognostic or diagnostic inferences in human ovarian cancer histopathology images. Risk of bias was assessed using PROBAST. Information about each model was tabulated and summary statistics were reported. The study was registered on PROSPERO (CRD42022334730) and PRISMA 2020 reporting guidelines were followed. Searches identified 1573 records, of which 45 were eligible for inclusion. These studies contained 80 models of interest, including 37 diagnostic models, 22 prognostic models, and 21 other diagnostically relevant models. Common tasks included treatment response prediction (11/80), malignancy status classification (10/80), stain quantification (9/80), and histological subtyping (7/80). Models were developed using 1-1375 histopathology slides from 1-776 ovarian cancer patients. A high or unclear risk of bias was found in all studies, most frequently due to limited analysis and incomplete reporting regarding participant recruitment. Limited research has been conducted on the application of AI to histopathology images for diagnostic or prognostic purposes in ovarian cancer, and none of the models have been demonstrated to be ready for real-world implementation. Key aspects to accelerate clinical translation include transparent and comprehensive reporting of data provenance and modelling approaches, and improved quantitative evaluation using cross-validation and external validations. This work was funded by the Engineering and Physical Sciences Research Council.

Computational pathology in cancer diagnosis, prognosis, and prediction - present day and prospects

Computational pathology refers to applying deep learning techniques and algorithms to analyse and interpret histopathology images. Advances in artificial intelligence (AI) have led to an explosion in innovation in computational pathology, ranging from the prospect of automation of routine diagnostic tasks to the discovery of new prognostic and predictive biomarkers from tissue morphology. Despite the promising potential of computational pathology, its integration in clinical settings has been limited by a range of obstacles including operational, technical, regulatory, ethical, financial, and cultural challenges. Here, we focus on the pathologists' perspective of computational pathology: we map its current translational research landscape, evaluate its clinical utility, and address the more common challenges slowing clinical adoption and implementation. We conclude by describing contemporary approaches to drive forward these techniques. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

The slow-paced digital evolution of pathology: lights and shadows from a multifaceted board

Objective

The digital revolution in pathology represents an invaluable resource fto optimise costs, reduce the risk of error and improve patient care, even though it is still adopted in a minority of laboratories. Barriers include concerns about initial costs, lack of confidence in using whole slide images for primary diagnosis, and lack of guidance on transition. To address these challenges and develop a programme to facilitate the introduction of digital pathology (DP) in Italian pathology departments, a panel discussion was set up to identify the key points to be considered.

Methods

On 21 July 2022, an initial conference call was held on Zoom to identify the main issues to be discussed during the face-to-face meeting. The final summit was divided into four different sessions: (I) the definition of DP, (II) practical applications of DP, (III) the use of AI in DP, (IV) DP and education.

Results

Essential requirements for the implementation of DP are a fully tracked and automated workflow, selection of the appropriate scanner based on the specific needs of each department, and a strong commitment combined with coordinated teamwork (pathologists, technicians, biologists, IT service and industries). This could reduce human error, leading to the application of AI tools for diagnosis, prognosis and prediction. Open challenges are the lack of specific regulations for virtual slide storage and the optimal storage solution for large volumes of slides.

Conclusion

Teamwork is key to DP transition, including close collaboration with industry. This will ease the transition and help bridge the gap that currently exists between many labs and full digitisation. The ultimate goal is to improve patient care.

Direct prediction of Homologous Recombination Deficiency from routine histology in ten different tumor types with attention-based Multiple Instance Learning: a development and validation study

Background

Homologous Recombination Deficiency (HRD) is a pan-cancer predictive biomarker that identifies patients who benefit from therapy with PARP inhibitors (PARPi). However, testing for HRD is highly complex. Here, we investigated whether Deep Learning can predict HRD status solely based on routine Hematoxylin & Eosin (H&E) histology images in ten cancer types.

Methods

We developed a fully automated deep learning pipeline with attention-weighted multiple instance learning (attMIL) to predict HRD status from histology images. A combined genomic scar HRD score, which integrated loss of heterozygosity (LOH), telomeric allelic imbalance (TAI) and large-scale state transitions (LST) was calculated from whole genome sequencing data for n=4,565 patients from two independent cohorts. The primary statistical endpoint was the Area Under the Receiver Operating Characteristic curve (AUROC) for the prediction of genomic scar HRD with a clinically used cutoff value.

Results

We found that HRD status is predictable in tumors of the endometrium, pancreas and lung, reaching cross-validated AUROCs of 0.79, 0.58 and 0.66. Predictions generalized well to an external cohort with AUROCs of 0.93, 0.81 and 0.73 respectively. Additionally, an HRD classifier trained on breast cancer yielded an AUROC of 0.78 in internal validation and was able to predict HRD in endometrial, prostate and pancreatic cancer with AUROCs of 0.87, 0.84 and 0.67 indicating a shared HRD-like phenotype is across tumor entities.

Conclusion

In this study, we show that HRD is directly predictable from H&E slides using attMIL within and across ten different tumor types.

Deep Learning Prediction of TERT Promoter Mutation Status in Thyroid Cancer Using Histologic Images

Background and objectives: Telomerase reverse transcriptase (TERT) promoter mutation, found in a subset of patients with thyroid cancer, is strongly associated with aggressive biologic behavior. Predicting TERT promoter mutation is thus necessary for the prognostic stratification of thyroid cancer patients. Materials and Methods: In this study, we evaluate TERT promoter mutation status in thyroid cancer through the deep learning approach using histologic images. Our analysis included 13 consecutive surgically resected thyroid cancers with TERT promoter mutations (either C228T or C250T) and 12 randomly selected surgically resected thyroid cancers with a wild-type TERT promoter. Our deep learning model was created using a two-step cascade approach. First, tumor areas were identified using convolutional neural networks (CNNs), and then TERT promoter mutations within tumor areas were predicted using the CNN–recurrent neural network (CRNN) model. Results: Using the hue–saturation–value (HSV)-strong color transformation scheme, the overall experiment results show 99.9% sensitivity and 60% specificity (improvements of approximately 25% and 37%, respectively, compared to image normalization as a baseline model) in predicting TERT mutations. Conclusions: Highly sensitive screening for TERT promoter mutations is possible using histologic image analysis based on deep learning. This approach will help improve the classification of thyroid cancer patients according to the biologic behavior of tumors.

HRD-related morphology discovery in breast cancer by controlling for confounding factors

Lazard et al.¹ predict homologous recombination deficiency from hematoxylin and eosin-stained slides of breast cancer tissue using deep learning. By controlling for technical artifacts on a curated dataset, the model puts forward novel HRD-related morphologies in luminal breast cancers.