Digital pathology for primary diagnosis of screen-detected breast lesions - experimental data, validation and experience from four centres

An update on applications of digital pathology: primary diagnosis; telepathology, education and research

Digital Pathology or whole slide imaging (WSI) is a diagnostic evaluation technique that produces digital images of high quality from tissue fragments. These images are formed on glass slides and evaluated by pathologist with the aid of microscope. As the concept of digital pathology is introduced, these high quality images are digitized and produced on-screen whole slide images in the form of digital files. This has paved the way for pathologists to collaborate with other pathology professionals in case of any additional recommendations and also provides remote working opportunities. The application of digital pathology in clinical practice is glazed with several advantages and adopted by pathologists and researchers for clinical, educational and research purposes. Moreover, digital pathology system integration requires an intensive effort from multiple stakeholders. All pathology departments have different needs, case usage, and blueprints, even though the framework elements and variables for effective clinical integration can be applied to any institution aiming for digital transformation. This article reviews the background and developmental phases of digital pathology and its application in clinical services, educational and research activities.

Digital pathology for reporting histopathology samples, including cancer screening samples - definitive evidence from a multisite study

AIMS

To conduct a definitive multicentre comparison of digital pathology (DP) with light microscopy (LM) for reporting histopathology slides including breast and bowel cancer screening samples.

METHODS

A total of 2024 cases (608 breast, 607 GI, 609 skin, 200 renal) were studied, including 207 breast and 250 bowel cancer screening samples. Cases were examined by four pathologists (16 study pathologists across the four speciality groups), using both LM and DP, with the order randomly assigned and 6 weeks between viewings. Reports were compared for clinical management concordance (CMC), meaning identical diagnoses plus differences which do not affect patient management. Percentage CMCs were computed using logistic regression models with crossed random-effects terms for case and pathologist. The obtained percentage CMCs were referenced to 98.3% calculated from previous studies.

RESULTS

For all cases LM versus DP comparisons showed the CMC rates were 99.95% [95% confidence interval (CI) = 99.90-99.97] and 98.96 (95% CI = 98.42-99.32) for cancer screening samples. In speciality groups CMC for LM versus DP showed: breast 99.40% (99.06-99.62) overall and 96.27% (94.63-97.43) for cancer screening samples; [gastrointestinal (GI) = 99.96% (99.89-99.99)] overall and 99.93% (99.68-99.98) for bowel cancer screening samples; skin 99.99% (99.92-100.0); renal 99.99% (99.57-100.0). Analysis of clinically significant differences revealed discrepancies in areas where interobserver variability is known to be high, in reads performed with both modalities and without apparent trends to either.

CONCLUSIONS

Comparing LM and DP CMC, overall rates exceed the reference 98.3%, providing compelling evidence that pathologists provide equivalent results for both routine and cancer screening samples irrespective of the modality used.

Artificial Intelligence in pathology: current applications, limitations, and future directions

PURPOSE

Given AI's recent success in computer vision applications, majority of pathologists anticipate that it will be able to assist them with a variety of digital pathology activities. Massive improvements in deep learning have enabled a synergy between Artificial Intelligence (AI) and deep learning, enabling image-based diagnosis against the backdrop of digital pathology. AI-based solutions are being developed to eliminate errors and save pathologists time.

AIMS

In this paper, we will discuss the components that went into the use of Artificial Intelligence in Pathology, its use in the medical profession, the obstacles and constraints that it encounters, and the future possibilities of AI in the medical field.

CONCLUSIONS

Based on these factors, we elaborate upon the use of AI in medical pathology and provide future recommendations for its successful implementation in this field.

Standardized Clinical Annotation of Digital Histopathology Slides at the Point of Diagnosis

As digital pathology replaces conventional glass slide microscopy as a means of reporting cellular pathology samples, the annotation of digital pathology whole slide images is rapidly becoming part of a pathologist's regular practice. Currently, there is no recognizable organization of these annotations, and as a result, pathologists adopt an arbitrary approach to defining regions of interest, leading to irregularity and inconsistency and limiting the downstream efficient use of this valuable effort. In this study, we propose a Standardized Annotation Reporting Style for digital whole slide images. We formed a list of 167 commonly annotated entities (under 12 specialty subcategories) based on review of Royal College of Pathologists and College of American Pathologists documents, feedback from reporting pathologists in our NHS department, and experience in developing annotation dictionaries for PathLAKE research projects. Each entity was assigned a suitable annotation shape, SNOMED CT (SNOMED International) code, and unique color. Additionally, as an example of how the approach could be expanded to specific tumor types, all lung tumors in the fifth World Health Organization of thoracic tumors 2021 were included. The proposed standardization of annotations increases their utility, making them identifiable at low power and searchable across and between cases. This would aid pathologists reporting and reviewing cases and enable annotations to be used for research. This structured approach could serve as the basis for an industry standard and be easily adopted to ensure maximum functionality and efficiency in the use of annotations made during routine clinical examination of digital slides.

Future Practices of Breast Pathology Using Digital and Computational Pathology

Pathology clinical practice has evolved by adopting technological advancements initially regarded as potentially disruptive, such as electron microscopy, immunohistochemistry, and genomic sequencing. Breast pathology has a critical role as a medical domain, where the patient's pathology diagnosis has significant implications for prognostication and treatment of diseases. The advent of digital and computational pathology has brought about significant advancements in the field, offering new possibilities for enhancing diagnostic accuracy and improving patient care. Digital slide scanning enables to conversion of glass slides into high-fidelity digital images, supporting the review of cases in a digital workflow. Digitization offers the capability to render specimen diagnoses, digital archival of patient specimens, collaboration, and telepathology. Integration of image analysis and machine learning-based systems layered atop the high-resolution digital images offers novel workflows to assist breast pathologists in their clinical, educational, and research endeavors. Decision support tools may improve the detection and classification of breast lesions and the quantification of immunohistochemical studies. Computational biomarkers may help to contribute to patient management or outcomes. Furthermore, using digital and computational pathology may increase standardization and quality assurance, especially in areas with high interobserver variability. This review explores the current landscape and possible future applications of digital and computational techniques in the field of breast pathology.

Deciphering the Morphology of Tumor-Stromal Features in Invasive Breast Cancer Using Artificial Intelligence

Tumor-associated stroma in breast cancer (BC) is complex and exhibits a high degree of heterogeneity. To date, no standardized assessment method has been established. Artificial intelligence (AI) could provide an objective morphologic assessment of tumors and stroma, with the potential to identify new features not discernible by visual microscopy. In this study, we used AI to assess the clinical significance of (1) stroma-to-tumor ratio (S:TR) and (2) the spatial arrangement of stromal cells, tumor cell density, and tumor burden in BC. Whole-slide images of a large cohort (n = 1968) of well-characterized luminal BC cases were examined. Region and cell-level annotation was performed, and supervised deep learning models were applied for automated quantification of tumor and stromal features. S:TR was calculated in terms of surface area and cell count ratio, and the S:TR heterogeneity and spatial distribution were also assessed. Tumor cell density and tumor size were used to estimate tumor burden. Cases were divided into discovery (n = 1027) and test (n = 941) sets for validation of the findings. In the whole cohort, the stroma-to-tumor mean surface area ratio was 0.74, and stromal cell density heterogeneity score was high (0.7/1). BC with high S:TR showed features characteristic of good prognosis and longer patient survival in both the discovery and test sets. Heterogeneous spatial distribution of S:TR areas was predictive of worse outcome. Higher tumor burden was associated with aggressive tumor behavior and shorter survival and was an independent predictor of worse outcome (BC-specific survival; hazard ratio: 1.7, P = .03, 95% CI, 1.04-2.83 and distant metastasis-free survival; hazard ratio: 1.64, P = .04, 95% CI, 1.01-2.62) superior to absolute tumor size. The study concludes that AI provides a tool to assess major and subtle morphologic stromal features in BC with prognostic implications. Tumor burden is more prognostically informative than tumor size.

Deep learning supported mitoses counting on whole slide images: A pilot study for validating breast cancer grading in the clinical workflow

Introduction

Breast cancer (BC) prognosis is largely influenced by histopathological grade, assessed according to the Nottingham modification of Bloom-Richardson (BR). Mitotic count (MC) is a component of histopathological grading but is prone to subjectivity. This study investigated whether mitoses counting in BC using digital whole slide images (WSI) compares better to light microscopy (LM) when assisted by artificial intelligence (AI), and to which extent differences in digital MC (AI assisted or not) result in BR grade variations.

Methods

Fifty BC patients with paired core biopsies and resections were randomly selected. Component scores for BR grade were extracted from pathology reports. MC was assessed using LM, WSI, and AI. Different modalities (LM-MC, WSI-MC, and AI-MC) were analyzed for correlation with scatterplots and linear regression, and for agreement in final BR with Cohen's κ.

Results

MC modalities strongly correlated in both biopsies and resections: LM-MC and WSI-MC (R² 0.85 and 0.83, respectively), LM-MC and AI-MC (R² 0.85 and 0.95), and WSI-MC and AI-MC (R² 0.77 and 0.83). Agreement in BR between modalities was high in both biopsies and resections: LM-MC and WSI-MC (κ 0.93 and 0.83, respectively), LM-MC and AI-MC (κ 0.89 and 0.83), and WSI-MC and AI-MC (κ 0.96 and 0.73).

Conclusion

This first validation study shows that WSI-MC may compare better to LM-MC when using AI. Agreement between BR grade based on the different mitoses counting modalities was high. These results suggest that mitoses counting on WSI can well be done, and validate the presented AI algorithm for pathologist supervised use in daily practice. Further research is required to advance our knowledge of AI-MC, but it appears at least non-inferior to LM-MC.

Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology

Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.

Current Developments of Artificial Intelligence in Digital Pathology and Its Future Clinical Applications in Gastrointestinal Cancers

The implementation of DP will revolutionize current practice by providing pathologists with additional tools and algorithms to improve workflow. Furthermore, DP will open up opportunities for development of AI-based tools for more precise and reproducible diagnosis through computational pathology. One of the key features of AI is its capability to generate perceptions and recognize patterns beyond the human senses. Thus, the incorporation of AI into DP can reveal additional morphological features and information. At the current rate of AI development and adoption of DP, the interest in computational pathology is expected to rise in tandem. There have already been promising developments related to AI-based solutions in prostate cancer detection; however, in the GI tract, development of more sophisticated algorithms is required to facilitate histological assessment of GI specimens for early and accurate diagnosis. In this review, we aim to provide an overview of the current histological practices in AP laboratories with respect to challenges faced in image preprocessing, present the existing AI-based algorithms, discuss their limitations and present clinical insight with respect to the application of AI in early detection and diagnosis of GI cancer.

Assessment of deep learning algorithms to predict histopathological diagnosis of breast cancer: first Moroccan prospective study on a private dataset

Objective

Breast cancer is a critical public health issue and a leading cause of cancer-related deaths among women worldwide. Its early diagnosis and detection can effectively help in increasing the chances of survival rate. For this reason, the diagnosis and classification of breast cancer using Deep learning algorithms have attracted a lot of attention. Therefore, our study aimed to design a computational approach based on deep convolutional neural networks for an efficient classification of breast cancer histopathological images by using our own created dataset. We collected overall 328 digital slides, from 116 of surgical breast specimens diagnosed with invasive breast carcinoma of non-specific type, and referred to the histopathology department of the National Institute of Oncology in Rabat, Morocco. We used two models of deep neural network architectures in order to accurately classify the images into one of three categories: normal tissue-benign lesions, in situ carcinoma or invasive carcinoma.

Results

Both Resnet50 and Xception models achieved comparable results, with a small advantage to Xception extracted features. We reported high degrees of overall correct classification accuracy (88%), and sensitivity (95%) for detection of carcinoma cases, which is important for diagnostic pathology workflow in order to assist pathologists for diagnosing breast cancer with precision. The results of the present study showed that the designed classification model has a good generalization performance in predicting diagnosis of breast cancer, in spite of the limited size of the data. To our knowledge, this approach can be highly compared with other common methods in the automated analysis of breast cancer images reported in literature.

Potential quality pitfalls of digitalized whole slide image of breast pathology in routine practice

Using digitalized whole slide images (WSI) in routine histopathology practice is a revolutionary technology. This study aims to assess the clinical impacts of WSI quality and representation of the corresponding glass slides. 40,160 breast WSIs were examined and compared with their corresponding glass slides. The presence, frequency, location, tissue type, and the clinical impacts of missing tissue were assessed. Scanning time, type of the specimens, time to WSIs implementation, and quality control (QC) measures were also considered. The frequency of missing tissue ranged from 2% to 19%. The area size of the missed tissue ranged from 1-70%. In most cases (>75%), the missing tissue area size was <10% and peripherally located. In all cases the missed tissue was fat with or without small entrapped normal breast parenchyma. No missing tissue was identified in WSIs of the core biopsy specimens. QC measures improved images quality and reduced WSI failure rates by seven-fold. A negative linear correlation between the frequency of missing tissue and both the scanning time and the image file size was observed (p < 0.05). None of the WSI with missing tissues resulted in a change in the final diagnosis. Missing tissue on breast WSI is observed but with variable frequency and little diagnostic consequence. Balancing between WSI quality and scanning time/image file size should be considered and pathology laboratories should undertake their own assessments of risk and provide the relevant mitigations with the appropriate level of caution.

Perspectives on emerging technologies, personalised medicine, and clinical research for cancer control in Latin America and the Caribbean

Challenges of health systems in Latin America and the Caribbean include accessibility, inequity, segmentation, and poverty. These challenges are similar in different countries of the region and transcend national borders. The increasing digital transformation of health care holds promise of more precise interventions, improved health outcomes, increased efficiency, and ultimately reduced health-care costs. In Latin America and the Caribbean, the adoption of digital health tools is in early stages and the quality of cancer registries, electronic health records, and structured databases are problematic. Cancer research and innovation in the region are limited due to inadequate academic resources and translational research is almost fully dependent on public funding. Regulatory complexity and extended timelines jeopardise the potential improvement in participation in international studies. Emerging technologies, artificial intelligence, big data, and cancer research represent an opportunity to address the health-care challenges in Latin America and the Caribbean collectively, by optimising national capacities, sharing and comparing best practices, and transferring scientific and technical capabilities.

Fully digital pathology laboratory routine and remote reporting of oral and maxillofacial diagnosis during the COVID-19 pandemic: a validation study

The role of digital pathology in remote reporting has seen an increase during the COVID-19 pandemic. Recently, recommendations had been made regarding the urgent need of reorganizing head and neck cancer diagnostic services to provide a safe work environment for the staff. A total of 162 glass slides from 109 patients over a period of 5 weeks were included in this validation and were assessed by all pathologists in both analyses (digital and conventional) to allow intraobserver comparison. The intraobserver agreement between the digital method (DM) and conventional method (CM) was considered almost perfect (κ ranged from 0.85 to 0.98, with 95% CI, ranging from 0.81 to 1). The most significant and frequent disagreements within trainees encompassed epithelial dysplasia grading and differentiation among severe dysplasia (carcinoma in situ) and oral squamous cell carcinoma. The most frequent pitfall from DM was lag in screen mirroring. The lack of details of inflammatory cells and the need for a higher magnification to assess dysplasia were pointed in one case each. The COVID-19 crisis has accelerated and consolidated the use of online meeting tools, which would be a valuable resource even in the post-pandemic scenario. Adaptation in laboratory workflow, the advent of digital pathology and remote reporting can mitigate the impact of similar future disruptions to the oral and maxillofacial pathology laboratory workflow avoiding delays in diagnosis and report, to facilitate timely management of head and neck cancer patients.

The International Collaboration for Cancer Classification and Research

Gaps in the translation of research findings to clinical management have been recognized for decades. They exist for the diagnosis as well as the management of cancer. The international standards for cancer diagnosis are contained within the World Health Organization (WHO) Classification of Tumours, published by the International Agency for Research on Cancer (IARC) and known worldwide as the WHO Blue Books. In addition to their relevance to individual patients, these volumes provide a valuable contribution to cancer research and surveillance, fulfilling an important role in scientific evidence synthesis and international standard setting. However, the multidimensional nature of cancer classification, the way in which the WHO Classification of Tumours is constructed, and the scientific information overload in the field pose important challenges for the translation of research findings to tumour classification and hence cancer diagnosis. To help address these challenges, we have established the International Collaboration for Cancer Classification and Research (IC3 R) to provide a forum for the coordination of efforts in evidence generation, standard setting and best practice recommendations in the field of tumour classification. The first IC3 R meeting, held in Lyon, France, in February 2019, gathered representatives of major institutions involved in tumour classification and related fields to identify and discuss translational challenges in data comparability, standard setting, quality management, evidence evaluation and copyright, as well as to develop a collaborative plan for addressing these challenges.

Microscopic imaging of Inflammatory Bowel Disease (IBD) and Non-IBD Colitis on digital slides: The Italian Group-IBD Pathologists experience

BACKGROUND

The aim of the study is to report the experience of the pathologists of the Italian Group for the Study of Inflammatory Bowel Disease (IBD) (group formed by pathologists with various experience) on the morphological assessment of digital slides pertaining to IBD and Non-IBD colitis underlining the necessity to implement this tool in daily routine and its utility to share opinions on difficult cases.

MATERIALS AND METHODS

Forty-eight histological slides stained with haematoxylin and eosin obtained from ileo-colorectal endoscopic biopsies were digitized using Menarini D-Sight 2.0 system, uploaded onto a website platform and shared among 40 pathologists participating in the study. Information regarding the site of biopsy was disclosed; clinical data were blinded. Each participant was committed to write a comment on microscopic features purposing diagnostic opinion. One month after the last uploaded case, a form was sent to each participant to evaluate the personal experience on digital slide sharing.

RESULTS

Sixteen pathologists out of 40 (40%) had consistently accessed to the site,9/40 (22%) commented on all slides, a diagnostic opinion was rendered in 8 slides. Most common critical issues were: A) poor internet connection resulting in ineffective evaluation of the digital slides, B) time-consuming cases raising difficult diagnostic interpretation, C) lack of clinical history. Overall, 24 participants (60%) found the forum valuable for practical training and educational purposes.

CONCLUSIONS

Sharing scanned slides circulating within a dedicated forum is an effective educational tool in both IBDs and Non-IBDs colitis. Although our results demonstrated a substantial compliance of the participants, their limited participation was an objective shortcoming. Hence, further efforts are needed to encourage this potentially rewarding practice among the pathologist community.

Current and future applications of artificial intelligence in pathology: a clinical perspective

During the last decade, a dramatic rise in the development and application of artificial intelligence (AI) tools for use in pathology services has occurred. This trend is often expected to continue and reshape the field of pathology in the coming years. The deployment of computational pathology and applications of AI tools can be considered as a paradigm shift that will change pathology services, making them more efficient and capable of meeting the needs of this era of precision medicine. Despite the success of AI models, the translational process from discovery to clinical applications has been slow. The gap between self-contained research and clinical environment may be too wide and has been largely neglected. In this review, we cover the current and prospective applications of AI in pathology. We examine its applications in diagnosis and prognosis, and we offer insights for considerations that could improve clinical applicability of these tools. Then, we discuss its potential to improve workflow efficiency, and its benefits in pathologist education. Finally, we review the factors that could influence adoption in clinical practices and the associated regulatory processes.