Clinical Application of Image Analysis in Pathology

Color Standardization and Stain Intensity Calibration for Whole Slide Image-Based Immunohistochemistry Assessment

Automated quantification of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) using whole slide imaging (WSI) is expected to eliminate subjectivity in visual assessment. However, the color intensity in WSI varies depending on the staining process and scanner device. Such variations affect the image analysis results. This paper presents methods to diminish the influence of color variation produced in the staining process using a calibrator slide consisting of peptide-coated microbeads. The calibrator slide is stained along with tissue sample slides, and the 3,3'-diaminobenzidine (DAB) color intensities of the microbeads are used for calibrating the color variation of the sample slides. An off-the-shelf image analysis tool is employed for the automated assessment, in which cells are classified by the thresholds for the membrane staining. We have adopted two methods for calibrating the color variation based on the DAB color intensities obtained from the calibrator slide: (1) thresholds for classifying the DAB membranous intensity are adjusted, and (2) the color intensity of WSI is corrected. In the experiment, the calibrator slides and tissue of breast cancer slides were stained together on different days and used to test our protocol. With the proposed protocol, the discordance in the HER2 evaluation was reduced to one slide out of 120 slides.

Learning with limited target data to detect cells in cross-modality images

Deep neural networks have achieved excellent cell or nucleus quantification performance in microscopy images, but they often suffer from performance degradation when applied to cross-modality imaging data. Unsupervised domain adaptation (UDA) based on generative adversarial networks (GANs) has recently improved the performance of cross-modality medical image quantification. However, current GAN-based UDA methods typically require abundant target data for model training, which is often very expensive or even impossible to obtain for real applications. In this paper, we study a more realistic yet challenging UDA situation, where (unlabeled) target training data is limited and previous work seldom delves into cell identification. We first enhance a dual GAN with task-specific modeling, which provides additional supervision signals to assist with generator learning. We explore both single-directional and bidirectional task-augmented GANs for domain adaptation. Then, we further improve the GAN by introducing a differentiable, stochastic data augmentation module to explicitly reduce discriminator overfitting. We examine source-, target-, and dual-domain data augmentation for GAN enhancement, as well as joint task and data augmentation in a unified GAN-based UDA framework. We evaluate the framework for cell detection on multiple public and in-house microscopy image datasets, which are acquired with different imaging modalities, staining protocols and/or tissue preparations. The experiments demonstrate that our method significantly boosts performance when compared with the reference baseline, and it is superior to or on par with fully supervised models that are trained with real target annotations. In addition, our method outperforms recent state-of-the-art UDA approaches by a large margin on different datasets.

Digital pathology systems enabling quality patient care

Pathology laboratories are undergoing digital transformations, adopting innovative technologies to enhance patient care. Digital pathology systems impact clinical, education, and research use cases where pathologists use digital technologies to perform tasks in lieu of using glass slides and a microscope. Pathology professional societies have established clinical validation guidelines, and the US Food and Drug Administration have also authorized digital pathology systems for primary diagnosis, including image analysis and machine learning systems. Whole slide images, or digital slides, can be viewed and navigated similar to glass slides on a microscope. These modern tools not only enable pathologists to practice their routine clinical activities, but can potentially enable digital computational discovery. Assimilation of whole slide images in pathology clinical workflow can further empower machine learning systems to support computer assisted diagnostics. The potential enrichment these systems can provide is unprecedented in the field of pathology. With appropriate integration, these clinical decision support systems will allow pathologists to increase the delivery of quality patient care. This review describes the digital pathology transformation process, applicable clinical use cases, incorporation of image analysis and machine learning systems in the clinical workflow, as well as future technologies that may further disrupt pathology modalities to deliver quality patient care.

Future Practices of Breast Pathology Using Digital and Computational Pathology

Pathology clinical practice has evolved by adopting technological advancements initially regarded as potentially disruptive, such as electron microscopy, immunohistochemistry, and genomic sequencing. Breast pathology has a critical role as a medical domain, where the patient's pathology diagnosis has significant implications for prognostication and treatment of diseases. The advent of digital and computational pathology has brought about significant advancements in the field, offering new possibilities for enhancing diagnostic accuracy and improving patient care. Digital slide scanning enables to conversion of glass slides into high-fidelity digital images, supporting the review of cases in a digital workflow. Digitization offers the capability to render specimen diagnoses, digital archival of patient specimens, collaboration, and telepathology. Integration of image analysis and machine learning-based systems layered atop the high-resolution digital images offers novel workflows to assist breast pathologists in their clinical, educational, and research endeavors. Decision support tools may improve the detection and classification of breast lesions and the quantification of immunohistochemical studies. Computational biomarkers may help to contribute to patient management or outcomes. Furthermore, using digital and computational pathology may increase standardization and quality assurance, especially in areas with high interobserver variability. This review explores the current landscape and possible future applications of digital and computational techniques in the field of breast pathology.

Standardizing HER2 immunohistochemistry assessment: calibration of color and intensity variation in whole slide imaging caused by staining and scanning

In the evaluation of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) - one of the standard biomarkers for breast cancer- visual assessment is laborious and subjective. Image analysis using whole slide image (WSI) could produce more consistent results; however, color variability in WSIs due to the choice of stain and scanning processes may impact image analysis. We therefore developed a calibration protocol to diminish the staining and scanning variations of WSI using two calibrator slides. The IHC calibrator slide (IHC-CS) contains peptide-coated microbeads with different concentrations. The color distribution obtained from the WSI of stained IHC-CS reflects the staining process and scanner characteristics. A color chart slide (CCS) is also useful for calibrating the color variation due to the scanner. The results of the automated HER2 assessment were compared to confirm the effectiveness of two calibration slides. The IHC-CS and HER2 breast cancer cases were stained on different days. All stained slides and CCS were digitized by two different WSI scanners. Results revealed 100% concordance between automated evaluation and the pathologist's assessment with both the scanner and staining calibration. The proposed method may enable consistent evaluation of HER2.

Multiplex Immunohistochemistry and Immunofluorescence: A Practical Update for Pathologists

Our understanding of the biology and management of human disease has undergone a remarkable evolution in recent decades. Improved understanding of the roles of complex immune populations in the tumor microenvironment has advanced our knowledge of antitumor immunity, and immunotherapy has radically improved outcomes for many advanced cancers. Digital pathology has unlocked new possibilities for the assessment and discovery of the tumor microenvironment, such as quantitative and spatial image analysis. Despite these advances, tissue-based evaluations for diagnosis and prognosis continue to rely on traditional practices, such as hematoxylin and eosin staining, supplemented by the assessment of single biomarkers largely using chromogenic immunohistochemistry (IHC). Such approaches are poorly suited to complex quantitative analyses and the simultaneous evaluation of multiple biomarkers. Thus, multiplex staining techniques have significant potential to improve diagnostic practice and immuno-oncology research. The different approaches to achieve multiplexed IHC and immunofluorescence are described in this study. Alternatives to multiplex immunofluorescence/IHC include epitope-based tissue mass spectrometry and digital spatial profiling (DSP), which require specialized platforms not available to most clinical laboratories. Virtual multiplexing, which involves digitally coregistering singleplex IHC stains performed on serial sections, is another alternative to multiplex staining. Regardless of the approach, analysis of multiplexed stains sequentially or simultaneously will benefit from standardized protocols and digital pathology workflows. Although this is a complex and rapidly advancing field, multiplex staining is now technically feasible for most clinical laboratories and may soon be leveraged for routine diagnostic use. This review provides an update on the current state of the art for tissue multiplexing, including the capabilities and limitations of different techniques, with an emphasis on potential relevance to clinical diagnostic practice.

The Approach of Artificial Intelligence in Neuroendocrine Carcinomas of the Breast: A Next Step towards Precision Pathology?—A Case Report and Review of the Literature

Primary neuroendocrine tumors (NETs) of the breast are considered a rare and undervalued subtype of breast carcinoma that occur mainly in postmenopausal women and are graded as G1 or G2 NETs or an invasive neuroendocrine carcinoma (NEC) (small cell or large cell). To establish a final diagnosis of breast carcinoma with neuroendocrine differentiation, it is essential to perform an immunohistochemical profile of the tumor, using antibodies against synaptophysin or chromogranin, as well as the MIB-1 proliferation index, one of the most controversial markers in breast pathology regarding its methodology in current clinical practice. A standardization error between institutions and pathologists regarding the evaluation of the MIB-1 proliferation index is present. Another challenge refers to the counting process of MIB-1′s expressiveness, which is known as a time-consuming process. The involvement of AI (artificial intelligence) automated systems could be a solution for diagnosing early stages, as well. We present the case of a post-menopausal 79-year-old woman diagnosed with primary neuroendocrine carcinoma of the breast (NECB). The purpose of this paper is to expose the interpretation of MIB-1 expression in our patient’ s case of breast neuroendocrine carcinoma, assisted by artificial intelligence (AI) software (HALO—IndicaLabs), and to analyze the associations between MIB-1 and common histopathological parameters.

Investigating In Situ Expression of c-MYC and Candidate Ubiquitin-Specific Proteases in DLBCL and Assessment for Peptidyl Disruptor Molecule against c-MYC-USP37 Complex

Diffuse Large B-Cell Lymphoma (DLBCL) is the most common form of non-Hodgkin's lymphoma (NHL). Elevated expression of c-MYC in DLBCL is associated with poor prognosis of the disease. In different cancers, c-MYC has been found regulated by different ubiquitin-specific proteases (USPs), but to date, the role of USPs in c-MYC regulation has not been investigated in DLBCL. In this study, in situ co expression of c-MYC and three candidates USPs, USP28, USP36 and USP37, have been investigated in both the ABC and GCB subtypes of DLBCL. This shows that USP37 expression is positively correlated with the c-MYC expression in the ABC subtype of DLBCL. Structurally, both c-MYC and USP37 has shown large proportion of intrinsically disordered regions, minimizing their chances for full structure crystallization. Peptide array and docking simulations has shown that N-terminal region of c-MYC interacts directly with residues within and in proximity of catalytically active C19 domain of the USP37. Given the structural properties of the interaction sites in the c-MYC-USP37 complex, a peptidyl inhibitor has been designed. Molecular docking has shown that the peptide fits well in the targeted site of c-MYC, masking most of its residues involved in the binding with USP37. The findings could further be exploited to develop therapeutic interventions against the ABC subtype of DLBCL.

The Evolution of Ki-67 and Breast Carcinoma: Past Observations, Present Directions, and Future Considerations

The 1983 discovery of a mouse monoclonal antibody-the Ki-67 antibody-that recognized a nuclear antigen present only in proliferating cells represented a seminal discovery for the pathologic assessment of cellular proliferation in breast cancer and other solid tumors. Cellular proliferation is a central determinant of prognosis and response to cytotoxic chemotherapy in patients with breast cancer, and since the discovery of the Ki-67 antibody, Ki-67 has evolved as an important biomarker with both prognostic and predictive potential in breast cancer. Although there is universal recognition among the international guideline recommendations of the value of Ki-67 in breast cancer, recommendations for the actual use of Ki-67 assays in the prognostic and predictive evaluation of breast cancer remain mixed, primarily due to the lack of assay standardization and inconsistent inter-observer and inter-laboratory reproducibility. The treatment of high-risk ER-positive/human epidermal growth factor receptor-2 (HER2) negative breast cancer with the recently FDA-approved drug abemaciclib relies on a quantitative assessment of Ki-67 expression in the treatment decision algorithm. This further reinforces the urgent need for standardization of Ki-67 antibody selection and staining interpretation, which will hopefully lead to multidisciplinary consensus on the use of Ki-67 as a prognostic and predictive marker in breast cancer. The goals of this review are to highlight the historical evolution of Ki-67 in breast cancer, summarize the present literature on Ki-67 in breast cancer, and discuss the evolving literature on the use of Ki-67 as a companion diagnostic biomarker in breast cancer, with consideration for the necessary changes required across pathology practices to help increase the reliability and widespread adoption of Ki-67 as a prognostic and predictive marker for breast cancer in clinical practice.

Current and Emerging Approaches to Study Microenvironmental Interactions and Drug Activity in Classical Hodgkin Lymphoma

Simple Summary

In classical Hodgkin Lymphoma (cHL), the tumor microenvironment (TME) plays an important role in tumor progression and treatment response, making its evaluation critical for determining prognosis, treatment strategies and predicting an increase in drug toxicity. Therefore, there is a need to utilize more complex systems to study the cHL-TME and its interplay with tumor cells. To evaluate new anticancer drugs and to find the mechanisms of drug resistance, this review summarizes emerging approaches for the analysis of the TME composition and to identify the state of the disease; the in vitro techniques used to determine the mechanisms involved in the building of an immunosuppressive and protective TME; new 3-dimensional (3D) models, the heterospheroids (HS), developed to mimic TME interactions. Here, we describe the present and likely future clinical applications indicated by the results of these studies and propose a classification for the in vitro culture methods used to study TME interactions in cHL.

Abstract

Classic Hodgkin lymphoma is characterized by a few tumor cells surrounded by a protective and immunosuppressive tumor microenvironment (TME) composed by a wide variety of noncancerous cells that are an active part of the disease. Therefore, new techniques to study the cHL-TME and new therapeutic strategies targeting specifically tumor cells, reactivating the antitumor immunity, counteracting the protective effects of the TME, were developed. Here, we describe new methods used to study the cell composition, the phenotype, and the spatial distribution of Hodgkin and Reed–Sternberg (HRS) cells and of noncancerous cells in tumor tissues. Moreover, we propose a classification, with increasing complexity, of the in vitro functional studies used to clarify the interactions leading not only to HRS cell survival, growth and drug resistance, but also to the immunosuppressive tumor education of monocytes, T lymphocytes and fibroblasts. This classification also includes new 3-dimensional (3D) models, obtained by cultivating HRS cells in extracellular matrix scaffolds or in sponge scaffolds, under non-adherent conditions with noncancerous cells to form heterospheroids (HS), implanted in developing chick eggs (ovo model). We report results obtained with these approaches and their applications in clinical setting.

High throughput whole-slide scanning to enable large-scale data repository building

Digital pathology and artificial intelligence (AI) rely on digitization of patient material as a necessary first step. AI development benefits from large sample sizes and diverse cohorts, and therefore efforts to digitize glass slides must meet these needs in an efficient and cost-effective manner. Technical innovation in whole-slide imaging has enabled high throughput slide scanning through the coordinated increase in scanner capacity, speed, and automation. Combining these hardware innovations with automated informatics approaches has enabled more efficient workflows and the opportunity to provide higher quality imaging data using fewer personnel. Here we review several practical considerations for deploying high throughput scanning and we present strategies to increase efficiency with a focus on quality. Finally, we review remaining challenges and issue a call to vendors to innovate in the areas of automation and quality control in order to make high throughput scanning realizable to laboratories with limited resources. This article is protected by copyright. All rights reserved.

Digital Technology in Diagnostic Breast Pathology and Immunohistochemistry

Digital technology has been used in the field of diagnostic breast pathology and immunohistochemistry (IHC) for decades. Examples include automated tissue processing and staining, digital data processing, storing and management, voice recognition systems, and digital technology-based production of antibodies and other IHC reagents. However, the recent application of whole slide imaging technology and artificial intelligence (AI)-based tools has attracted a lot of attention. The use of AI tools in breast pathology is discussed briefly as it is covered in other reviews. Here, we present the main application of digital technology in IHC. This includes automation of IHC staining, using image analysis systems and computer vision technology to interpret IHC staining, and the use of AI-based tools to predict marker expression from haematoxylin and eosin-stained digitalized images.

Scarring Alopecias: Pathology and an Update on Digital Developments

Primary cicatricial alopecias (PCA) represent a challenging group of disorders that result in irreversible hair loss from the destruction and fibrosis of hair follicles. Scalp skin biopsies are considered essential in investigating these conditions. Unfortunately, the recognised complexity of histopathologic interpretation is compounded by inadequate sampling and inappropriate laboratory processing. By sharing our successes in developing the communication pathway between the clinician, laboratory and histopathologist, we hope to mitigate some of the difficulties that can arise in managing these conditions. We provide insight from clinical and pathology practice into how diagnoses are derived and the key histological features observed across the most common PCAs seen in practice. Additionally, we highlight the opportunities that have emerged with advances in digital pathology and how these technologies may be used to develop clinicopathological relationships, improve working practices, enhance remote learning, reduce inefficiencies, optimise diagnostic yield, and harness the potential of artificial intelligence (AI).

Bidirectional Mapping-Based Domain Adaptation for Nucleus Detection in Cross-Modality Microscopy Images

Cell or nucleus detection is a fundamental task in microscopy image analysis and has recently achieved state-of-the-art performance by using deep neural networks. However, training supervised deep models such as convolutional neural networks (CNNs) usually requires sufficient annotated image data, which is prohibitively expensive or unavailable in some applications. Additionally, when applying a CNN to new datasets, it is common to annotate individual cells/nuclei in those target datasets for model re-learning, leading to inefficient and low-throughput image analysis. To tackle these problems, we present a bidirectional, adversarial domain adaptation method for nucleus detection on cross-modality microscopy image data. Specifically, the method learns a deep regression model for individual nucleus detection with both source-to-target and target-to-source image translation. In addition, we explicitly extend this unsupervised domain adaptation method to a semi-supervised learning situation and further boost the nucleus detection performance. We evaluate the proposed method on three cross-modality microscopy image datasets, which cover a wide variety of microscopy imaging protocols or modalities, and obtain a significant improvement in nucleus detection compared to reference baseline approaches. In addition, our semi-supervised method is very competitive with recent fully supervised learning models trained with all real target training labels.

Artificial intelligence for automating the measurement of histologic image biomarkers

Artificial intelligence has been applied to histopathology for decades, but the recent increase in interest is attributable to well-publicized successes in the application of deep-learning techniques, such as convolutional neural networks, for image analysis. Recently, generative adversarial networks (GANs) have provided a method for performing image-to-image translation tasks on histopathology images, including image segmentation. In this issue of the JCI, Koyuncu et al. applied GANs to whole-slide images of p16-positive oropharyngeal squamous cell carcinoma (OPSCC) to automate the calculation of a multinucleation index (MuNI) for prognostication in p16-positive OPSCC. Multivariable analysis showed that the MuNI was prognostic for disease-free survival, overall survival, and metastasis-free survival. These results are promising, as they present a prognostic method for p16-positive OPSCC and highlight methods for using deep learning to measure image biomarkers from histopathologic samples in an inherently explainable manner.

Automatic Pancreatic Ductal Adenocarcinoma Detection in Whole Slide Images Using Deep Convolutional Neural Networks

Pancreatic ductal adenocarcinoma (PDAC) is one of the deadliest cancer types worldwide, with the lowest 5-year survival rate among all kinds of cancers. Histopathology image analysis is considered a gold standard for PDAC detection and diagnosis. However, the manual diagnosis used in current clinical practice is a tedious and time-consuming task and diagnosis concordance can be low. With the development of digital imaging and machine learning, several scholars have proposed PDAC analysis approaches based on feature extraction methods that rely on field knowledge. However, feature-based classification methods are applicable only to a specific problem and lack versatility, so that the deep-learning method is becoming a vital alternative to feature extraction. This paper proposes the first deep convolutional neural network architecture for classifying and segmenting pancreatic histopathological images on a relatively large WSI dataset. Our automatic patch-level approach achieved 95.3% classification accuracy and the WSI-level approach achieved 100%. Additionally, we visualized the classification and segmentation outcomes of histopathological images to determine which areas of an image are more important for PDAC identification. Experimental results demonstrate that our proposed model can effectively diagnose PDAC using histopathological images, which illustrates the potential of this practical application.