Impact of Altering Various Image Parameters on Human Epidermal Growth Factor Receptor 2 Image Analysis Data Quality

Future Practices of Breast Pathology Using Digital and Computational Pathology

Pathology clinical practice has evolved by adopting technological advancements initially regarded as potentially disruptive, such as electron microscopy, immunohistochemistry, and genomic sequencing. Breast pathology has a critical role as a medical domain, where the patient's pathology diagnosis has significant implications for prognostication and treatment of diseases. The advent of digital and computational pathology has brought about significant advancements in the field, offering new possibilities for enhancing diagnostic accuracy and improving patient care. Digital slide scanning enables to conversion of glass slides into high-fidelity digital images, supporting the review of cases in a digital workflow. Digitization offers the capability to render specimen diagnoses, digital archival of patient specimens, collaboration, and telepathology. Integration of image analysis and machine learning-based systems layered atop the high-resolution digital images offers novel workflows to assist breast pathologists in their clinical, educational, and research endeavors. Decision support tools may improve the detection and classification of breast lesions and the quantification of immunohistochemical studies. Computational biomarkers may help to contribute to patient management or outcomes. Furthermore, using digital and computational pathology may increase standardization and quality assurance, especially in areas with high interobserver variability. This review explores the current landscape and possible future applications of digital and computational techniques in the field of breast pathology.

Digital image analysis and assisted reading of the HER2 score display reduced concordance: pitfalls in the categorisation of HER2-low breast cancer

AIMS

Digital image analysis (DIA) is used increasingly as an assisting tool to evaluate biomarkers, including human epidermal growth factor receptor 2 (HER2) in invasive breast cancer (BC). DIA can assist pathologists in HER2 evaluation by presenting quantitative information about the HER2 staining in APP assisted reading (AR). Concurrently, the HER2-low category (HER2-1+/2+ without HER2 gene amplification) has gained prominence due to newly developed antibody-drug conjugates. However, major inter- and intraobserver variability have been observed for the entity. The present quality assurance study investigated the concordance between DIA and AR in clinical use, especially concerning the HER2-low category.

METHODS AND RESULTS

HER2 immunohistochemistry (IHC) in 761 tumours from 727 patients was evaluated in tissue microarray (TMA) cores by DIA (Visiopharm HER2-CONNECT) and AR. Overall concordance between HER2-scores were 73% (n = 552, weighted-κ: 0.66), and 88% (n = 669, weighted-κ: 0.70), when combining HER2-0/1+. A total of 205 scores were discordant by one category, while four were discordant by two categories. A heterogeneous HER2 pattern was relatively common in the discordant cases and a pitfall in the categorisation of HER2-low BC. AR more commonly reassigned a lower HER2 score (from HER2-1+ to HER2-0) within the HER2-low subgroup (n = 624) compared with DIA.

CONCLUSION

DIA and AR display moderate agreement with heterogeneous and aberrant staining, representing a source of discordance and a pitfall in the evaluation of HER2.

Quantitative Image Analysis as an Adjunct to Manual Scoring of ER, PgR, and HER2 in Invasive Breast Carcinoma

OBJECTIVES

Biomarker expression evaluation for estrogen receptor (ER), progesterone receptor (PgR), and human epidermal growth factor receptor 2 (HER2) is an essential prognostic and predictive parameter for breast cancer and critical for guiding hormonal and neoadjuvant therapy. This study compared quantitative image analysis (QIA) with pathologists' scoring for ER, PgR, and HER2.

METHODS

A retrospective analysis was undertaken of 1,367 invasive breast carcinomas, including all histopathology subtypes, for which ER, PgR, and HER2 were analyzed by manual scoring and QIA. The resulting scores were compared, and in a subset of HER2 cases (n = 373, 26%), scores were correlated with available fluorescence in situ hybridization (FISH) results.

RESULTS

Concordance between QIA and manual scores for ER, PgR, and HER2 was 93%, 96%, and 90%, respectively. Discordant cases had low positive scores (1%-10%) for ER (n = 33), were due to nonrepresentative region selection (eg, ductal carcinoma in situ) or tumor heterogeneity for PgR (n = 43), and were of one-step difference (negative to equivocal, equivocal to positive, or vice versa) for HER2 (n = 90). Among HER2 cases where FISH results were available, only four (1.0%) showed discordant QIA and FISH results.

CONCLUSIONS

QIA is a computer-aided diagnostic support tool for pathologists. It significantly improves ER, PgR, and HER2 scoring standardization. QIA demonstrated excellent concordance with pathologists' scores. To avoid pitfalls, pathologist oversight of representative region selection is recommended.

Artificial intelligence applied to breast pathology

The convergence of digital pathology and computer vision is increasingly enabling computers to perform tasks performed by humans. As a result, artificial intelligence (AI) is having an astoundingly positive effect on the field of pathology, including breast pathology. Research using machine learning and the development of algorithms that learn patterns from labeled digital data based on "deep learning" neural networks and feature-engineered approaches to analyze histology images have recently provided promising results. Thus far, image analysis and more complex AI-based tools have demonstrated excellent success performing tasks such as the quantification of breast biomarkers and Ki67, mitosis detection, lymph node metastasis recognition, tissue segmentation for diagnosing breast carcinoma, prognostication, computational assessment of tumor-infiltrating lymphocytes, and prediction of molecular expression as well as treatment response and benefit of therapy from routine H&E images. This review critically examines the literature regarding these applications of AI in the area of breast pathology.

Improved 3D U-Net robustness against JPEG 2000 compression for male pelvic organ segmentation in radiotherapy

Purpose: Automation of organ segmentation, via convolutional neural networks (CNNs), is key to facilitate the work of medical practitioners by ensuring that the adequate radiation dose is delivered to the target area while avoiding harmful exposure of healthy organs. The issue with CNNs is that they require large amounts of data transfer and storage which makes the use of image compression a necessity. Compression will affect image quality which in turn affects the segmentation process. We address the dilemma involved with handling large amounts of data while preserving segmentation accuracy.

Approach: We analyze and improve 2D and 3D U-Net robustness against JPEG 2000 compression for male pelvic organ segmentation. We conduct three experiments on 56 cone beam computed tomography (CT) and 74 CT scans targeting bladder and rectum segmentation. The two objectives of the experiments are to compare the compression robustness of 2D versus 3D U-Net and to improve the 3D U-Net compression tolerance via fine-tuning.

Results: We show that a 3D U-Net is 50% more robust to compression than a 2D U-Net. Moreover, by fine-tuning the 3D U-Net, we can double its compression tolerance compared to a 2D U-Net. Furthermore, we determine that fine-tuning the network to a compression ratio of 64:1 will ensure its flexibility to be used at compression ratios equal or lower.

Conclusions: We reduce the potential risk involved with using image compression on automated organ segmentation. We demonstrate that a 3D U-Net can be fine-tuned to handle high compression ratios while preserving segmentation accuracy.

Report on computational assessment of Tumor Infiltrating Lymphocytes from the International Immuno-Oncology Biomarker Working Group

Assessment of tumor-infiltrating lymphocytes (TILs) is increasingly recognized as an integral part of the prognostic workflow in triple-negative (TNBC) and HER2-positive breast cancer, as well as many other solid tumors. This recognition has come about thanks to standardized visual reporting guidelines, which helped to reduce inter-reader variability. Now, there are ripe opportunities to employ computational methods that extract spatio-morphologic predictive features, enabling computer-aided diagnostics. We detail the benefits of computational TILs assessment, the readiness of TILs scoring for computational assessment, and outline considerations for overcoming key barriers to clinical translation in this arena. Specifically, we discuss: 1. ensuring computational workflows closely capture visual guidelines and standards; 2. challenges and thoughts standards for assessment of algorithms including training, preanalytical, analytical, and clinical validation; 3. perspectives on how to realize the potential of machine learning models and to overcome the perceptual and practical limits of visual scoring.

Quantitative Image Analysis of Human Epidermal Growth Factor Receptor 2 Immunohistochemistry for Breast Cancer: Guideline From the College of American Pathologists

CONTEXT.—

Advancements in genomic, computing, and imaging technology have spurred new opportunities to use quantitative image analysis (QIA) for diagnostic testing.

OBJECTIVE.—

To develop evidence-based recommendations to improve accuracy, precision, and reproducibility in the interpretation of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) for breast cancer where QIA is used.

DESIGN.—

The College of American Pathologists (CAP) convened a panel of pathologists, histotechnologists, and computer scientists with expertise in image analysis, immunohistochemistry, quality management, and breast pathology to develop recommendations for QIA of HER2 IHC in breast cancer. A systematic review of the literature was conducted to address 5 key questions. Final recommendations were derived from strength of evidence, open comment feedback, expert panel consensus, and advisory panel review.

RESULTS.—

Eleven recommendations were drafted: 7 based on CAP laboratory accreditation requirements and 4 based on expert consensus opinions. A 3-week open comment period received 180 comments from more than 150 participants.

CONCLUSIONS.—

To improve accurate, precise, and reproducible interpretation of HER2 IHC results for breast cancer, QIA and procedures must be validated before implementation, followed by regular maintenance and ongoing evaluation of quality control and quality assurance. HER2 QIA performance, interpretation, and reporting should be supervised by pathologists with expertise in QIA.

Impact of JPEG 2000 compression on deep convolutional neural networks for metastatic cancer detection in histopathological images

The availability of massive amounts of data in histopathological whole-slide images (WSIs) has enabled the application of deep learning models and especially convolutional neural networks (CNNs), which have shown a high potential for improvement in cancer diagnosis. However, storage and transmission of large amounts of data such as gigapixel histopathological WSIs are challenging. Exploiting lossy compression algorithms for medical images is controversial but, as long as the clinical diagnosis is not affected, is acceptable. We study the impact of JPEG 2000 compression on our proposed CNN-based algorithm, which has produced performance comparable to that of pathologists and which was ranked second place in the CAMELYON17 challenge. Detecting tumor metastases in hematoxylin and eosin-stained tissue sections of breast lymph nodes is evaluated and compared with the pathologists' diagnoses in three different experimental setups. Our experiments show that the CNN model is robust against compression ratios up to 24:1 when it is trained on uncompressed high-quality images. We demonstrate that a model trained on lower quality images-i.e., lossy compressed images-depicts a classification performance that is significantly improved for the corresponding compression ratio. Moreover, it is also observed that the model performs equally well on all higher-quality images. These properties will help to design cloud-based computer-aided diagnosis (CAD) systems, e.g., telemedicine that employ deep CNN models that are more robust to image quality variations due to compression required to address data storage and transmission constraints. However, the results presented are specific to the CAD system and application described, and further work is needed to examine whether they generalize to other systems and applications.