Whole slide imaging for human epidermal growth factor receptor 2 immunohistochemistry interpretation: Accuracy, Precision, and reproducibility studies for digital manual and paired glass slide manual interpretation

Validating Whole Slide Imaging Systems for Diagnostic Purposes in Pathology

CONTEXT.—

The original guideline, "Validating Whole Slide Imaging for Diagnostic Purposes in Pathology," was published in 2013 and included 12 guideline statements. The College of American Pathologists convened an expert panel to update the guideline following standards established by the National Academies of Medicine for developing trustworthy clinical practice guidelines.

OBJECTIVE.—

To assess evidence published since the release of the original guideline and provide updated recommendations for validating whole slide imaging (WSI) systems used for diagnostic purposes.

DESIGN.—

An expert panel performed a systematic review of the literature. Frozen sections, anatomic pathology specimens (biopsies, curettings, and resections), and hematopathology cases were included. Cytology cases were excluded. Using the Grading of Recommendations Assessment, Development, and Evaluation approach, the panel reassessed and updated the original guideline recommendations.

RESULTS.—

Three strong recommendations and 9 good practice statements are offered to assist laboratories with validating WSI digital pathology systems.

CONCLUSIONS.—

Systematic review of literature following release of the 2013 guideline reaffirms the use of a validation set of at least 60 cases, establishing intraobserver diagnostic concordance between WSI and glass slides and the use of a 2-week washout period between modalities. Although all discordances between WSI and glass slide diagnoses discovered during validation need to be reconciled, laboratories should be particularly concerned if their overall WSI-glass slide concordance is less than 95%.

Interobserver Variation of PD-L1 SP142 Immunohistochemistry Interpretation in Breast Carcinoma: A Study of 79 Cases Using Whole Slide Imaging

CONTEXT.—

The Ventana programmed death ligand-1 (PD-L1) SP142 immunohistochemical assay (IHC) is approved by the US Food and Drug Administration as the companion diagnostic assay to identify patients with locally advanced or metastatic triple-negative breast cancer for immunotherapy with atezolizumab, a monoclonal antibody targeting PD-L1.

OBJECTIVE.—

To determine interobserver variability in PD-L1 SP142 IHC interpretation in invasive breast carcinoma.

DESIGN.—

The pathology database was interrogated for all patients diagnosed with primary invasive, locally recurrent, or metastatic breast carcinoma on which PD-L1 SP142 IHC was performed from November 2018 to June 2019 at our institution. A subset of cases was selected using a computerized random-number generator. PD-L1 IHC was evaluated in stromal tumor-infiltrating immune cells using the IMpassion130 trial criteria, with positive cases defined as immunoreactivity in immune cells in 1% or more of the tumor area. IHC was interpreted on whole slide images by staff pathologists with breast pathology expertise. Interobserver variability was calculated using unweighted κ.

RESULTS.—

A total of 79 cases were assessed by 8 pathologists. Interobserver agreement was substantial (κ = 0.727). There was complete agreement among all 8 pathologists in 62% (49 of 79) of cases, 7 pathologists or more in 84% (66 of 79) of cases, and 6 pathologists or more in 92% (73 of 79) of cases. In 4% (3 of 79) of cases, all of which were small biopsies, pathologists' interpretations were evenly split between scores of positive and negative.

CONCLUSIONS.—

The findings show substantial agreement in PD-L1 SP142 IHC assessment of breast carcinoma cases among 8 pathologists at a single institution. Further study is warranted to define the basis for discrepant results.

A literature review of quality, costs, process-associated with digital pathology

Digital pathology incorporates the acquisition, management, sharing, and interpretation of pathological information, including slides and data, in a digital environment. Digital slides are created using a scanning device to capture a high-resolution image on glass slides for analysis on a computer or a mobile device. Though digital pathology has drastically grown over the last 10 years and has created opportunities to support specialists, few have attempted to address its full-scale implementation in routine clinical practice. To incorporate new technologies in diagnostic processes, it is necessary to study their application, the value they provide to specialists, and their effects on improvements across the entire workflow, rather than studying a particular element. In this study, we aimed to identify what have the current digital pathology systems contributed to the pathological and diagnostic process. We retrieved articles published between 2010 and 2020 from the databases PubMed and Google Scholar. We explored how digital pathology systems can better utilize existing medical data and new technologies within the current diagnostic workflow. While the evidence concerning the efficacy and effectiveness of digital pathology is mounting, high-quality evidence regarding its impact on resource allocation and value for diagnosis is still needed to support clinical diagnosis and policy decision-making.

Accuracy of Digital Pathologic Analysis vs Traditional Microscopy in the Interpretation of Melanocytic Lesions

Importance

Use of digital whole-slide imaging (WSI) for dermatopathology in general has been noted to be similar to traditional microscopy (TM); however, concern has been noted that WSI is inferior for interpretation of melanocytic lesions. Since approximately 1 of every 4 skin biopsies is of a melanocytic lesion, the use of WSI requires verification before use in clinical practice.

Objective

To compare pathologists' accuracy and reproducibility in diagnosing melanocytic lesions using Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis (MPATH-Dx) categories when analyzing by TM vs WSI.

Design, Setting, and Participants

A total of 87 pathologists in community-based and academic settings from 10 US states were randomized with stratification based on clinical experience to interpret in TM format 180 skin biopsy cases of melanocytic lesions, including 90 invasive melanoma, divided into 5 sets of 36 cases (phase 1). The pathologists were then randomized via stratified permuted block randomization with block size 2 to interpret cases in either TM (n = 46) or WSI format (n = 41), with each pathologist interpreting the same 36 cases on 2 separate occasions (phase 2). Diagnoses were categorized as MPATH-Dx categories I through V, with I indicating the least severe and V the most severe.

Main Outcomes and Measures

Accuracy with respect to a consensus reference diagnosis and the reproducibility of repeated interpretations of the same cases.

Results

Of the 87 pathologists in the study, 46% (40) were women and the mean (SD) age was 50.7 (10.2) years. Except for class III melanocytic lesions, the diagnostic categories showed no significant differences in diagnostic accuracy between TM and WSI interpretation. Discordance was lower among class III lesions for the TM interpretation arm (51%; 95% CI, 46%-57%) than for the WSI arm (61%; 95% CI, 53%-69%) (P = .05). This difference is likely to have clinical significance, because 6% of TM vs 11% of WSI class III lesions were interpreted as invasive melanoma. Reproducibility was similar between the traditional and digital formats overall (66.4%; 95% CI, 63.3%-69.3%; and 62.7%; 95% CI, 59.5%-65.7%, respectively), and for all classes, although class III showed a nonsignificant lower intraobserver agreement for digital. Significantly more mitotic figures were detected with TM compared with WSI: mean (SD) TM, 6.72 (2.89); WSI, 5.84 (2.56); P = .002.

Conclusions and Relevance

Interpretive accuracy for melanocytic lesions was similar for WSI and TM slides except for class III lesions. We found no clinically meaningful differences in reproducibility for any of the diagnostic classes.

Whole-Slide Imaging for Esophageal Adenocarcinoma

Whole-slide imaging revolutionizes the field of pathology especially in the areas of facilitation of research, long-term storages, exchange of information, and image analysis. In this process, a scanning equipment (scanner) scans the whole glass slide into a digital file. In research in esophageal adenocarcinoma or other cancers, whole-slide imaging could help in production of high-resolution images for studying and sharing of research information, assessment of tissue microarray slides as well as allowing digital image analysis of the tissue information such as level of staining (e.g., HER2) in a more efficient and objective manner. In this chapter, we will elaborate the concepts, advantages, barriers, and the operations of whole-slide imaging scanning.

A quantitative approach to evaluate image quality of whole slide imaging scanners

CONTEXT

The quality of images produced by whole slide imaging (WSI) scanners has a direct influence on the readers' performance and reliability of the clinical diagnosis. Therefore, WSI scanners should produce not only high quality but also consistent quality images.

AIM

We aim to evaluate reproducibility of WSI scanners based on the quality of images produced over time and among multiple scanners. The evaluation is independent of content or context of test specimen.

METHODS

The ultimate judge of image quality is a pathologist, however, subjective evaluations are heavily influenced by the complexity of a case and subtle variations introduced by a scanner can be easily overlooked. Therefore, we employed a quantitative image quality assessment method based on clinically relevant parameters, such as sharpness and brightness, acquired in a survey of pathologists. The acceptable level of quality per parameter was determined in a subjective study. The evaluation of scanner reproducibility was conducted with Philips Ultra-Fast Scanners. A set of 36 HercepTest™ slides were used in three sub-studies addressing variations due to systems and time, producing 8640 test images for evaluation.

RESULTS

The results showed that the majority of images in all the sub-studies are within the acceptable quality level; however, some scanners produce higher quality images more often than others. The results are independent of case types, and they match our perception of quality.

CONCLUSION

The quantitative image quality assessment method was successfully applied in the HercepTest™ slides to evaluate WSI scanner reproducibility. The proposed method is generic and applicable to any other types of slide stains and scanners.

Development of a database system and image viewer to assist in the correlation of histopathologic features and digital image analysis with clinical and molecular genetic information

Pathologists are required to integrate data from multiple sources when making a diagnosis. Furthermore, whole slide imaging (WSI) and next generation sequencing will escalate data size and complexity. Development of well-designed databases that can allow efficient navigation between multiple data types is necessary for both clinical and research purposes. We developed and evaluated an interactive, web-based database that integrates clinical, histologic, immunohistochemical and genetic information to aid in pathologic diagnosis and interpretation with nine lung adenocarcinoma cases. To minimize sectioning artifacts, representative blocks were serially sectioned using automated tissue sectioning (Kurabo Industries, Osaka Japan) and selected slides were stained by multiple techniques, (hematoxylin and eosin [H&E], immunohistochemistry [IHC] or fluorescence in situ hybridization [FISH]). Slides were digitized by WSI scanners. An interactive relational database was designed based on a list of proposed fields covering a variety of clinical, pathologic and molecular parameters. By focusing on the three main tasks of 1.) efficient management of textual information, 2.) effective viewing of all varieties of stained whole slide images (WSI), and 3.) assistance in evaluating WSI with computer-aided diagnosis, this database prototype shows great promise for multi-modality research and diagnosis.

Free digital image analysis software helps to resolve equivocal scores in HER2 immunohistochemistry

Evaluation of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) is subject to interobserver variation and lack of reproducibility. Digital image analysis (DIA) has been shown to improve the consistency and accuracy of the evaluation and its use is encouraged in current testing guidelines. We studied whether digital image analysis using a free software application (ImmunoMembrane) can assist in interpreting HER2 IHC in equivocal 2+ cases. We also compared digital photomicrographs with whole-slide images (WSI) as material for ImmunoMembrane DIA. We stained 750 surgical resection specimens of invasive breast cancers immunohistochemically for HER2 and analysed staining with ImmunoMembrane. The ImmunoMembrane DIA scores were compared with the originally responsible pathologists' visual scores, a researcher's visual scores and in situ hybridisation (ISH) results. The originally responsible pathologists reported 9.1 % positive 3+ IHC scores, for the researcher this was 8.4 % and for ImmunoMembrane 9.5 %. Equivocal 2+ scores were 34 % for the pathologists, 43.7 % for the researcher and 10.1 % for ImmunoMembrane. Negative 0/1+ scores were 57.6 % for the pathologists, 46.8 % for the researcher and 80.8 % for ImmunoMembrane. There were six false positive cases, which were classified as 3+ by ImmunoMembrane and negative by ISH. Six cases were false negative defined as 0/1+ by IHC and positive by ISH. ImmunoMembrane DIA using digital photomicrographs and WSI showed almost perfect agreement. In conclusion, digital image analysis by ImmunoMembrane can help to resolve a majority of equivocal 2+ cases in HER2 IHC, which reduces the need for ISH testing.