The Diagnostic Concordance of Whole Slide Imaging and Light Microscopy: A Systematic Review

Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study)

Most prior studies of primary diagnosis in surgical pathology using whole slide imaging (WSI) versus microscopy have focused on specific organ systems or included relatively few cases. The objective of this study was to demonstrate that WSI is noninferior to microscopy for primary diagnosis in surgical pathology. A blinded randomized noninferiority study was conducted across the entire range of surgical pathology cases (biopsies and resections, including hematoxylin and eosin, immunohistochemistry, and special stains) from 4 institutions using the original sign-out diagnosis (baseline diagnosis) as the reference standard. Cases were scanned, converted to WSI and randomized. Sixteen pathologists interpreted cases by microscopy or WSI, followed by a wash-out period of ≥4 weeks, after which cases were read by the same observers using the other modality. Major discordances were identified by an adjudication panel, and the differences between major discordance rates for both microscopy (against the reference standard) and WSI (against the reference standard) were calculated. A total of 1992 cases were included, resulting in 15,925 reads. The major discordance rate with the reference standard diagnosis was 4.9% for WSI and 4.6% for microscopy. The difference between major discordance rates for microscopy and WSI was 0.4% (95% confidence interval, -0.30% to 1.01%). The difference in major discordance rates for WSI and microscopy was highest in endocrine pathology (1.8%), neoplastic kidney pathology (1.5%), urinary bladder pathology (1.3%), and gynecologic pathology (1.2%). Detailed analysis of these cases revealed no instances where interpretation by WSI was consistently inaccurate compared with microscopy for multiple observers. We conclude that WSI is noninferior to microscopy for primary diagnosis in surgical pathology, including biopsies and resections stained with hematoxylin and eosin, immunohistochemistry and special stains. This conclusion is valid across a wide variety of organ systems and specimen types.

Diagnostic Accuracy of Virtual Pathology vs Traditional Microscopy in a Large Dermatopathology Study

Importance

Digital pathology represents a transformative technology that impacts dermatologists and dermatopathologists from residency to academic and private practice. Two concerns are accuracy of interpretation from whole-slide images (WSI) and effect on workflow. Studies of considerably large series involving single-organ systems are lacking.

Objective

To evaluate whether diagnosis from WSI on a digital microscope is inferior to diagnosis of glass slides from traditional microscopy (TM) in a large cohort of dermatopathology cases with attention on image resolution, specifically eosinophils in inflammatory cases and mitotic figures in melanomas, and to measure the workflow efficiency of WSI compared with TM.

Design, Setting, and Participants

Three dermatopathologists established interobserver ground truth consensus (GTC) diagnosis for 499 previously diagnosed cases proportionally representing the spectrum of diagnoses seen in the laboratory. Cases were distributed to 3 different dermatopathologists who diagnosed by WSI and TM with a minimum 30-day washout between methodologies. Intraobserver WSI/TM diagnoses were compared, followed by interobserver comparison with GTC. Concordance, major discrepancies, and minor discrepancies were calculated and analyzed by paired noninferiority testing. We also measured pathologists' read rates to evaluate workflow efficiency between WSI and TM. This retrospective study was caried out in an independent, national, university-affiliated dermatopathology laboratory.

Main Outcomes and Measures

Intraobserver concordance of diagnoses between WSI and TM methods and interobserver variance from GTC, following College of American Pathology guidelines.

Results

Mean intraobserver concordance between WSI and TM was 94%. Mean interobserver concordance was 94% for WSI and GTC and 94% for TM and GTC. Mean interobserver concordance between WSI, TM, and GTC was 91%. Diagnoses from WSI were noninferior to those from TM. Whole-slide image read rates were commensurate with WSI experience, achieving parity with TM by the most experienced user.

Conclusions and Relevance

Diagnosis from WSI was found equivalent to diagnosis from glass slides using TM in this statistically powerful study of 499 dermatopathology cases. This study supports the viability of WSI for primary diagnosis in the clinical setting.

Routine Digital Pathology Workflow: The Catania Experience

Introduction:

Successful implementation of whole slide imaging (WSI) for routine clinical practice has been accomplished in only a few pathology laboratories worldwide. We report the transition to an effective and complete digital surgical pathology workflow in the pathology laboratory at Cannizzaro Hospital in Catania, Italy.

Methods:

All (100%) permanent histopathology glass slides were digitized at ×20 using Aperio AT2 scanners. Compatible stain and scanning slide racks were employed to streamline operations. eSlide Manager software was bidirectionally interfaced with the anatomic pathology laboratory information system. Virtual slide trays connected to the two-dimensional (2D) barcode tracking system allowed pathologists to confirm that they were correctly assigned slides and that all tissues on these glass slides were scanned.

Results:

Over 115,000 glass slides were digitized with a scan fail rate of around 1%. Drying glass slides before scanning minimized them sticking to scanner racks. Implementation required introduction of a 2D barcode tracking system and modification of histology workflow processes.

Conclusion:

Our experience indicates that effective adoption of WSI for primary diagnostic use was more dependent on optimizing preimaging variables and integration with the laboratory information system than on information technology infrastructure and ensuring pathologist buy-in. Implementation of digital pathology for routine practice not only leveraged the benefits of digital imaging but also creates an opportunity for establishing standardization of workflow processes in the pathology laboratory.

Digital pathology for the primary diagnosis of breast histopathological specimens: an innovative validation and concordance study on digital pathology validation and training

AIM

To train and individually validate a group of breast pathologists in specialty-specific digital primary diagnosis by using a novel protocol endorsed by the Royal College of Pathologists' new guideline for digital pathology. The protocol allows early exposure to live digital reporting, in a risk-mitigated environment, and focuses on patient safety and professional development.

METHODS AND RESULTS

Three specialty breast pathologists completed training in the use of a digital microscopy system, and were exposed to a training set of 20 challenging cases, designed to help them identify personal digital diagnostic pitfalls. Following this, the three pathologists viewed a total of 694 live, entire breast cases. All primary diagnoses were made on digital slides, with immediate glass slide review and reconciliation before final case sign-out. There was complete clinical concordance between the glass and digital impression of the case in 98.8% of cases. Only 1.2% of cases had a clinically significant difference in diagnosis/prognosis on glass and digital slide reads. All pathologists elected to continue using the digital microscope as the standard for breast histopathology specimens, with deferral to glass for a limited number of clinical/histological scenarios as a safety net.

CONCLUSION

Individual training and validation for digital primary diagnosis allows pathologists to develop competence and confidence in their digital diagnostic skills, and aids safe and responsible transition from the light microscope to the digital microscope.

Enterprise Implementation of Digital Pathology: Feasibility, Challenges, and Opportunities

Digital pathology is becoming technically possible to implement for routine pathology work. At our institution, we have been using digital pathology for second opinion intraoperative consultations for over 10 years. Herein, we describe our experience in converting to a digital pathology platform for primary pathology diagnosis. We implemented an incremental rollout for digital pathology on subspecialty benches, beginning with cases that contained small amounts of tissue (biopsy specimens). We successfully scanned over 40,000 slides through our digital pathology system. Several lessons (both challenges and opportunities) were learned through this implementation. A successful conversion to digital pathology requires pre-imaging adjustments, integrated software and post-imaging evaluations.

An update on the validation of whole slide imaging systems following FDA approval of a system for a routine pathology diagnostic service in the United States

Pathologists have used light microscopes and glass slides to interpret the histologic appearance of normal and diseased tissues for more than 150 years. The quality of both microtomes used to cut tissue sections and microscopes has improved significantly during the past few decades, but the process of rendering diagnoses has changed little. By contrast, major advances in digital technology have occurred since the introduction of hand held electronic devices, including the development of whole slide imaging (WSI) systems with software packages that can convert microscope images into virtual (digital) slides that can be viewed on computer monitors and via the internet. To date, however, these technological developments have had minimal impact on the way pathologists perform their daily work, with the exception of using computers to access electronic medical records and scholarly web sites for pertinent information to assist interpretation of cases. Traditional practice is likely to change significantly during the next decade, especially since the Federal Drug Administration in the USA has approved the first WSI system for routine diagnostic practice. I review here the development and slow acceptance of WSI by pathology departments. I focus on recent advances in validation of WSI systems that is required for routine diagnostic reporting of pathology cases using this technology.

Clinical Applications of Whole-slide Imaging in Anatomic Pathology

The development of whole-slide imaging has paved the way for digitizing of glass slides that are the basis for surgical pathology. This transformative technology has changed the landscape in research applications and education but despite its tremendous potential, its adoption for clinical use has been slow. We review the various niche applications that initiated awareness of this technology, provide examples of clinical use cases, and discuss the requirements and challenges for full adoption in clinical diagnosis. The opportunities for applications of image analysis tools in a workflow will be changed by integration of whole-slide imaging into routine diagnosis.

Colour in digital pathology: a review

Colour is central to the practice of pathology because of the use of coloured histochemical and immunohistochemical stains to visualize tissue features. Our reliance upon histochemical stains and light microscopy has evolved alongside a wide variation in slide colour, with little investigation into the implications of colour variation. However, the introduction of the digital microscope and whole-slide imaging has highlighted the need for further understanding and control of colour. This is because the digitization process itself introduces further colour variation which may affect diagnosis, and image analysis algorithms often use colour or intensity measures to detect or measure tissue features. The US Food and Drug Administration have released recent guidance stating the need to develop a method of controlling colour reproduction throughout the digitization process in whole-slide imaging for primary diagnostic use. This comprehensive review introduces applied basic colour physics and colour interpretation by the human visual system, before discussing the importance of colour in pathology. The process of colour calibration and its application to pathology are also included, as well as a summary of the current guidelines and recommendations regarding colour in digital pathology.

Nuclear features of infiltrating urothelial carcinoma are distinguished from low-grade noninvasive papillary urothelial carcinoma by image analysis

Recent advances in computer technology have been made and image analysis (IA) has been introduced into pathological fields. The present study aimed to investigate the utility of IA for the evaluation of nuclear features and staining of immunohistochemistry (IHC) for Ki-67, p53 and GATA-binding protein 3 (GATA-3) in urothelial carcinoma tissue samples. A total of 49 cases of urothelial carcinoma tissue samples were obtained by transurethral resection of bladder tumors, which included 11 low-grade papillary urothelial carcinomas (LGPUCs), 1 non-invasive high-grade urothelial carcinoma and 37 infiltrating urothelial carcinomas (IUCs). Whole slide imaging (WSI) and IA were performed in Feulgen reaction and IHC-stained tissue samples. There was a significant difference in the average nuclear density, standard deviation (SD) of nuclear size and SD of nuclear minimum and maximum diameter between LGPUC and IUC, which is equivalent to the diagnostic features of IUC in nuclear variability, and hyperchromatic nuclei. In addition, the present study revealed that the SD of nuclear density was significantly different between the two groups. Regarding IA in IHC-stained tissue samples, Ki-67 was significantly overexpressed in IUC. Furthermore, the GATA-3 expression level in IUC samples with muscle invasion was significantly downregulated compared with that in non-muscle invasive tumors. The results of the present study suggest that IA in combination with WSI may be a beneficial tool for evaluating morphometric characteristics and performing semi-quantitative analysis of IHC.

A Systematic Analysis of Discordant Diagnoses in Digital Pathology Compared With Light Microscopy

CONTEXT

- Relatively little is known about the significance and potential impact of glass-digital discordances, and this is likely to be of importance when considering digital pathology adoption.

OBJECTIVE

- To apply evidence-based medicine to collect and analyze reported instances of glass-digital discordance from the whole slide imaging validation literature.

DESIGN

- We used our prior systematic review protocol to identify studies assessing the concordance of light microscopy and whole slide imaging between 1999 and 2015. Data were extracted and analyzed by a team of histopathologists to classify the type, significance, and potential root cause of discordances.

RESULTS

- Twenty-three studies were included, yielding 8069 instances of a glass diagnosis being compared with a digital diagnosis. From these 8069 comparisons, 335 instances of discordance (4%) were reported, in which glass was the preferred diagnostic medium in 286 (85%), and digital in 44 (13%), with no consensus in 5 (2%). Twenty-eight discordances had the potential to cause moderate/severe patient harm. Of these, glass was the preferred diagnostic medium for 26 (93%). Of the 335 discordances, 109 (32%) involved the diagnosis or grading of dysplasia. For these cases, glass was the preferred diagnostic medium in 101 cases (93%), suggesting that diagnosis and grading of dysplasia may be a potential pitfall of digital diagnosis. In 32 of 335 cases (10%), discordance on digital was attributed to the inability to find a small diagnostic/prognostic object.

CONCLUSIONS

- Systematic analysis of concordance studies reveals specific areas that may be problematic on whole slide imaging. It is important that pathologists are aware of these areas to ensure patient safety.

RecutClub.com: An Open Source, Whole Slide Image-based Pathology Education System

BACKGROUND

Our institution's pathology unknown conferences provide educational cases for our residents. However, the cases have not been previously available digitally, have not been collated for postconference review, and were not accessible to a wider audience. Our objective was to create an inexpensive whole slide image (WSI) education suite to address these limitations and improve the education of pathology trainees.

MATERIALS AND METHODS

We surveyed residents regarding their preference between four unique WSI systems. We then scanned weekly unknown conference cases and study set cases and uploaded them to our custom built WSI viewer located at RecutClub.com. We measured site utilization and conference participation.

RESULTS

Residents preferred our OpenLayers WSI implementation to Ventana Virtuoso, Google Maps API, and OpenSlide. Over 16 months, we uploaded 1366 cases from 77 conferences and ten study sets, occupying 793.5 GB of cloud storage. Based on resident evaluations, the interface was easy to use and demonstrated minimal latency. Residents are able to review cases from home and from their mobile devices. Worldwide, 955 unique IP addresses from 52 countries have viewed cases in our site.

CONCLUSIONS

We implemented a low-cost, publicly available repository of WSI slides for resident education. Our trainees are very satisfied with the freedom to preview either the glass slides or WSI and review the WSI postconference. Both local users and worldwide users actively and repeatedly view cases in our study set.

Relevance of deep learning to facilitate the diagnosis of HER2 status in breast cancer

Tissue biomarker scoring by pathologists is central to defining the appropriate therapy for patients with cancer. Yet, inter-pathologist variability in the interpretation of ambiguous cases can affect diagnostic accuracy. Modern artificial intelligence methods such as deep learning have the potential to supplement pathologist expertise to ensure constant diagnostic accuracy. We developed a computational approach based on deep learning that automatically scores HER2, a biomarker that defines patient eligibility for anti-HER2 targeted therapies in breast cancer. In a cohort of 71 breast tumour resection samples, automated scoring showed a concordance of 83% with a pathologist. The twelve discordant cases were then independently reviewed, leading to a modification of diagnosis from initial pathologist assessment for eight cases. Diagnostic discordance was found to be largely caused by perceptual differences in assessing HER2 expression due to high HER2 staining heterogeneity. This study provides evidence that deep learning aided diagnosis can facilitate clinical decision making in breast cancer by identifying cases at high risk of misdiagnosis.

The Empirical Foundations of Telepathology: Evidence of Feasibility and Intermediate Effects

INTRODUCTION

Telepathology evolved from video microscopy (i.e., "television microscopy") research in the early 1950s to video microscopy used in basic research in the biological sciences to a basic diagnostic tool in telemedicine clinical applications. Its genesis can be traced to pioneering feasibility studies regarding the importance of color and other image-based parameters for rendering diagnoses and a series of studies assessing concordance of virtual slide and light microscopy diagnoses. This article documents the empirical foundations of telepathology.

METHODS

A selective review of the research literature during the past decade (2005-2016) was conducted using robust research design and adequate sample size as criteria for inclusion.

CONCLUSIONS

The evidence regarding feasibility/acceptance of telepathology and related information technology applications has been well documented for several decades. The majority of evidentiary studies focused on intermediate outcomes, as indicated by comparability between telepathology and conventional light microscopy. A consistent trend of concordance between the two modalities was observed in terms of diagnostic accuracy and reliability. Additional benefits include use of telepathology and whole slide imaging for teaching, research, and outreach to resource-limited countries. Challenges still exist, however, in terms of use of telepathology as an effective diagnostic modality in clinical practice.

Digital pathology in the diagnostic setting: beyond technology into best practice and service management

Digital pathology (DP) and whole-slide imaging (WSI) technology have matured substantially over the last few years and there is growing evidence from validation studies that WSI is comparable to glass slides for histopathology diagnosis, although with some limitations, which can be appropriately minimised. Whether the controlled environment of validation studies translates to the same level of robustness when WSI is used in the actual diagnostic setting depends on the technical quality of WSI acquisition and on factors that influence the pre-image acquisition variables including the quality of glass slide inputs, and postimage acquisition variables such as access and use of WSI. The concept of 'DP service management' is introduced to fulfil the holistic needs of a laboratory intending to use the DP solution incorporating WSI for diagnostic purposes. The DP service management team should be an integral part of the diagnostic laboratory as it plays a central role undertaking responsibility to address an extensive range of issues from technical and training to governance and accreditation, hence ensuring a viable and sustainable diagnostic DP integration and usage. The pathologist as a specialist in the field and key decision maker of histopathology diagnoses has the duty and responsibility to acquaint and familiarise with DP and WSI when using the technology, especially on their indications and limitations, so as to take full advantage of these tools to enhance diagnostic quality.

Summary of third Nordic symposium on digital pathology

Cross-disciplinary and cross-sectorial collaboration is a key success factor for turning the promise of digital pathology into actual clinical benefits. The Nordic symposium on digital pathology (NDP) was created to promote knowledge exchange in this area, among stakeholders in health care, industry, and academia. This article is a summary of the third NDP symposium in Linkφping, Sweden. The Nordic experiences, including several hospitals using whole-slide imaging for substantial parts of their primary reviews, formed a fertile base for discussions among the 190 NDP attendees originating from 15 different countries. This summary also contains results from a survey on adoption and validation aspects of clinical digital pathology use.