Whole-slide imaging: widening the scope of cytopathology

Digital cytology part 2: artificial intelligence in cytology: a concept paper with review and recommendations from the American Society of Cytopathology Digital Cytology Task Force

Digital cytology and artificial intelligence (AI) are gaining greater adoption in the cytology laboratory. However, peer-reviewed real-world data and literature are lacking in regard to the current clinical landscape. The American Society of Cytopathology in conjunction with the International Academy of Cytology and the Digital Pathology Association established a special task force comprising 20 members with expertise and/or interest in digital cytology. The aim of the group was to investigate the feasibility of incorporating digital cytology, specifically cytology whole slide scanning and AI applications, into the workflow of the laboratory. In turn, the impact on cytopathologists, cytologists (cytotechnologists), and cytology departments were also assessed. The task force reviewed existing literature on digital cytology, conducted a worldwide survey, and held a virtual roundtable discussion on digital cytology and AI with multiple industry corporate representatives. This white paper, presented in 2 parts, summarizes the current state of digital cytology and AI practice in global cytology practice. Part 1 of the white paper is presented as a separate paper which details a review and best practice recommendations for incorporating digital cytology into practice. Part 2 of the white paper presented here provides a comprehensive review of AI in cytology practice along with best practice recommendations and legal considerations. Additionally, the cytology global survey results highlighting current AI practices by various laboratories, as well as current attitudes, are reported.

Blur-specific image quality assessment of microscopic hyperspectral images

Hyperspectral (HS) imaging (HSI) expands the number of channels captured within the electromagnetic spectrum with respect to regular imaging. Thus, microscopic HSI can improve cancer diagnosis by automatic classification of cells. However, homogeneous focus is difficult to achieve in such images, being the aim of this work to automatically quantify their focus for further image correction. A HS image database for focus assessment was captured. Subjective scores of image focus were obtained from 24 subjects and then correlated to state-of-the-art methods. Maximum Local Variation, Fast Image Sharpness block-based Method and Local Phase Coherence algorithms provided the best correlation results. With respect to execution time, LPC was the fastest.

Computationally efficient adaptive decompression for whole slide image processing

Whole slide image (WSI) analysis is increasingly being adopted as an important tool in modern pathology. Recent deep learning-based methods have achieved state-of-the-art performance on WSI analysis tasks such as WSI classification, segmentation, and retrieval. However, WSI analysis requires a significant amount of computation resources and computation time due to the large dimensions of WSIs. Most of the existing analysis approaches require the complete decompression of the whole image exhaustively, which limits the practical usage of these methods, especially for deep learning-based workflows. In this paper, we present compression domain processing-based computation efficient analysis workflows for WSIs classification that can be applied to state-of-the-art WSI classification models. The approaches leverage the pyramidal magnification structure of WSI files and compression domain features that are available from the raw code stream. The methods assign different decompression depths to the patches of WSIs based on the features directly retained from compressed patches or partially decompressed patches. Patches from the low-magnification level are screened by attention-based clustering, resulting in different decompression depths assigned to the high-magnification level patches at different locations. A finer-grained selection based on compression domain features from the file code stream is applied to select further a subset of the high-magnification patches that undergo a full decompression. The resulting patches are fed to the downstream attention network for final classification. Computation efficiency is achieved by reducing unnecessary access to the high zoom level and expensive full decompression. With the number of decompressed patches reduced, the time and memory costs of downstream training and inference procedures are also significantly reduced. Our approach achieves a 7.2× overall speedup, and the memory cost is reduced by 1.1 orders of magnitudes, while the resulting model accuracy is comparable to the original workflow.

Digital validation of breast biomarkers (ER, PR, AR, and HER2) in cytology specimens using three different scanners

Progression in digital pathology has yielded new opportunities for a remote work environment. We evaluated the utility of digital review of breast cancer immunohistochemical prognostic markers (IHC) using whole slide images (WSI) from formalin fixed paraffin embedded (FFPE) cytology cell block specimens (CB) using three different scanners.CB from 20 patients with breast cancer diagnosis and available IHC were included. Glass slides including 20 Hematoxylin and eosin (H&E), 20 Estrogen Receptor (ER), 20 Progesterone Receptor (PR), 16 Androgen Receptor (AR), and 20 Human Epidermal Growth Factor Receptor 2 (HER2) were scanned on 3 different scanners. Four breast pathologists reviewed the WSI and recorded their semi-quantitative scoring for each marker. Kappa concordance was defined as complete agreement between glass/digital pairs. Discordances between microscopic and digital reads were classified as a major when a clinically relevant change was seen. Minor discordances were defined as differences in scoring percentages/staining pattern that would not have resulted in a clinical implication. Scanner precision was tabulated according to the success rate of each scan on all three scanners.In total, we had 228 paired glass/digital IHC reads on all 3 scanners. There was strong concordance kappa ≥0.85 for all pathologists when comparing paired microscopic/digital reads. Strong concordance (kappa ≥0.86) was also seen when comparing reads between scanners.Twenty-three percent of the WSI required rescanning due to barcode detection failures, 14% due to tissue detection failures, and 2% due to focus issues. Scanner 1 had the best average precision of 92%. HER2 IHC had the lowest intra-scanner precision (64%) among all stains.This study is the first to address the utility of WSI in breast cancer IHC in CB and to validate its reporting using 3 different scanners. Digital images are reliable for breast IHC assessment in CB and offer similar reproducibility to microscope reads.

Experience Reviewing Digital Pap Tests using a Gallery of Images

Introduction:

Hologic is developing a digital cytology platform. An educational website was launched for users to review these digitized Pap test cases. The aim of this study was to analyze data captured from this website.

Materials and Methods:

ThinPrep^® Pap test slides were scanned at ×40 using a volumetric (14 focal plane) technique. Website cases consisted of an image gallery and whole slide image (WSI). Over a 13 month period data were recorded including diagnoses, time participants spent online, and number of clicks on the gallery and WSI.

Results:

51,289 cases were reviewed by 918 reviewers. Cytotechnologists spent less time (M [Median] = 65.0 s) than pathologists (M = 82.2 s) reviewing cases (P < 0.001). Longer times were associated with incorrect diagnoses and cases with organisms. Cytotechnologists matched the reference diagnoses in 85% of cases compared to pathologists who matched in 79.8%. While in 62% of cases reviewers only examined the gallery, they attained the correct diagnosis 92.7% of the time. Pathologists made more clicks on the gallery and WSI than cytotechnologists (P < 0.001). Diagnostic accuracy decreased with increasing clicks.

Conclusions:

Website participation provided feedback about how cytologists interact with a digital platform when reviewing cases. These data suggest that digital Pap test review when comprised of an image gallery displaying diagnostically relevant objects is quick and easy to interpret. The high diagnostic concordance of digital Pap tests with reference diagnoses can be attributed to high image quality with volumetric scanning, image gallery format, and ability for users to freely navigate the entire digital slide.

A smartphone-based petrographic microscope

Photomicrographs of thin sections provide a swift and efficient means of sharing information for consultation, education, documentation and publication within the Geosciences and related areas. In general terms, the main way to capture digital microscopic images involves the use of a mounted camera unit on a high-end costly benchtop microscope. However, freehand methods to capture microscope-scale images using a smartphone, as well as smartphone adapters that can be attached to a microscope have emerged during recent years. This paper presents the design features of a costless system able to obtain photomicrographs without requiring a conventional microscope. The imaging device is comprised of a mini-objective lens attached to a smartphone and a structure that allows it to focus as well as to rotate the stage and to insert/remove a polarized sheet. The quality and magnification of the images attainable from the new design is comparable to the images normally obtained by a conventional petrographic microscope using a ×4 objective and a ×10 ocular (total magnification ×40).

Computational imaging modalities for multi-focal whole-slide imaging systems

Whole-slide imaging systems can generate full-color image data of tissue slides efficiently, which are needed for digital pathology applications. This paper focuses on a scanner architecture that is based on a multi-line image sensor that is tilted with respect to the optical axis, such that every line of the sensor scans the tissue slide at a different focus level. This scanner platform is designed for imaging with continuous autofocus and inherent color registration at a throughput of the order of 400 MPx/s. Here, single-scan multi-focal whole-slide imaging, enabled by this platform, is explored. In particular, two computational imaging modalities based on multi-focal image data are studied. First, 3D imaging of thick absorption stained slides (∼60µm) is demonstrated in combination with deconvolution to ameliorate the inherently weak contrast in thick-tissue imaging. Second, quantitative phase tomography is demonstrated on unstained tissue slides and on fluorescently stained slides, revealing morphological features complementary to features made visible with conventional absorption or fluorescence stains. For both computational approaches simplified algorithms are proposed, targeted for straightforward parallel processing implementation at ∼GPx/s throughputs.

The utility of cell blocks for international cytopathology teleconsultation by whole slide imaging

INTRODUCTION

Telecytology for second opinion consultation has largely been limited by technical issues, such as the inability to focus well on cellular material. Nevertheless, international telecytology consultation was undertaken at our institution with partners in China and Italy. To overcome issues with scanning cytology slides, we adopted a cell-block (CB) preference for teleconsultation.

METHODS

Telecytology consultation cases received over a 7.5-year period were retrospectively reviewed. Cytology glass slides were scanned without Z-stacking using different whole slide scanners. For one referring site, only haematoxylin-eosin-stained CBs were scanned, as well as immunostains requested by consultants. For another host centre, aspirate smears were also scanned in some cases.

RESULTS

A total of 51 non-gynaecological cases (44 CB only) were evaluated from 48 patients. The specimens included pleural fluids (19), pancreas (14), lymph nodes (6), peritoneal fluids (2) and miscellaneous samples (10). The cytological diagnoses spectrum included 16 (31.37%) cases positive for malignancy, 7 (13.72%) positive for neoplasm, 6 (11.76%) suspicious for malignancy, 10 (19.60%) atypical, 10 (19.60%) negative for malignancy and 2 (3.92%) non-diagnostic. In 42 (82.35%) cases, immunocytochemistry was requested. Turn-around-time ranged from 1.5 to 306 hours.

CONCLUSIONS

Our experience shows that international telecytology for consultation purposes involving non-gynaecological cases is feasible. A second opinion interpretation was rendered in the majority (64.7%) of cases. Utilising CB only for cytology consultations by whole slide imaging solved focus issues that typically plague evaluation of cytology aspirate smears.

Feasibility of using the Omnyx digital pathology system for cytology practice

INTRODUCTION

Whole slide imaging systems have focused mostly on surgical pathologic evaluation. However, for pathology laboratories to become fully digital, cytology slides will also need to be digitized, managed, viewed, and analyzed. Our aim was to determine the feasibility of using the Omnyx whole slide imaging system for various purposes in cytology.

MATERIALS AND METHODS

Our institution implemented the Omnyx digital pathology system, which was tested for feasibility and not implemented for clinical use in cytology. Glass slides (n = 18), scanned using various whole slide scanners, were uploaded into the Omnyx system. The system was evaluated for its feasibility with cytology case management, digital slide navigation and annotation, telecytology, and cytologic-histologic correlation.

RESULTS

The Omnyx software was able to manage cases similar to a laboratory information system. Users were able to electronically distribute, search, and sort the clinical cases. A graphic dashboard approach and virtual slide tray is available for end users to evaluate cases. The ability to create custom folders and drag-and-drop images into these folders fulfilled clinical, quality assurance, education, and research needs. Innovative tools for digital slide navigation and annotation (eg, auto-pan, adding text to annotation, hiding annotations, image coregistration) offered innovative methods to work with slides. Omnyx also provided a mechanism for sharing images with others to perform teleconsultation.

CONCLUSIONS

We have demonstrated the feasibility of using the Omnyx whole slide imaging system for various purposes in cytology practice. The application supported, not only case management, but also the ability to perform cytologic-histologic correlation and telecytology. The viewer offered many features that improved digital slide navigation and annotation.

Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives

Almost 20 years have passed since the commercial introduction of whole-slide imaging (WSI) scanners. During this time, the creation of various WSI devices with the ability to digitize an entire glass slide has transformed the field of pathology. Parallel advances in computational technology and storage have permitted rapid processing of large-scale WSI datasets. This article provides an overview of important past and present efforts related to WSI. An account of how the virtual microscope evolved from the need to visualize and manage satellite data for earth science applications is provided. The article also discusses important milestones beginning from the first WSI scanner designed by Bacus to the Food and Drug Administration approval of the first digital pathology system for primary diagnosis in surgical pathology. As pathology laboratories commit to going fully digitalize, the need has emerged to include WSIs into an enterprise-level vendor-neutral archive (VNA). The different types of VNAs available are reviewed as well as how best to implement them and how pathology can benefit from participating in this effort. Differences between traditional image algorithms that extract pixel-, object-, and semantic-level features versus deep learning methods are highlighted. The need for large-scale data management, analysis, and visualization in computational pathology is also addressed.

Digital Applications in Cytopathology: Problems, Rationalizations, and Alternative Approaches

OBJECTIVE

The aim of this work was to raise awareness of problems using digital applications for examining, teaching, and applying telecytology at King Abdulaziz Medical City (KAMC), Riyadh, Saudi Arabia; University of Nebraska Medical Center (UNMC), Omaha, NE, USA; and University of Pittsburgh Medical Center (UPMC), Pittsburgh, PA, USA. The objective was to rationalize problems and propose alternative digital approaches.

STUDY DESIGN

We sought to identify solutions to improve the following: (a) interpretive examination scores at KAMC for complex cytological templates (i.e., high-grade squamous intraepithelial lesions [HSIL]) when using static digital images (SDI) of cells in regions of interest (ROI); (b) visualization of cells in 3D clusters when teaching at UNMC using 2D and 3D whole-slide imaging (WSI); and (c) visualization of cells through streaming telecytology at UPMC.

RESULTS

Composite SDI (CSDI) improved test scores for complex interpretations (i.e., HSIL) by converging diagnostic criteria from multiple ROI. Multiplane focusing through z-stacked WSI facilitated the teaching of cytological entities characterized by 3D cell clusters and consultative telecytology through robotic cell analysis.

CONCLUSIONS

Adequately visualized cytomorphology and multiplane focusing are essential for virtual cytopathology examinations, teaching, or consultative telecytology. Visualization of diagnostic criteria through 2D or 3D imaging is critical. Panoptiq panoramic WSI with integrated z-stacked video clips enables optimal applied telecytology.

The role of informatics in patient-centered care and personalized medicine

The practice of cytopathology has dramatically changed due to advances in genomics and information technology. Cytology laboratories have accordingly become increasingly dependent on pathology informatics support to meet the emerging demands of precision medicine. Pathology informatics deals with information technology in the laboratory, and the impact of this technology on workflow processes and staff who interact with these tools. This article covers the critical role that laboratory information systems, electronic medical records, and digital imaging plays in patient-centered personalized medicine. The value of integrated diagnostic reports, clinical decision support, and the use of whole-slide imaging to better evaluate cytology samples destined for molecular testing is discussed. Image analysis that offers more precise and quantitative measurements in cytology is addressed, as well as the role of bioinformatics tools to cope with Big Data from next-generation sequencing. This article also highlights the barriers to the widespread adoption of these disruptive technologies due to regulatory obstacles, limited commercial solutions, poor interoperability, and lack of standardization. Cancer Cytopathol 2017;125(6 suppl):494-501. © 2017 American Cancer Society.

Implementation of Whole Slide Imaging for Clinical Purposes: Issues to Consider From the Perspective of Early Adopters

CONTEXT

- There is growing interest in the use of digital pathology, especially whole slide imaging, for diagnostic purposes. Many issues need to be considered when incorporating this technology into a clinical laboratory. The College of American Pathologists (CAP) established a Digital Pathology Committee to support the development of CAP programs related to digital pathology. One of its many initiatives was a panel discussion entitled "Implementing Whole-Slide Imaging for Clinical Use: What to Do and What to Avoid," given for 3 years at the CAP annual meetings starting in 2014.

OBJECTIVES

- To review major issues to consider when implementing whole slide imaging for clinical purposes as covered during the panel discussion.

DESIGN

- The views expressed and recommendations given are based primarily on the personal experience of the authors as early adopters of this technology. It is not intended to be an exhaustive review of digital pathology.

RESULTS

- Implementation is best approached in phases. Early efforts are directed toward identifying initial clinical applications and assembling an implementation team. Scanner selection should be based on intended use and budget. Recognizing pathologist concerns over the use of digital pathology for diagnostic purposes, ensuring adequate training, and performing appropriate validation studies will enhance adoption. Once implemented, the transition period from glass slide to image-based diagnostics will be associated with challenges, especially those related to a hybrid glass slide-digital slide workflow.

CONCLUSIONS

- With appropriate preparation, planning, and stepwise implementation, whole slide imaging can be used safely and reliably for frozen sections, consultation, quality assurance, and primary diagnosis.

Comparison of glass slides and various digital-slide modalities for cytopathology screening and interpretation

BACKGROUND

Whole-slide imaging in cytology is limited when glass slides are digitized without z-stacks for focusing. Different vendors have started to provide z-stacking solutions to overcome this limitation. The Panoptiq imaging system allows users to create digital files combining low-magnification panoramic images with regions of interest (ROIs) that are imaged with high-magnification z-stacks. The aim of this study was to compare such panoramic images with conventional whole-slide images and glass slides for the tasks of screening and interpretation in cytopathology.

METHODS

Thirty glass slides, including 10 ThinPrep Papanicolaou tests and 20 nongynecologic cytology cases, were digitized with an Olympus BX45 integrated microscope with an attached Prosilica GT camera. ViewsIQ software was used for image acquisition and viewing. These glass slides were also scanned on an Aperio ScanScope XT at ×40 (0.25 μm/pixel) with 1 z-plane and were viewed with ImageScope software. Digital and glass sides were screened and dotted/annotated by a cytotechnologist and were subsequently reviewed by 3 cytopathologists. For panoramic images, the cytotechnologist manually created digital maps and selected representative ROIs to generate z-stacks at a higher magnification. After 3-week washout periods, panoramic images were compared with Aperio digital slides and glass slides.

RESULTS

The Panoptiq system permitted fine focusing of thick smears and cell clusters. In comparison with glass slides, the average screening times were 5.5 and 1.8 times longer with Panoptiq and Aperio images, respectively, but this improved with user experience. There was no statistical difference in diagnostic concordance between all 3 modalities. Users' diagnostic confidence was also similar for all modalities.

CONCLUSIONS

The Aperio whole-slide scanner with 1 z-plane scanning and the Panoptiq imaging system with z-stacking are both suitable for cytopathology screening and interpretation. However, ROI z-stacks do offer a superior mechanism for overcoming focusing problems commonly encountered with digital cytology slides. Unlike whole-slide imaging, the acquisition of representative z-stack images with the Panoptiq system requires a trained cytologist to create digital files. Cancer Cytopathol 2017;125:701-9. © 2017 American Cancer Society.