Integrated digital pathology at scale: A solution for clinical diagnostics and cancer research at a large academic medical center

Understanding the financial aspects of digital pathology: A dynamic customizable return on investment calculator for informed decision-making

Background

The adoption of digital pathology has transformed the field of pathology, however, the economic impact and cost analysis of implementing digital pathology solutions remain a critical consideration for institutions to justify. Digital pathology implementation requires a thorough evaluation of associated costs and should identify and optimize resource allocation to facilitate informed decision-making. A dynamic cost calculator to estimate the financial implications of deploying digital pathology systems was needed to estimate the financial effects on transitioning to a digital workflow.

Methods

A systematic approach was used to comprehensively assess the various components involved in implementing and maintaining a digital pathology system. This consisted of: (1) identification of key cost categories associated with digital pathology implementation; (2) data collection and analysis of cost estimation; (3) cost categorization and quantification of direct and indirect costs associated with different use cases, allowing customization of each factor based on specific intended uses and market rates, industry standards, and regional variations; (4) opportunities for savings realized by digitization of glass slides and (5) integration of the cost calculator into a unified framework for a holistic view of the financial implications associated with digital pathology implementation. The online tool enables the user to test various scenarios specific to their institution and provides adjustable parameters to assure organization specific relatability.

Results

The Digital Pathology Association has developed a web-based calculator as a companion tool to provide an exhaustive list of the necessary concepts needed when assessing the financial implications of transitioning to a digital pathology system. The dynamic return on investment (ROI) calculator successfully integrated relevant cost and cost-saving components associated with digital pathology implementation and maintenance. Considerations include factors such as digital pathology infrastructure, clinical operations, staffing, hardware and software, information technology, archive and retrieval, medical-legal, and potential reimbursements. The ROI calculator developed for digital pathology workflows offers a comprehensive, customizable tool for institutions to assess their anticipated upfront and ongoing annual costs as they start or expand their digital pathology journey. It also offers cost-savings analysis based on specific user case volume, institutional geographic considerations, and actual costs. In addition, the calculator also serves as a tool to estimate number of required whole slide scanners, scanner throughput, and data storage (TB). This tool is intended to estimate the potential costs and cost savings resulting from the transition to digital pathology for business plan justifications and return on investment calculations.

Conclusions

The digital pathology online cost calculator provides a comprehensive and reliable means of estimating the financial implications associated with implementing and maintaining a digital pathology system. By considering various cost factors and allowing customization based on institution-specific variables, the calculator empowers pathology laboratories, healthcare institutions, and administrators to make informed decisions and optimize resource allocation when adopting or expanding digital pathology technologies. The ROI calculator will enable healthcare institutions to assess the financial feasibility and potential return on investment on adopting digital pathology, facilitating informed decision-making and resource allocation.

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities

This paper discusses some overlooked challenges faced when working with machine learning models for histopathology and presents a novel opportunity to support "Learning Health Systems" with them. Initially, the authors elaborate on these challenges after separating them according to their mitigation strategies: those that need innovative approaches, time, or future technological capabilities and those that require a conceptual reappraisal from a critical perspective. Then, a novel opportunity to support "Learning Health Systems" by integrating hidden information extracted by ML models from digitalized histopathology slides with other healthcare big data is presented.

Transforming diagnostics: The implementation of digital pathology in clinical laboratories

Digital pathology (DP) has emerged as a cutting-edge technology that promises to revolutionise diagnostics in clinical laboratories. This perspective article explores the implementation planning and considerations of DP in a single multicentre institution in Canada, the University Health Network, discussing benefits, challenges, potential implications and considerations for future adopters. We examine the transition from traditional microscopy to digital slide scanning and its impact on pathology practice, patient care and medical research. Furthermore, we address the regulatory, infrastructure and change management considerations for successful integration into clinical laboratories. By highlighting the advantages and addressing concerns, we aim to shed light on the transformative potential of DP and its role in shaping the future of diagnostics.

Understanding enterprise data warehouses to support clinical and translational research: impact, sustainability, demand management, and accessibility

OBJECTIVES

Healthcare organizations, including Clinical and Translational Science Awards (CTSA) hubs funded by the National Institutes of Health, seek to enable secondary use of electronic health record (EHR) data through an enterprise data warehouse for research (EDW4R), but optimal approaches are unknown. In this qualitative study, our goal was to understand EDW4R impact, sustainability, demand management, and accessibility.

MATERIALS AND METHODS

We engaged a convenience sample of informatics leaders from CTSA hubs (n = 21) for semi-structured interviews and completed a directed content analysis of interview transcripts.

RESULTS

EDW4R have created institutional capacity for single- and multi-center studies, democratized access to EHR data for investigators from multiple disciplines, and enabled the learning health system. Bibliometrics have been challenging due to investigator non-compliance, but one hub's requirement to link all study protocols with funding records enabled quantifying an EDW4R's multi-million dollar impact. Sustainability of EDW4R has relied on multiple funding sources with a general shift away from the CTSA grant toward institutional and industry support. To address EDW4R demand, institutions have expanded staff, used different governance approaches, and provided investigator self-service tools. EDW4R accessibility can benefit from improved tools incorporating user-centered design, increased data literacy among scientists, expansion of informaticians in the workforce, and growth of team science.

DISCUSSION

As investigator demand for EDW4R has increased, approaches to tracking impact, ensuring sustainability, and improving accessibility of EDW4R resources have varied.

CONCLUSION

This study adds to understanding of how informatics leaders seek to support investigators using EDW4R across the CTSA consortium and potentially elsewhere.

Artificial Intelligence-Based Quality Assessment of Histopathology Whole-Slide Images within a Clinical Workflow: Assessment of 'PathProfiler' in a Diagnostic Pathology Setting

Digital pathology continues to gain momentum, with the promise of artificial intelligence to aid diagnosis and for assessment of features which may impact prognosis and clinical management. Successful adoption of these technologies depends upon the quality of digitised whole-slide images (WSI); however, current quality control largely depends upon manual assessment, which is inefficient and subjective. We previously developed PathProfiler, an automated image quality assessment tool, and in this feasibility study we investigate its potential for incorporation into a diagnostic clinical pathology setting in real-time. A total of 1254 genitourinary WSI were analysed by PathProfiler. PathProfiler was developed and trained on prostate tissue and, of the prostate biopsy WSI, representing 46% of the WSI analysed, 4.5% were flagged as potentially being of suboptimal quality for diagnosis. All had concordant subjective issues, mainly focus-related, 54% severe enough to warrant remedial action which resulted in improved image quality. PathProfiler was less reliable in assessment of non-prostate surgical resection-type cases, on which it had not been trained. PathProfiler shows potential for incorporation into a digitised clinical pathology workflow, with opportunity for image quality improvement. Whilst its reliability in the current form appears greatest for assessment of prostate specimens, other specimen types, particularly biopsies, also showed benefit.

[Artificial intelligence for pathology-how, where, and why?]

Artificial intelligence promises many innovations and simplifications in pathology, but also raises just as many questions and uncertainties. In this article, we provide a brief overview of the current status, the goals already achieved by existing algorithms, and the remaining challenges.

Invisible for a few but essential for many: the role of Histotechnologists in the establishment of digital pathology

Digital pathology (DP) is indisputably the future for histopathology laboratories. The process of digital implementation requires deep workflow reorganisation which involves an interdisciplinary team. This transformation may have the greatest impact on the Histotechnologist (HTL) profession. Our review of the literature has clearly revealed that the role of HTLs in the establishment of DP is being unnoticed and guidance is limited. This article aims to bring HTLs from behind-the-scenes into the spotlight. Our objective is to provide them guidance and practical recommendations to successfully contribute to the implementation of a new digital workflow. Furthermore, it also intends to contribute for improvement of study programs, ensuring the role of HTL in DP is addressed as part of graduate and post-graduate education. In our review, we report on the differences encountered between workflow schemes and the limitations observed in this process. The authors propose a digital workflow to achieve its limitless potential, focusing on the HTL's role. This article explores the novel responsibilities of HTLs during specimen gross dissection, embedding, microtomy, staining, digital scanning, and whole slide image quality control. Furthermore, we highlight the benefits and challenges that DP implementation might bring the HTLs career. HTLs have an important role in the digital workflow: the responsibility of achieving the perfect glass slide.

[Digital transformation of a routine histopathology lab : Dos and don'ts!]

The implementation of digital histopathology in the laboratory marks a crucial milestone in the overall digital transformation of pathology. This shift offers a range of new possibilities, including access to extensive datasets for AI-assisted analyses, the flexibility of remote work and home office arrangements for specialists, and the expedited and simplified sharing of images and data for research, conferences, and tumor boards. However, the transition to a fully digital workflow involves significant technological and personnel-related efforts. It necessitates careful and adaptable change management to minimize disruptions, particularly in the personnel domain, and to prevent the loss of valuable potential from employees who may be resistant to change. This article consolidates our institute's experiences, highlighting technical and personnel-related challenges encountered during the transition to digital pathology. It also presents a comprehensive overview of potential difficulties at various interfaces when converting routine operations to a digital workflow.

Establishing guidelines for sentinel lymph node ultrastaging in endometrial cancer

BACKGROUND

Many sentinel lymph node (SLN) ultrastaging protocols for endometrial cancer exist, but there is no consensus method.

OBJECTIVE

This study aims to develop guidelines for size criteria in SLN evaluation for endometrial cancer, to determine whether a single cytokeratin AE1:AE3 immunohistochemical slide provides sufficient data for diagnosis, and to compare cost efficiency between current and limited ultrastaging protocols at a large tertiary care institution.

METHODS

Our current SLN ultrastaging protocol consists of cutting two adjacent paraffin block sections at two levels (L1 and L2), 50 μm apart, with two slides at each level stained with hematoxylin and eosin and cytokeratin AE1:AE3 immunohistochemistry. We retrospectively reviewed digitized L1 and L2 slides of all positive ultrastaged SLNs from patients treated for endometrial cancer between January 2013 and January 2020. SLN diagnosis was defined by measuring the largest cluster of contiguous tumor cells in a single cross section: macrometastasis (>2.0 mm), micrometastasis (>0.2 to ≤2.0 mm or >200 cells), or isolated tumor cells (≤0.2 mm or ≤200 cells). Concordance between L1 and L2 results was evaluated. Cost efficiency between current (two immunohistochemical slides per block) and proposed limited (one immunohistochemical slide per block) protocols was compared.

RESULTS

Digitized slides of 147 positive SLNs from 109 patients were reviewed; 4.1% of SLNs were reclassified based on refined size criteria. Complete concordance between L1 and L2 interpretations was seen in 91.8% of SLNs. A false-negative rate of 0%-0.9% in detecting micrometastasis and macrometastasis using a limited protocol was observed. Estimated charge-level savings of a limited protocol were 50% per patient.

CONCLUSION

High diagnostic accuracy in SLN interpretation may be achieved using a limited ultrastaging protocol of one immunohistochemical slide per block and linear measurement of the largest cluster of contiguous tumor cells. Implementation of the proposed limited ultrastaging protocol may result in laboratory cost savings with minimal impact on health outcomes.

Complete digital pathology transition: A large multi-center experience

INTRODUCTION

Transitioning from glass slide pathology to digital pathology for primary diagnostics requires an appropriate laboratory information system, an image management system, and slide scanners; it also reinforces the need for sophisticated pathology informatics including synoptic reporting. Previous reports have discussed the transition itself and relevant considerations for it, but not the selection criteria and considerations for the infrastructure.

OBJECTIVE

To describe the process used to evaluate slide scanners, image management systems, and synoptic reporting systems for a large multisite institution.

METHODS

Six network hospitals evaluated six slide scanners, three image management systems, and three synoptic reporting systems. Scanners were evaluated based on the quality of image, speed, ease of operation, and special capabilities (including z-stacking, fluorescence and others). Image management and synoptic reporting systems were evaluated for their ease of use and capacity.

RESULTS

Among the scanners evaluated, the Leica GT450 produced the highest quality images, while the 3DHistech Pannoramic provided fluorescence and superior z-stacking. The newest generation of scanners, released relatively recently, performed better than slightly older scanners from major manufacturers Although the Olympus VS200 was not fully vetted due to not meeting all inclusion criteria, it is discussed herein due to its exceptional versatility. For Image Management Software, the authors believe that Sectra is, at the time of writing the best developed option, but this could change in the very near future as other systems improve their capabilities. All synoptic reporting systems performed impressively.

CONCLUSIONS

Specifics regarding quality and abilities of different components will change rapidly with time, but large pathology practices considering such a transition should be aware of the issues discussed and evaluate the most current generation to arrive at appropriate conclusions.

Digitization of Pathology Labs: A Review of Lessons Learned

Pathology laboratories are increasingly using digital workflows. This has the potential of increasing laboratory efficiency, but the digitization process also involves major challenges. Several reports have been published describing the individual experiences of specific laboratories with the digitization process. However, a comprehensive overview of the lessons learned is still lacking. We provide an overview of the lessons learned for different aspects of the digitization process, including digital case management, digital slide reading, and computer-aided slide reading. We also cover metrics used for monitoring performance and pitfalls and corresponding values observed in practice. The overview is intended to help pathologists, information technology decision makers, and administrators to benefit from the experiences of others and to implement the digitization process in an optimal way to make their own laboratory future-proof.

Quality Management System in Clinical Digital Pathology Operations at a Tertiary Cancer Center

Digital pathology workflows can improve pathology operations by allowing reliable and fast retrieval of digital images, digitally reviewing pathology slides, enabling remote work and telepathology, use of computer-aided tools, and sharing of digital images for research and educational purposes. The need for quality systems is a prerequisite for successful clinical-grade digital pathology adoption and patient safety. In this article, we describe the development of a structured digital pathology laboratory quality management system (QMS) for clinical digital pathology operations at Memorial Sloan Kettering Cancer Center (MSK). This digital pathology-specific QMS development stemmed from the gaps that were identified when MSK integrated digital pathology into its clinical practice. The digital scan team in conjunction with the Department of Pathology and Laboratory Medicine quality team developed a QMS tailored to the scanning operation to support departmental and institutional needs. As a first step, systemic mapping of the digital pathology operations identified the prescan, scan, and postscan processes; instrumentation; and staffing involved in the digital pathology operation. Next, gaps identified in quality control and quality assurance measures led to the development of standard operating procedures and training material for the different roles and workflows in the process. All digital pathology-related documents were subject to regulatory review and approval by departmental leadership. The quality essentials were developed into an extensive Digital Pathology Quality Essentials framework to specifically address the needs of the growing clinical use of digital pathology technologies. Using the unique digital experience gained at MSK, we present our recommendations for QMS for large-scale digital pathology operations in clinical settings.

Clinical Validation of Artificial Intelligence-Augmented Pathology Diagnosis Demonstrates Significant Gains in Diagnostic Accuracy in Prostate Cancer Detection

CONTEXT.—

Prostate cancer diagnosis rests on accurate assessment of tissue by a pathologist. The application of artificial intelligence (AI) to digitized whole slide images (WSIs) can aid pathologists in cancer diagnosis, but robust, diverse evidence in a simulated clinical setting is lacking.

OBJECTIVE.—

To compare the diagnostic accuracy of pathologists reading WSIs of prostatic biopsy specimens with and without AI assistance.

DESIGN.—

Eighteen pathologists, 2 of whom were genitourinary subspecialists, evaluated 610 prostate needle core biopsy WSIs prepared at 218 institutions, with the option for deferral. Two evaluations were performed sequentially for each WSI: initially without assistance, and immediately thereafter aided by Paige Prostate (PaPr), a deep learning-based system that provides a WSI-level binary classification of suspicious for cancer or benign and pinpoints the location that has the greatest probability of harboring cancer on suspicious WSIs. Pathologists' changes in sensitivity and specificity between the assisted and unassisted modalities were assessed, together with the impact of PaPr output on the assisted reads.

RESULTS.—

Using PaPr, pathologists improved their sensitivity and specificity across all histologic grades and tumor sizes. Accuracy gains on both benign and cancerous WSIs could be attributed to PaPr, which correctly classified 100% of the WSIs showing corrected diagnoses in the PaPr-assisted phase.

CONCLUSIONS.—

This study demonstrates the effectiveness and safety of an AI tool for pathologists in simulated diagnostic practice, bridging the gap between computational pathology research and its clinical application, and resulted in the first US Food and Drug Administration authorization of an AI system in pathology.

How to use AI in pathology

AI plays an important role in pathology, both in clinical practice supporting pathologists in their daily work, and in research discovering novel biomarkers for improved patient care. Still, AI is in its starting phase, and many pathology labs still need to transition to a digital workflow to be able to enjoy the benefits of AI. In this perspective, we explain the major benefits of AI in pathology, highlight key requirements that need to be met and example how to use it in a typical workflow.

Assessing the decision quality of artificial intelligence and oncologists of different experience in different regions in breast cancer treatment

Background

AI-based clinical decision support system (CDSS) has important prospects in overcoming the current informational challenges that cancer diseases faced, promoting the homogeneous development of standardized treatment among different geographical regions, and reforming the medical model. However, there are still a lack of relevant indicators to comprehensively assess its decision-making quality and clinical impact, which greatly limits the development of its clinical research and clinical application. This study aims to develop and application an assessment system that can comprehensively assess the decision-making quality and clinical impacts of physicians and CDSS.

Methods

Enrolled adjuvant treatment decision stage early breast cancer cases were randomly assigned to different decision-making physician panels (each panel consisted of three different seniority physicians in different grades hospitals), each physician made an independent "Initial Decision" and then reviewed the CDSS report online and made a "Final Decision". In addition, the CDSS and guideline expert groups independently review all cases and generate "CDSS Recommendations" and "Guideline Recommendations" respectively. Based on the design framework, a multi-level multi-indicator system including "Decision Concordance", "Calibrated Concordance", " Decision Concordance with High-level Physician", "Consensus Rate", "Decision Stability", "Guideline Conformity", and "Calibrated Conformity" were constructed.

Results

531 cases containing 2124 decision points were enrolled; 27 different seniority physicians from 10 different grades hospitals have generated 6372 decision opinions before and after referring to the "CDSS Recommendations" report respectively. Overall, the calibrated decision concordance was significantly higher for CDSS and provincial-senior physicians (80.9%) than other physicians. At the same time, CDSS has a higher " decision concordance with high-level physician" (76.3%-91.5%) than all physicians. The CDSS had significantly higher guideline conformity than all decision-making physicians and less internal variation, with an overall guideline conformity variance of 17.5% (97.5% vs. 80.0%), a standard deviation variance of 6.6% (1.3% vs. 7.9%), and a mean difference variance of 7.8% (1.5% vs. 9.3%). In addition, provincial-middle seniority physicians had the highest decision stability (54.5%). The overall consensus rate among physicians was 64.2%.

Conclusions

There are significant internal variation in the standardization treatment level of different seniority physicians in different geographical regions in the adjuvant treatment of early breast cancer. CDSS has a higher standardization treatment level than all physicians and has the potential to provide immediate decision support to physicians and have a positive impact on standardizing physicians' treatment behaviors.

Digital pathology operations at a tertiary cancer center: Infrastructure requirements and operational cost

Whole slide imaging is revolutionizing the field of pathology and is currently being used for clinical, educational, and research initiatives by an increasing number of institutions. Pathology departments have distinct needs for digital pathology systems, yet the cost of digital workflows is cited as a major barrier for widespread adoption by many organizations. Memorial Sloan Kettering Cancer Center (MSK) is an early adopter of whole slide imaging with incremental investments in resources that started more than 15 years ago. This experience and the large-scale scan operations led to the identification of required framework components of digital pathology operations. The cost of these components for the 2021 digital pathology operations at MSK were studied and calculated to enable an understanding of the operation and benchmark the accompanying costs. This paper describes the unique infrastructure cost and the costs associated with the digital pathology clinical operation use cases in a large, tertiary cancer center. These calculations can serve as a blueprint for other institutions to provide the necessary concepts and offer insights towards the financial requirements for digital pathology adoption by other institutions.

Interoperable slide microscopy viewer and annotation tool for imaging data science and computational pathology

The exchange of large and complex slide microscopy imaging data in biomedical research and pathology practice is impeded by a lack of data standardization and interoperability, which is detrimental to the reproducibility of scientific findings and clinical integration of technological innovations. We introduce Slim, an open-source, web-based slide microscopy viewer that implements the internationally accepted Digital Imaging and Communications in Medicine (DICOM) standard to achieve interoperability with a multitude of existing medical imaging systems. We showcase the capabilities of Slim as the slide microscopy viewer of the NCI Imaging Data Commons and demonstrate how the viewer enables interactive visualization of traditional brightfield microscopy and highly-multiplexed immunofluorescence microscopy images from The Cancer Genome Atlas and Human Tissue Atlas Network, respectively, using standard DICOMweb services. We further show how Slim enables the collection of standardized image annotations for the development or validation of machine learning models and the visual interpretation of model inference results in the form of segmentation masks, spatial heat maps, or image-derived measurements.

Rapid Deployment of Whole Slide Imaging for Primary Diagnosis in Surgical Pathology at Stanford Medicine: Responding to Challenges of the COVID-19 Pandemic

CONTEXT.—

Stanford Pathology began stepwise subspecialty implementation of whole slide imaging (WSI) in 2018 soon after the first US Food and Drug Administration approval. In 2020, during the COVID-19 pandemic, the Centers for Medicare & Medicaid Services waived the requirement for pathologists to perform diagnostic tests in Clinical Laboratory Improvement Amendments (CLIA)-licensed facilities. This encouraged rapid implementation of WSI across all surgical pathology subspecialties.

OBJECTIVE.—

To present our experience with validation and implementation of WSI at a large academic medical center encompassing a caseload of more than 50 000 cases per year.

DESIGN.—

Validation was performed independently for 3 subspecialty services with a diagnostic concordance threshold above 95%. Analysis of user experience, staffing, infrastructure, and information technology was performed after department-wide expansion.

RESULTS.—

Diagnostic concordance was achieved in 96% of neuropathology cases, 100% of gynecologic pathology cases, and 98% of immunohistochemistry cases. After full implementation, 8 high-capacity scanners were operational, with whole slide images generated on greater than 2000 slides per weekday, accounting for approximately 80% of histologic slides at Stanford Medicine. Multiple modifications in workflow and information technology were needed to improve performance. Within months of full implementation, most attending pathologists and trainees had adopted WSI for primary diagnosis.

CONCLUSIONS.—

WSI across all surgical subspecialities is achievable at scale at an academic medical center; however, adoption required flexibility to adjust workflows and develop tailored solutions. WSI at scale supported the health and safety of medical staff while facilitating high-quality patient care and education during COVID-19 restrictions.

Deep Learning-Based Objective and Reproducible Osteosarcoma Chemotherapy Response Assessment and Outcome Prediction

Osteosarcoma is the most common primary bone cancer, whose standard treatment includes pre-operative chemotherapy followed by resection. Chemotherapy response is used for prognosis and management of patients. Necrosis is routinely assessed after chemotherapy from histology slides on resection specimens, where necrosis ratio is defined as the ratio of necrotic tumor/overall tumor. Patients with necrosis ratio ≥90% are known to have a better outcome. Manual microscopic review of necrosis ratio from multiple glass slides is semiquantitative and can have intraobserver and interobserver variability. In this study, an objective and reproducible deep learning-based approach was proposed to estimate necrosis ratio with outcome prediction from scanned hematoxylin and eosin whole slide images (WSIs). To conduct the study, 103 osteosarcoma cases with 3134 WSIs were collected. Deep Multi-Magnification Network was trained to segment multiple tissue subtypes, including viable tumor and necrotic tumor at a pixel level and to calculate case-level necrosis ratio from multiple WSIs. Necrosis ratio estimated by the segmentation model highly correlates with necrosis ratio from pathology reports manually assessed by experts. Furthermore, patients were successfully stratified to predict overall survival with P = 2.4 × 10-6 and progression-free survival with P = 0.016. This study indicates that deep learning can support pathologists as an objective tool to analyze osteosarcoma from histology for assessing treatment response and predicting patient outcome.

Anonymization of whole slide images in histopathology for research and education

Objective

The exchange of health-related data is subject to regional laws and regulations, such as the General Data Protection Regulation (GDPR) in the EU or the Health Insurance Portability and Accountability Act (HIPAA) in the United States, resulting in non-trivial challenges for researchers and educators when working with these data. In pathology, the digitization of diagnostic tissue samples inevitably generates identifying data that can consist of sensitive but also acquisition-related information stored in vendor-specific file formats. Distribution and off-clinical use of these Whole Slide Images (WSIs) are usually done in these formats, as an industry-wide standardization such as DICOM is yet only tentatively adopted and slide scanner vendors currently do not provide anonymization functionality.

Methods

We developed a guideline for the proper handling of histopathological image data particularly for research and education with regard to the GDPR. In this context, we evaluated existing anonymization methods and examined proprietary format specifications to identify all sensitive information for the most common WSI formats. This work results in a software library that enables GDPR-compliant anonymization of WSIs while preserving the native formats.

Results

Based on the analysis of proprietary formats, all occurrences of sensitive information were identified for file formats frequently used in clinical routine, and finally, an open-source programming library with an executable CLI tool and wrappers for different programming languages was developed.

Conclusions

Our analysis showed that there is no straightforward software solution to anonymize WSIs in a GDPR-compliant way while maintaining the data format. We closed this gap with our extensible open-source library that works instantaneously and offline.

How, for whom, and in what contexts will artificial intelligence be adopted in pathology? A realist interview study

OBJECTIVE

There is increasing interest in using artificial intelligence (AI) in pathology to improve accuracy and efficiency. Studies of clinicians' perceptions of AI have found only moderate acceptability, suggesting further research is needed regarding integration into clinical practice. This study aimed to explore stakeholders' theories concerning how and in what contexts AI is likely to become integrated into pathology.

MATERIALS AND METHODS

A literature review provided tentative theories that were revised through a realist interview study with 20 pathologists and 5 pathology trainees. Questions sought to elicit whether, and in what ways, the tentative theories fitted with interviewees' perceptions and experiences. Analysis focused on identifying the contextual factors that may support or constrain uptake of AI in pathology.

RESULTS

Interviews highlighted the importance of trust in AI, with interviewees emphasizing evaluation and the opportunity for pathologists to become familiar with AI as means for establishing trust. Interviewees expressed a desire to be involved in design and implementation of AI tools, to ensure such tools address pressing needs, but needs vary by subspecialty. Workflow integration is desired but whether AI tools should work automatically will vary according to the task and the context.

CONCLUSIONS

It must not be assumed that AI tools that provide benefit in one subspecialty will provide benefit in others. Pathologists should be involved in the decision to introduce AI, with opportunity to assess strengths and weaknesses. Further research is needed concerning the evidence required to satisfy pathologists regarding the benefits of AI.

Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation

Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. The segmentation model and code have been released at https://github.com/MSKCC-Computational-Pathology/DMMN-ovary.

Efficient Visualization of Whole Slide Images in Web-based Viewers for Digital Pathology

CONTEXT.—

Wide adoption of digital pathology requires efficient visualization and navigation in Web-based digital slide viewers, which is poorly defined.

OBJECTIVE.—

To define and quantify relevant performance metrics for efficient visualization of cases and slides in digital slide viewers.

DESIGN.—

With a universal slide viewer used in clinical routine diagnostics, we evaluated the impact of slide caching, compression type, tile, and block size of whole slide images generated from Philips, Leica, and 3DHistech scanners on streaming performance on case, slide, and field of view levels.

RESULTS.—

Two hundred thirty-nine pathologists routinely reviewed 60 080 whole slide images over 3 months. The median time to open a case's slides from the laboratory information system was less than 4 seconds, the time to change to a slide within the case was less than 1 second, and the time to render the adjacent field of view when navigating the slide was less than one-quarter of a second. A whole slide image's block size and a viewer tile size of 1024 pixels showed best performance to display a field of view and was preferrable over smaller tiles due to fewer mosaic effects. For Philips, fastest median slide streaming pace was 238 ms per field of view and for 3DHistech, 125 ms. For Leica, the fastest pace of 108 ms per field of view was established with block serving without decompression.

CONCLUSIONS.—

This is the first study to systematically assess user-centric slide visualization performance metrics for digital viewers, including time to open a case, time to change a slide, and time to change a field of view. These metrics help to improve the viewer's configuration, leading to an efficient visualization baseline that is widely accepted among pathologists using routine digital pathology.

Whole slide image data utilization informed by digital diagnosis patterns

Context

Despite the benefits of digital pathology, data storage and management of digital whole slide images introduces new logistical and infrastructure challenges to traditionally analog pathology labs.

Aims

Our goal was to analyze pathologist slide diagnosis patterns to determine the minimum number of pixels required during the diagnosis.

Methods

We developed a method of using pathologist viewing patterns to vary digital image resolution across virtual slides, which we call variable resolution images. An additional pathologist reviewed the variable resolution images to determine if diagnoses could still be rendered.

Results

Across all slides, the pathologists rarely zoomed in to the full resolution level. As a result, the variable resolution images are significantly smaller than the original whole slide images. Despite the reduction in image sizes, the final pathologist reviewer could still proide diagnoses on the variable resolution slide images.

Conclusions

Future studies will be conducted to understand variability in resolution requirements between and within pathologists. These findings have the potential to dramatically reduce the data storage requirements of high-resolution whole slide images.

Can artificial intelligence improve cancer treatments?

Artificial intelligence (AI) powered by the accumulating clinical and molecular data about cancer has fueled the expectation that a transformation in cancer treatments towards significant improvement of patient outcomes is at hand. However, such transformation has been so far elusive. The opacity of AI algorithms and the lack of quality annotated data being available at population scale are among the challenges to the application of AI in oncology. Fundamentally however, the heterogeneity of cancer and its evolutionary dynamics make every tumor response to therapy sufficiently different from the population, machine-learned statistical models, challenging hence the capacity of these models to yield reliable inferences about treatment recommendations that can improve patient outcomes. This article reviews the nominal elements of clinical decision-making for precision oncology and frames the utility of AI to cancer treatment improvements in light of cancer unique challenges.

DigiPatICS: Digital Pathology Transformation of the Catalan Health Institute Network of 8 Hospitals—Planification, Implementation, and Preliminary Results

Complete digital pathology transformation for primary histopathological diagnosis is a challenging yet rewarding endeavor. Its advantages are clear with more efficient workflows, but there are many technical and functional difficulties to be faced. The Catalan Health Institute (ICS) has started its DigiPatICS project, aiming to deploy digital pathology in an integrative, holistic, and comprehensive way within a network of 8 hospitals, over 168 pathologists, and over 1 million slides each year. We describe the bidding process and the careful planning that was required, followed by swift implementation in stages. The purpose of the DigiPatICS project is to increase patient safety and quality of care, improving diagnosis and the efficiency of processes in the pathological anatomy departments of the ICS through process improvement, digital pathology, and artificial intelligence tools.

The Role of Artificial Intelligence in Early Cancer Diagnosis

Improving the proportion of patients diagnosed with early-stage cancer is a key priority of the World Health Organisation. In many tumour groups, screening programmes have led to improvements in survival, but patient selection and risk stratification are key challenges. In addition, there are concerns about limited diagnostic workforces, particularly in light of the COVID-19 pandemic, placing a strain on pathology and radiology services. In this review, we discuss how artificial intelligence algorithms could assist clinicians in (1) screening asymptomatic patients at risk of cancer, (2) investigating and triaging symptomatic patients, and (3) more effectively diagnosing cancer recurrence. We provide an overview of the main artificial intelligence approaches, including historical models such as logistic regression, as well as deep learning and neural networks, and highlight their early diagnosis applications. Many data types are suitable for computational analysis, including electronic healthcare records, diagnostic images, pathology slides and peripheral blood, and we provide examples of how these data can be utilised to diagnose cancer. We also discuss the potential clinical implications for artificial intelligence algorithms, including an overview of models currently used in clinical practice. Finally, we discuss the potential limitations and pitfalls, including ethical concerns, resource demands, data security and reporting standards.

Digital Pathology Implementation in Private Practice: Specific Challenges and Opportunities

Digital pathology (DP) is being deployed in many pathology laboratories, but most reported experiences refer to public health facilities. In this paper, we report our experience in DP transition at a high-volume private laboratory, addressing the main challenges in DP implementation in a private practice setting and how to overcome these issues. We started our implementation in 2020 and we are currently scanning 100% of our histology cases. Pre-existing sample tracking infrastructure facilitated this process. We are currently using two high-capacity scanners (Aperio GT450DX) to digitize all histology slides at 40×. Aperio eSlide Manager WebViewer viewing software is bidirectionally linked with the laboratory information system. Scanning error rate, during the test phase, was 2.1% (errors detected by the scanners) and 3.5% (manual quality control). Pre-scanning phase optimizations and vendor feedback and collaboration were crucial to improve WSI quality and are ongoing processes. Regarding pathologists' validation, we followed the Royal College of Pathologists recommendations for DP implementation (adapted to our practice). Although private sector implementation of DP is not without its challenges, it will ultimately benefit from DP safety and quality-associated features. Furthermore, DP deployment lays the foundation for artificial intelligence tools integration, which will ultimately contribute to improving patient care.

A community-based approach to image analysis of cells, tissues and tumors

Emerging multiplexed imaging platforms provide an unprecedented view of an increasing number of molecular markers at subcellular resolution and the dynamic evolution of tumor cellular composition. As such, they are capable of elucidating cell-to-cell interactions within the tumor microenvironment that impact clinical outcome and therapeutic response. However, the rapid development of these platforms has far outpaced the computational methods for processing and analyzing the data they generate. While being technologically disparate, all imaging assays share many computational requirements for post-collection data processing. As such, our Image Analysis Working Group (IAWG), composed of researchers in the Cancer Systems Biology Consortium (CSBC) and the Physical Sciences - Oncology Network (PS-ON), convened a workshop on "Computational Challenges Shared by Diverse Imaging Platforms" to characterize these common issues and a follow-up hackathon to implement solutions for a selected subset of them. Here, we delineate these areas that reflect major axes of research within the field, including image registration, segmentation of cells and subcellular structures, and identification of cell types from their morphology. We further describe the logistical organization of these events, believing our lessons learned can aid others in uniting the imaging community around self-identified topics of mutual interest, in designing and implementing operational procedures to address those topics and in mitigating issues inherent in image analysis (e.g., sharing exemplar images of large datasets and disseminating baseline solutions to hackathon challenges through open-source code repositories).

Building tools for machine learning and artificial intelligence in cancer research: best practices and a case study with the PathML toolkit for computational pathology

Imaging datasets in cancer research are growing exponentially in both quantity and information density. These massive datasets may enable derivation of insights for cancer research and clinical care, but only if researchers are equipped with the tools to leverage advanced computational analysis approaches such as machine learning and artificial intelligence. In this work, we highlight three themes to guide development of such computational tools: scalability, standardization, and ease of use. We then apply these principles to develop PathML, a general-purpose research toolkit for computational pathology. We describe the design of the PathML framework and demonstrate applications in diverse use-cases. PathML is publicly available at www.pathml.com.

FlexTileSource: An OpenSeadragon Extension for Efficient Whole-Slide Image Visualization

BACKGROUND

Web-based digital slide viewers for pathology commonly use OpenSlide and OpenSeadragon (OSD) to access, visualize, and navigate whole-slide images (WSI). Their standard settings represent WSI as deep zoom images (DZI), a generic image pyramid structure that differs from the proprietary pyramid structure in the WSI files. The transformation from WSI to DZI is an additional, time-consuming step when rendering digital slides in the viewer, and inefficiency of digital slide viewers is a major criticism for digital pathology.

AIMS

To increase efficiency of digital slide visualization by serving tiles directly from the native WSI pyramid, making the transformation from WSI to DZI obsolete.

METHODS

We implemented a new flexible tile source for OSD that accepts arbitrary native pyramid structures instead of DZI levels. We measured its performance on a data set of 8104 WSI reviewed by 207 pathologists over 40 days in a web-based digital slide viewer used for routine diagnostics.

RESULTS

The new FlexTileSource accelerates the display of a field of view in general by 67 ms and even by 117 ms if the block size of the WSI and the tile size of the viewer is increased to 1024 px. We provide the code of our open-source library freely on https://github.com/schuefflerlab/openseadragon.

CONCLUSIONS

This is the first study to quantify visualization performance on a web-based slide viewer at scale, taking block size and tile size of digital slides into account. Quantifying performance will enable to compare and improve web-based viewers and therewith facilitate the adoption of digital pathology.