Evaluating the role of Z-stack to improve the morphologic evaluation of urine cytology whole slide images for high-grade urothelial carcinoma: Results and review of a pilot study

[What contribution can make artificial intelligence to urinary cytology?]

Urinary cytology using the Paris system is still the method of choice for screening high-grade urothelial carcinomas. However, the use of the objective criteria described in this terminology shows a lack of inter- and intra-observer reproducibility. Moreover, if its sensitivity is excellent on instrumented urine, it remains insufficient on voided urine samples. Urinary cytology appears to be an excellent model for the application of artificial intelligence to improve performance, since the objective criteria of the Paris system are defined at cellular level, and the resulting diagnostic approach is presented in a highly "algorithmic" way. Nevertheless, there is no commercially available morphological diagnostic aid, and very few predictive devices are still undergoing clinical validation. The analysis of different systems using artificial intelligence in urinary cytology rises clear prospects for mutual contributions.

Changing digital and telecytology practices post COVID-19 comparing ASC survey results from 2016 to 2023

INTRODUCTION

During the COVID-19 pandemic, the need for digital pathology tools became more urgent. However, there needs to be more knowledge of the use in cytology. We aimed to evaluate current digital cytology practices and attitudes and compare the results with a pre-COVID-19 American Society of Cytopathology (ASC) survey.

MATERIALS AND METHODS

Fourteen survey questions assessing current attitudes toward digital cytology were developed from a 2016 ASC Digital Pathology Survey. Ten new survey questions were also created to evaluate telecytology use. The survey was e-mailed to ASC members over 6 weeks in 2023.

RESULTS

A total of 123 individuals responded (116 in 2016). Attitudes toward digital cytology were unchanged; most participants stated digital cytology is beneficial (87% 2023 versus 90% 2016). The percentage of individuals using digital cytology was unchanged (56% in 2016 and 2023). However, telecytology for rapid onsite assessment (ROSE) is now considered the best application (55% 2023 versus 31% 2016). Forty-three institutions reported using digital and telecytology tools; 40% made implementations after 2020; most did not feel that COVID-19 affected digital cytology (56%). Telecytology for ROSE is the most common application now (78%) compared with education (30%) in 2016. Limitations for implementing digital imaging in cytology included inability to focus (38%) and expense (33%).

CONCLUSIONS

General attitudes toward digital tools by the cytology community have essentially remained the same between 2016 and now. However, telecytology for ROSE is increasingly being used, which supports a need for validation and competency guidelines.

Evaluating Urine Cytology Slide Digitization Efficiency: A Comparative Study Using an Artificial Intelligence-Based Heuristic Scanning Simulation and Multiple Z-Plane Scanning

INTRODUCTION

Digitizing cytology slides presents challenges because of their three-dimensional features and uneven cell distribution. While multi-Z-plane scan is a prevalent solution, its adoption in clinical digital cytopathology is hindered by prolonged scanning times, increased image file sizes, and the requirement for cytopathologists to review multiple Z-plane images.

METHODS

This study presents heuristic scan as a novel solution, using an artificial intelligence (AI)-based approach specifically designed for cytology slide scanning as an alternative to the multi-Z-plane scan. Both the 21 Z-plane scan and the heuristic scan simulation methods were used on 52 urine cytology slides from three distinct cytopreparations (Cytospin, ThinPrep, and BD CytoRich™ [SurePath]), generating whole-slide images (WSIs) via the Leica Aperio AT2 digital scanner. The AI algorithm inferred the WSI from 21 Z-planes to quantitate the total number of suspicious for high-grade urothelial carcinoma or more severe cells (SHGUC+) cells. The heuristic scan simulation calculated the total number of SHGUC+ cells from the 21 Z-plane scan data. Performance metrics including SHGUC+ cell coverage rates (calculated by dividing the number of SHGUC+ cells identified in multiple Z-planes or heuristic scan simulation by the total SHGUC+ cells in the 21 Z-planes for each WSI), scanning time, and file size were analyzed to compare the performance of each scanning method. The heuristic scan's metrics were linearly estimated from the 21 Z-plane scan data. Additionally, AI-aided interpretations of WSIs with scant SHGUC+ cells followed The Paris System guidelines and were compared with original diagnoses.

RESULTS

The heuristic scan achieved median SHGUC+ cell coverage rates similar to 5 Z-plane scans across three cytopreparations (0.78-0.91 vs. 0.75-0.88, p = 0.451-0.578). Notably, it substantially reduced both scanning time (137.2-635.0 s vs. 332.6-1,278.8 s, p < 0.05) and image file size (0.51-2.10 GB vs. 1.16-3.10 GB, p < 0.05). Importantly, the heuristic scan yielded higher rates of accurate AI-aided interpretations compared to the single Z-plane scan (62.5% vs. 37.5%).

CONCLUSION

We demonstrated that the heuristic scan offers a cost-effective alternative to the conventional multi-Z-plane scan in digital cytopathology. It achieves comparable SHGUC+ cell capture rates while reducing both scanning time and image file size, promising to aid digital urine cytology interpretations with a higher accuracy rate compared to the conventional single (optimal) plane scan. Further studies are needed to assess the integration of this new technology into compatible digital scanners for practical cytology slide scanning.

Digital cytology part 1: digital cytology implementation for practice: a concept paper with review and recommendations from the American Society of Cytopathology Digital Cytology Task Force

Digital cytology and artificial intelligence (AI) are gaining greater adoption in the cytopathology laboratory. However, peer-reviewed real-world data and literature are lacking regarding the current clinical landscape. The American Society of Cytopathology in conjunction with the International Academy of Cytology and the Digital Pathology Association established a special task force comprising 20 members with expertise and/or interest in digital cytology. The aim of the group was to investigate the feasibility of incorporating digital cytology, specifically cytology whole slide scanning and AI applications, into the workflow of the laboratory. In turn, the impact on cytopathologists, cytologists (cytotechnologists), and cytology departments were also assessed. The task force reviewed existing literature on digital cytology, conducted a worldwide survey, and held a virtual roundtable discussion on digital cytology and AI with multiple industry corporate representatives. This white paper, presented in 2 parts, summarizes the current state of digital cytology and AI practice in global cytology practice. Part 1 of the white paper presented herein is a review and offers best practice recommendations for incorporating digital cytology into practice. Part 2 of the white paper provides a comprehensive review of AI in cytology practice along with best practice recommendations and legal considerations. Additionally, the results of a global survey regarding digital cytology are highlighted.

Comparison of glass and digital slides for cervical cytopathology screening and interpretation

Cervical cancer is the second most common form of cancer and a leading cause of premature death among women aged 15 to 44 worldwide. In Brazil, there is a high prevalence of infection by the human papillomavirus - HPV. Digital pathology optimizes time and space for reading cervicovaginal cytology slides. We evaluated the feasibility of using whole slide images (WSI) for the routine interpretation of cytology exams. A total of 99 cases of vaginal cytology were selected from a reference laboratory in Northeastern Brazil. Three cytotechnicians participated in the study. Cellular atypia was the one that most presented concordance values. Two observers almost perfectly agreed (k = 0.86 and k = 0.84, respectively) on the negative diagnoses. The performance of the evaluators for NILM (negative for intraepithelial lesion and malignancy) showed high reproducibility and sensitivity in the digital slides, mainly between evaluators A and C. In contrast, the microbiology group showed disagreement between the diagnoses by digital slides and the standard- gold. The concordance between the digital diagnoses and the gold standard for ASCUS was 89%. In the inflammatory category, Spearman's test showed similar results between raters A, B, and C (rs = 0.47, rs = 0.41, and rs = 0.47, respectively). This study reports the diagnostic validation using digital slides in view of the need to optimize the cytology visualization process. Our experience shows good diagnostic agreement between digital and optical microscopy in several analyzed categories, but mainly in relation to cellular atypia and inflammatory processes.

Large-scale validation study of an improved semiautonomous urine cytology assessment tool: AutoParis-X

BACKGROUND

Adopting a computational approach for the assessment of urine cytology specimens has the potential to improve the efficiency, accuracy, and reliability of bladder cancer screening, which has heretofore relied on semisubjective manual assessment methods. As rigorous, quantitative criteria and guidelines have been introduced for improving screening practices (e.g., The Paris System for Reporting Urinary Cytology), algorithms to emulate semiautonomous diagnostic decision-making have lagged behind, in part because of the complex and nuanced nature of urine cytology reporting.

METHODS

In this study, the authors report on the development and large-scale validation of a deep-learning tool, AutoParis-X, which can facilitate rapid, semiautonomous examination of urine cytology specimens.

RESULTS

The results of this large-scale, retrospective validation study indicate that AutoParis-X can accurately determine urothelial cell atypia and aggregate a wide variety of cell-related and cluster-related information across a slide to yield an atypia burden score, which correlates closely with overall specimen atypia and is predictive of Paris system diagnostic categories. Importantly, this approach accounts for challenges associated with the assessment of overlapping cell cluster borders, which improve the ability to predict specimen atypia and accurately estimate the nuclear-to-cytoplasm ratio for cells in these clusters.

CONCLUSIONS

The authors developed a publicly available, open-source, interactive web application that features a simple, easy-to-use display for examining urine cytology whole-slide images and determining the level of atypia in specific cells, flagging the most abnormal cells for pathologist review. The accuracy of AutoParis-X (and other semiautomated digital pathology systems) indicates that these technologies are approaching clinical readiness and necessitates full evaluation of these algorithms in head-to-head clinical trials.

Examining longitudinal markers of bladder cancer recurrence through a semiautonomous machine learning system for quantifying specimen atypia from urine cytology

BACKGROUND

Urine cytology is generally considered the primary approach for screening for recurrence of bladder cancer. However, it is currently unclear how best to use cytological examinations for assessment and early detection of recurrence, beyond identifying a positive finding that requires more invasive methods to confirm recurrence and decide on therapeutic options. Because screening programs are frequent, and can be burdensome, finding quantitative means to reduce this burden for patients, cytopathologists, and urologists is an important endeavor and can improve both the efficiency and reliability of findings. Additionally, identifying ways to risk-stratify patients is crucial for improving quality of life while reducing the risk of future recurrence or progression of the cancer.

METHODS

In this study, a computational machine learning tool, AutoParis-X, was leveraged to extract imaging features from urine cytology examinations longitudinally to study the predictive potential of urine cytology for assessing recurrence risk. This study examined how the significance of imaging predictors changes over time before and after surgery to determine which predictors and time periods are most relevant for assessing recurrence risk.

RESULTS

Results indicate that imaging predictors extracted using AutoParis-X can predict recurrence as well or better than traditional cytological/histological assessments alone and that the predictiveness of these features is variable across time, with key differences in overall specimen atypia identified immediately before tumor recurrence.

CONCLUSIONS

Further research will clarify how computational methods can be effectively used in high-volume screening programs to improve recurrence detection and complement traditional modes of assessment.

Current status of machine learning in thyroid cytopathology

The implementation of Digital Pathology has allowed the development of computational Pathology. Digital image-based applications that have received FDA Breakthrough Device Designation have been primarily focused on tissue specimens. The development of Artificial Intelligence-assisted algorithms using Cytology digital images has been much more limited due to technical challenges and a lack of optimized scanners for Cytology specimens. Despite the challenges in scanning whole slide images of cytology specimens, there have been many studies evaluating CP to create decision-support tools in Cytopathology. Among different Cytology specimens, thyroid fine needle aspiration biopsy (FNAB) specimens have one of the greatest potentials to benefit from machine learning algorithms (MLA) derived from digital images. Several authors have evaluated different machine learning algorithms focused on thyroid cytology in the past few years. The results are promising. The algorithms have mostly shown increased accuracy in the diagnosis and classification of thyroid cytology specimens. They have brought new insights and demonstrated the potential for improving future cytopathology workflow efficiency and accuracy. However, many issues still need to be addressed to further build on and improve current MLA models and their applications. To optimally train and validate MLA for thyroid cytology specimens, larger datasets obtained from multiple institutions are needed. MLAs hold great potential in improving thyroid cancer diagnostic speed and accuracy that will lead to improvements in patient management.

Nuclear membrane irregularity in high-grade urothelial carcinoma cells can be measured by using circularity and solidity as morphometric shape definitions in digital image analysis of urinary tract cytology specimens

BACKGROUND

The Paris System for Reporting Urine Cytology defines objective (elevated nuclear/cytoplasmic ratio ≥0.7) and subjective (nuclear membrane irregularity, hyperchromicity, and coarse chromatin) cytomorphologic criteria to identify conventional high-grade urothelial carcinoma (HGUC) cells. Digital image analysis allows quantitative and objective measurement of these subjective criteria. In this study, digital image analysis was used to quantitate nuclear membrane irregularity in HGUC cells.

METHODS

Whole-slide images of HGUC urine specimens were acquired, and HGUC nuclei were manually annotated using the open-source bioimage analysis software QuPath. Custom scripts were used to calculate nuclear morphometrics and perform downstream analysis.

RESULTS

In total, 1395 HGUC cell nuclei were annotated across 24 HGUC specimens (48.1 ± 6.0 nuclei per case) using both pixel-level and smooth annotation approaches. Nuclear membrane irregularity was estimated by calculating nuclear circularity and solidity. Annotating at pixel-level resolution artifactually increases nuclear membrane perimeter, thus smoothing is necessary to better approximate a pathologist's assessment of nuclear membrane irregularity. After smoothing, nuclear circularity and solidity discriminate between HGUC cell nuclei with visually apparent differences in nuclear membrane irregularity.

CONCLUSIONS

Nuclear membrane irregularity defined by The Paris System for Reporting Urine Cytology is inherently subjective. This study identifies nuclear morphometrics that visually correlate with nuclear membrane irregularity. HGUC specimens show intercase variation in nuclear morphometrics, with some nuclei appearing remarkably regular while others show marked irregularity. A small population of irregular nuclei generates most of the intracase variation in nuclear morphometrics. These results highlight nuclear membrane irregularity as an important, but not definitive, cytomorphologic criterion in HGUC diagnosis.

Assessing the quality of cytopathology whole slide imaging for education from archived cases

INTRODUCTION

Many institutions have cytopathology case archives for education. Unfortunately, these slides deteriorate over time and have limited accessibility. Whole slide imaging (WSI) can overcome these limitations. However, suboptimal image quality and scanning effort are barriers.

MATERIALS AND METHODS

We selected 123 slides from cytopathology study sets for WSI scanning at 400x magnification without z-stacking. The Ventana DP 200 scanner and Virtuoso software were used. Slides were scanned in 2 rounds: the first round of slides was prepared for scanning with light cleaning, and the second round was performed only on slides that had unacceptable WSI quality after thorough cleaning. Slides were assessed with a 4-tier grading system created by the authors. Time to scan each slide was recorded.

RESULTS

Within the first round, 96 of 123 (78%) slides scanned were determined to be of acceptable quality. After the second round of scanning, in total, 118 of 123 (95.9%) slides were determined to be of acceptable quality. The average time needed to scan each slide was 213 seconds.

CONCLUSIONS

The majority of slides scanned were of acceptable quality in the first round of scanning. After cleaning and rescanning, nearly every slide investigated was of acceptable quality. The primary objective is to provide other institutions that may be considering a similar project a benchmark so that they know what to expect in terms of slide scan success rate and the amount of time needed to digitize slides for educational archiving. This pilot study demonstrates the feasibility of using WSI for cytology education cases.