A deep learning system to diagnose the malignant potential of urothelial carcinoma cells in cytology specimens

Comparative evaluation of slide scanners, scan settings, and cytopreparations for digital urine cytology

Background

Acquiring well-focused digital images of cytology slides with scanners can be challenging due to the 3-dimensional nature of the slides. This study evaluates performances of whole-slide images (WSIs) obtained from 2 different cytopreparations by 2 distinct scanners with 3 focus modes.

Methods

Fourteen urine specimens were collected from patients with urothelial carcinoma. Each specimen was equally divided into 2 portions, prepared with Cytospin and ThinPrep methods and scanned for WSIs using Leica (Aperio AT2) and Hamamatsu (NanoZoomer S360) scanners, respectively. The scan settings included 3 focus modes (default, semi-auto, and manual) for single-layer scanning, along with a manual focus mode for 21 Z-layers scanning. Performance metrics were evaluated including scanning success rate, artificial intelligence (AI) algorithm-inferred atypical cell numbers and coverage rate (atypical cell numbers in single or multiple Z-layers divided by the total atypical cell numbers in 21 Z-layers), scanning time, and image file size.

Results

The default mode had scanning success rates of 85.7% or 92.9%, depending on the scanner used. The semi-auto mode increased success to 92.9% or 100%, and manual even further to 100%. However, these changes did not affect the standardized median atypical cell numbers and coverage rates. The selection of scanners, cytopreparations, and Z-stacking influenced standardized median atypical cell numbers and coverage rates, scanning times, and image file sizes.

Discussion

Both scanners showed satisfactory scanning. We recommend using semi-auto or manual focus modes to achieve a scanning success rate of up to 100%. Additionally, a minimum of 9-layer Z-stacking at 1 μm intervals is required to cover 80% of atypical cells. These advanced focus methods do not impact the number of atypical cells or their coverage rate. While Z-stacking enhances the AI algorithm's inferred quantity and coverage rates of atypical cells, it simultaneously results in longer scanning times and larger image file sizes.

Computer-assisted urine cytology: Faster, cheaper, better?

Recent advancements in computer-assisted diagnosis (CAD) have catalysed significant progress in pathology, particularly in the realm of urine cytopathology. This review synthesizes the latest developments and challenges in CAD for diagnosing urothelial carcinomas, addressing the limitations of traditional urinary cytology. Through a literature review, we identify and analyse CAD models and algorithms developed for urine cytopathology, highlighting their methodologies and performance metrics. We discuss the potential of CAD to improve diagnostic accuracy, efficiency and patient outcomes, emphasizing its role in streamlining workflow and reducing errors. Furthermore, CAD tools have shown potential in exploring pathological conditions, uncovering novel biomarkers and prognostic/predictive features previously unknown or unseen. Finally, we examine the practical issues surrounding the integration of CAD into clinical practice, including regulatory approval, validation and training for pathologists. Despite the promising results, challenges remain, necessitating further research and validation efforts. Overall, CAD presents a transformative opportunity to revolutionize diagnostic practices in urine cytopathology, paving the way for enhanced patient care and outcomes.

Artificial Intelligence Applications in Cytopathology: Current State of the Art

The practice of cytopathology has been significantly refined in recent years, largely through the creation of consensus rule sets for the diagnosis of particular specimens (Bethesda, Milan, Paris, and so forth). In general, these diagnostic systems have focused on reducing intraobserver variance, removing nebulous/redundant categories, reducing the use of "atypical" diagnoses, and promoting the use of quantitative scoring systems while providing a uniform language to communicate these results. Computational pathology is a natural offshoot of this process in that it promises 100% reproducible diagnoses rendered by quantitative processes that are free from many of the biases of human practitioners.

Deep learning predicts the 1-year prognosis of pancreatic cancer patients using positive peritoneal washing cytology

Peritoneal washing cytology (CY) in patients with pancreatic cancer is mainly used for staging; however, it may also be used to evaluate the intraperitoneal status to predict a more accurate prognosis. Here, we investigated the potential of deep learning of CY specimen images for predicting the 1-year prognosis of pancreatic cancer in CY-positive patients. CY specimens from 88 patients with prognostic information were retrospectively analyzed. CY specimens scanned by the whole slide imaging device were segmented and subjected to deep learning with a Vision Transformer (ViT) and a Convolutional Neural Network (CNN). The results indicated that ViT and CNN predicted the 1-year prognosis from scanned images with accuracies of 0.8056 and 0.8009 in the area under the curve of the receiver operating characteristic curves, respectively. Patients predicted to survive 1 year or more by ViT showed significantly longer survivals by Kaplan-Meier analyses. The cell nuclei found to have a negative prognostic impact by ViT appeared to be neutrophils. Our results indicate that AI-mediated analysis of CY specimens can successfully predict the 1-year prognosis of patients with pancreatic cancer positive for CY. Intraperitoneal neutrophils may be a novel prognostic marker and therapeutic target for CY-positive patients with pancreatic cancer.

Development and validation of an artificial intelligence-based model for detecting urothelial carcinoma using urine cytology images: a multicentre, diagnostic study with prospective validation

Background

Urine cytology is an important non-invasive examination for urothelial carcinoma (UC) diagnosis and follow-up. We aimed to explore whether artificial intelligence (AI) can enhance the sensitivity of urine cytology and help avoid unnecessary endoscopy.

Methods

In this multicentre diagnostic study, consecutive patients who underwent liquid-based urine cytology examinations at four hospitals in China were included for model development and validation. Patients who declined surgery and lacked associated histopathology results, those diagnosed with rare subtype tumours of the urinary tract, or had low-quality images were excluded from the study. All liquid-based cytology slides were scanned into whole-slide images (WSIs) at 40 × magnification and the WSI-labels were derived from the corresponding histopathology results. The Precision Urine Cytology AI Solution (PUCAS) was composed of three distinct stages (patch extraction, features extraction, and classification diagnosis) and was trained to identify important WSI features associated with UC diagnosis. The diagnostic sensitivity was mainly used to validate the performance of PUCAS in retrospective and prospective validation cohorts. This study is registered with the ChiCTR, ChiCTR2300073192.

Findings

Between January 1, 2018 and October 31, 2022, 2641 patients were retrospectively recruited in the training cohort, and 2335 in retrospective validation cohorts; 400 eligible patients were enrolled in the prospective validation cohort between July 7, 2023 and September 15, 2023. The sensitivity of PUCAS ranged from 0.922 (95% CI: 0.811-0.978) to 1.000 (0.782-1.000) in retrospective validation cohorts, and was 0.896 (0.837-0.939) in prospective validation cohort. The PUCAS model also exhibited a good performance in detecting malignancy within atypical urothelial cells cases, with a sensitivity of over 0.84. In the recurrence detection scenario, PUCAS could reduce 57.5% of endoscopy use with a negative predictive value of 96.4%.

Interpretation

PUCAS may help to improve the sensitivity of urine cytology, reduce misdiagnoses of UC, avoid unnecessary endoscopy, and reduce the clinical burden in resource-limited areas. The further validation in other countries is needed.

Funding

National Natural Science Foundation of China; Key Program of the National Natural Science Foundation of China; the National Science Foundation for Distinguished Young Scholars; the Science and Technology Planning Project of Guangdong Province; the National Key Research and Development Programme of China; Guangdong Provincial Clinical Research Centre for Urological Diseases.

Bioinformatics in urology - molecular characterization of pathophysiology and response to treatment

The application of bioinformatics has revolutionized the practice of medicine in the past 20 years. From early studies that uncovered subtypes of cancer to broad efforts spearheaded by the Cancer Genome Atlas initiative, the use of bioinformatics strategies to analyse high-dimensional data has provided unprecedented insights into the molecular basis of disease. In addition to the identification of disease subtypes - which enables risk stratification - informatics analysis has facilitated the identification of novel risk factors and drivers of disease, biomarkers of progression and treatment response, as well as possibilities for drug repurposing or repositioning; moreover, bioinformatics has guided research towards precision and personalized medicine. Implementation of specific computational approaches such as artificial intelligence, machine learning and molecular subtyping has yet to become widespread in urology clinical practice for reasons of cost, disruption of clinical workflow and need for prospective validation of informatics approaches in independent patient cohorts. Solving these challenges might accelerate routine integration of bioinformatics into clinical settings.

A Fully Automated Artificial Intelligence System to Assist Pathologists' Diagnosis to Predict Histologically High-grade Urothelial Carcinoma from Digitized Urine Cytology Slides Using Deep Learning

BACKGROUND

Urine cytology, although a useful screening method for urothelial carcinoma, lacks sensitivity. As an emerging technology, artificial intelligence (AI) improved image analysis accuracy significantly.

OBJECTIVE

To develop a fully automated AI system to assist pathologists in the histological prediction of high-grade urothelial carcinoma (HGUC) from digitized urine cytology slides.

DESIGN, SETTING, AND PARTICIPANTS

We digitized 535 consecutive urine cytology slides for AI use. Among these slides, 181 were used for AI development, 39 were used as AI test data to identify HGUC by cell-level classification, and 315 were used as AI test data for slide-level classification.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

Out of the 315 slides, 171 were collected immediately prior to bladder biopsy or transurethral resection of bladder tumor, and then outcomes were compared with the histological presence of HGUC in the surgical specimen. The primary aim was to compare AI prediction of the histological presence of HGUC with the pathologist's histological diagnosis of HGUC. Secondary aims were to compare the time required for AI evaluation and concordance between the AI's classification and pathologist's cytology diagnosis.

RESULTS AND LIMITATIONS

The AI capability for predicting the histological presence of HGUC was 0.78 for the area under the curve. Comparing the AI predictive performance with pathologists' diagnosis, the AI sensitivity of 63% for histological HGUC prediction was superior to a pathologists' cytology sensitivity of 46% (p = 0.0037). On the contrary, there was no significant difference between the AI specificity of 83% and pathologists' specificity of 89% (p = 0.13), and AI accuracy of 74% and pathologists' accuracy of 68% (p = 0.08). The time required for AI evaluation was 139 s. With respect to the concordance between the AI prediction and pathologist's cytology diagnosis, the accuracy was 86%. Agreements with positive and negative findings were 92% and 84%, respectively.

CONCLUSIONS

We developed a fully automated AI system to assist pathologists' histological diagnosis of HGUC using digitized slides. This AI system showed significantly higher sensitivity than a board-certified cytopathologist and may assist pathologists in making urine cytology diagnoses, reducing their workload.

PATIENT SUMMARY

In this study, we present a deep learning-based artificial intelligence (AI) system that classifies urine cytology slides according to the Paris system. An automated AI system was developed and validated with 535 consecutive urine cytology slides. The AI predicted histological high-grade urothelial carcinoma from digitized urine cytology slides with superior sensitivity than pathologists, while maintaining comparable specificity and accuracy.

Digital cytology part 2: artificial intelligence in cytology: a concept paper with review and recommendations from the American Society of Cytopathology Digital Cytology Task Force

Digital cytology and artificial intelligence (AI) are gaining greater adoption in the cytology laboratory. However, peer-reviewed real-world data and literature are lacking in regard to the current clinical landscape. The American Society of Cytopathology in conjunction with the International Academy of Cytology and the Digital Pathology Association established a special task force comprising 20 members with expertise and/or interest in digital cytology. The aim of the group was to investigate the feasibility of incorporating digital cytology, specifically cytology whole slide scanning and AI applications, into the workflow of the laboratory. In turn, the impact on cytopathologists, cytologists (cytotechnologists), and cytology departments were also assessed. The task force reviewed existing literature on digital cytology, conducted a worldwide survey, and held a virtual roundtable discussion on digital cytology and AI with multiple industry corporate representatives. This white paper, presented in 2 parts, summarizes the current state of digital cytology and AI practice in global cytology practice. Part 1 of the white paper is presented as a separate paper which details a review and best practice recommendations for incorporating digital cytology into practice. Part 2 of the white paper presented here provides a comprehensive review of AI in cytology practice along with best practice recommendations and legal considerations. Additionally, the cytology global survey results highlighting current AI practices by various laboratories, as well as current attitudes, are reported.

The pathobiology of follicular lymphoma

Follicular lymphoma is one of the most frequent lymphomas. Histologically, it is characterized by a follicular (nodular) growth pattern of centrocytes and centroblasts; mixed with variable immune microenvironment cells. Clinically, it is characterized by diffuse lymphadenopathy, bone marrow involvement, and splenomegaly. It is biologically and clinically heterogeneous. In most patients it is indolent, but others have a more aggressive evolution with relapses; and transformation to diffuse large B-cell lymphoma. Tumorigenesis includes an asymptomatic preclinical phase in which premalignant B-lymphocytes with the t(14;18) chromosomal translocation acquire additional genetic alterations in the germinal centers, and clonal evolution occurs, although not all the cells progress to the tumor stage. This manuscript reviews the pathobiology and clinicopathological characteristics of follicular lymphoma. It includes a description of the physiology of the germinal center, the genetic alterations of BCL2 and BCL6, the mutational profile, the immune checkpoint, precision medicine, and highlights in the lymphoma classification. In addition, a comment and review on artificial intelligence and machine (deep) learning are made.

Examining longitudinal markers of bladder cancer recurrence through a semiautonomous machine learning system for quantifying specimen atypia from urine cytology

BACKGROUND

Urine cytology is generally considered the primary approach for screening for recurrence of bladder cancer. However, it is currently unclear how best to use cytological examinations for assessment and early detection of recurrence, beyond identifying a positive finding that requires more invasive methods to confirm recurrence and decide on therapeutic options. Because screening programs are frequent, and can be burdensome, finding quantitative means to reduce this burden for patients, cytopathologists, and urologists is an important endeavor and can improve both the efficiency and reliability of findings. Additionally, identifying ways to risk-stratify patients is crucial for improving quality of life while reducing the risk of future recurrence or progression of the cancer.

METHODS

In this study, a computational machine learning tool, AutoParis-X, was leveraged to extract imaging features from urine cytology examinations longitudinally to study the predictive potential of urine cytology for assessing recurrence risk. This study examined how the significance of imaging predictors changes over time before and after surgery to determine which predictors and time periods are most relevant for assessing recurrence risk.

RESULTS

Results indicate that imaging predictors extracted using AutoParis-X can predict recurrence as well or better than traditional cytological/histological assessments alone and that the predictiveness of these features is variable across time, with key differences in overall specimen atypia identified immediately before tumor recurrence.

CONCLUSIONS

Further research will clarify how computational methods can be effectively used in high-volume screening programs to improve recurrence detection and complement traditional modes of assessment.

Artificial Intelligence in Urooncology: What We Have and What We Expect

INTRODUCTION

Artificial intelligence is transforming healthcare by driving innovation, automation, and optimization across various fields of medicine. The aim of this study was to determine whether artificial intelligence (AI) techniques can be used in the diagnosis, treatment planning, and monitoring of urological cancers.

METHODOLOGY

We conducted a thorough search for original and review articles published until 31 May 2022 in the PUBMED/Scopus database. Our search included several terms related to AI and urooncology. Articles were selected with the consensus of all authors.

RESULTS

Several types of AI can be used in the medical field. The most common forms of AI are machine learning (ML), deep learning (DL), neural networks (NNs), natural language processing (NLP) systems, and computer vision. AI can improve various domains related to the management of urologic cancers, such as imaging, grading, and nodal staging. AI can also help identify appropriate diagnoses, treatment options, and even biomarkers. In the majority of these instances, AI is as accurate as or sometimes even superior to medical doctors.

CONCLUSIONS

AI techniques have the potential to revolutionize the diagnosis, treatment, and monitoring of urologic cancers. The use of AI in urooncology care is expected to increase in the future, leading to improved patient outcomes and better overall management of these tumors.

Artificial Intelligence in the Advanced Diagnosis of Bladder Cancer-Comprehensive Literature Review and Future Advancement

Artificial intelligence is highly regarded as the most promising future technology that will have a great impact on healthcare across all specialties. Its subsets, machine learning, deep learning, and artificial neural networks, are able to automatically learn from massive amounts of data and can improve the prediction algorithms to enhance their performance. This area is still under development, but the latest evidence shows great potential in the diagnosis, prognosis, and treatment of urological diseases, including bladder cancer, which are currently using old prediction tools and historical nomograms. This review focuses on highly significant and comprehensive literature evidence of artificial intelligence in the management of bladder cancer and investigates the near introduction in clinical practice.

Relationship between a deep learning model and liquid-based cytological processing techniques

OBJECTIVE

Artificial intelligence (AI)-based cytopathology studies conducted using deep learning have enabled cell detection and classification. Liquid-based cytology (LBC) has facilitated the standardisation of specimen preparation; however, cytomorphology varies according to the LBC processing technique used. In this study, we elucidated the relationship between two LBC techniques and cell detection and classification using a deep learning model.

METHODS

Cytological specimens were prepared using the ThinPrep and SurePath methods. The accuracy of cell detection and cell classification was examined using the one- and five-cell models, which were trained with one and five cell types, respectively.

RESULTS

When the same LBC processing techniques were used for the training and detection preparations, the cell detection and classification rates were high. The model trained on ThinPrep preparations was more accurate than that trained on SurePath. When the preparation types used for training and detection were different, the accuracy of cell detection and classification was significantly reduced (P < 0.01). The model trained on both ThinPrep and SurePath preparations exhibited slightly reduced cell detection and classification rates but was highly accurate.

CONCLUSIONS

For the two LBC processing techniques, cytomorphology varied according to cell type; this difference affects the accuracy of cell detection and classification by deep learning. Therefore, for highly accurate cell detection and classification using AI, the same processing technique must be used for both training and detection. Our assessment also suggests that a deep learning model should be constructed using specimens prepared via a variety of processing techniques to construct a globally applicable AI model.

Predicting Lymph Node Metastasis Status from Primary Muscle-Invasive Bladder Cancer Histology Slides Using Deep Learning: A Retrospective Multicenter Study

BACKGROUND

Accurate prediction of lymph node metastasis (LNM) status in patients with muscle-invasive bladder cancer (MIBC) before radical cystectomy can guide the use of neoadjuvant chemotherapy and the extent of pelvic lymph node dissection. We aimed to develop and validate a weakly-supervised deep learning model to predict LNM status from digitized histopathological slides in MIBC.

METHODS

We trained a multiple instance learning model with an attention mechanism (namely SBLNP) from a cohort of 323 patients in the TCGA cohort. In parallel, we collected corresponding clinical information to construct a logistic regression model. Subsequently, the score predicted by the SBLNP was incorporated into the logistic regression model. In total, 417 WSIs from 139 patients in the RHWU cohort and 230 WSIs from 78 patients in the PHHC cohort were used as independent external validation sets.

RESULTS

In the TCGA cohort, the SBLNP achieved an AUROC of 0.811 (95% confidence interval [CI], 0.771-0.855), the clinical classifier achieved an AUROC of 0.697 (95% CI, 0.661-0.728) and the combined classifier yielded an improvement to 0.864 (95% CI, 0.827-0.906). Encouragingly, the SBLNP still maintained high performance in the RHWU cohort and PHHC cohort, with an AUROC of 0.762 (95% CI, 0.725-0.801) and 0.746 (95% CI, 0.687-0.799), respectively. Moreover, the interpretability of SBLNP identified stroma with lymphocytic inflammation as a key feature of predicting LNM presence.

CONCLUSIONS

Our proposed weakly-supervised deep learning model can predict the LNM status of MIBC patients from routine WSIs, demonstrating decent generalization performance and holding promise for clinical implementation.

Deep learning for computational cytology: A survey

Computational cytology is a critical, rapid-developing, yet challenging topic in medical image computing concerned with analyzing digitized cytology images by computer-aided technologies for cancer screening. Recently, an increasing number of deep learning (DL) approaches have made significant achievements in medical image analysis, leading to boosting publications of cytological studies. In this article, we survey more than 120 publications of DL-based cytology image analysis to investigate the advanced methods and comprehensive applications. We first introduce various deep learning schemes, including fully supervised, weakly supervised, unsupervised, and transfer learning. Then, we systematically summarize public datasets, evaluation metrics, versatile cytology image analysis applications including cell classification, slide-level cancer screening, nuclei or cell detection and segmentation. Finally, we discuss current challenges and potential research directions of computational cytology.

Uncovering additional predictors of urothelial carcinoma from voided urothelial cell clusters through a deep learning-based image preprocessing technique

BACKGROUND

Urine cytology is commonly used as a screening test for high-grade urothelial carcinoma for patients with risk factors or hematuria and is an essential step in longitudinal monitoring of patients with previous bladder cancer history. However, the semisubjective nature of current reporting systems for urine cytology (e.g., The Paris System) can hamper reproducibility. For instance, the incorporation of urothelial cell clusters into the classification schema is still an item of debate and perplexity among expert cytopathologists because several previous works have disputed their diagnostic relevance.

METHODS

In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation).

RESULTS

In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation). Results indicate that cell cluster atypia (i.e., defined by whether the cell cluster harbored multiple atypical cells, thresholded by a minimum number of cells), cell border overlap and smoothness, and total number of clusters are important markers of specimen atypia when considering assessment of urothelial cell clusters.

CONCLUSIONS

Markers established through techniques to separate cell clusters may have wider applicability for the design and implementation of machine learning approaches for urine cytology assessment.

Recent Application of Artificial Intelligence in Non-Gynecological Cancer Cytopathology: A Systematic Review

Simple Summary

Artificial intelligence (AI) has attracted significant interest in the healthcare sector due to its promising results. Cytological examination is a critical step in the initial diagnosis of cancer. Here, we conducted a systematic review with quantitative analysis to understand the current status of AI applications in non-gynecological (non-GYN) cancer cytology. In our analysis, we found that most of the studies focused on classification and segmentation tasks. Overall, AI showed promising results for non-GYN cancer cytopathology analysis. However, the lack of well-annotated, large-scale datasets with Z-stacking and external cross-validation was the major limitation across all studies.

Abstract

State-of-the-art artificial intelligence (AI) has recently gained considerable interest in the healthcare sector and has provided solutions to problems through automated diagnosis. Cytological examination is a crucial step in the initial diagnosis of cancer, although it shows limited diagnostic efficacy. Recently, AI applications in the processing of cytopathological images have shown promising results despite the elementary level of the technology. Here, we performed a systematic review with a quantitative analysis of recent AI applications in non-gynecological (non-GYN) cancer cytology to understand the current technical status. We searched the major online databases, including MEDLINE, Cochrane Library, and EMBASE, for relevant English articles published from January 2010 to January 2021. The searched query terms were: “artificial intelligence”, “image processing”, “deep learning”, “cytopathology”, and “fine-needle aspiration cytology.” Out of 17,000 studies, only 26 studies (26 models) were included in the full-text review, whereas 13 studies were included for quantitative analysis. There were eight classes of AI models treated of according to target organs: thyroid (n = 11, 39%), urinary bladder (n = 6, 21%), lung (n = 4, 14%), breast (n = 2, 7%), pleural effusion (n = 2, 7%), ovary (n = 1, 4%), pancreas (n = 1, 4%), and prostate (n = 1, 4). Most of the studies focused on classification and segmentation tasks. Although most of the studies showed impressive results, the sizes of the training and validation datasets were limited. Overall, AI is also promising for non-GYN cancer cytopathology analysis, such as pathology or gynecological cytology. However, the lack of well-annotated, large-scale datasets with Z-stacking and external cross-validation was the major limitation found across all studies. Future studies with larger datasets with high-quality annotations and external validation are required.

Application of a Deep Learning Neural Network for Voiding Dysfunction Diagnosis Using a Vibration Sensor

In a clinical context, there are increasing numbers of people with voiding dysfunction. To date, the methods of monitoring the voiding status of patients have included voiding diary records at home or urodynamic examinations at hospitals. The former is less objective and often contains missing data, while the latter lacks frequent measurements and is an invasive procedure. In light of these shortcomings, this study developed an innovative and contact-free technique that assists in clinical voiding dysfunction monitoring and diagnosis. Vibration signals during urination were first detected using an accelerometer and then converted into the mel-frequency cepstrum coefficient (MFCC). Lastly, an artificial intelligence model combined with uniform manifold approximation and projection (UMAP) dimensionality reduction was used to analyze and predict six common patterns of uroflowmetry to assist in diagnosing voiding dysfunction. The model was applied to the voiding database, which included data from 76 males aged 30 to 80 who required uroflowmetry for voiding symptoms. The resulting system accuracy (precision, recall, and f1-score) was around 98% for both the weighted average and macro average. This low-cost system is suitable for at-home urinary monitoring and facilitates the long-term uroflow monitoring of patients outside hospital checkups. From a disease treatment and monitoring perspective, this article also reviews other studies and applications of artificial intelligence-based methods for voiding dysfunction monitoring, thus providing helpful diagnostic information for physicians.

Evaluation of an artificial intelligence algorithm for assisting the Paris System in reporting urinary cytology: A pilot study

BACKGROUND

The Paris System for Reporting Urinary Cytology (TPS) has been shown to improve bladder cancer diagnosis. Advances in artificial intelligence (AI) may assist and improve the clinical workflow by applying TPS in routine diagnostic services.

METHODS

A deep-learning-based algorithm was developed to identify urothelial cancer candidate cells using whole-slide images (WSIs). In the testing cohort, 131 urine cytology slides were retrospectively retrieved and analyzed using this AI algorithm. The authors compared the performance of one cytopathologist and two cytotechnologists using AI-assisted digital urine cytology. Then, the AI-assisted WSIs were evaluated in the clinical workflow. The cytopathologist first made a diagnosis by reviewing the AI-inferred WSIs and quantitative data (nuclear-to-cytoplasmic ratio and nuclear size) for each sample. After a washout period, the same cytopathologist made a diagnosis for the same samples using direct microscopy. All diagnosis results were compared with the expert panel consensus.

RESULTS

The AI-assisted diagnosis by the two cytotechnologists and the one cytopathologist demonstrated performance results that were comparable to the expert panel consensus (sensitivity, 79.5% and 82.1% vs. 92.3%, respectively; specificity, 100% and 98.9% vs. 100%, respectively). Furthermore, the performance of the AI-assisted WSIs compared with the microscopic diagnosis by the cytopathologist demonstrated superior sensitivity (92.3% vs. 87.2%) and negative predictive value (96.8% vs. 94.8%). In addition, the AI-assisted reporting demonstrated near perfect agreement with the expert panel consensus (κ = 0.944) and the microscopic diagnosis (κ = 0.862).

CONCLUSIONS

The AI algorithm developed by the authors effectively assisted TPS-based reporting by providing AI-inferred WSIs and quantitative data.

Machine learning-based gene alteration prediction model for primary lung cancer using cytologic images

BACKGROUND

Understanding the gene alteration status of primary lung cancers is important for determining treatment strategies, but gene testing is both time-consuming and costly, limiting its application in clinical practice. Here, potential therapeutic targets were selected by predicting gene alterations in cytologic specimens before conventional gene testing.

METHODS

This was a retrospective study to develop a cytologic image-based gene alteration prediction model for primary lung cancer. Photomicroscopic images of cytology samples were collected and image patches were generated for analyses. Cancer-positive (n = 106) and cancer-negative (n = 32) samples were used to develop a neural network model for selecting cancer-positive images. Cancer-positive cases were randomly assigned to training (n = 77) and validation (n = 26) data sets. Another neural network model was developed to classify cancer images of the training data set into 4 groups: anaplastic lymphoma kinase (ALK)-fusion, epidermal growth factor receptor (EGFR), or Kirsten rat sarcoma viral oncogene homologue (KRAS) mutated groups, and other (None group), and images of the validation data set were classified. A decision algorithm to predict gene alteration for cases with 3 probability ranks was developed.

RESULTS

The accuracy and precision for selecting cancer-positive patches were 0.945 and 0.991, respectively. Predictive accuracy for the EGFR and KRAS groups in the validation data set was ~0.95, whereas that for the ALK and None groups was ~0.75 and ~ 0.80, respectively. Gene status was correctly predicted in the probability rank A cases. The model extracted characteristic conventional cytologic findings in images and a novel specific feature was discovered for the EGFR group.

CONCLUSIONS

A gene alteration prediction model for lung cancers by machine learning based on cytologic images was successfully developed.

A Deep Learning System to Predict the Histopathological Results From Urine Cytopathological Images

Background

Although deep learning systems (DLSs) have been developed to diagnose urine cytology, more evidence is required to prove if such systems can predict histopathology results as well.

Methods

We retrospectively retrieved urine cytology slides and matched histological results. High-power field panel images were annotated by a certified urological pathologist. A deep learning system was designed with a ResNet101 Faster R-CNN (faster region-based convolutional neural network). It was firstly built to spot cancer cells. Then, it was directly used to predict the likelihood of the presence of tissue malignancy.

Results

We retrieved 441 positive cases and 395 negative cases. The development involved 387 positive cases, accounting for 2,668 labeled cells, to train the DLS to spot cancer cells. The DLS was then used to predict corresponding histopathology results. In an internal test set of 85 cases, the area under the curve (AUC) was 0.90 (95%CI 0.84-0.96), and the kappa score was 0.68 (95%CI 0.52-0.84), indicating substantial agreement. The F1 score was 0.56, sensitivity was 71% (95%CI 52%-85%), and specificity was 94% (95%CI 84%-98%). In an extra test set of 333 cases, the DLS achieved 0.25 false-positive cells per image. The AUC was 0.93 (95%CI 0.90-0.95), and the kappa score was 0.58 (95%CI 0.46-0.70) indicating moderate agreement. The F1 score was 0.66, sensitivity was 67% (95%CI 54%-78%), and specificity was 92% (95%CI 88%-95%).

Conclusions

The deep learning system could predict if there was malignancy using cytocentrifuged urine cytology images. The process was explainable since the prediction of malignancy was directly based on the abnormal cells selected by the model and can be verified by examining those candidate abnormal cells in each image. Thus, this DLS was not just a tool for pathologists in cytology diagnosis. It simultaneously provided novel histopathologic insights for urologists.

Non-Invasive Biomarkers in the Diagnosis of Upper Urinary Tract Urothelial Carcinoma-A Systematic Review

Beyond laboratory, imaging and endoscopic procedures, new diagnostic tools are increasingly being sought for the diagnosis of upper urinary tract urothelial carcinoma (UTUC), especially those that are non-invasive. In this systematic review, we aimed to determine the effectiveness of non-invasive tests in the diagnosis of UTUC. PubMed and Embase electronic databases were searched to identify studies assessing effectiveness of non-invasive tests in the primary diagnosis of UTUC. The study protocol was registered with PROSPERO (CRD42020216480). Among 10,084 screened publications, 25 were eligible and included in the analysis. Most of them were conducted on small samples of patients and the control groups were heterogenous. The test used in the largest number of studies was voided urinary cytology, which has poor sensitivity (11-71.1%) with favorable specificity (54-100%). Fluorescence in situ hybridization in diagnostic cytology showed higher sensitivity (35-85.7%) with equally good specificity (80-100%). There were also studies on the use of tests known to diagnose bladder cancer such as NMP22, uCYT or BTA test. Other urine or blood tests have been the subject of only isolated studies, with varying results. To conclude, currently there is a lack of high-quality data that could confirm good effectiveness of non-invasive tests used in the diagnosis of UTUC.