Performance of an artificial intelligence algorithm for reporting urine cytopathology

Comparative evaluation of slide scanners, scan settings, and cytopreparations for digital urine cytology

Background

Acquiring well-focused digital images of cytology slides with scanners can be challenging due to the 3-dimensional nature of the slides. This study evaluates performances of whole-slide images (WSIs) obtained from 2 different cytopreparations by 2 distinct scanners with 3 focus modes.

Methods

Fourteen urine specimens were collected from patients with urothelial carcinoma. Each specimen was equally divided into 2 portions, prepared with Cytospin and ThinPrep methods and scanned for WSIs using Leica (Aperio AT2) and Hamamatsu (NanoZoomer S360) scanners, respectively. The scan settings included 3 focus modes (default, semi-auto, and manual) for single-layer scanning, along with a manual focus mode for 21 Z-layers scanning. Performance metrics were evaluated including scanning success rate, artificial intelligence (AI) algorithm-inferred atypical cell numbers and coverage rate (atypical cell numbers in single or multiple Z-layers divided by the total atypical cell numbers in 21 Z-layers), scanning time, and image file size.

Results

The default mode had scanning success rates of 85.7% or 92.9%, depending on the scanner used. The semi-auto mode increased success to 92.9% or 100%, and manual even further to 100%. However, these changes did not affect the standardized median atypical cell numbers and coverage rates. The selection of scanners, cytopreparations, and Z-stacking influenced standardized median atypical cell numbers and coverage rates, scanning times, and image file sizes.

Discussion

Both scanners showed satisfactory scanning. We recommend using semi-auto or manual focus modes to achieve a scanning success rate of up to 100%. Additionally, a minimum of 9-layer Z-stacking at 1 μm intervals is required to cover 80% of atypical cells. These advanced focus methods do not impact the number of atypical cells or their coverage rate. While Z-stacking enhances the AI algorithm's inferred quantity and coverage rates of atypical cells, it simultaneously results in longer scanning times and larger image file sizes.

Computer-assisted urine cytology: Faster, cheaper, better?

Recent advancements in computer-assisted diagnosis (CAD) have catalysed significant progress in pathology, particularly in the realm of urine cytopathology. This review synthesizes the latest developments and challenges in CAD for diagnosing urothelial carcinomas, addressing the limitations of traditional urinary cytology. Through a literature review, we identify and analyse CAD models and algorithms developed for urine cytopathology, highlighting their methodologies and performance metrics. We discuss the potential of CAD to improve diagnostic accuracy, efficiency and patient outcomes, emphasizing its role in streamlining workflow and reducing errors. Furthermore, CAD tools have shown potential in exploring pathological conditions, uncovering novel biomarkers and prognostic/predictive features previously unknown or unseen. Finally, we examine the practical issues surrounding the integration of CAD into clinical practice, including regulatory approval, validation and training for pathologists. Despite the promising results, challenges remain, necessitating further research and validation efforts. Overall, CAD presents a transformative opportunity to revolutionize diagnostic practices in urine cytopathology, paving the way for enhanced patient care and outcomes.

[What contribution can make artificial intelligence to urinary cytology?]

Urinary cytology using the Paris system is still the method of choice for screening high-grade urothelial carcinomas. However, the use of the objective criteria described in this terminology shows a lack of inter- and intra-observer reproducibility. Moreover, if its sensitivity is excellent on instrumented urine, it remains insufficient on voided urine samples. Urinary cytology appears to be an excellent model for the application of artificial intelligence to improve performance, since the objective criteria of the Paris system are defined at cellular level, and the resulting diagnostic approach is presented in a highly "algorithmic" way. Nevertheless, there is no commercially available morphological diagnostic aid, and very few predictive devices are still undergoing clinical validation. The analysis of different systems using artificial intelligence in urinary cytology rises clear prospects for mutual contributions.

LESS: Label-efficient multi-scale learning for cytological whole slide image screening

In computational pathology, multiple instance learning (MIL) is widely used to circumvent the computational impasse in giga-pixel whole slide image (WSI) analysis. It usually consists of two stages: patch-level feature extraction and slide-level aggregation. Recently, pretrained models or self-supervised learning have been used to extract patch features, but they suffer from low effectiveness or inefficiency due to overlooking the task-specific supervision provided by slide labels. Here we propose a weakly-supervised Label-Efficient WSI Screening method, dubbed LESS, for cytological WSI analysis with only slide-level labels, which can be effectively applied to small datasets. First, we suggest using variational positive-unlabeled (VPU) learning to uncover hidden labels of both benign and malignant patches. We provide appropriate supervision by using slide-level labels to improve the learning of patch-level features. Next, we take into account the sparse and random arrangement of cells in cytological WSIs. To address this, we propose a strategy to crop patches at multiple scales and utilize a cross-attention vision transformer (CrossViT) to combine information from different scales for WSI classification. The combination of our two steps achieves task-alignment, improving effectiveness and efficiency. We validate the proposed label-efficient method on a urine cytology WSI dataset encompassing 130 samples (13,000 patches) and a breast cytology dataset FNAC 2019 with 212 samples (21,200 patches). The experiment shows that the proposed LESS reaches 84.79%, 85.43%, 91.79% and 78.30% on the urine cytology WSI dataset, and 96.88%, 96.86%, 98.95%, 97.06% on the breast cytology high-resolution-image dataset in terms of accuracy, AUC, sensitivity and specificity. It outperforms state-of-the-art MIL methods on pathology WSIs and realizes automatic cytological WSI cancer screening.

A lightweight bladder tumor segmentation method based on attention mechanism

In the endoscopic images of bladder, accurate segmentation of different grade bladder tumor from blurred boundary regions and highly variable shapes is of great significance for doctors' diagnosis and patients' later treatment. We propose a nested attentional feature fusion segmentation network (NAFF-Net) based on the encoder-decoder structure formed by the combination of weighted pyramid pooling module (WPPM) and nested attentional feature fusion (NAFF). Among them, WPPM applies the cascade of atrous convolution to enhance the overall perceptual field while introducing adaptive weights to optimize multi-scale feature extraction, NAFF integrates deep semantic information into shallow feature maps, effectively focusing on edge and detail information in bladder tumor images. Additionally, a weighted mixed loss function is constructed to alleviate the impact of imbalance between positive and negative sample distribution on segmentation accuracy. Experiments illustrate the proposed NAFF-Net achieves better segmentation results compared to other mainstream models, with a MIoU of 84.05%, MPrecision of 91.52%, MRecall of 90.81%, and F1-score of 91.16%, and also achieves good results on the public datasets Kvasir-SEG and CVC-ClinicDB. Compared to other models, NAFF-Net has a smaller number of parameters, which is a significant advantage in model deployment.

The current state of digital cytology and artificial intelligence (AI): global survey results from the American Society of Cytopathology Digital Cytology Task Force

INTRODUCTION

The integration of whole slide imaging (WSI) and artificial intelligence (AI) with digital cytology has been growing gradually. Therefore, there is a need to evaluate the current state of digital cytology. This study aimed to determine the current landscape of digital cytology via a survey conducted as part of the American Society of Cytopathology (ASC) Digital Cytology White Paper Task Force.

MATERIALS AND METHODS

A survey with 43 questions pertaining to the current practices and experiences of WSI and AI in both surgical pathology and cytology was created. The survey was sent to members of the ASC, the International Academy of Cytology (IAC), and the Papanicolaou Society of Cytopathology (PSC). Responses were recorded and analyzed.

RESULTS

In total, 327 individuals participated in the survey, spanning a diverse array of practice settings, roles, and experiences around the globe. The majority of responses indicated there was routine scanning of surgical pathology slides (n = 134; 61%) with fewer respondents scanning cytology slides (n = 150; 46%). The primary challenge for surgical WSI is the need for faster scanning and cost minimization, whereas image quality is the top issue for cytology WSI. AI tools are not widely utilized, with only 16% of participants using AI for surgical pathology samples and 13% for cytology practice.

CONCLUSIONS

Utilization of digital pathology is limited in cytology laboratories as compared to surgical pathology. However, as more laboratories are willing to implement digital cytology in the near future, the establishment of practical clinical guidelines is needed.

Bioinformatics in urology - molecular characterization of pathophysiology and response to treatment

The application of bioinformatics has revolutionized the practice of medicine in the past 20 years. From early studies that uncovered subtypes of cancer to broad efforts spearheaded by the Cancer Genome Atlas initiative, the use of bioinformatics strategies to analyse high-dimensional data has provided unprecedented insights into the molecular basis of disease. In addition to the identification of disease subtypes - which enables risk stratification - informatics analysis has facilitated the identification of novel risk factors and drivers of disease, biomarkers of progression and treatment response, as well as possibilities for drug repurposing or repositioning; moreover, bioinformatics has guided research towards precision and personalized medicine. Implementation of specific computational approaches such as artificial intelligence, machine learning and molecular subtyping has yet to become widespread in urology clinical practice for reasons of cost, disruption of clinical workflow and need for prospective validation of informatics approaches in independent patient cohorts. Solving these challenges might accelerate routine integration of bioinformatics into clinical settings.

A Fully Automated Artificial Intelligence System to Assist Pathologists' Diagnosis to Predict Histologically High-grade Urothelial Carcinoma from Digitized Urine Cytology Slides Using Deep Learning

BACKGROUND

Urine cytology, although a useful screening method for urothelial carcinoma, lacks sensitivity. As an emerging technology, artificial intelligence (AI) improved image analysis accuracy significantly.

OBJECTIVE

To develop a fully automated AI system to assist pathologists in the histological prediction of high-grade urothelial carcinoma (HGUC) from digitized urine cytology slides.

DESIGN, SETTING, AND PARTICIPANTS

We digitized 535 consecutive urine cytology slides for AI use. Among these slides, 181 were used for AI development, 39 were used as AI test data to identify HGUC by cell-level classification, and 315 were used as AI test data for slide-level classification.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

Out of the 315 slides, 171 were collected immediately prior to bladder biopsy or transurethral resection of bladder tumor, and then outcomes were compared with the histological presence of HGUC in the surgical specimen. The primary aim was to compare AI prediction of the histological presence of HGUC with the pathologist's histological diagnosis of HGUC. Secondary aims were to compare the time required for AI evaluation and concordance between the AI's classification and pathologist's cytology diagnosis.

RESULTS AND LIMITATIONS

The AI capability for predicting the histological presence of HGUC was 0.78 for the area under the curve. Comparing the AI predictive performance with pathologists' diagnosis, the AI sensitivity of 63% for histological HGUC prediction was superior to a pathologists' cytology sensitivity of 46% (p = 0.0037). On the contrary, there was no significant difference between the AI specificity of 83% and pathologists' specificity of 89% (p = 0.13), and AI accuracy of 74% and pathologists' accuracy of 68% (p = 0.08). The time required for AI evaluation was 139 s. With respect to the concordance between the AI prediction and pathologist's cytology diagnosis, the accuracy was 86%. Agreements with positive and negative findings were 92% and 84%, respectively.

CONCLUSIONS

We developed a fully automated AI system to assist pathologists' histological diagnosis of HGUC using digitized slides. This AI system showed significantly higher sensitivity than a board-certified cytopathologist and may assist pathologists in making urine cytology diagnoses, reducing their workload.

PATIENT SUMMARY

In this study, we present a deep learning-based artificial intelligence (AI) system that classifies urine cytology slides according to the Paris system. An automated AI system was developed and validated with 535 consecutive urine cytology slides. The AI predicted histological high-grade urothelial carcinoma from digitized urine cytology slides with superior sensitivity than pathologists, while maintaining comparable specificity and accuracy.

Artificial-Intelligence-Assisted Detection of Metastatic Colorectal Cancer Cells in Ascitic Fluid

Ascites cytology is a cost-effective test for metastatic colorectal cancer (CRC) in the abdominal cavity. However, metastatic carcinoma of the peritoneum is difficult to diagnose based on biopsy findings, and ascitic aspiration cytology has a low sensitivity and specificity and a high inter-observer variability. The aim of the present study was to apply artificial intelligence (AI) to classify benign and malignant cells in ascites cytology patch images of metastatic CRC using a deep convolutional neural network. Datasets were collected from The OPEN AI Dataset Project, a nationwide cytology dataset for AI research. The numbers of patch images used for training, validation, and testing were 56,560, 7068, and 6534, respectively. We evaluated 1041 patch images of benign and metastatic CRC in the ascitic fluid to compare the performance of pathologists and an AI algorithm, and to examine whether the diagnostic accuracy of pathologists improved with the assistance of AI. This AI method showed an accuracy, a sensitivity, and a specificity of 93.74%, 87.76%, and 99.75%, respectively, for the differential diagnosis of malignant and benign ascites. The diagnostic accuracy and sensitivity of the pathologist with the assistance of the proposed AI method increased from 86.8% to 90.5% and from 73.3% to 79.3%, respectively. The proposed deep learning method may assist pathologists with different levels of experience in diagnosing metastatic CRC cells of ascites.

Digital cytology part 2: artificial intelligence in cytology: a concept paper with review and recommendations from the American Society of Cytopathology Digital Cytology Task Force

Digital cytology and artificial intelligence (AI) are gaining greater adoption in the cytology laboratory. However, peer-reviewed real-world data and literature are lacking in regard to the current clinical landscape. The American Society of Cytopathology in conjunction with the International Academy of Cytology and the Digital Pathology Association established a special task force comprising 20 members with expertise and/or interest in digital cytology. The aim of the group was to investigate the feasibility of incorporating digital cytology, specifically cytology whole slide scanning and AI applications, into the workflow of the laboratory. In turn, the impact on cytopathologists, cytologists (cytotechnologists), and cytology departments were also assessed. The task force reviewed existing literature on digital cytology, conducted a worldwide survey, and held a virtual roundtable discussion on digital cytology and AI with multiple industry corporate representatives. This white paper, presented in 2 parts, summarizes the current state of digital cytology and AI practice in global cytology practice. Part 1 of the white paper is presented as a separate paper which details a review and best practice recommendations for incorporating digital cytology into practice. Part 2 of the white paper presented here provides a comprehensive review of AI in cytology practice along with best practice recommendations and legal considerations. Additionally, the cytology global survey results highlighting current AI practices by various laboratories, as well as current attitudes, are reported.

Bladder Cancer and Artificial Intelligence: Emerging Applications

Bladder cancer is a common and heterogeneous disease that poses a significant burden to the patient and health care system. Major unmet needs include effective early detection strategy, imprecision of risk stratification, and treatment-associated morbidities. The existing clinical paradigm is imprecise, which results in missed tumors, suboptimal therapy, and disease progression. Artificial intelligence holds immense potential to address many unmet needs in bladder cancer, including early detection, risk stratification, treatment planning, quality assessment, and outcome prediction. Despite recent advances, extensive work remains to affirm the efficacy of artificial intelligence as a decision-making tool for bladder cancer management.

A clinical microscopy dataset to develop a deep learning diagnostic test for urinary tract infection

Urinary tract infection (UTI) is a common disorder. Its diagnosis can be made by microscopic examination of voided urine for markers of infection. This manual technique is technically difficult, time-consuming and prone to inter-observer errors. The application of computer vision to this domain has been slow due to the lack of a clinical image dataset from UTI patients. We present an open dataset containing 300 images and 3,562 manually annotated urinary cells labelled into seven classes of clinically significant cell types. It is an enriched dataset acquired from the unstained and untreated urine of patients with symptomatic UTI using a simple imaging system. We demonstrate that this dataset can be used to train a Patch U-Net, a novel deep learning architecture with a random patch generator to recognise urinary cells. Our hope is, with this dataset, UTI diagnosis will be made possible in nearly all clinical settings by using a simple imaging system which leverages advanced machine learning techniques.

Comparison of glass and digital slides for cervical cytopathology screening and interpretation

Cervical cancer is the second most common form of cancer and a leading cause of premature death among women aged 15 to 44 worldwide. In Brazil, there is a high prevalence of infection by the human papillomavirus - HPV. Digital pathology optimizes time and space for reading cervicovaginal cytology slides. We evaluated the feasibility of using whole slide images (WSI) for the routine interpretation of cytology exams. A total of 99 cases of vaginal cytology were selected from a reference laboratory in Northeastern Brazil. Three cytotechnicians participated in the study. Cellular atypia was the one that most presented concordance values. Two observers almost perfectly agreed (k = 0.86 and k = 0.84, respectively) on the negative diagnoses. The performance of the evaluators for NILM (negative for intraepithelial lesion and malignancy) showed high reproducibility and sensitivity in the digital slides, mainly between evaluators A and C. In contrast, the microbiology group showed disagreement between the diagnoses by digital slides and the standard- gold. The concordance between the digital diagnoses and the gold standard for ASCUS was 89%. In the inflammatory category, Spearman's test showed similar results between raters A, B, and C (rs = 0.47, rs = 0.41, and rs = 0.47, respectively). This study reports the diagnostic validation using digital slides in view of the need to optimize the cytology visualization process. Our experience shows good diagnostic agreement between digital and optical microscopy in several analyzed categories, but mainly in relation to cellular atypia and inflammatory processes.

Use and application of organ-on-a-chip platforms in cancer research

Tumors are a major cause of death worldwide, and much effort has been made to develop appropriate anti-tumor therapies. Existing in vitro and in vivo tumor models cannot reflect the critical features of cancer. The development of organ-on-a-chip models has enabled the integration of organoids, microfluidics, tissue engineering, biomaterials research, and microfabrication, offering conditions that mimic tumor physiology. Three-dimensional in vitro human tumor models that have been established as organ-on-a-chip models contain multiple cell types and a structure that is similar to the primary tumor. These models can be applied to various foci of oncology research. Moreover, the high-throughput features of microfluidic organ-on-a-chip models offer new opportunities for achieving large-scale drug screening and developing more personalized treatments. In this review of the literature, we explore the development of organ-on-a-chip technology and discuss its use as an innovative tool in basic and clinical applications and summarize its advancement of cancer research.

Digital Examination of LYmph node CYtopathology Using the Sydney system (DELYCYUS): An international, multi-institutional study

BACKGROUND

After a series of standardized reporting systems in cytopathology, the Sydney system was recently introduced to address the need for reproducibility and standardization in lymph node cytopathology. Since then, the risk of malignancy for the categories of the Sydney system has been explored by several studies, but no studies have yet examined the interobserver reproducibility of the Sydney system.

METHODS

The authors assessed interobserver reproducibility of the Sydney system on 85 lymph node fine-needle aspiration cytology cases reviewed by 15 cytopathologists from 12 institutions in eight different countries, resulting in 1275 diagnoses. In total, 186 slides stained with Diff-Quik, Papanicolaou, and immunocytochemistry were scanned. A subset of the cases included clinical data and results from ultrasound examinations, flow cytometry immunophenotyping, and fluorescence in situ hybridization analysis. The study participants assessed the cases digitally using whole-slide images.

RESULTS

Overall, the authors observed an almost perfect agreement of cytopathologists with the ground truth (median weighted Cohen κ = 0.887; interquartile range, κ = 0.210) and moderate overall interobserver concordance (Fleiss κ = 0.476). There was substantial agreement for the inadequate and malignant categories (κ = 0.794 and κ = 0.729, respectively), moderate agreement for the benign category (κ = 0.490), and very slight agreement for the suspicious (κ = 0.104) and atypical (κ = 0.075) categories.

CONCLUSIONS

The Sydney system for reporting lymph node cytopathology shows adequate interobserver concordance. Digital microscopy is an adequate means to assess lymph node cytopathology specimens.

Large-scale validation study of an improved semiautonomous urine cytology assessment tool: AutoParis-X

BACKGROUND

Adopting a computational approach for the assessment of urine cytology specimens has the potential to improve the efficiency, accuracy, and reliability of bladder cancer screening, which has heretofore relied on semisubjective manual assessment methods. As rigorous, quantitative criteria and guidelines have been introduced for improving screening practices (e.g., The Paris System for Reporting Urinary Cytology), algorithms to emulate semiautonomous diagnostic decision-making have lagged behind, in part because of the complex and nuanced nature of urine cytology reporting.

METHODS

In this study, the authors report on the development and large-scale validation of a deep-learning tool, AutoParis-X, which can facilitate rapid, semiautonomous examination of urine cytology specimens.

RESULTS

The results of this large-scale, retrospective validation study indicate that AutoParis-X can accurately determine urothelial cell atypia and aggregate a wide variety of cell-related and cluster-related information across a slide to yield an atypia burden score, which correlates closely with overall specimen atypia and is predictive of Paris system diagnostic categories. Importantly, this approach accounts for challenges associated with the assessment of overlapping cell cluster borders, which improve the ability to predict specimen atypia and accurately estimate the nuclear-to-cytoplasm ratio for cells in these clusters.

CONCLUSIONS

The authors developed a publicly available, open-source, interactive web application that features a simple, easy-to-use display for examining urine cytology whole-slide images and determining the level of atypia in specific cells, flagging the most abnormal cells for pathologist review. The accuracy of AutoParis-X (and other semiautomated digital pathology systems) indicates that these technologies are approaching clinical readiness and necessitates full evaluation of these algorithms in head-to-head clinical trials.

Artificial intelligence to improve cytology performance in urothelial carcinoma diagnosis: results from validation phase of the French, multicenter, prospective VISIOCYT1 trial

PURPOSE

Cytology and cystoscopy, the current gold standard for diagnosing urothelial carcinomas, have limits: cytology has high interobserver variability with moderate or not optimal sensitivity (particularly for low-grade tumors); while cystoscopy is expensive, invasive, and operator dependent. The VISIOCYT1 study assessed the benefit of VisioCyt® for diagnosing urothelial carcinoma.

METHODS

VISIOCYT1 was a French prospective clinical trial conducted in 14 centers. The trial enrolled adults undergoing endoscopy for suspected bladder cancer or to explore the lower urinary tract. Participants were allocated either Group 1: with bladder cancer, i.e., with positive cystoscopy or with negative cystoscopy but positive cytology, or Group 2: without bladder cancer. Before cystoscopy and histopathology, slides were prepared for cytology and the VisioCyt® test from urine samples. The diagnostic performance of VisioCyt® was assessed using sensitivity (primary objective, 70% lower-bound threshold) and specificity (75% lower-bound threshold). Sensitivity was also assessed by tumor grade and T-staging. VisioCyt® and cytology performance were evaluated relative to the histopathological assessments.

RESULTS

Between October 2017 and December 2019, 391 participants (170 in Group 1 and 149 in Group 2) were enrolled. VisioCyt®'s sensitivity was 80.9% (95% CI 73.9-86.4%) and specificity was 61.8% (95% CI 53.4-69.5%). In high-grade tumors, the sensitivity was 93.7% (95% CI 86.0-97.3%) and in low-grade tumors 66.7% (95% CI 55.2-76.5%). Sensitivity by T-staging, compared to the overall sensitivity, was higher in high-grade tumors and lower in low-grade tumors.

CONCLUSION

VisioCyt® is a promising diagnostic tool for urothelial cancers with improved sensitivities for high-grade tumors and notably for low-grade tumors.

Examining longitudinal markers of bladder cancer recurrence through a semiautonomous machine learning system for quantifying specimen atypia from urine cytology

BACKGROUND

Urine cytology is generally considered the primary approach for screening for recurrence of bladder cancer. However, it is currently unclear how best to use cytological examinations for assessment and early detection of recurrence, beyond identifying a positive finding that requires more invasive methods to confirm recurrence and decide on therapeutic options. Because screening programs are frequent, and can be burdensome, finding quantitative means to reduce this burden for patients, cytopathologists, and urologists is an important endeavor and can improve both the efficiency and reliability of findings. Additionally, identifying ways to risk-stratify patients is crucial for improving quality of life while reducing the risk of future recurrence or progression of the cancer.

METHODS

In this study, a computational machine learning tool, AutoParis-X, was leveraged to extract imaging features from urine cytology examinations longitudinally to study the predictive potential of urine cytology for assessing recurrence risk. This study examined how the significance of imaging predictors changes over time before and after surgery to determine which predictors and time periods are most relevant for assessing recurrence risk.

RESULTS

Results indicate that imaging predictors extracted using AutoParis-X can predict recurrence as well or better than traditional cytological/histological assessments alone and that the predictiveness of these features is variable across time, with key differences in overall specimen atypia identified immediately before tumor recurrence.

CONCLUSIONS

Further research will clarify how computational methods can be effectively used in high-volume screening programs to improve recurrence detection and complement traditional modes of assessment.

Validation of full-remote reporting for cervicovaginal cytology: the Caltagirone-Acireale distributed lab

INTRODUCTION

Cervical cancer is the fourth most common cancer in women, and its prevention is based on vaccination and screening. Screening consists of molecular human papillomavirus (HPV) testing and cytologic analysis of cervical smears, which require expensive equipment and the interaction of numerous professionals such as biologists, cytologists, laboratory technicians, and pathologists.

MATERIALS AND METHODS

We centralize the cervical samples from more than 51 clinics in 1 main laboratory, where automated HPV testing is performed. HPV-positive cases are collected and used to prepare a liquid-based cytology slide, which is stained and immediately scanned. The resulting whole-slide images (WSIs) are immediately available in a remote laboratory where they are examined by experienced cytologists using virtual microscopy. This setup was validated by making each of the 3 readers independently diagnose 506 specimens in random order, using both conventional light microscopy (CLM) and WSIs, with a minimum wash-out period of 3 weeks and with a final discussion for all cases.

RESULTS

Intraobserver agreement among CLM and WSI ranged from 0.71 to 0.79, and interobserver agreement for the 3 readers compared with the consensus diagnosis was similar for the 2 modes of assessment. Readers subjectively felt confident in their WSI diagnosis for inadequate and negative cases, but less so in other cases. The perceived difficulty was slightly higher in WSI readings.

CONCLUSIONS

Interobserver agreement in cervicovaginal cytology is moderate and does not vary if the slides are examined conventionally or digitally. Despite higher reported subjective difficulty and lower confidence in the WSI diagnosis, we did not observe a deterioration in diagnostic performance using WSI compared with CLM.

Artificial Intelligence in the Advanced Diagnosis of Bladder Cancer-Comprehensive Literature Review and Future Advancement

Artificial intelligence is highly regarded as the most promising future technology that will have a great impact on healthcare across all specialties. Its subsets, machine learning, deep learning, and artificial neural networks, are able to automatically learn from massive amounts of data and can improve the prediction algorithms to enhance their performance. This area is still under development, but the latest evidence shows great potential in the diagnosis, prognosis, and treatment of urological diseases, including bladder cancer, which are currently using old prediction tools and historical nomograms. This review focuses on highly significant and comprehensive literature evidence of artificial intelligence in the management of bladder cancer and investigates the near introduction in clinical practice.

An economic evaluation of fine-needle cytology as the primary diagnostic tool in the diagnosis of lymphadenopathy

Fine-needle aspiration cytology (FNAC) is commonly used to obtain a pre-surgical pathological diagnosis in many organs, but its cost-effectiveness in lymphadenopathy has not been studied yet. We calculated the cost and diagnostic accuracy of a diagnostic algorithm that uses FNAC as a first-line procedure and compared it to a purely surgical approach in 545 consecutive lymphadenopathies. In 74% of the cases, FNAC alone can obtain a sufficiently detailed diagnosis, avoiding the surgical biopsy. In doing so, the average cost of diagnosis is cut to less than one-third, the patient avoids an invasive procedure and the diagnosis is reached earlier. In conclusion, the systematic use of lymph node-FNAC in the initial assessment of lymphadenopathy is clinically and economically advantageous as it avoids surgical biopsies in cases where cytology can suffice.

The slow-paced digital evolution of pathology: lights and shadows from a multifaceted board

Objective

The digital revolution in pathology represents an invaluable resource fto optimise costs, reduce the risk of error and improve patient care, even though it is still adopted in a minority of laboratories. Barriers include concerns about initial costs, lack of confidence in using whole slide images for primary diagnosis, and lack of guidance on transition. To address these challenges and develop a programme to facilitate the introduction of digital pathology (DP) in Italian pathology departments, a panel discussion was set up to identify the key points to be considered.

Methods

On 21 July 2022, an initial conference call was held on Zoom to identify the main issues to be discussed during the face-to-face meeting. The final summit was divided into four different sessions: (I) the definition of DP, (II) practical applications of DP, (III) the use of AI in DP, (IV) DP and education.

Results

Essential requirements for the implementation of DP are a fully tracked and automated workflow, selection of the appropriate scanner based on the specific needs of each department, and a strong commitment combined with coordinated teamwork (pathologists, technicians, biologists, IT service and industries). This could reduce human error, leading to the application of AI tools for diagnosis, prognosis and prediction. Open challenges are the lack of specific regulations for virtual slide storage and the optimal storage solution for large volumes of slides.

Conclusion

Teamwork is key to DP transition, including close collaboration with industry. This will ease the transition and help bridge the gap that currently exists between many labs and full digitisation. The ultimate goal is to improve patient care.

An emerging era of computational cytology

BACKGROUND

The significant advancement in digital imaging, data management, advanced computational power, and artificial neural network have an immense impact on the field of cytology. The amalgamation of these areas has generated a newer discipline known as computational cytology.

AIMS AND OBJECTIVE

In To discuss the various important aspects of computational cytology.

MATERIALS AND METHODS

We reviewed the different studies published in English during the last few years on computational cytology.

RESULT

Computational cytology is a newer and emerging discipline in pathology that deals with the patient's meta-data and digital image data to make a mathematical model to produce diagnostic interpretations and predictions. The role of the cytologist is now changing from a simple observational scientist and slide interpreter to a dynamic and integrated multi-parametric prediction-based scientist.

CONCLUSION

In the current stage, the cytologist must understand the situation and should have a vision of the complete scenario on computational cytology.

Uncovering additional predictors of urothelial carcinoma from voided urothelial cell clusters through a deep learning-based image preprocessing technique

BACKGROUND

Urine cytology is commonly used as a screening test for high-grade urothelial carcinoma for patients with risk factors or hematuria and is an essential step in longitudinal monitoring of patients with previous bladder cancer history. However, the semisubjective nature of current reporting systems for urine cytology (e.g., The Paris System) can hamper reproducibility. For instance, the incorporation of urothelial cell clusters into the classification schema is still an item of debate and perplexity among expert cytopathologists because several previous works have disputed their diagnostic relevance.

METHODS

In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation).

RESULTS

In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation). Results indicate that cell cluster atypia (i.e., defined by whether the cell cluster harbored multiple atypical cells, thresholded by a minimum number of cells), cell border overlap and smoothness, and total number of clusters are important markers of specimen atypia when considering assessment of urothelial cell clusters.

CONCLUSIONS

Markers established through techniques to separate cell clusters may have wider applicability for the design and implementation of machine learning approaches for urine cytology assessment.

Perceptions of Paris: an international survey in preparation for The Paris System for Reporting Urinary Cytology 2.0 (TPS 2.0)

INTRODUCTION

An international panel of experts in the field of urinary cytopathology conducted a survey, supported by the American Society of Cytopathology, to seek opinions, gather evidence, and identify practice patterns regarding urinary cytology before and after the introduction of The Paris System for Reporting Urinary Cytopathology (TPS). Results from this survey were utilized in the development of the second edition of TPS (TPS-2.0).

MATERIALS AND METHODS

The study group, originally formed during the 2013 International Congress of Cytology, reconvened at the 2019 annual meeting of the American Society of Cytopathology. To prepare for the second edition of TPS, the group generated a survey that included 43 questions related to the taxonomy and practice of urinary cytology.

RESULTS

A total of 523 participant responses were collected, and 451 from 54 countries passed a qualifying screen. Three hundred ninety-four participants provided information about their work settings. Eighty-two percent (218/266) of responding participants use TPS. One hundred sixty-eight people who responded on their urinary cytology atypia rates reported an average decrease from 21.6% to 16%. Over three fourths of participants felt that the same criteria should be used for upper and lower tract interpretations and for instrumented and voided samples. There were varied opinions on addressing atypical squamous cells and suggestions for an expanded discussion of the issue to be included in TPS 2.0.

CONCLUSIONS

Results of the survey demonstrate strong support for TPS and show a decreased self-reported atypia rate in the laboratories using TPS. The majority of participants related that the criteria put forth for the reporting categories were user-friendly and applied with relative ease. The comment section of the survey included suggestions from the participants for further improvement of TPS. Results of this survey have been useful in fine-tuning and advancing TPS. They were considered along with recent literature to generate the second edition of TPS.

Deep Learning-Based Screening of Urothelial Carcinoma in Whole Slide Images of Liquid-Based Cytology Urine Specimens

Urinary cytology is a useful, essential diagnostic method in routine urological clinical practice. Liquid-based cytology (LBC) for urothelial carcinoma screening is commonly used in the routine clinical cytodiagnosis because of its high cellular yields. Since conventional screening processes by cytoscreeners and cytopathologists using microscopes is limited in terms of human resources, it is important to integrate new deep learning methods that can automatically and rapidly diagnose a large amount of specimens without delay. The goal of this study was to investigate the use of deep learning models for the classification of urine LBC whole-slide images (WSIs) into neoplastic and non-neoplastic (negative). We trained deep learning models using 786 WSIs by transfer learning, fully supervised, and weakly supervised learning approaches. We evaluated the trained models on two test sets, one of which was representative of the clinical distribution of neoplastic cases, with a combined total of 750 WSIs, achieving an area under the curve for diagnosis in the range of 0.984-0.990 by the best model, demonstrating the promising potential use of our model for aiding urine cytodiagnostic processes.

Large-scale longitudinal comparison of urine cytological classification systems reveals potential early adoption of The Paris System criteria

INTRODUCTION

Urine cytology is used to screen for urothelial carcinoma in patients with hematuria or risk factors (eg, smoking, industrial dye exposure) and is an essential clinical triage and longitudinal monitoring tool for patients with known bladder cancer. However, urine cytology is semisubjective and thus susceptible to issues including specimen quality, interobserver variability, and "hedging" towards equivocal ("atypical") diagnoses. These factors limit the predictive value of urine cytology and increase reliance on invasive procedures (cystoscopy). The Paris System for Reporting Urine Cytology (TPS) was formulated to provide more quantitative/reproducible endpoints with well-defined criteria for urothelial atypia. TPS is often compared to other assessment techniques to justify its adoption. TPS results in decreased use of the atypical category and better reproducibility. Previous reports comparing diagnoses pre- and post-TPS have not considered temporal differences between diagnoses made under prior systems and TPS. By aggregating across time, studies may underestimate the magnitude of differences between assessment methods.

MATERIALS AND METHODS

We conducted a large-scale longitudinal reassessment of urine cytology using TPS criteria from specimens collected from 2008 to 2018, prior to the mid-2018 adoption of TPS at an academic medical center.

RESULTS

Findings indicate that differences in atypical assignment were largest at the start of the period and these differences progressively decreased towards insignificance just prior to TPS implementation.

CONCLUSIONS

This finding suggests that cytopathologists had begun to utilize the quantitative TPS criteria prior to official adoption, which may more broadly inform adoption strategies, communication, and understanding for evolving classification systems in cytology.

Deep Learning Approaches in Histopathology

The revolution of artificial intelligence and its impacts on our daily life has led to tremendous interest in the field and its related subtypes: machine learning and deep learning. Scientists and developers have designed machine learning- and deep learning-based algorithms to perform various tasks related to tumor pathologies, such as tumor detection, classification, grading with variant stages, diagnostic forecasting, recognition of pathological attributes, pathogenesis, and genomic mutations. Pathologists are interested in artificial intelligence to improve the diagnosis precision impartiality and to minimize the workload combined with the time consumed, which affects the accuracy of the decision taken. Regrettably, there are already certain obstacles to overcome connected to artificial intelligence deployments, such as the applicability and validation of algorithms and computational technologies, in addition to the ability to train pathologists and doctors to use these machines and their willingness to accept the results. This review paper provides a survey of how machine learning and deep learning methods could be implemented into health care providers' routine tasks and the obstacles and opportunities for artificial intelligence application in tumor morphology.

Recent Application of Artificial Intelligence in Non-Gynecological Cancer Cytopathology: A Systematic Review

Simple Summary

Artificial intelligence (AI) has attracted significant interest in the healthcare sector due to its promising results. Cytological examination is a critical step in the initial diagnosis of cancer. Here, we conducted a systematic review with quantitative analysis to understand the current status of AI applications in non-gynecological (non-GYN) cancer cytology. In our analysis, we found that most of the studies focused on classification and segmentation tasks. Overall, AI showed promising results for non-GYN cancer cytopathology analysis. However, the lack of well-annotated, large-scale datasets with Z-stacking and external cross-validation was the major limitation across all studies.

Abstract

State-of-the-art artificial intelligence (AI) has recently gained considerable interest in the healthcare sector and has provided solutions to problems through automated diagnosis. Cytological examination is a crucial step in the initial diagnosis of cancer, although it shows limited diagnostic efficacy. Recently, AI applications in the processing of cytopathological images have shown promising results despite the elementary level of the technology. Here, we performed a systematic review with a quantitative analysis of recent AI applications in non-gynecological (non-GYN) cancer cytology to understand the current technical status. We searched the major online databases, including MEDLINE, Cochrane Library, and EMBASE, for relevant English articles published from January 2010 to January 2021. The searched query terms were: “artificial intelligence”, “image processing”, “deep learning”, “cytopathology”, and “fine-needle aspiration cytology.” Out of 17,000 studies, only 26 studies (26 models) were included in the full-text review, whereas 13 studies were included for quantitative analysis. There were eight classes of AI models treated of according to target organs: thyroid (n = 11, 39%), urinary bladder (n = 6, 21%), lung (n = 4, 14%), breast (n = 2, 7%), pleural effusion (n = 2, 7%), ovary (n = 1, 4%), pancreas (n = 1, 4%), and prostate (n = 1, 4). Most of the studies focused on classification and segmentation tasks. Although most of the studies showed impressive results, the sizes of the training and validation datasets were limited. Overall, AI is also promising for non-GYN cancer cytopathology analysis, such as pathology or gynecological cytology. However, the lack of well-annotated, large-scale datasets with Z-stacking and external cross-validation was the major limitation found across all studies. Future studies with larger datasets with high-quality annotations and external validation are required.

Evaluation of an artificial intelligence algorithm for assisting the Paris System in reporting urinary cytology: A pilot study

BACKGROUND

The Paris System for Reporting Urinary Cytology (TPS) has been shown to improve bladder cancer diagnosis. Advances in artificial intelligence (AI) may assist and improve the clinical workflow by applying TPS in routine diagnostic services.

METHODS

A deep-learning-based algorithm was developed to identify urothelial cancer candidate cells using whole-slide images (WSIs). In the testing cohort, 131 urine cytology slides were retrospectively retrieved and analyzed using this AI algorithm. The authors compared the performance of one cytopathologist and two cytotechnologists using AI-assisted digital urine cytology. Then, the AI-assisted WSIs were evaluated in the clinical workflow. The cytopathologist first made a diagnosis by reviewing the AI-inferred WSIs and quantitative data (nuclear-to-cytoplasmic ratio and nuclear size) for each sample. After a washout period, the same cytopathologist made a diagnosis for the same samples using direct microscopy. All diagnosis results were compared with the expert panel consensus.

RESULTS

The AI-assisted diagnosis by the two cytotechnologists and the one cytopathologist demonstrated performance results that were comparable to the expert panel consensus (sensitivity, 79.5% and 82.1% vs. 92.3%, respectively; specificity, 100% and 98.9% vs. 100%, respectively). Furthermore, the performance of the AI-assisted WSIs compared with the microscopic diagnosis by the cytopathologist demonstrated superior sensitivity (92.3% vs. 87.2%) and negative predictive value (96.8% vs. 94.8%). In addition, the AI-assisted reporting demonstrated near perfect agreement with the expert panel consensus (κ = 0.944) and the microscopic diagnosis (κ = 0.862).

CONCLUSIONS

The AI algorithm developed by the authors effectively assisted TPS-based reporting by providing AI-inferred WSIs and quantitative data.

A Deep Learning System to Predict the Histopathological Results From Urine Cytopathological Images

Background

Although deep learning systems (DLSs) have been developed to diagnose urine cytology, more evidence is required to prove if such systems can predict histopathology results as well.

Methods

We retrospectively retrieved urine cytology slides and matched histological results. High-power field panel images were annotated by a certified urological pathologist. A deep learning system was designed with a ResNet101 Faster R-CNN (faster region-based convolutional neural network). It was firstly built to spot cancer cells. Then, it was directly used to predict the likelihood of the presence of tissue malignancy.

Results

We retrieved 441 positive cases and 395 negative cases. The development involved 387 positive cases, accounting for 2,668 labeled cells, to train the DLS to spot cancer cells. The DLS was then used to predict corresponding histopathology results. In an internal test set of 85 cases, the area under the curve (AUC) was 0.90 (95%CI 0.84-0.96), and the kappa score was 0.68 (95%CI 0.52-0.84), indicating substantial agreement. The F1 score was 0.56, sensitivity was 71% (95%CI 52%-85%), and specificity was 94% (95%CI 84%-98%). In an extra test set of 333 cases, the DLS achieved 0.25 false-positive cells per image. The AUC was 0.93 (95%CI 0.90-0.95), and the kappa score was 0.58 (95%CI 0.46-0.70) indicating moderate agreement. The F1 score was 0.66, sensitivity was 67% (95%CI 54%-78%), and specificity was 92% (95%CI 88%-95%).

Conclusions

The deep learning system could predict if there was malignancy using cytocentrifuged urine cytology images. The process was explainable since the prediction of malignancy was directly based on the abnormal cells selected by the model and can be verified by examining those candidate abnormal cells in each image. Thus, this DLS was not just a tool for pathologists in cytology diagnosis. It simultaneously provided novel histopathologic insights for urologists.

Application and performance of artificial intelligence technology in cytopathology

Deep learning algorithms and artificial intelligence (AI) are making great progress in their capacity to evaluate and interpret image data recent advancements in computer vision and machine learning. The first use of AI in a pathology lab was in cytopathology, when a computer-assisted Pap test screening was created. Initially designed to diagnose rather than screen, there was a lot of disagreement concerning their wide use to clinical specimens. However, whole-slide imaging of both gynaecological and non-gynaecological histopathology have been the subject of recent AI work. An overview of the literature on AI in cytopathology is provided in this brief review. To be more precise, it intends to emphasize the relevance of applications of AI algorithms to gynaecological and non-gynaecologic cytology. Between January 2000 and December 2021, a search on artificial intelligence in cytopathology was conducted in several well-known databases, including PubMed, Web of Science, Scopus, Embase, and Google Scholar. Only full-text papers that could be accessed online were evaluated.

[How has the Paris System contributed to urine cytology? Evaluating the contribution of the Paris System to urine cytology. A comparative study of the Paris System and the Papanicolaou method in a tertiary centre]

INTRODUCTION AND OBJECTIVES

The Paris System (PS) has replaced the classical Papanicolaou System (PapS) in reporting urine cytology, due to its improved sensitivity and negative predictive value (NPV) without loss of specificity. Furthermore, it has enabled the risk of malignancy to be established in each cytological category. The aim of this study is to compare the Paris System with previous results and determine the changes in sensitivity, specificity, positive predictive value, NPV and risk of malignancy in our centre, MATERIALS AND METHODS: Evaluation of the diagnostic power of urine cytology by means of a retrospective cohort study, comparing two series of 400 cytological studies, one using the Papanicolaou System and the other the Paris System.

RESULTS

In the detection of high-grade urothelial carcinoma, Paris System has better specificity (93.82% PapS vs 98.64% PS; P=.001) and PPV (39.5% PapS vs 70.6% PS; P=.044) than Papanicolaou System, without changes in sensitivity (53.5% PapS vs 37.5% PS; P=.299) or NPV (96.4% PapS vs 94.8% PS; P=.183). The risk of malignancy for the atypical category increases from low to high levels (1.6% PapS vs 40.0% PS; P=.001); the other categories showed no significant statistical changes.

CONCLUSION

The Paris System improves specificity and positive predictive value and establishes a better indication of risk of malignancy for each category, enabling specific clinical management in each case.

Organ on Chip Technology to Model Cancer Growth and Metastasis

Organ on chip (OOC) has emerged as a major technological breakthrough and distinct model system revolutionizing biomedical research and drug discovery by recapitulating the crucial structural and functional complexity of human organs in vitro. OOC are rapidly emerging as powerful tools for oncology research. Indeed, Cancer on chip (COC) can ideally reproduce certain key aspects of the tumor microenvironment (TME), such as biochemical gradients and niche factors, dynamic cell-cell and cell-matrix interactions, and complex tissue structures composed of tumor and stromal cells. Here, we review the state of the art in COC models with a focus on the microphysiological systems that host multicellular 3D tissue engineering models and can help elucidate the complex biology of TME and cancer growth and progression. Finally, some examples of microengineered tumor models integrated with multi-organ microdevices to study disease progression in different tissues will be presented.

Applications of artificial intelligence in urological setting: a hopeful path to improved care

Artificial intelligence (AI) has been introduced in urology research and practice. Application of AI leads to better accuracy of disease diagnosis and predictive model for monitoring of responses to medical treatments. This mini-review article aims to summarize current applications and development of AI in urology setting, in particular for diagnosis and treatment of urological diseases. This review will introduce that machine learning algorithm-based models will enhance the prediction accuracy for various bladder diseases including interstitial cystitis, bladder cancer, and reproductive urology.

Leveraging advances in immunopathology and artificial intelligence to analyze in vitro tumor models in composition and space

Cancer is the leading cause of death worldwide. Unfortunately, efforts to understand this disease are confounded by the complex, heterogenous tumor microenvironment (TME). Better understanding of the TME could lead to novel diagnostic, prognostic, and therapeutic discoveries. One way to achieve this involves in vitro tumor models that recapitulate the in vivo TME composition and spatial arrangement. Here, we review the potential of harnessing in vitro tumor models and artificial intelligence to delineate the TME. This includes (i) identification of novel features, (ii) investigation of higher-order relationships, and (iii) analysis and interpretation of multiomics data in a (iv) holistic, objective, reproducible, and efficient manner, which surpasses previous methods of TME analysis. We also discuss limitations of this approach, namely inadequate datasets, indeterminate biological correlations, ethical concerns, and logistical constraints; finally, we speculate on future avenues of research that could overcome these limitations, ultimately translating to improved clinical outcomes.

Whole-slide imaging, tissue image analysis, and artificial intelligence in veterinary pathology: An updated introduction and review

Since whole-slide imaging has been commercially available for over 2 decades, digital pathology has become a constantly expanding aspect of the pathology profession that will continue to significantly impact how pathologists conduct their craft. While some aspects, such as whole-slide imaging for archiving, consulting, and teaching, have gained broader acceptance, other facets such as quantitative tissue image analysis and artificial intelligence-based assessments are still met with some reservations. While most vendors in this space have focused on diagnostic applications, that is, viewing one or few slides at a time, some are developing solutions tailored more specifically to the various aspects of veterinary pathology including updated diagnostic, discovery, and research applications. This has especially advanced the use of digital pathology in toxicologic pathology and drug development, for primary reads as well as peer reviews. It is crucial that pathologists gain a deeper understanding of digital pathology and tissue image analysis technology and their applications in order to fully use these tools in a way that enhances and improves the pathologist's assessment as well as work environment. This review focuses on an updated introduction to the basics of digital pathology and image analysis and introduces emerging topics around artificial intelligence and machine learning.

Advances in Imaging Modalities, Artificial Intelligence, and Single Cell Biomarker Analysis, and Their Applications in Cytopathology

Several advances in recent decades in digital imaging, artificial intelligence, and multiplex modalities have improved our ability to automatically analyze and interpret imaging data. Imaging technologies such as optical coherence tomography, optical projection tomography, and quantitative phase microscopy allow analysis of tissues and cells in 3-dimensions and with subcellular granularity. Improvements in computer vision and machine learning have made algorithms more successful in automatically identifying important features to diagnose disease. Many new automated multiplex modalities such as antibody barcoding with cleavable DNA (ABCD), single cell analysis for tumor phenotyping (SCANT), fast analytical screening technique fine needle aspiration (FAST-FNA), and portable fluorescence-based image cytometry analyzer (CytoPAN) are under investigation. These have shown great promise in their ability to automatically analyze several biomarkers concurrently with high sensitivity, even in paucicellular samples, lending themselves well as tools in FNA. Not yet widely adopted for clinical use, many have successfully been applied to human samples. Once clinically validated, some of these technologies are poised to change the routine practice of cytopathology.

Urine cell image recognition using a deep-learning model for an automated slide evaluation system

OBJECTIVES

To develop a classification system for urine cytology with artificial intelligence (AI) using a convolutional neural network algorithm that classifies urine cell images as negative (benign) or positive (atypical or malignant).

PATIENTS AND METHODS

We collected 195 urine cytology slides from consecutive patients with a histologically confirmed diagnosis of urothelial cancer (between January 2016 and December 2017). Two certified cytotechnologists independently evaluated and labelled each slide; 4637 cell images with concordant diagnoses were selected, including 3128 benign cells (negative), 398 atypical cells, and 1111 cells that were malignant or suspicious for malignancy (positive). This pathologically confirmed labelled dataset was used to represent the ground truth for AI training/validation/testing. Customized CutMix (CircleCut) and Refined Data Augmentation were used for image processing. The model architecture included EfficientNet B6 and Arcface. We used 80% of the data for training and validation (4:1 ratio) and 20% for testing. Model performance was evaluated with fivefold cross-validation. A receiver-operating characteristic (ROC) analysis was used to evaluate the binary classification model. Bayesian posterior probabilities for the AI performance measure (Y) and cytotechnologist performance measure (X) were compared.

RESULTS

The area under the ROC curve was 0.99 (95% confidence interval [CI] 0.98-0.99), the highest accuracy was 95% (95% CI 94-97), sensitivity was 97% (95% CI 95-99), and specificity was 95% (95% CI 93-97). The accuracy of AI surpassed the highest level of cytotechnologists for the binary classification [Pr(Y > X) = 0.95]. AI achieved >90% accuracy for all cell subtypes. In the subgroup analysis based on the clinicopathological characteristics of patients who provided the test cells, the accuracy of AI ranged between 89% and 97%.

CONCLUSION

Our novel AI classification system for urine cytology successfully classified all cell subtypes with an accuracy of higher than 90%, and achieved diagnostic accuracy of malignancy superior to the highest level achieved by cytotechnologists.

A Calibrated Multiexit Neural Network for Detecting Urothelial Cancer Cells

Deep convolutional networks have become a powerful tool for medical imaging diagnostic. In pathology, most efforts have been focused in the subfield of histology, while cytopathology (which studies diagnostic tools at the cellular level) remains underexplored. In this paper, we propose a novel deep learning model for cancer detection from urinary cytopathology screening images. We leverage recent ideas from the field of multioutput neural networks to provide a model that can efficiently train even on small-scale datasets, such as those typically found in real-world scenarios. Additionally, we argue that calibration (i.e., providing confidence levels that are aligned with the ground truth probability of an event) has been a major shortcoming of prior works, and we experiment a number of techniques to provide a well-calibrated model. We evaluate the proposed algorithm on a novel dataset, and we show that the combination of focal loss, multiple outputs, and temperature scaling provides a model that is significantly more accurate and calibrated than a baseline deep convolutional network.

Artificial intelligence-based pathology for gastrointestinal and hepatobiliary cancers

Artificial intelligence (AI) can extract complex information from visual data. Histopathology images of gastrointestinal (GI) and liver cancer contain a very high amount of information which human observers can only partially make sense of. Complementing human observers, AI allows an in-depth analysis of digitised histological slides of GI and liver cancer and offers a wide range of clinically relevant applications. First, AI can automatically detect tumour tissue, easing the exponentially increasing workload on pathologists. In addition, and possibly exceeding pathologist's capacities, AI can capture prognostically relevant tissue features and thus predict clinical outcome across GI and liver cancer types. Finally, AI has demonstrated its capacity to infer molecular and genetic alterations of cancer tissues from histological digital slides. These are likely only the first of many AI applications that will have important clinical implications. Thus, pathologists and clinicians alike should be aware of the principles of AI-based pathology and its ability to solve clinically relevant problems, along with its limitations and biases.

What is the state of the art of computer vision-assisted cytology? A Systematic Literature Review

Cytology is a low-cost and non-invasive diagnostic procedure employed to support the diagnosis of a broad range of pathologies. Cells are harvested from tissues by aspiration or scraping, and it is still predominantly performed manually by medical or laboratory professionals extensively trained for this purpose. It is a time-consuming and repetitive process where many diagnostic criteria are subjective and vulnerable to human interpretation. Computer Vision technologies, by automatically generating quantitative and objective descriptions of examinations' contents, can help minimize the chances of misdiagnoses and shorten the time required for analysis. To identify the state-of-art of computer vision techniques currently applied to cytology, we conducted a Systematic Literature Review, searching for approaches for the segmentation, detection, quantification, and classification of cells and organelles using computer vision on cytology slides. We analyzed papers published in the last 4 years. The initial search was executed in September 2020 and resulted in 431 articles. After applying the inclusion/exclusion criteria, 157 papers remained, which we analyzed to build a picture of the tendencies and problems present in this research area, highlighting the computer vision methods, staining techniques, evaluation metrics, and the availability of the used datasets and computer code. As a result, we identified that the most used methods in the analyzed works are deep learning-based (70 papers), while fewer works employ classic computer vision only (101 papers). The most recurrent metric used for classification and object detection was the accuracy (33 papers and 5 papers), while for segmentation it was the Dice Similarity Coefficient (38 papers). Regarding staining techniques, Papanicolaou was the most employed one (130 papers), followed by H&E (20 papers) and Feulgen (5 papers). Twelve of the datasets used in the papers are publicly available, with the DTU/Herlev dataset being the most used one. We conclude that there still is a lack of high-quality datasets for many types of stains and most of the works are not mature enough to be applied in a daily clinical diagnostic routine. We also identified a growing tendency towards adopting deep learning-based approaches as the methods of choice.

A deep learning system to diagnose the malignant potential of urothelial carcinoma cells in cytology specimens

BACKGROUND

Although deep learning algorithms for clinical cytology have recently been developed, their application to practical assistance systems has not been achieved. In addition, whether deep learning systems (DLSs) can perform diagnoses that cannot be performed by pathologists has not been fully evaluated.

METHODS

The authors initially obtained low-power field cytology images from archived Papanicolaou-stained urinary cytology glass slides from 232 patients. To aid in the development of a diagnosis support system that could identify suspicious atypical cells, the images were divided into high-power field panel image sets for training and testing of the 16-layer Visual Geometry Group convolutional neural network. The DLS was trained using linked information pertaining to whether urothelial carcinoma (UC) in the corresponding histology specimen was invasive or noninvasive, or high-grade or low-grade, followed by an evaluation of whether the DLS could diagnose these characteristics.

RESULTS

The DLS achieved excellent performance (eg, an area under the curve [AUC] of 0.9890; F1 score, 0.9002) when trained on high-power field images of malignant and benign cases. The DLS could diagnose whether the lesions were invasive UC (AUC, 0.8628; F1 score, 0.8239) or high-grade UC (AUC, 0.8661; F1 score, 0.8218). Gradient-weighted class activation mapping of these images indicated that the diagnoses were based on the color of tumor cell nuclei.

CONCLUSIONS

The DLS could accurately screen UC cells and determine the malignant potential of tumors more accurately than classical cytology. The use of a DLS during cytopathology screening could help urologists plan therapeutic strategies, which, in turn, may be beneficial for patients.

Hexylaminolevulinate-mediated fluorescent urine cytology with a novel automated detection technology for screening and surveillance of bladder cancer

OBJECTIVES

To evaluate the diagnostic performance of fluorescent voided urine cytology (FVUC) using a novel automated detection technology to screen for primary bladder cancer and for surveillance of recurrent bladder tumour.

PATIENTS AND METHODS

We created a rapid, objective, automated, and high-throughput detection device for hexylaminolevulinate-mediated FVUC, named the cellular fluorescence analysis unit-II (CFAU-II). Two different cohorts were used in this study: (i) screening test for primary bladder cancer (165 patients with bladder cancer and 52 controls), and (ii) surveillance test for detecting intravesical recurrent tumour (192 patients with treated non-muscle-invasive bladder cancer and 15 with post-nephroureterectomy upper urinary tract cancer). Voided urine samples were subjected to urine analysis, conventional VUC (cVUC), and FVUC. Diagnostic performance was compared between cVUC, FVUC, and a combination of the two.

RESULTS

A total of 614 urine samples were successfully collected, processed, and analysed. Comparative analysis of the screening test cohort demonstrated that the overall sensitivity of FVUC (63%, P < 0.001) and combination testing (72%, P < 0.001) was significantly higher than that of cVUC (29%). FVUC was found to be superior in most of the subgroups, especially in low-grade, Ta, and small tumours. Analysis of the surveillance test cohort showed that combination testing achieved a sensitivity of 82% and a negative predictive value of 98%, whereas those of cVUC were 39% and 96%, respectively. According to the pathological finding of recurrent tumours presenting false-negative result in the FVUC, the majority of the overlooked recurrent diseases were Ta low-grade tumours. Logistic regression analysis suggested an association between the risk of false-positive results and high density of urine white blood cells and alkaluria.

CONCLUSION

The present findings clearly demonstrate that FVUC using the newly developed automation technology has superior sensitivity to cVUC for both screening for primary bladder cancer and recurrent tumour detection. It is essential to confirm the clinical usefulness of this method via further large-scale studies, in addition to ensuring its affordability and availability.

Clinical applications of artificial intelligence in urologic oncology

PURPOSE OF REVIEW

This review aims to shed light on recent applications of artificial intelligence in urologic oncology.

RECENT FINDINGS

Artificial intelligence algorithms harness the wealth of patient data to assist in diagnosing, staging, treating, and monitoring genitourinary malignancies. Successful applications of artificial intelligence in urologic oncology include interpreting diagnostic imaging, pathology, and genomic annotations. Many of these algorithms, however, lack external validity and can only provide predictions based on one type of dataset.

SUMMARY

Future applications of artificial intelligence will need to incorporate several forms of data in order to truly make headway in urologic oncology. Researchers must actively ensure future artificial intelligence developments encompass the entire prospective patient population.

Cervical cytology screening facilitated by an artificial intelligence microscope: A preliminary study

BACKGROUND

Cervical cytology screening is usually laborious with a heavy workload and poor diagnostic consistency. The authors have developed an artificial intelligence (AI) microscope that can provide onsite diagnostic assistance for cervical cytology screening in real time.

METHODS

A total of 2167 cervical cytology slides were selected from a cohort of 10,601 cases from Shenzhen Maternity and Child Healthcare Hospital, and the training data set consisted of 42,073 abnormal cervical epithelial cells. The recognition results of an AI technique were presented in a microscope eyepiece by an augmented reality technique. Potentially abnormal cells were highlighted with binary classification results in a 10× field of view (FOV) and with multiclassification results according to the Bethesda system in 20× and 40× FOVs. In addition, 486 slides were selected for the reader study to evaluate the performance of the AI microscope.

RESULTS

In the reader study, which compared manual reading with AI assistance, the sensitivities for the detection of low-grade squamous intraepithelial lesions and high-grade squamous intraepithelial lesions were significantly improved from 0.837 to 0.923 (P < .001) and from 0.830 to 0.917 (P < .01), respectively; the κ score for atypical squamous cells of undetermined significance (ASCUS) was improved from 0.581 to 0.637; the averaged pairwise κ of consistency for multiclassification was improved from 0.649 to 0.706; the averaged pairwise κ of consistency for binary classification was improved from 0.720 to 0.798; and the averaged pairwise κ of ASCUS was improved from 0.557 to 0.639.

CONCLUSIONS

The results of this study show that an AI microscope can provide real-time assistance for cervical cytology screening and improve the efficiency and accuracy of cervical cytology diagnosis.

Current applications of artificial intelligence combined with urine detection in disease diagnosis and treatment

In recent years, the advantages of artificial intelligence (AI) in data processing and model analysis have emerged in the medical field, enabled by computer technology developments and the integration of multiple disciplines. The application of AI in the medical field has gradually deepened and broadened. Among them, the development of clinical medicine intelligent decision-making is the fastest. The advantage of clinical medicine intelligent decision-making is to make the diagnosis faster and more accurate on the basis of certain information. Urine detection technologies, such as urine proteomics, urine metabolomics, and urine RNomics, have developed rapidly with the advancements in omics and medical tests. Advances in urine testing have made it possible to obtain a wealth of information from easily accessible urine. However, it has always been a problem to extract effective information from this information and use it. AI technology provides the possibility to process and use the information in urine. AI, combined with urine detection, not only provides new possibilities for precise and individual diagnosis and disease treatment, but also helps promote non-invasive diagnosis and treatment. This article reviews the research and applications of AI combined with urine detection for disease diagnosis and treatment and discusses its existing problems and future development.

Deep learning based digital cell profiles for risk stratification of urine cytology images

Urine cytology is a test for the detection of high-grade bladder cancer. In clinical practice, the pathologist would manually scan the sample under the microscope to locate atypical and malignant cells. They would assess the morphology of these cells to make a diagnosis. Accurate identification of atypical and malignant cells in urine cytology is a challenging task and is an essential part of identifying different diagnosis with low-risk and high-risk malignancy. Computer-assisted identification of malignancy in urine cytology can be complementary to the clinicians for treatment management and in providing advice for carrying out further tests. In this study, we presented a method for identifying atypical and malignant cells followed by their profiling to predict the risk of diagnosis automatically. For cell detection and classification, we employed two different deep learning-based approaches. Based on the best performing network predictions at the cell level, we identified low-risk and high-risk cases using the count of atypical cells and the total count of atypical and malignant cells. The area under the receiver operating characteristic (ROC) curve shows that a total count of atypical and malignant cells is comparably better at diagnosis as compared to the count of malignant cells only. We obtained area under the ROC curve with the count of malignant cells and the total count of atypical and malignant cells as 0.81 and 0.83, respectively. Our experiments also demonstrate that the digital risk could be a better predictor of the final histopathology-based diagnosis. We also analyzed the variability in annotations at both cell and whole slide image level and also explored the possible inherent rationales behind this variability.

QuPath: The global impact of an open source digital pathology system

QuPath, originally created at the Centre for Cancer Research & Cell Biology at Queen's University Belfast as part of a research programme in digital pathology (DP) funded by Invest Northern Ireland and Cancer Research UK, is arguably the most wildly used image analysis software program in the world. On the back of the explosion of DP and a need to comprehensively visualise and analyse whole slides images (WSI), QuPath was developed to address the many needs associated with tissue based image analysis; these were several fold and, predominantly, translational in nature: from the requirement to visualise images containing billions of pixels from files several GBs in size, to the demand for high-throughput reproducible analysis, which the paradigm of routine visual pathological assessment continues to struggle to deliver. Resultantly, large-scale biomarker quantification must increasingly be augmented with DP. Here we highlight the impact of the open source Quantitative Pathology & Bioimage Analysis DP system since its inception, by discussing the scope of scientific research in which QuPath has been cited, as the system of choice for researchers.