Augmented Bladder Tumor Detection Using Deep Learning

[Bimodal and multimodal endoscopy of the urinary bladder in diagnosis and treatment]

White light cystoscopy is a precise instrument for the detection and treatment of papillary bladder tumors. Various additional macroscopic detection methods have been established. Some of them, especially PDD or NBI, have been shown to have an additional benefit on the recurrence rate of bladder tumors, so they should be used as part of the diagnosis and treatment when available. Other microscopic classification techniques or multimodality techniques are currently under development. Widespread use of these techniques is still pending. Newer modalities such as multi-parametric imaging or AI-assisted endoscopy promise a significant leap in innovation in the future and could ensure that real-time urological endoscopy is significantly advanced.

Intelligent skin disease prediction system using transfer learning and explainable artificial intelligence

Skin diseases impact millions of people around the world and pose a severe risk to public health. These diseases have a wide range of effects on the skin's structure, functionality, and appearance. Identifying and predicting skin diseases are laborious processes that require a complete physical examination, a review of the patient's medical history, and proper laboratory diagnostic testing. Additionally, it necessitates a significant number of histological and clinical characteristics for examination and subsequent treatment. As a disease's complexity and quantity of features grow, identifying and predicting it becomes more challenging. This research proposes a deep learning (DL) model utilizing transfer learning (TL) to quickly identify skin diseases like chickenpox, measles, and monkeypox. A pre-trained VGG16 is used for transfer learning. The VGG16 can identify and predict diseases more quickly by learning symptom patterns. Images of the skin from the four classes of chickenpox, measles, monkeypox, and normal are included in the dataset. The dataset is separated into training and testing. The experimental results performed on the dataset demonstrate that the VGG16 model can identify and predict skin diseases with 93.29% testing accuracy. However, the VGG16 model does not explain why and how the system operates because deep learning models are black boxes. Deep learning models' opacity stands in the way of their widespread application in the healthcare sector. In order to make this a valuable system for the health sector, this article employs layer-wise relevance propagation (LRP) to determine the relevance scores of each input. The identified symptoms provide valuable insights that could support timely diagnosis and treatment decisions for skin diseases.

AI predicting recurrence in non-muscle-invasive bladder cancer: systematic review with study strengths and weaknesses

Background

Non-muscle-invasive Bladder Cancer (NMIBC) is notorious for its high recurrence rate of 70-80%, imposing a significant human burden and making it one of the costliest cancers to manage. Current prediction tools for NMIBC recurrence rely on scoring systems that often overestimate risk and lack accuracy. Machine learning (ML) and artificial intelligence (AI) are transforming oncological urology by leveraging molecular and clinical data to enhance predictive precision.

Methods

This comprehensive review critically examines ML-based frameworks for predicting NMIBC recurrence. A systematic literature search was conducted, focusing on the statistical robustness and algorithmic efficacy of studies. These were categorised by data modalities (e.g., radiomics, clinical, histopathological, genomic) and types of ML models, such as neural networks, deep learning, and random forests. Each study was analysed for strengths, weaknesses, performance metrics, and limitations, with emphasis on generalisability, interpretability, and cost-effectiveness.

Results

ML algorithms demonstrate significant potential, with neural networks achieving accuracies of 65-97.5%, particularly with multi-modal datasets, and support vector machines averaging around 75%. Models combining multiple data types consistently outperformed single-modality approaches. However, challenges include limited generalisability due to small datasets and the "black-box" nature of advanced models. Efforts to enhance explainability, such as SHapley Additive ExPlanations (SHAP), show promise but require refinement for clinical use.

Conclusion

This review illuminates the nuances, complexities and contexts that influence the real-world advancement and adoption of these AI-driven techniques in precision oncology. It equips researchers with a deeper understanding of the intricacies of the ML algorithms employed. Actionable insights are provided for refining algorithms, optimising multimodal data utilisation, and bridging the gap between predictive accuracy and clinical utility. This rigorous analysis serves as a roadmap to advance real-world AI applications in oncological care, highlighting the collaborative efforts and robust datasets necessary to translate these advancements into tangible benefits for patient management.

Deep Learning Predicts Lymphovascular Invasion Status in Muscle Invasive Bladder Cancer Histopathology

BACKGROUND

Lymphovascular invasion (LVI) is linked to poor prognosis in patients with muscle-invasive bladder cancer (MIBC). Accurately identifying the LVI status in MIBC patients is crucial for effective risk stratification and precision treatment. We aim to develop a deep learning model to identify the LVI status in whole-slide images (WSIs) of MIBC patients.

PATIENTS AND METHODS

A cohort from The Cancer Genome Atlas (TCGA) database was used to train a deep learning model, slide-based lymphovascular invasion predictor (SBLVIP), based on multiple-instance learning. This model was externally validated using the Renmin Hospital of Wuhan University (RHWU) and People's Hospital of Hanchuan City (PHHC) cohorts. Kaplan-Meier curves, along with univariate and multivariate Cox models, were employed to evaluate the association between the LVI status predicted by SBLVIP and the survival outcomes of MIBC patients.

RESULTS

In the TCGA cohort, the SBLVIP model achieved an average accuracy of 0.804 [95% confidence interval (CI) 0.712-0.895] and an area under the receiver operating characteristic curve (AUC) of 0.77 (95% CI 0.63-0.84) in the training set. In the internal validation set, the model's average accuracy and AUC were 0.774 (95% CI, 0.701-0.846) and 0.76 (95% CI, 0.60-0.83), respectively. In the RHWU cohort, the SBLVIP model achieved an average accuracy of 0.807 (95% CI 0.734-0.880) and an AUC of 0.74 (95% CI 0.55-0.83). In the PHHC cohort, SBLVIP demonstrated an average accuracy of 0.821 (95% CI 0.737-0.909) and an AUC of 0.74 (95% CI 0.58-0.89). Moreover, the LVI status predicted by SBLVIP showed significant independent prognostic value (P = 1 × 10-6).

CONCLUSIONS

We developed a deep learning model named SBLVIP to predict the LVI status in routine WSIs of MIBC patients.

Optimizing cystoscopy and TURBT: enhanced imaging and artificial intelligence

Diagnostic cystoscopy in combination with transurethral resection of the bladder tumour are the standard for the diagnosis, surgical treatment and surveillance of bladder cancer. The ability to inspect the bladder in its current form stems from a long chain of advances in imaging science and endoscopy. Despite these advances, bladder cancer recurrence and progression rates remain high after endoscopic resection. This stagnation is a result of the heterogeneity of cancer biology as well as limitations in surgical techniques and tools, as incomplete resection and provider-specific differences affect cancer persistence and early recurrence. An unmet clinical need remains for solutions that can improve tumour delineation and resection. Translational advances in enhanced cystoscopy technologies and artificial intelligence offer promising avenues to overcoming the progress plateau.

A novel artificial intelligence segmentation model for early diagnosis of bladder tumors

OBJECTIVE

Despite cystoscopy plays an important role in bladder tumors diagnosis, it often falls short in flat cancerous tissue and minuscule satellite lesions. It can easily lead to a missed diagnosis by the urologist, which can lead to a swift tumor regrowth following transurethral resection of the bladder tumor (TURBT). Therefore, we developed a deep learning-based intelligent diagnosis system for early bladder cancer to improve the identification rate of early bladder tumors.

METHODS

Video data from 273 bladder cancer patients who underwent TURBT at Zhongnan Hospital were collected. The dataset was carefully annotated by urologists to clearly define tumor boundaries. Subsequently, we developed a new bladder tumor segmentation network (BTS-Net) based on transformer to accurately diagnose early-stage bladder cancer lesions.

RESULTS

Our experiments demonstrate that the BTS-Net we developed has outperformed other method on the external B validation dataset, achieving a MPrecision of 91.39%, a MRecall of 95.71%, a MIoU of 88.18% and an F1-score of 93.18%. The BTS-Net showed high accuracy with real-time processing speed at 23 fps.

CONCLUSION

Missed detection of satellite lesions in early bladder tumors often leads to tumor recurrence. Our BTS-Net is capable of segmenting all potential satellite lesions in surgical videos, without the need for complex professional equipment. This AI-assisted diagnosis system has the potential to improve surgical outcomes by ensuring comprehensive treatment of all tumor-related areas during TURBT.

Artificial Intelligence-Based Classification and Segmentation of Bladder Cancer in Cystoscope Images

BACKGROUND/OBJECTIVES

Cystoscopy is necessary for diagnosing bladder cancer, but it has limitations in identifying ambiguous lesions, such as carcinoma in situ (CIS), which leads to a high recurrence rate of bladder cancer. With the significant advancements in deep learning in the medical field, several studies have explored its application in cystoscopy. This study aimed to utilize the VGG19 and Deeplab v3+ deep learning models to classify and segment cystoscope images, respectively.

METHODS

We classified cystoscope images obtained from 772 patients based on morphology (normal, papillary, flat, mixed) and biopsy results (normal, Ta, T1, T2, CIS, etc.). Experienced urologists annotated and labeled the lesion areas and image categories. The classification model for bladder cancer lesion, annotated with pathological results, was developed using VGG19 with an additional fully connected layer, utilizing sparse categorical cross-entropy as the loss function. The Deeplab v3+ model was used for segmenting each morphological type of bladder cancer in the cystoscope images, employing the dice coefficient loss function. The classification model was evaluated using validation accuracy and correlation with biopsy results, while the segmentation model was assessed using the Intersection over Union (IoU) combined with binary accuracy.

RESULTS

The dataset was split into training and validation sets with a 4:1 ratio. The VGG19 classification model achieved an accuracy score of 0.912. The Deeplab v3+ segmentation model achieved an IoU of 0.833 and a binary accuracy of 0.951. Visual analysis revealed a high similarity between the lesions identified by Deeplab v3+ and those labeled by experts.

CONCLUSIONS

In this study, we applied two deep learning models using well-annotated datasets of cystoscopic images. Both VGG19 and Deeplab v3+ demonstrated high performance in classification and segmentation, respectively. These models can serve as valuable tools for bladder cancer research and may aid in the diagnosis of bladder cancer.

Low-cost and label-free blue light cystoscopy through digital staining of white light cystoscopy videos

BACKGROUND

Bladder cancer is the 10th most common malignancy and carries the highest treatment cost among all cancers. The elevated cost stems from its high recurrence rate, which necessitates frequent surveillance. White light cystoscopy (WLC), the standard of care surveillance tool to examine the bladder for lesions, has limited sensitivity for early-stage bladder cancer. Blue light cystoscopy (BLC) utilizes a fluorescent dye to induce contrast in cancerous regions, improving the sensitivity of detection by 43%. Nevertheless, the added equipment cost and lengthy dwell time of the dye limits the availability of BLC.

METHODS

Here, we report the first demonstration of digital staining as a promising strategy to convert WLC images collected with standard-of-care clinical equipment into accurate BLC-like images, providing enhanced sensitivity for WLC without the associated labor or equipment cost.

RESULTS

By introducing key pre-processing steps to circumvent color and brightness variations in clinical datasets needed for successful model performance, the results achieve a staining accuracy of 80.58% and show excellent qualitative and quantitative agreement of the digitally stained WLC (dsWLC) images with ground truth BLC images, including color consistency.

CONCLUSIONS

In short, dsWLC can affordably provide the fluorescent contrast needed to improve the detection sensitivity of bladder cancer, thereby increasing the accessibility of BLC contrast for bladder cancer surveillance. The broader implications of this work suggest digital staining is a cost-effective alternative to contrast-based endoscopy for other clinical scenarios outside of urology that can democratize access to better healthcare.

Evaluation of the Diagnostic Efficacy of the AI-Based Software INF-M01 in Detecting Suspicious Areas of Bladder Cancer Using Cystoscopy Images

Background/Objectives: We aimed to evaluate the accuracy of the artificial intelligence (AI)-based software INF-M01 in diagnosing suspected bladder tumors using cystoscopy images. Additionally, we aimed to assess the ability of INF-M01 to distinguish and mark suspected bladder cancer using whole cystoscopy images. Methods: A randomized retrospective clinical trial was conducted using a total of 5670 cystoscopic images provided by three institutions, comprising 1890 images each (486 bladder cancer images and 1404 normal images). The images were randomly distributed into five sets (A-E), each containing 1890 photographs. INF-M01 analyzed the images in set A to evaluate sensitivity, specificity, and accuracy. Sets B to E were analyzed by INF-M01 and four urologists, who marked the suspected bladder tumors. The Dice coefficient was used to compare the ability to differentiate bladder tumors. Results: For set A, the sensitivity, specificity, accuracy, and 95% confidence intervals were 0.973 (0.955-0.984), 0.921 (0.906-0.934), and 0.934 (0.922-0.945), respectively. The mean value of the Dice coefficient of AI was 0.889 (0.873-0.927), while that of clinicians was 0.941 (0.903-0.963), indicating that AI showed a reliable ability to distinguish bladder tumors from normal bladder tissue. AI demonstrated a sensitivity similar to that of urologists (0.971 (0.971-0.983) vs. 0.921 (0.777-0.995)), but a lower specificity (0.920 (0.882-0.962) vs. 0.991 (0.984-0.996)) compared to the urologists. Conclusions: INF-M01 demonstrated satisfactory accuracy in the diagnosis of bladder tumors. Additionally, it displayed an ability to distinguish and mark tumor regions from normal bladder tissue, similar to that of urologists. These results suggest that AI has promising diagnostic capabilities and clinical utility for urologists.

Artificial intelligence application in the diagnosis and treatment of bladder cancer: advance, challenges, and opportunities

Bladder cancer (BC) is a serious and common malignant tumor of the urinary system. Accurate and convenient diagnosis and treatment of BC is a major challenge for the medical community. Due to the limited medical resources, the existing diagnosis and treatment protocols for BC without the assistance of artificial intelligence (AI) still have certain shortcomings. In recent years, with the development of AI technologies such as deep learning and machine learning, the maturity of AI has made it more and more applied to the medical field, including improving the speed and accuracy of BC diagnosis and providing more powerful treatment options and recommendations related to prognosis. Advances in medical imaging technology and molecular-level research have also contributed to the further development of such AI applications. However, due to differences in the sources of training information and algorithm design issues, there is still room for improvement in terms of accuracy and transparency for the broader use of AI in clinical practice. With the popularization of digitization of clinical information and the proposal of new algorithms, artificial intelligence is expected to learn more effectively and analyze similar cases more accurately and reliably, promoting the development of precision medicine, reducing resource consumption, and speeding up diagnosis and treatment. This review focuses on the application of artificial intelligence in the diagnosis and treatment of BC, points out some of the challenges it faces, and looks forward to its future development.

Stearoyl CoA desaturase inhibition can effectively induce apoptosis in bladder cancer stem cells

Bladder cancer stands as one of the most prevalent cancers worldwide. While our previous research confirmed the significant role of stearoyl-CoA desaturase (SCD) in bladder cancer, the underlying reasons for its abnormal overexpression remain largely unknown. Moreover, the distinct response to SCD inhibitors between cancer stem cells (CSCs) and adherent cultured cell lines lacks clear elucidation. Therefore, in this experiment, we aim to conduct an analysis and screening of the SCD transcription start site, further seeking critical transcription factors involved. Simultaneously, through experimental validation, we aim to explore the pivotal role of endoplasmic reticulum stress/unfolded protein response in drug sensitivity among cancer stem cells. Additionally, our RNA-seq and lipid metabolism analysis revealed the significant impact of nervonic acid on altering the proliferative capacity of bladder cancer cell lines.

Using artificial intelligence for bladder cancer detection during cystoscopy and its impact on clinical outcomes: a protocol for a systematic review and meta-analysis

INTRODUCTION

Cystoscopy has revolutionised the process of diagnosing bladder cancer leading to better categorisation of risk levels and more precise treatment plans. Nonetheless, concerns arise about the lack of uniformity among observers in predicting tumour stage and grade. To address these concerns, artificial intelligence (AI) is being incorporated into clinical settings to aid in the analysis of diagnostic and therapeutic images. The subsequent report outlines a systematic review and meta-analysis protocol aimed at evaluating the effectiveness of AI in predicting bladder cancer based on cystoscopic images.

METHODS AND ANALYSIS

Our systematic search will use databases including PubMed, MEDLINE, Embase and Cochrane. The articles published between May 2015 and April 2024 will be eligible for inclusion. For articles to be considered, they must employ AI for analysis of cystoscopic images to identify bladder cancer, present original data and be written in English. The protocol adheres to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocol 2015 checklist. Quality and bias risk across chosen studies will be evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 score.

ETHICS AND DISSEMINATION

Ethical clearance will not be necessary for conducting this systematic review since results will be disseminated through peer-reviewed publications and presentations at both national and international conferences.

PROSPERO REGISTRATION NUMBER

CRD42024528345.

Can artificial intelligence aid the urologists in detecting bladder cancer?

Introduction

The emergence of artificial intelligence (AI)-based support system endoscopy, including cystoscopy, has shown promising results by training deep learning algorithms with large datasets of images and videos. This AI-aided cystoscopy has the potential to significantly transform the urological practice by assisting the urologists in identifying malignant areas, especially considering the diverse appearance of these lesions.

Methods

Four databases, the PubMed, ProQuest, EBSCOHost, and ScienceDirect were searched, along with a manual hand search. Prospective and retrospective studies, experimental studies, cross-sectional studies, and case-control studies assessing the utilization of AI for the detection of bladder cancer through cystoscopy and comparing with the histopathology results as the reference standard were included. The following terms and their variants were used: "artificial intelligence," "cystoscopy," and "bladder cancer." The risk of bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. A random effects model was used to calculate the pooled sensitivity and specificity. The Moses-Littenberg model was used to derive the Summary Receiver Operating Characteristics (SROC) curve.

Results

Five studies were selected for the analysis. Pooled sensitivity and specificity were 0.953 (95% confidence interval [CI]: 0.908-0.976) and 0.957 (95% CI: 0.923-0.977), respectively. Pooled diagnostic odd ratio was 449.79 (95% CI: 12.42-887.17). SROC curve (area under the curve: 0.988, 95% CI: 0.982-0.994) indicated a strong discriminating power of AI-aided cystoscopy in differentiation normal or benign bladder lesions from the malignant ones.

Conclusions

Although the utilization of AI for aiding in the detection of bladder cancer through cystoscopy remains questionable, it has shown encouraging potential for enhancing the detection rates. Future studies should concentrate on identification of the patients groups which could derive maximum benefit from accurate identification of the bladder cancer, such as those with intermediate or high-risk invasive tumors.

Intraoperative detection of parathyroid glands using artificial intelligence: optimizing medical image training with data augmentation methods

BACKGROUND

Postoperative hypoparathyroidism is a major complication of thyroidectomy, occurring when the parathyroid glands are inadvertently damaged during surgery. Although intraoperative images are rarely used to train artificial intelligence (AI) because of its complex nature, AI may be trained to intraoperatively detect parathyroid glands using various augmentation methods. The purpose of this study was to train an effective AI model to detect parathyroid glands during thyroidectomy.

METHODS

Video clips of the parathyroid gland were collected during thyroid lobectomy procedures. Confirmed parathyroid images were used to train three types of datasets according to augmentation status: baseline, geometric transformation, and generative adversarial network-based image inpainting. The primary outcome was the average precision of the performance of AI in detecting parathyroid glands.

RESULTS

152 Fine-needle aspiration-confirmed parathyroid gland images were acquired from 150 patients who underwent unilateral lobectomy. The average precision of the AI model in detecting parathyroid glands based on baseline data was 77%. This performance was enhanced by applying both geometric transformation and image inpainting augmentation methods, with the geometric transformation data augmentation dataset showing a higher average precision (79%) than the image inpainting model (78.6%). When this model was subjected to external validation using a completely different thyroidectomy approach, the image inpainting method was more effective (46%) than both the geometric transformation (37%) and baseline (33%) methods.

CONCLUSION

This AI model was found to be an effective and generalizable tool in the intraoperative identification of parathyroid glands during thyroidectomy, especially when aided by appropriate augmentation methods. Additional studies comparing model performance and surgeon identification, however, are needed to assess the true clinical relevance of this AI model.

Application of artificial intelligence in the diagnosis and treatment of urinary tumors

Diagnosis and treatment of urological tumors, relying on auxiliary data such as medical imaging, while incorporating individual patient characteristics into treatment selection, has long been a key challenge in clinical medicine. Traditionally, clinicians used extensive experience for decision-making, but recent artificial intelligence (AI) advancements offer new solutions. Machine learning (ML) and deep learning (DL), notably convolutional neural networks (CNNs) in medical image recognition, enable precise tumor diagnosis and treatment. These technologies analyze complex medical image patterns, improving accuracy and efficiency. AI systems, by learning from vast datasets, reveal hidden features, offering reliable diagnostics and personalized treatment plans. Early detection is crucial for tumors like renal cell carcinoma (RCC), bladder cancer (BC), and Prostate Cancer (PCa). AI, coupled with data analysis, improves early detection and reduces misdiagnosis rates, enhancing treatment precision. AI's application in urological tumors is a research focus, promising a vital role in urological surgery with improved patient outcomes. This paper examines ML, DL in urological tumors, and AI's role in clinical decisions, providing insights for future AI applications in urological surgery.

Boundary guidance network for medical image segmentation

Accurate segmentation of the tumor area is crucial for the treatment and prognosis of patients with bladder cancer. Cystoscopy is the gold standard for diagnosing bladder tumors. However, The vast majority of current work uses deep learning to identify and segment tumors from CT and MRI findings, and rarely involves cystoscopy findings. Accurately segmenting bladder tumors remains a great challenge due to their diverse morphology and fuzzy boundaries. In order to solve the above problems, this paper proposes a medical image segmentation network with boundary guidance called boundary guidance network. This network combines local features extracted by CNNs and long-range dependencies between different levels inscribed by Parallel ViT, which can capture tumor features more effectively. The Boundary extracted module is designed to extract boundary features and utilize the boundary features to guide the decoding process. Foreground-background dual-channel decoding is performed by boundary integrated module. Experimental results on our proposed new cystoscopic bladder tumor dataset (BTD) show that our method can efficiently perform accurate segmentation of tumors and retain more boundary information, achieving an IoU score of 91.3%, a Hausdorff Distance of 10.43, an mAP score of 85.3%, and a F1 score of 94.8%. On BTD and three other public datasets, our model achieves the best scores compared to state-of-the-art methods, which proves the effectiveness of our model for common medical image segmentation.

Involving logical clinical knowledge into deep neural networks to improve bladder tumor segmentation

Segmentation of bladder tumors from medical radiographic images is of great significance for early detection, diagnosis and prognosis evaluation of bladder cancer. Deep Convolution Neural Networks (DCNNs) have been successfully used for bladder tumor segmentation, but the segmentation based on DCNN is data-hungry for model training and ignores clinical knowledge. From the clinical view, bladder tumors originate from the mucosal surface of bladder and must rely on the bladder wall to survive and grow. This clinical knowledge of tumor location is helpful to improve the bladder tumor segmentation. To achieve this, we propose a novel bladder tumor segmentation method, which incorporates the clinical logic rules of bladder tumor and bladder wall into DCNNs to harness the tumor segmentation. Clinical logical rules provide a semantic and human-readable knowledge representation and are easy for knowledge acquisition from clinicians. In addition, incorporating logical rules of clinical knowledge helps to reduce the data dependency of the segmentation network, and enables precise segmentation results even with limited number of annotated images. Experiments on bladder MR images collected from the collaborating hospital validate the effectiveness of the proposed bladder tumor segmentation method.

The expanding role of artificial intelligence in the histopathological diagnosis in urological oncology: a literature review

The ongoing growth of artificial intelligence (AI) involves virtually every aspect of oncologic care in medicine. Although AI is in its infancy, it has shown great promise in the diagnosis of oncologic urological conditions. This paper aims to explore the expanding role of artificial intelligence in the histopathological diagnosis in urological oncology. We conducted a focused review of the literature on AI in urological oncology, searching PubMed and Google Scholar for recent advancements in histopathological diagnosis using AI. Various keyword combinations were used to find relevant sources published before April 2nd, 2024. We approached this article by focusing on the impact of AI on common urological malignancies by incorporating the use of different AI algorithms. We targeted the capabilities of AI's potential in aiding urologists and pathologists in histological cancer diagnosis. Promising results suggest AI can enhance diagnosis and personalized patient care, yet further refinements are needed before widespread hospital adoption. AI is transforming urological oncology by improving histopathological diagnosis and patient care. This review highlights AI's advancements in diagnosing prostate, renal cell, and bladder cancer. It is anticipated that as AI becomes more integrated into clinical practice, it will have a greater influence on diagnosis and improve patient outcomes.

Comparative efficacy of Bacillus Calmette-Guérin instillation and radical cystectomy treatments for high-risk non-muscle-invasive urothelial cancer classified as high-grade T1 in initial and repeat transurethral resection of bladder tumor

Objective

To compare the differential therapeutic effects of Bacillus Calmette-Guérin (BCG) instillation and radical cystectomy (RC) for high-risk non-muscle-invasive urothelial cancer (NMIBC) classified as high-grade T1 in initial and repeat transurethral resection of bladder tumors (TURBT) and to construct a prediction model.

Methods

We retrospectively analyzed the clinical data of patients with malignant bladder tumors treated at the First Affiliated Hospital of Soochow University from January 2016 to December 2017 and compared the differences in 1-year, 2-year, 3-year, 5-year, and comprehensive overall survival (OS) and progression-free survival (PFS) between BCG instillation treatment and RC treatment. Survival curves were drawn to show differences in OS and PFS between the two groups. Concurrently, univariate and multivariate COX analyses were performed to identify risk factors affecting OS and PFS, and a nomogram was created.

Results

In total, 146 patients were included in the study, of whom 97 and 49 were in the BCG and RC groups, respectively. No statistical differences were observed in the 1- and 2-year OS and PFS between the two groups, whereas significant statistical differences were found in the 3-year, 5-year, and comprehensive OS and PFS. Survival curves also confirmed the statistical differences in OS and PFS between the BCG and RC groups. Multivariate COX analysis revealed that the treatment method, concomitant satellite lesions, and albumin-to-alkaline phosphatase ratio (AAPR) were independent risk factors affecting OS and PFS. The nomogram that was further plotted showed good predictive ability for OS and PFS.

Conclusion

For patients who exhibit high-level T1 pathology after both initial and repeat TURBT, especially those with low AAPR, and concomitant satellite lesions, choosing RC as a treatment method offers a better prognosis.

Enhancing bladder cancer diagnosis through transitional cell carcinoma polyp detection and segmentation: an artificial intelligence powered deep learning solution

Background

Bladder cancer, specifically transitional cell carcinoma (TCC) polyps, presents a significant healthcare challenge worldwide. Accurate segmentation of TCC polyps in cystoscopy images is crucial for early diagnosis and urgent treatment. Deep learning models have shown promise in addressing this challenge.

Methods

We evaluated deep learning architectures, including Unetplusplus_vgg19, Unet_vgg11, and FPN_resnet34, trained on a dataset of annotated cystoscopy images of low quality.

Results

The models showed promise, with Unetplusplus_vgg19 and FPN_resnet34 exhibiting precision of 55.40 and 57.41%, respectively, suitable for clinical application without modifying existing treatment workflows.

Conclusion

Deep learning models demonstrate potential in TCC polyp segmentation, even when trained on lower-quality images, suggesting their viability in improving timely bladder cancer diagnosis without impacting the current clinical processes.

A lightweight bladder tumor segmentation method based on attention mechanism

In the endoscopic images of bladder, accurate segmentation of different grade bladder tumor from blurred boundary regions and highly variable shapes is of great significance for doctors' diagnosis and patients' later treatment. We propose a nested attentional feature fusion segmentation network (NAFF-Net) based on the encoder-decoder structure formed by the combination of weighted pyramid pooling module (WPPM) and nested attentional feature fusion (NAFF). Among them, WPPM applies the cascade of atrous convolution to enhance the overall perceptual field while introducing adaptive weights to optimize multi-scale feature extraction, NAFF integrates deep semantic information into shallow feature maps, effectively focusing on edge and detail information in bladder tumor images. Additionally, a weighted mixed loss function is constructed to alleviate the impact of imbalance between positive and negative sample distribution on segmentation accuracy. Experiments illustrate the proposed NAFF-Net achieves better segmentation results compared to other mainstream models, with a MIoU of 84.05%, MPrecision of 91.52%, MRecall of 90.81%, and F1-score of 91.16%, and also achieves good results on the public datasets Kvasir-SEG and CVC-ClinicDB. Compared to other models, NAFF-Net has a smaller number of parameters, which is a significant advantage in model deployment.

Bioinformatics in urology - molecular characterization of pathophysiology and response to treatment

The application of bioinformatics has revolutionized the practice of medicine in the past 20 years. From early studies that uncovered subtypes of cancer to broad efforts spearheaded by the Cancer Genome Atlas initiative, the use of bioinformatics strategies to analyse high-dimensional data has provided unprecedented insights into the molecular basis of disease. In addition to the identification of disease subtypes - which enables risk stratification - informatics analysis has facilitated the identification of novel risk factors and drivers of disease, biomarkers of progression and treatment response, as well as possibilities for drug repurposing or repositioning; moreover, bioinformatics has guided research towards precision and personalized medicine. Implementation of specific computational approaches such as artificial intelligence, machine learning and molecular subtyping has yet to become widespread in urology clinical practice for reasons of cost, disruption of clinical workflow and need for prospective validation of informatics approaches in independent patient cohorts. Solving these challenges might accelerate routine integration of bioinformatics into clinical settings.

Harnessing Artificial Intelligence for Enhanced Renal Analysis: Automated Detection of Hydronephrosis and Precise Kidney Segmentation

Background and objective

Hydronephrosis is essential in the diagnosis of renal colic. We automated the detection of hydronephrosis from ultrasound images to standardize the therapy and reduce the misdiagnosis of renal colic.

Methods

Anonymously collected ultrasound images of human kidneys, both normal and hydronephrotic, were preprocessed for neural networks. Six "state of the art" models were trained and cross-validated for the detection of hydronephrosis, and two convolutional networks were used for kidney segmentation. In the testing phase, performance metrics included true positives, true negatives, false positives, false negatives, accuracy, and F1 score, while the evaluation of the segmentation task involved accuracy, precision, dice, jaccard, recall, and ASSD.

Key findings and limitations

A total of 523 sonographic kidney images (423 nonhydronephrotic and 100 hydronephrotic) were collected from three different ultrasound devices. After training on this dataset, all models were used to evaluate 200 new ultrasound kidney images (142 nonhydronephrotic and 58 hydronephrotic kidneys). The highest validation accuracy (98.5%) was achieved by the AlexNet model (GoogLeNet 97%, AlexNet_v2 96%, ResNet50 96%, ResNet101 97.5%, and ResNet152 95%). The deeplabv3_resnet50 and deeplabv3_resnet101 reached a dice coefficient of 94.74% and 94.48%, respectively, on the task of automated kidney segmentation. The study is limited by analyzing only hydronephrosis, but this specific focus enabled high detection accuracy.

Conclusions and clinical implications

We show that our automated ultrasound deep learning model can be trained and used to interpret and segmentate ultrasound images from different sources with high accuracy. This method will serve as an automated tool in the diagnostic algorithm of acute renal failure in the future.

Patient summary

Hydronephrosis is crucial in the diagnosis of renal colic. Recent advances in artificial intelligence allow automated detection of hydronephrosis in ultrasound images with high accuracy. These methods will help standardize the diagnosis and treatment renal colic.

A Fully Automated Artificial Intelligence System to Assist Pathologists' Diagnosis to Predict Histologically High-grade Urothelial Carcinoma from Digitized Urine Cytology Slides Using Deep Learning

BACKGROUND

Urine cytology, although a useful screening method for urothelial carcinoma, lacks sensitivity. As an emerging technology, artificial intelligence (AI) improved image analysis accuracy significantly.

OBJECTIVE

To develop a fully automated AI system to assist pathologists in the histological prediction of high-grade urothelial carcinoma (HGUC) from digitized urine cytology slides.

DESIGN, SETTING, AND PARTICIPANTS

We digitized 535 consecutive urine cytology slides for AI use. Among these slides, 181 were used for AI development, 39 were used as AI test data to identify HGUC by cell-level classification, and 315 were used as AI test data for slide-level classification.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

Out of the 315 slides, 171 were collected immediately prior to bladder biopsy or transurethral resection of bladder tumor, and then outcomes were compared with the histological presence of HGUC in the surgical specimen. The primary aim was to compare AI prediction of the histological presence of HGUC with the pathologist's histological diagnosis of HGUC. Secondary aims were to compare the time required for AI evaluation and concordance between the AI's classification and pathologist's cytology diagnosis.

RESULTS AND LIMITATIONS

The AI capability for predicting the histological presence of HGUC was 0.78 for the area under the curve. Comparing the AI predictive performance with pathologists' diagnosis, the AI sensitivity of 63% for histological HGUC prediction was superior to a pathologists' cytology sensitivity of 46% (p = 0.0037). On the contrary, there was no significant difference between the AI specificity of 83% and pathologists' specificity of 89% (p = 0.13), and AI accuracy of 74% and pathologists' accuracy of 68% (p = 0.08). The time required for AI evaluation was 139 s. With respect to the concordance between the AI prediction and pathologist's cytology diagnosis, the accuracy was 86%. Agreements with positive and negative findings were 92% and 84%, respectively.

CONCLUSIONS

We developed a fully automated AI system to assist pathologists' histological diagnosis of HGUC using digitized slides. This AI system showed significantly higher sensitivity than a board-certified cytopathologist and may assist pathologists in making urine cytology diagnoses, reducing their workload.

PATIENT SUMMARY

In this study, we present a deep learning-based artificial intelligence (AI) system that classifies urine cytology slides according to the Paris system. An automated AI system was developed and validated with 535 consecutive urine cytology slides. The AI predicted histological high-grade urothelial carcinoma from digitized urine cytology slides with superior sensitivity than pathologists, while maintaining comparable specificity and accuracy.

Identification of kidney stones in KUB X-ray images using VGG16 empowered with explainable artificial intelligence

A kidney stone is a solid formation that can lead to kidney failure, severe pain, and reduced quality of life from urinary system blockages. While medical experts can interpret kidney-ureter-bladder (KUB) X-ray images, specific images pose challenges for human detection, requiring significant analysis time. Consequently, developing a detection system becomes crucial for accurately classifying KUB X-ray images. This article applies a transfer learning (TL) model with a pre-trained VGG16 empowered with explainable artificial intelligence (XAI) to establish a system that takes KUB X-ray images and accurately categorizes them as kidney stones or normal cases. The findings demonstrate that the model achieves a testing accuracy of 97.41% in identifying kidney stones or normal KUB X-rays in the dataset used. VGG16 model delivers highly accurate predictions but lacks fairness and explainability in their decision-making process. This study incorporates the Layer-Wise Relevance Propagation (LRP) technique, an explainable artificial intelligence (XAI) technique, to enhance the transparency and effectiveness of the model to address this concern. The XAI technique, specifically LRP, increases the model's fairness and transparency, facilitating human comprehension of the predictions. Consequently, XAI can play an important role in assisting doctors with the accurate identification of kidney stones, thereby facilitating the execution of effective treatment strategies.

PolypMixNet: Enhancing semi-supervised polyp segmentation with polyp-aware augmentation

BACKGROUND

AI-assisted polyp segmentation in colonoscopy plays a crucial role in enabling prompt diagnosis and treatment of colorectal cancer. However, the lack of sufficient annotated data poses a significant challenge for supervised learning approaches. Existing semi-supervised learning methods also suffer from performance degradation, mainly due to task-specific characteristics, such as class imbalance in polyp segmentation.

PURPOSE

The purpose of this work is to develop an effective semi-supervised learning framework for accurate polyp segmentation in colonoscopy, addressing limited annotated data and class imbalance challenges.

METHODS

We proposed PolypMixNet, a semi-supervised framework, for colorectal polyp segmentation, utilizing novel augmentation techniques and a Mean Teacher architecture to improve model performance. PolypMixNet introduces the polyp-aware mixup (PolypMix) algorithm and incorporates dual-level consistency regularization. PolypMix addresses the class imbalance in colonoscopy datasets and enhances the diversity of training data. By performing a polyp-aware mixup on unlabeled samples, it generates mixed images with polyp context along with their artificial labels. A polyp-directed soft pseudo-labeling (PDSPL) mechanism was proposed to generate high-quality pseudo labels and eliminate the dilution of lesion features caused by mixup operations. To ensure consistency in the training phase, we introduce the PolypMix prediction consistency (PMPC) loss and PolypMix attention consistency (PMAC) loss, enforcing consistency at both image and feature levels. Code is available at https://github.com/YChienHung/PolypMix.

RESULTS

PolypMixNet was evaluated on four public colonoscopy datasets, achieving 88.97% Dice and 88.85% mIoU on the benchmark dataset of Kvasir-SEG. In scenarios where the labeled training data is limited to 15%, PolypMixNet outperforms the state-of-the-art semi-supervised approaches with a 2.88-point improvement in Dice. It also shows the ability to reach performance comparable to the fully supervised counterpart. Additionally, we conducted extensive ablation studies to validate the effectiveness of each module and highlight the superiority of our proposed approach.

CONCLUSION

PolypMixNet effectively addresses the challenges posed by limited annotated data and unbalanced class distributions in polyp segmentation. By leveraging unlabeled data and incorporating novel augmentation and consistency regularization techniques, our method achieves state-of-the-art performance. We believe that the insights and contributions presented in this work will pave the way for further advancements in semi-supervised polyp segmentation and inspire future research in the medical imaging domain.

Improving Respiratory Infection Diagnosis with Deep Learning and Combinatorial Fusion: A Two-Stage Approach Using Chest X-ray Imaging

The challenges of respiratory infections persist as a global health crisis, placing substantial stress on healthcare infrastructures and necessitating ongoing investigation into efficacious treatment modalities. The persistent challenge of respiratory infections, including COVID-19, underscores the critical need for enhanced diagnostic methodologies to support early treatment interventions. This study introduces an innovative two-stage data analytics framework that leverages deep learning algorithms through a strategic combinatorial fusion technique, aimed at refining the accuracy of early-stage diagnosis of such infections. Utilizing a comprehensive dataset compiled from publicly available lung X-ray images, the research employs advanced pre-trained deep learning models to navigate the complexities of disease classification, addressing inherent data imbalances through methodical validation processes. The core contribution of this work lies in its novel application of combinatorial fusion, integrating select models to significantly elevate diagnostic precision. This approach not only showcases the adaptability and strength of deep learning in navigating the intricacies of medical imaging but also marks a significant step forward in the utilization of artificial intelligence to improve outcomes in healthcare diagnostics. The study's findings illuminate the path toward leveraging technological advancements in enhancing diagnostic accuracies, ultimately contributing to the timely and effective treatment of respiratory diseases.

Multiple mask and boundary scoring R-CNN with cGAN data augmentation for bladder tumor segmentation in WLC videos

Automatic diagnosis systems capable of handling multiple pathologies are essential in clinical practice. This study focuses on enhancing precise lesion localization, classification and delineation in transurethral resection of bladder tumor (TURBT) to reduce cancer recurrence. Despite deep learning models success, medical applications face challenges like small and limited datasets and poor image characterization, including the absence lack of color/texture modeling. To address these issues, three solutions are proposed: (1) an improved texture-constrained version of the pix2pixHD cGAN for data augmentation, addressing the tradeoff of generating high-quality images with enough stochasticity using the Fréchet Inception Distance (FID) measure. (2) Introducing the Multiple Mask and Boundary Scoring R-CNN (MM&BS R-CNN), a new mask sub-net scheme where multiple masks are generated from the different levels of the mask sub-net pipeline, improving segmentation accuracy by including a new scoring module to refine object boundaries. (3) A novel accelerated training strategy based on the SGD optimizer with the second momentum. Experimental results show significant mAP improvements: the data generation scheme improves by more than 12 %; MM&BS R-CNN proposed architecture is responsible for an improvement of about 1.25 %, and the training algorithm based on the second-order momentum increases mAP by 2-3 %. The simultaneous use of all three proposals improved the state-of-the-art mAP by 17.44 %.

StoneNet: An Efficient Lightweight Model Based on Depthwise Separable Convolutions for Kidney Stone Detection from CT Images

Kidney stone disease is one of the most common and serious health problems in much of the world, leading to many hospitalizations with severe pain. Detecting small stones is difficult and time-consuming, so an early diagnosis of kidney disease is needed to prevent the loss of kidney failure. Recent advances in artificial intelligence (AI) found to be very successful in the diagnosis of various diseases in the biomedical field. However, existing models using deep networks have several problems, such as high computational cost, long training time, and huge parameters. Providing a low-cost solution for diagnosing kidney stones in a medical decision support system is of paramount importance. Therefore, in this study, we propose "StoneNet", a lightweight and high-performance model for the detection of kidney stones based on MobileNet using depthwise separable convolution. The proposed model includes a combination of global average pooling (GAP), batch normalization, dropout layer, and dense layers. Our study shows that using GAP instead of flattening layers greatly improves the robustness of the model by significantly reducing the parameters. The developed model is benchmarked against four pre-trained models as well as the state-of-the-art heavy model. The results show that the proposed model can achieve the highest accuracy of 97.98%, and only requires training and testing time of 996.88 s and 14.62 s. Several parameters, such as different batch sizes and optimizers, were considered to validate the proposed model. The proposed model is computationally faster and provides optimal performance than other considered models. Experiments on a large kidney dataset of 1799 CT images show that StoneNet has superior performance in terms of higher accuracy and lower complexity. The proposed model can assist the radiologist in faster diagnosis of kidney stones and has great potential for deployment in real-time applications.

Application of convolutional neural network-based endoscopic imaging in esophageal cancer or high-grade dysplasia: A systematic review and meta-analysis

BACKGROUND

Esophageal cancer is the seventh-most common cancer type worldwide, accounting for 5% of death from malignancy. Development of novel diagnostic techniques has facilitated screening, early detection, and improved prognosis. Convolutional neural network (CNN)-based image analysis promises great potential for diagnosing and determining the prognosis of esophageal cancer, enabling even early detection of dysplasia.

AIM

To conduct a meta-analysis of the diagnostic accuracy of CNN models for the diagnosis of esophageal cancer and high-grade dysplasia (HGD).

METHODS

PubMed, EMBASE, Web of Science and Cochrane Library databases were searched for articles published up to November 30, 2022. We evaluated the diagnostic accuracy of using the CNN model with still image-based analysis and with video-based analysis for esophageal cancer or HGD, as well as for the invasion depth of esophageal cancer. The pooled sensitivity, pooled specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and area under the curve (AUC) were estimated, together with the 95% confidence intervals (CI). A bivariate method and hierarchical summary receiver operating characteristic method were used to calculate the diagnostic test accuracy of the CNN model. Meta-regression and subgroup analyses were used to identify sources of heterogeneity.

RESULTS

A total of 28 studies were included in this systematic review and meta-analysis. Using still image-based analysis for the diagnosis of esophageal cancer or HGD provided a pooled sensitivity of 0.95 (95%CI: 0.92-0.97), pooled specificity of 0.92 (0.89-0.94), PLR of 11.5 (8.3-16.0), NLR of 0.06 (0.04-0.09), DOR of 205 (115-365), and AUC of 0.98 (0.96-0.99). When video-based analysis was used, a pooled sensitivity of 0.85 (0.77-0.91), pooled specificity of 0.73 (0.59-0.83), PLR of 3.1 (1.9-5.0), NLR of 0.20 (0.12-0.34), DOR of 15 (6-38) and AUC of 0.87 (0.84-0.90) were found. Prediction of invasion depth resulted in a pooled sensitivity of 0.90 (0.87-0.92), pooled specificity of 0.83 (95%CI: 0.76-0.88), PLR of 7.8 (1.9-32.0), NLR of 0.10 (0.41-0.25), DOR of 118 (11-1305), and AUC of 0.95 (0.92-0.96).

CONCLUSION

CNN-based image analysis in diagnosing esophageal cancer and HGD is an excellent diagnostic method with high sensitivity and specificity that merits further investigation in large, multicenter clinical trials.

General Overview of Artificial Intelligence for Interstitial Cystitis in Urology

Our understanding of interstitial cystitis/bladder pain syndrome (IC/BPS) has evolved over time. The diagnosis of IC/BPS is primarily based on symptoms such as urgency, frequency, and bladder or pelvic pain. While the exact causes of IC/BPS remain unclear, it is thought to involve several factors, including abnormalities in the bladder's urothelium, mast cell degranulation within the bladder, inflammation of the bladder, and altered innervation of the bladder. Treatment options include patient education, dietary and lifestyle modifications, medications, intravesical therapy, and surgical interventions. This review article provides insights into IC/BPS, including aspects of treatment, prognosis prediction, and emerging therapeutic options. Additionally, it explores the application of deep learning for diagnosing major diseases associated with IC/BPS.

Development and validation of a predictive model for the diagnosis of bladder tumors using narrow band imaging

PURPOSE

At present, the prediction of bladder tumor nature during cystoscopy is partially dependent on the clinician's own experience. Subjective factors may lead to excessive biopsy or delayed treatment. The purpose of our study is to establish a reliable model for predicting the nature of bladder tumors using narrow band imaging.

METHODS

From November 2021 to November 2022, the clinical data of 231 patients who required a cystoscopy were prospectively collected at our center. Cystoscopy was performed in 219 eligible patients, in which both tumor and vascular morphology characteristics were recorded. Pathological results were used as the diagnostic standard. A logistic regression analysis was used to screen out factors related to tumor pathology. Bootstrap resampling was used for internal validation. A total of 71 patients from four other centers served as an external validation cohort.

RESULTS

The following diagnostic factors were identified: tumor morphology (cauliflower-like or algae-like lesions), vascular morphology (dotted or circumferential vessels), tumor boundary (clear or unclear), and patients' symptoms (gross hematuria) and were included in the prediction model. The internal validation results showed that the area under the curve was 0.94 (95% CI 0.92-0.97), and the P value from the goodness-of-fit test was 0.97. After external validation, the results showed the area under the curve was 0.89 (95% CI 0.82-0.97) and the P value of the goodness-of-fit test was 0.24.

CONCLUSION

A diagnostic prediction nomogram was established for bladder cancer. The verification results showed that the prediction model has good prediction performance.

Semi-Supervised Bladder Tissue Classification in Multi-Domain Endoscopic Images

OBJECTIVE

Accurate visual classification of bladder tissue during Trans-Urethral Resection of Bladder Tumor (TURBT) procedures is essential to improve early cancer diagnosis and treatment. During TURBT interventions, White Light Imaging (WLI) and Narrow Band Imaging (NBI) techniques are used for lesion detection. Each imaging technique provides diverse visual information that allows clinicians to identify and classify cancerous lesions. Computer vision methods that use both imaging techniques could improve endoscopic diagnosis. We address the challenge of tissue classification when annotations are available only in one domain, in our case WLI, and the endoscopic images correspond to an unpaired dataset, i.e. there is no exact equivalent for every image in both NBI and WLI domains.

METHOD

We propose a semi-surprised Generative Adversarial Network (GAN)-based method composed of three main components: a teacher network trained on the labeled WLI data; a cycle-consistency GAN to perform unpaired image-to-image translation, and a multi-input student network. To ensure the quality of the synthetic images generated by the proposed GAN we perform a detailed quantitative, and qualitative analysis with the help of specialists.

CONCLUSION

The overall average classification accuracy, precision, and recall obtained with the proposed method for tissue classification are 0.90, 0.88, and 0.89 respectively, while the same metrics obtained in the unlabeled domain (NBI) are 0.92, 0.64, and 0.94 respectively. The quality of the generated images is reliable enough to deceive specialists.

SIGNIFICANCE

This study shows the potential of using semi-supervised GAN-based bladder tissue classification when annotations are limited in multi-domain data.

KD_ConvNeXt: knowledge distillation-based image classification of lung tumor surgical specimen sections

Introduction: Lung cancer is currently among the most prevalent and lethal cancers in the world in terms of incidence and fatality rates. In clinical practice, identifying the specific subtypes of lung cancer is essential in diagnosing and treating lung lesions. Methods: This paper aims to collect histopathological section images of lung tumor surgical specimens to construct a clinical dataset for researching and addressing the classification problem of specific subtypes of lung tumors. Our method proposes a teacher-student network architecture based on a knowledge distillation mechanism for the specific subtype classification of lung tumor histopathological section images to assist clinical applications, namely KD_ConvNeXt. The proposed approach enables the student network (ConvNeXt) to extract knowledge from the intermediate feature layers of the teacher network (Swin Transformer), improving the feature extraction and fitting capabilities of ConvNeXt. Meanwhile, Swin Transformer provides soft labels containing information about the distribution of images in various categories, making the model focused more on the information carried by types with smaller sample sizes while training. Results: This work has designed many experiments on a clinical lung tumor image dataset, and the KD_ConvNeXt achieved a superior classification accuracy of 85.64% and an F1-score of 0.7717 compared with other advanced image classification methods.

Efficient Augmented Intelligence Framework for Bladder Lesion Detection

PURPOSE

Development of intelligence systems for bladder lesion detection is cost intensive. An efficient strategy to develop such intelligence solutions is needed.

MATERIALS AND METHODS

We used four deep learning models (ConvNeXt, PlexusNet, MobileNet, and SwinTransformer) covering a variety of model complexity and efficacy. We trained these models on a previously published educational cystoscopy atlas (n = 312 images) to estimate the ratio between normal and cancer scores and externally validated on cystoscopy videos from 68 cases, with region of interest (ROI) pathologically confirmed to be benign and cancerous bladder lesions (ie, ROI). The performance measurement included specificity and sensitivity at frame level, frame sequence (block) level, and ROI level for each case.

RESULTS

Specificity was comparable between four models at frame (range, 30.0%-44.8%) and block levels (56%-67%). Although sensitivity at the frame level (range, 81.4%-88.1%) differed between the models, sensitivity at the block level (100%) and ROI level (100%) was comparable between these models. MobileNet and PlexusNet were computationally more efficient for real-time ROI detection than ConvNeXt and SwinTransformer.

CONCLUSION

Educational cystoscopy atlas and efficient models facilitate the development of real-time intelligence system for bladder lesion detection.

Tumor detection under cystoscopy with transformer-augmented deep learning algorithm

Objective.Accurate tumor detection is critical in cystoscopy to improve bladder cancer resection and decrease recurrence. Advanced deep learning algorithms hold the potential to improve the performance of standard white-light cystoscopy (WLC) in a noninvasive and cost-effective fashion. The purpose of this work is to develop a cost-effective, transformer-augmented deep learning algorithm for accurate detection of bladder tumors in WLC and to assess its performance on archived patient data.Approach.'CystoNet-T', a deep learning-based bladder tumor detector, was developed with a transformer-augmented pyramidal CNN architecture to improve automated tumor detection of WLC. CystoNet-T incorporated the self-attention mechanism by attaching transformer encoder modules to the pyramidal layers of the feature pyramid network (FPN), and obtained multi-scale activation maps with global features aggregation. Features resulting from context augmentation served as the input to a region-based detector to produce tumor detection predictions. The training set was constructed by 510 WLC frames that were obtained from cystoscopy video sequences acquired from 54 patients. The test set was constructed based on 101 images obtained from WLC sequences of 13 patients.Main results.CystoNet-T was evaluated on the test set with 96.4 F1 and 91.4 AP (Average Precision). This result improved the benchmark of Faster R-CNN and YOLO by 7.3 points in F1 and 3.8 points in AP. The improvement is attributed to the strong ability of global attention of CystoNet-T and better feature learning of the pyramids architecture throughout the training. The model was found to be particularly effective in highlighting the foreground information for precise localization of the true positives while favorably avoiding false alarmsSignificance.We have developed a deep learning algorithm that accurately detects bladder tumors in WLC. Transformer-augmented AI framework promises to aid in clinical decision-making for improved bladder cancer diagnosis and therapeutic guidance.

A Brief Review of Artificial Intelligence in Genitourinary Oncological Imaging

Genitourinary (GU) system is among the most commonly involved malignancy sites in the human body. Imaging plays a crucial role not only in diagnosis of cancer but also in disease management and its prognosis. However, interpretation of conventional imaging methods such as CT or MR imaging (MRI) usually demonstrates variability across different readers and institutions. Artificial intelligence (AI) has emerged as a promising technology that could improve the patient care by providing helpful input to human readers through lesion detection algorithms and lesion classification systems. Moreover, the robustness of these models may be valuable in automating time-consuming tasks such as organ and lesion segmentations. Herein, we review the current state of imaging and existing challenges in GU malignancies, particularly for cancers of prostate, kidney and bladder; and briefly summarize the recent AI-based solutions to these challenges.

Machine learning applications for early detection of esophageal cancer: a systematic review

INTRODUCTION

Esophageal cancer (EC) is a significant global health problem, with an estimated 7th highest incidence and 6th highest mortality rate. Timely diagnosis and treatment are critical for improving patients' outcomes, as over 40% of patients with EC are diagnosed after metastasis. Recent advances in machine learning (ML) techniques, particularly in computer vision, have demonstrated promising applications in medical image processing, assisting clinicians in making more accurate and faster diagnostic decisions. Given the significance of early detection of EC, this systematic review aims to summarize and discuss the current state of research on ML-based methods for the early detection of EC.

METHODS

We conducted a comprehensive systematic search of five databases (PubMed, Scopus, Web of Science, Wiley, and IEEE) using search terms such as "ML", "Deep Learning (DL (", "Neural Networks (NN)", "Esophagus", "EC" and "Early Detection". After applying inclusion and exclusion criteria, 31 articles were retained for full review.

RESULTS

The results of this review highlight the potential of ML-based methods in the early detection of EC. The average accuracy of the reviewed methods in the analysis of endoscopic and computed tomography (CT (images of the esophagus was over 89%, indicating a high impact on early detection of EC. Additionally, the highest percentage of clinical images used in the early detection of EC with the use of ML was related to white light imaging (WLI) images. Among all ML techniques, methods based on convolutional neural networks (CNN) achieved higher accuracy and sensitivity in the early detection of EC compared to other methods.

CONCLUSION

Our findings suggest that ML methods may improve accuracy in the early detection of EC, potentially supporting radiologists, endoscopists, and pathologists in diagnosis and treatment planning. However, the current literature is limited, and more studies are needed to investigate the clinical applications of these methods in early detection of EC. Furthermore, many studies suffer from class imbalance and biases, highlighting the need for validation of detection algorithms across organizations in longitudinal studies.

Real-time Detection of Bladder Cancer Using Augmented Cystoscopy with Deep Learning: a Pilot Study

BACKGROUND

Detection of bladder tumors under white light cystoscopy (WLC) is challenging yet impactful on treatment outcomes. Artificial intelligence (AI) holds the potential to improve tumor detection; however, its application in the real-time setting remains unexplored. AI has been applied to previously recorded images for post hoc analysis. In this study, we evaluate the feasibility of real-time AI integration during clinic cystoscopy and transurethral resection of bladder tumor (TURBT) on live, streaming video.

METHODS

Patients undergoing clinic flexible cystoscopy and TURBT were prospectively enrolled. A real-time alert device system (real-time CystoNet) was developed and integrated with standard cystoscopy towers. Streaming videos were processed in real time to display alert boxes in sync with live cystoscopy. The per-frame diagnostic accuracy was measured.

RESULTS AND LIMITATIONS

Real-time CystoNet was successfully integrated in the operating room during TURBT and clinic cystoscopy in 50 consecutive patients. There were 55 procedures that met the inclusion criteria for analysis including 21 clinic cystoscopies and 34 TURBTs. For clinic cystoscopy, real-time CystoNet achieved per-frame tumor specificity of 98.8% with a median error rate of 3.6% (range: 0 - 47%) frames per cystoscopy. For TURBT, the per-frame tumor sensitivity was 52.9% and the per-frame tumor specificity was 95.4% with an error rate of 16.7% for cases with pathologically confirmed bladder cancers.

CONCLUSIONS

The current pilot study demonstrates the feasibility of using a real-time AI system (real-time CystoNet) during cystoscopy and TURBT to generate active feedback to the surgeon. Further optimization of CystoNet for real-time cystoscopy dynamics may allow for clinically useful AI-augmented cystoscopy.

Artificial Intelligence in the Advanced Diagnosis of Bladder Cancer-Comprehensive Literature Review and Future Advancement

Artificial intelligence is highly regarded as the most promising future technology that will have a great impact on healthcare across all specialties. Its subsets, machine learning, deep learning, and artificial neural networks, are able to automatically learn from massive amounts of data and can improve the prediction algorithms to enhance their performance. This area is still under development, but the latest evidence shows great potential in the diagnosis, prognosis, and treatment of urological diseases, including bladder cancer, which are currently using old prediction tools and historical nomograms. This review focuses on highly significant and comprehensive literature evidence of artificial intelligence in the management of bladder cancer and investigates the near introduction in clinical practice.

Conceptual framework and documentation standards of cystoscopic media content for artificial intelligence

BACKGROUND

The clinical documentation of cystoscopy includes visual and textual materials. However, the secondary use of visual cystoscopic data for educational and research purposes remains limited due to inefficient data management in routine clinical practice.

METHODS

A conceptual framework was designed to document cystoscopy in a standardized manner with three major sections: data management, annotation management, and utilization management. A Swiss-cheese model was proposed for quality control and root cause analyses. We defined the infrastructure required to implement the framework with respect to FAIR (findable, accessible, interoperable, reusable) principles. We applied two scenarios exemplifying data sharing for research and educational projects to ensure compliance with FAIR principles.

RESULTS

The framework was successfully implemented while following FAIR principles. The cystoscopy atlas produced from the framework could be presented in an educational web portal; a total of 68 full-length qualitative videos and corresponding annotation data were sharable for artificial intelligence projects covering frame classification and segmentation problems at case, lesion, and frame levels.

CONCLUSION

Our study shows that the proposed framework facilitates the storage of visual documentation in a standardized manner and enables FAIR data for education and artificial intelligence research.

Intravesical Bladder Treatment and Deep Learning Applications to Improve Irritative Voiding Symptoms Caused by Interstitial Cystitis: A Literature Review

Our comprehension of interstitial cystitis/painful bladder syndrome (IC/PBS) has evolved over time. The term painful bladder syndrome, preferred by the International Continence Society, is characterized as "a syndrome marked by suprapubic pain during bladder filling, alongside increased daytime and nighttime frequency, in the absence of any proven urinary infection or other pathology." The diagnosis of IC/PBS primarily relies on symptoms of urgency/frequency and bladder/pelvic pain. The exact pathogenesis of IC/PBS remains a mystery, but it is postulated to be multifactorial. Theories range from bladder urothelial abnormalities, mast cell degranulation in the bladder, bladder inflammation, to altered bladder innervation. Therapeutic strategies encompass patient education, dietary and lifestyle modifications, medication, intravesical therapy, and surgical intervention. This article delves into the diagnosis, treatment, and prognosis prediction of IC/PBS, presenting the latest research findings, artificial intelligence technology applications in diagnosing major diseases in IC/PBS, and emerging treatment alternatives.

Deep Learning Models for Cystoscopic Recognition of Hunner Lesion in Interstitial Cystitis

Background

Accurate cystoscopic recognition of Hunner lesions (HLs) is indispensable for better treatment prognosis in managing patients with Hunner-type interstitial cystitis (HIC), but frequently challenging due to its varying appearance.

Objective

To develop a deep learning (DL) system for cystoscopic recognition of a HL using artificial intelligence (AI).

Design setting and participants

A total of 626 cystoscopic images collected from January 8, 2019 to December 24, 2020, consisting of 360 images of HLs from 41 patients with HIC and 266 images of flat reddish mucosal lesions resembling HLs from 41 control patients including those with bladder cancer and other chronic cystitis, were used to create a dataset with an 8:2 ratio of training images and test images for transfer learning and external validation, respectively. AI-based five DL models were constructed, using a pretrained convolutional neural network model that was retrained to output 1 for a HL and 0 for control. A five-fold cross-validation method was applied for internal validation.

Outcome measurements and statistical analysis

True- and false-positive rates were plotted as a receiver operating curve when the threshold changed from 0 to 1. Accuracy, sensitivity, and specificity were evaluated at a threshold of 0.5. Diagnostic performance of the models was compared with that of urologists as a reader study.

Results and limitations

The mean area under the curve of the models reached 0.919, with mean sensitivity of 81.9% and specificity of 85.2% in the test dataset. In the reader study, the mean accuracy, sensitivity, and specificity were, respectively, 83.0%, 80.4%, and 85.6% for the models, and 62.4%, 79.6%, and 45.2% for expert urologists. Limitations include the diagnostic nature of a HL as warranted assertibility.

Conclusions

We constructed the first DL system that recognizes HLs with accuracy exceeding that of humans. This AI-driven system assists physicians with proper cystoscopic recognition of a HL.

Patient summary

In this diagnostic study, we developed a deep learning system for cystoscopic recognition of Hunner lesions in patients with interstitial cystitis. The mean area under the curve of the constructed system reached 0.919 with mean sensitivity of 81.9% and specificity of 85.2%, demonstrating diagnostic accuracy exceeding that of human expert urologists in detecting Hunner lesions. This deep learning system assists physicians with proper diagnosis of a Hunner lesion.

Conceptual Framework and Documentation Standards of Cystoscopic Media Content for Artificial Intelligence

BACKGROUND

The clinical documentation of cystoscopy includes visual and textual materials. However, the secondary use of visual cystoscopic data for educational and research purposes remains limited due to inefficient data management in routine clinical practice.

METHODS

A conceptual framework was designed to document cystoscopy in a standardized manner with three major sections: data management, annotation management, and utilization management. A Swiss-cheese model was proposed for quality control and root cause analyses. We defined the infrastructure required to implement the framework with respect to FAIR (findable, accessible, interoperable, re-usable) principles. We applied two scenarios exemplifying data sharing for research and educational projects to ensure the compliance with FAIR principles.

RESULTS

The framework was successfully implemented while following FAIR principles. The cystoscopy atlas produced from the framework could be presented in an educational web portal; a total of 68 full-length qualitative videos and corresponding annotation data were sharable for artificial intelligence projects covering frame classification and segmentation problems at case, lesion and frame levels.

CONCLUSION

Our study shows that the proposed framework facilitates the storage of the visual documentation in a standardized manner and enables FAIR data for education and artificial intelligence research.

Cross-attention multi-branch CNN using DCE-MRI to classify breast cancer molecular subtypes

Purpose

The aim of this study is to improve the accuracy of classifying luminal or non-luminal subtypes of breast cancer by using computer algorithms based on DCE-MRI, and to validate the diagnostic efficacy of the model by considering the patient's age of menarche and nodule size.

Methods

DCE-MRI images of patients with non-specific invasive breast cancer admitted to the Second Affiliated Hospital of Dalian Medical University were collected. There were 160 cases in total, with 84 cases of luminal type (luminal A and luminal B and 76 cases of non-luminal type (HER 2 overexpressing and triple negative). Patients were grouped according to thresholds of nodule sizes of 20 mm and age at menarche of 14 years. A cross-attention multi-branch net CAMBNET) was proposed based on the dataset to predict the molecular subtypes of breast cancer. Diagnostic performance was assessed by accuracy, sensitivity, specificity, F1 and area under the ROC curve (AUC). And the model is visualized with Grad-CAM.

Results

Several classical deep learning models were included for diagnostic performance comparison. Using 5-fold cross-validation on the test dataset, all the results of CAMBNET are significantly higher than the compared deep learning models. The average prediction recall, accuracy, precision, and AUC for luminal and non-luminal types of the dataset were 89.11%, 88.44%, 88.52%, and 96.10%, respectively. For patients with tumor size <20 mm, the CAMBNET had AUC of 83.45% and ACC of 90.29% for detecting triple-negative breast cancer. When classifying luminal from non-luminal subtypes for patients with age at menarche years, our CAMBNET model achieved an ACC of 92.37%, precision of 92.42%, recall of 93.33%, F1of 92.33%, and AUC of 99.95%.

Conclusions

The CAMBNET can be applied in molecular subtype classification of breasts. For patients with menarche at 14 years old, our model can yield more accurate results when classifying luminal and non-luminal subtypes. For patients with tumor sizes ≤20 mm, our model can yield more accurate result in detecting triple-negative breast cancer to improve patient prognosis and survival.

Where do we stand in AI for endoscopic image analysis? Deciphering gaps and future directions

Recent developments in deep learning have enabled data-driven algorithms that can reach human-level performance and beyond. The development and deployment of medical image analysis methods have several challenges, including data heterogeneity due to population diversity and different device manufacturers. In addition, more input from experts is required for a reliable method development process. While the exponential growth in clinical imaging data has enabled deep learning to flourish, data heterogeneity, multi-modality, and rare or inconspicuous disease cases still need to be explored. Endoscopy being highly operator-dependent with grim clinical outcomes in some disease cases, reliable and accurate automated system guidance can improve patient care. Most designed methods must be more generalisable to the unseen target data, patient population variability, and variable disease appearances. The paper reviews recent works on endoscopic image analysis with artificial intelligence (AI) and emphasises the current unmatched needs in this field. Finally, it outlines the future directions for clinically relevant complex AI solutions to improve patient outcomes.

Accurate Diagnosis and Survival Prediction of Bladder Cancer Using Deep Learning on Histological Slides

(1) Background: Early diagnosis and treatment are essential to reduce the mortality rate of bladder cancer (BLCA). We aimed to develop deep learning (DL)-based weakly supervised models for the diagnosis of BLCA and prediction of overall survival (OS) in muscle-invasive bladder cancer (MIBC) patients using whole slide digitized histological images (WSIs). (2) Methods: Diagnostic and prognostic models were developed using 926 WSIs of 412 BLCA patients from The Cancer Genome Atlas cohort. We collected 250 WSIs of 150 BLCA patients from the Renmin Hospital of Wuhan University cohort for external validation of the models. Two DL models were developed: a BLCA diagnostic model (named BlcaMIL) and an MIBC prognostic model (named MibcMLP). (3) Results: The BlcaMIL model identified BLCA with accuracy 0.987 in the external validation set, comparable to that of expert uropathologists and outperforming a junior pathologist. The C-index values for the MibcMLP model on the internal and external validation sets were 0.631 and 0.622, respectively. The risk score predicted by MibcMLP was a strong predictor independent of existing clinical or histopathologic indicators, as demonstrated by univariate Cox (HR = 2.390, p < 0.0001) and multivariate Cox (HR = 2.414, p < 0.0001) analyses. The interpretability of DL models can help in the analysis of critical regions associated with tumors to enrich the information obtained from WSIs. Furthermore, the expression of six genes (ANAPC7, MAPKAPK5, COX19, LINC01106, AL161431.1 and MYO16-AS1) was significantly associated with MibcMLP-predicted risk scores, revealing possible potential biological correlations. (4) Conclusions: Our study developed DL models for accurately diagnosing BLCA and predicting OS in MIBC patients, which will help promote the precise pathological diagnosis of BLCA and risk stratification of MIBC to improve clinical treatment decisions.

A Comparative Study of Deep Neural Networks for Real-Time Semantic Segmentation during the Transurethral Resection of Bladder Tumors

Bladder cancer is a common and often fatal disease. Papillary bladder tumors are well detectable using cystoscopic imaging, but small or flat lesions are frequently overlooked by urologists. However, detection accuracy can be improved if the images from the cystoscope are segmented in real time by a deep neural network (DNN). In this paper, we compare eight state-of-the-art DNNs for the semantic segmentation of white-light cystoscopy images: U-Net, UNet++, MA-Net, LinkNet, FPN, PAN, DeepLabv3, and DeepLabv3+. The evaluation includes per-image classification accuracy, per-pixel localization accuracy, prediction speed, and model size. Results show that the best F-score for bladder cancer (91%), the best segmentation map precision (92.91%), and the lowest size (7.93 MB) are also achieved by the PAN model, while the highest speed (6.73 ms) is obtained by DeepLabv3+. These results indicate better tumor localization accuracy than reported in previous studies. It can be concluded that deep neural networks may be extremely useful in the real-time diagnosis and therapy of bladder cancer, and among the eight investigated models, PAN shows the most promising results.

Deep learning diagnostics for bladder tumor identification and grade prediction using RGB method

We evaluate the diagnostic performance of deep learning artificial intelligence (AI) for bladder cancer, which used white-light images (WLIs) and narrow-band images, and tumor grade prediction of AI based on tumor color using the red/green/blue (RGB) method. This retrospective study analyzed 10,991 cystoscopic images of suspicious bladder tumors using a mask region-based convolutional neural network with a ResNeXt-101-32 × 8d-FPN backbone. The diagnostic performance of AI was evaluated by calculating sensitivity, specificity, and diagnostic accuracy, and its ability to detect cancers was investigated using the dice score coefficient (DSC). Using the support vector machine model, we analyzed differences in tumor colors according to tumor grade using the RGB method. The sensitivity, specificity, diagnostic accuracy and DSC of AI were 95.0%, 93.7%, 94.1% and 74.7%. In WLIs, there were differences in red and blue values according to tumor grade (p < 0.001). According to the average RGB value, the performance was ≥ 98% for the diagnosis of benign vs. low-and high-grade tumors using WLIs and > 90% for the diagnosis of chronic non-specific inflammation vs. carcinoma in situ using WLIs. The diagnostic performance of the AI-assisted diagnosis was of high quality, and the AI could distinguish the tumor grade based on tumor color.

Predicting Recurrence of Non-Muscle-Invasive Bladder Cancer: Current Techniques and Future Trends

Bladder cancer (BC) is the 10th most common cancer globally and has a high mortality rate if not detected early and treated promptly. Non-muscle-invasive BC (NMIBC) is a subclassification of BC associated with high rates of recurrence and progression. Current tools for predicting recurrence and progression on NMIBC use scoring systems based on clinical and histopathological markers. These exclude other potentially useful biomarkers which could provide a more accurate personalized risk assessment. Future trends are likely to use artificial intelligence (AI) to enhance the prediction of recurrence in patients with NMIBC and decrease the use of standard clinical protocols such as cystoscopy and cytology. Here, we provide a comprehensive survey of the most recent studies from the last decade (N = 70 studies), focused on the prediction of patient outcomes in NMIBC, particularly recurrence, using biomarkers such as radiomics, histopathology, clinical, and genomics. The value of individual and combined biomarkers is discussed in detail with the goal of identifying future trends that will lead to the personalized management of NMIBC.