Artificial intelligence at the intersection of pathology and radiology in prostate cancer

From molecular mechanisms of prostate cancer to translational applications: based on multi-omics fusion analysis and intelligent medicine

Prostate cancer is the most common cancer in men worldwide and has a high mortality rate. The complex and heterogeneous development of prostate cancer has become a core obstacle in the treatment of prostate cancer. Simultaneously, the issues of overtreatment in early-stage diagnosis, oligometastasis and dormant tumor recognition, as well as personalized drug utilization, are also specific concerns that require attention in the clinical management of prostate cancer. Some typical genetic mutations have been proved to be associated with prostate cancer's initiation and progression. However, single-omic studies usually are not able to explain the causal relationship between molecular alterations and clinical phenotypes. Exploration from a systems genetics perspective is also lacking in this field, that is, the impact of gene network, the environmental factors, and even lifestyle behaviors on disease progression. At the meantime, current trend emphasizes the utilization of artificial intelligence (AI) and machine learning techniques to process extensive multidimensional data, including multi-omics. These technologies unveil the potential patterns, correlations, and insights related to diseases, thereby aiding the interpretable clinical decision making and applications, namely intelligent medicine. Therefore, there is a pressing need to integrate multidimensional data for identification of molecular subtypes, prediction of cancer progression and aggressiveness, along with perosonalized treatment performing. In this review, we systematically elaborated the landscape from molecular mechanism discovery of prostate cancer to clinical translational applications. We discussed the molecular profiles and clinical manifestations of prostate cancer heterogeneity, the identification of different states of prostate cancer, as well as corresponding precision medicine practices. Taking multi-omics fusion, systems genetics, and intelligence medicine as the main perspectives, the current research results and knowledge-driven research path of prostate cancer were summarized.

Advancing Precision Medicine: Algebraic Topology and Differential Geometry in Radiology and Computational Pathology

Precision medicine aims to provide personalized care based on individual patient characteristics, rather than guideline-directed therapies for groups of diseases or patient demographics. Images-both radiology- and pathology-derived-are a major source of information on presence, type, and status of disease. Exploring the mathematical relationship of pixels in medical imaging ("radiomics") and cellular-scale structures in digital pathology slides ("pathomics") offers powerful tools for extracting both qualitative and, increasingly, quantitative data. These analytical approaches, however, may be significantly enhanced by applying additional methods arising from fields of mathematics such as differential geometry and algebraic topology that remain underexplored in this context. Geometry's strength lies in its ability to provide precise local measurements, such as curvature, that can be crucial for identifying abnormalities at multiple spatial levels. These measurements can augment the quantitative features extracted in conventional radiomics, leading to more nuanced diagnostics. By contrast, topology serves as a robust shape descriptor, capturing essential features such as connected components and holes. The field of topological data analysis was initially founded to explore the shape of data, with functional network connectivity in the brain being a prominent example. Increasingly, its tools are now being used to explore organizational patterns of physical structures in medical images and digitized pathology slides. By leveraging tools from both differential geometry and algebraic topology, researchers and clinicians may be able to obtain a more comprehensive, multi-layered understanding of medical images and contribute to precision medicine's armamentarium.

Molecular Pathology of Prostate Cancer

Molecular profiling studies have shed new light on the complex biology of prostate cancer. Genomic studies have highlighted that structural rearrangements are among the most common recurrent alterations. In addition, both germline and somatic mutations in DNA repair genes are enriched in patients with advanced disease. Primary prostate cancer has long been known to be multifocal, but recent studies demonstrate that a large fraction of prostate cancer shows evidence of multiclonality, suggesting that genetically distinct, independently arising tumor clones coexist. Metastatic prostate cancer shows a high level of morphologic and molecular diversity, which is associated with resistance to systemic therapies. The resulting high level of intratumoral heterogeneity has important implications for diagnosis and poses major challenges for the implementation of molecular studies. Here we provide a concise review of the molecular pathology of prostate cancer, highlight clinically relevant alterations, and discuss opportunities for molecular testing.

Healthcare Transformation: Artificial Intelligence Is the Dire Imperative of the Day

At present, healthcare systems around the world are confronted with unprecedented challenges caused by aging demographics, increasing chronic diseases, and resource challenges. In this scenario, artificial intelligence (AI) emerges as a disruptive technology that can provide solutions to these complicated problems. This review article outlines the vital role played by AI in altering the health landscape. The constant demand for effective and accessible healthcare demands the use of new solutions. AI can be described as an important imperative, enabling advancements in many areas of the delivery of healthcare. This review article explores the possibilities of use of AI to aid in the field of healthcare assistants, diagnosing, disease prediction, and personalized treatment and the discovery of drugs, telemedicine and remote monitoring of patients, robotic-assisted procedures imaging for pathology and radiology analysis, and the analysis of genomic data. By analyzing the existing research and cases, we explain how AI-driven technology can optimize processes in healthcare, improve diagnosis accuracy, improve the quality of treatment, and simplify administrative tasks. By highlighting the most successful AI applications and laying out possible future developments, the review article will provide insight for healthcare professionals, policymakers, researchers, and other stakeholders in harnessing the power of AI to transform healthcare delivery and enhance the quality of care for patients.

Exploring the efficacy of multi-flavored feature extraction with radiomics and deep features for prostate cancer grading on mpMRI

BACKGROUND

The purpose of this study is to investigate the use of radiomics and deep features obtained from multiparametric magnetic resonance imaging (mpMRI) for grading prostate cancer. We propose a novel approach called multi-flavored feature extraction or tensor, which combines four mpMRI images using eight different fusion techniques to create 52 images or datasets for each patient. We evaluate the effectiveness of this approach in grading prostate cancer and compare it to traditional methods.

METHODS

We used the PROSTATEx-2 dataset consisting of 111 patients' images from T2W-transverse, T2W-sagittal, DWI, and ADC images. We used eight fusion techniques to merge T2W, DWI, and ADC images, namely Laplacian Pyramid, Ratio of the low-pass pyramid, Discrete Wavelet Transform, Dual-Tree Complex Wavelet Transform, Curvelet Transform, Wavelet Fusion, Weighted Fusion, and Principal Component Analysis. Prostate cancer images were manually segmented, and radiomics features were extracted using the Pyradiomics library in Python. We also used an Autoencoder for deep feature extraction. We used five different feature sets to train the classifiers: all radiomics features, all deep features, radiomics features linked with PCA, deep features linked with PCA, and a combination of radiomics and deep features. We processed the data, including balancing, standardization, PCA, correlation, and Least Absolute Shrinkage and Selection Operator (LASSO) regression. Finally, we used nine classifiers to classify different Gleason grades.

RESULTS

Our results show that the SVM classifier with deep features linked with PCA achieved the most promising results, with an AUC of 0.94 and a balanced accuracy of 0.79. Logistic regression performed best when using only the deep features, with an AUC of 0.93 and balanced accuracy of 0.76. Gaussian Naive Bayes had lower performance compared to other classifiers, while KNN achieved high performance using deep features linked with PCA. Random Forest performed well with the combination of deep features and radiomics features, achieving an AUC of 0.94 and balanced accuracy of 0.76. The Voting classifiers showed higher performance when using only the deep features, with Voting 2 achieving the highest performance, with an AUC of 0.95 and balanced accuracy of 0.78.

CONCLUSION

Our study concludes that the proposed multi-flavored feature extraction or tensor approach using radiomics and deep features can be an effective method for grading prostate cancer. Our findings suggest that deep features may be more effective than radiomics features alone in accurately classifying prostate cancer.

A Narrative Review of the Use of Artificial Intelligence in Breast, Lung, and Prostate Cancer

Artificial intelligence (AI) has been an important topic within radiology. Currently, AI is used clinically to assist with the detection of lesions through detection systems. However, a number of recent studies have demonstrated the increased value of neural networks in radiology. With an increasing number of screening requirements for cancers, this review aims to study the accuracy of the numerous AI models used in the detection and diagnosis of breast, lung, and prostate cancers. This study summarizes pertinent findings from reviewed articles and provides analysis on the relevancy to clinical radiology. This study found that whereas AI is showing continual improvement in radiology, AI alone does not surpass the effectiveness of a radiologist. Additionally, it was found that there are multiple variations on how AI should be integrated with a radiologist's workflow.

An AI Predictive Model to Determine Who Benefits from ADT with Radiation: Working Smarter, Not Harder

Whether you are a surgical, medical, or radiation oncologist, the care goals remain the same, that is, achieving a durable treatment response. For patients with localized intermediate-risk prostate cancer undergoing radiation treatment, identifying those who would derive additional benefit from androgen deprivation therapy (ADT) is an ongoing challenge. To help physicians make this decision, prognostic risk scores have been derived from biobanked pathology specimens1-3 coupled with well-annotated clinical and imaging data from multiple phase III trials.

Textural Features of MR Images Correlate with an Increased Risk of Clinically Significant Cancer in Patients with High PSA Levels

BACKGROUND

Prostate cancer, which is associated with gland biology and also with environmental risks, is a serious clinical problem in the male population worldwide. Important progress has been made in the diagnostic and clinical setups designed for the detection of prostate cancer, with a multiparametric magnetic resonance diagnostic process based on the PIRADS protocol playing a key role. This method relies on image evaluation by an imaging specialist. The medical community has expressed its desire for image analysis techniques that can detect important image features that may indicate cancer risk.

METHODS

Anonymized scans of 41 patients with laboratory diagnosed PSA levels who were routinely scanned for prostate cancer were used. The peripheral and central zones of the prostate were depicted manually with demarcation of suspected tumor foci under medical supervision. More than 7000 textural features in the marked regions were calculated using MaZda software. Then, these 7000 features were used to perform region parameterization. Statistical analyses were performed to find correlations with PSA-level-based diagnosis that might be used to distinguish suspected (different) lesions. Further multiparametrical analysis using MIL-SVM machine learning was used to obtain greater accuracy.

RESULTS

Multiparametric classification using MIL-SVM allowed us to reach 92% accuracy.

CONCLUSIONS

There is an important correlation between the textural parameters of MRI prostate images made using the PIRADS MR protocol with PSA levels > 4 mg/mL. The correlations found express dependence between image features with high cancer markers and hence the cancer risk.

Remote Monitoring of Colorectal Cancer Survivors Using a Smartphone App and Internet of Things-Based Device: Development and Usability Study

BACKGROUND

Patients with colorectal cancer who undergo surgery face many postoperative problems. These problems include the risk of relapse, side effects, and long-term complications.

OBJECTIVE

This study sought to design and develop a remote monitoring system as a technological solution for the postdischarge care of these patients.

METHODS

This research was conducted in 3 main steps: system feature extraction, system design, and evaluation. After feature extraction from a systematic review, the necessary features were defined by 18 clinical experts in Iran. In the next step, the architecture of the system was designed based on the requirements; the software and hardware parts of the system were embedded in the architecture, then the software system components were drawn using the unified modeling language diagrams, and the details of software system implementation were identified. Regarding the hardware design, different accessible hardware modules were evaluated, and suitable ones were selected. Finally, the usability of the system was evaluated by demonstrating it over a Skype virtual meeting session and using Nilsen's usability principles.

RESULTS

A total of 21 mandatory features in 5 main categories, including patient information registration, periodic monitoring of health parameters, education, reminders, and assessments, were defined and validated for the system. The software was developed using an ASP.Net core backend, a Microsoft SQL Server database, and an Ionic frontend alongside the Angular framework, to build an Android app. The user roles of the system included 3 roles: physicians, patients, and the system administrator. The hardware was designed to contain an Esp8266 as the Internet of Things module, an MLX90614 infrared temperature sensor, and the Maxim Integrated MAX30101 sensor for sensing the heartbeat. The hardware was designed in the shape of a wristband device using SolidWorks 2020 and printed using a 3D printer. The firmware of the hardware was developed in Arduino with the capability of firmware over the air. In evaluating the software system from the perspective of usability, the system received an average score of 3.8 out of 5 from 4 evaluators.

CONCLUSIONS

Sensor-based telemonitoring systems for patients with colorectal cancer after surgery are possible solutions that can make the process automatic for patients and caregivers. The apps for remote colorectal patient monitoring could be designed to be useful; however, more research regarding the developed system's implementation in clinic settings and hospitals is required to understand the probable barriers and limitations.

Radiomics-based machine-learning method to diagnose prostate cancer using mp-MRI: a comparison between conventional and fused models

OBJECTIVES

Multiparametric MRI (mp-MRI) has been significantly used for detection, localization and staging of Prostate cancer (PCa). However, all the assessment suffers from poor reproducibility among the readers. The aim of this study was to evaluate radiomics models to diagnose PCa using high-resolution T2-weighted (T2-W) and dynamic contrast-enhanced (DCE) MRI.

MATERIALS AND METHODS

Thirty two patients who had high prostate specific antigen level were recruited. The prostate biopsies considered as the reference to differentiate between 66 benign and 36 malignant prostate lesions. 181 features were extracted from each modality. K-nearest neighbors, artificial neural network, decision tree, and linear discriminant analysis were used for machine-learning study. The leave-one-out cross-validation method was used to prevent overfitting and build robust models.

RESULTS

Radiomics analysis showed that T2-W images were more effective in PCa detection compare to DCE images. Local binary pattern features and speeded up robust features had the highest ability for prediction in T2-W and DCE images, respectively. The classifier fusion using decision template method showed the highest performance with accuracy, specificity, and sensitivity of 100%.

DISCUSSION

The findings of this framework provide researchers on PCa with a promising method for reliable detection of prostate lesions in MR images by fused model.

The Low Rate of Adherence to Checklist for Artificial Intelligence in Medical Imaging Criteria Among Published Prostate MRI Artificial Intelligence Algorithms

OBJECTIVE

To determine the rigor, generalizability, and reproducibility of published classification and detection artificial intelligence (AI) models for prostate cancer (PCa) on MRI using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines, a 42-item checklist that is considered a measure of best practice for presenting and reviewing medical imaging AI research.

MATERIALS AND METHODS

This review searched English literature for studies proposing PCa AI detection and classification models on MRI. Each study was evaluated with the CLAIM checklist. The additional outcomes for which data were sought included measures of AI model performance (eg, area under the curve [AUC], sensitivity, specificity, free-response operating characteristic curves), training and validation and testing group sample size, AI approach, detection versus classification AI, public data set utilization, MRI sequences used, and definition of gold standard for ground truth. The percentage of CLAIM checklist fulfillment was used to stratify studies into quartiles. Wilcoxon's rank-sum test was used for pair-wise comparisons.

RESULTS

In all, 75 studies were identified, and 53 studies qualified for analysis. The original CLAIM items that most studies did not fulfill includes item 12 (77% no): de-identification methods; item 13 (68% no): handling missing data; item 15 (47% no): rationale for choosing ground truth reference standard; item 18 (55% no): measurements of inter- and intrareader variability; item 31 (60% no): inclusion of validated interpretability maps; item 37 (92% no): inclusion of failure analysis to elucidate AI model weaknesses. An AUC score versus percentage CLAIM fulfillment quartile revealed a significant difference of the mean AUC scores between quartile 1 versus quartile 2 (0.78 versus 0.86, P = .034) and quartile 1 versus quartile 4 (0.78 versus 0.89, P = .003) scores. Based on additional information and outcome metrics gathered in this study, additional measures of best practice are defined. These new items include disclosure of public dataset usage, ground truth definition in comparison to other referenced works in the defined task, and sample size power calculation.

CONCLUSION

A large proportion of AI studies do not fulfill key items in CLAIM guidelines within their methods and results sections. The percentage of CLAIM checklist fulfillment is weakly associated with improved AI model performance. Additions or supplementations to CLAIM are recommended to improve publishing standards and aid reviewers in determining study rigor.

Deep Domain Adversarial Learning for Species-Agnostic Classification of Histologic Subtypes of Osteosarcoma

Osteosarcomas (OSs) are aggressive bone tumors with many divergent histologic patterns. During pathology review, OSs are subtyped based on the predominant histologic pattern; however, tumors often demonstrate multiple patterns. This high tumor heterogeneity coupled with scarcity of samples compared with other tumor types render histology-based prognosis of OSs challenging. To combat lower case numbers in humans, dogs with spontaneous OSs have been suggested as a model species. Herein, a convolutional neural network was adversarially trained to classify distinct histologic patterns of OS in humans using mostly canine OS data during training. Adversarial training improved domain adaption of a histologic subtype classifier from canines to humans, achieving an average multiclass F1 score of 0.77 (95% CI, 0.74-0.79) and 0.80 (95% CI, 0.78-0.81) when compared with the ground truth in canines and humans, respectively. Finally, this trained model, when used to characterize the histologic landscape of 306 canine OSs, uncovered distinct clusters with markedly different clinical responses to standard-of-care therapy.

A Deep Learning Approach to Capture the Essence of Candida albicans Morphologies

We present deep learning-based approaches for exploring the complex array of morphologies exhibited by the opportunistic human pathogen Candida albicans. Our system, entitled Candescence, automatically detects C. albicans cells from differential image contrast microscopy and labels each detected cell with one of nine morphologies. This ranges from yeast white and opaque forms to hyphal and pseudohyphal filamentous morphologies. The software is based upon a fully convolutional one-stage (FCOS) object detector, a deep learning technique that uses an extensive set of images that we manually annotated with the location and morphology of each cell. We developed a novel cumulative curriculum-based learning strategy that stratifies our images by difficulty from simple yeast forms to complex filamentous architectures. Candescence achieves very good performance (~85% recall; 81% precision) on this difficult learning set, where some images contain hundreds of cells with substantial intermixing between the predicted classes. To capture the essence of each C. albicans morphology and how they intermix, we used a second technique from deep learning entitled generative adversarial networks. The resultant models allow us to identify and explore technical variables, developmental trajectories, and morphological switches. Importantly, the model allows us to quantitatively capture morphological plasticity observed with genetically modified strains or strains grown in different media and environments. We envision Candescence as a community meeting point for quantitative explorations of C. albicans morphology. IMPORTANCE The fungus Candida albicans can "shape shift" between 12 morphologies in response to environmental variables. The cytoprotective capacity provided by this polymorphism makes C. albicans a formidable pathogen to treat clinically. Microscopy images of C. albicans colonies can contain hundreds of cells in different morphological states. Manual annotation of images can be difficult, especially as a result of densely packed and filamentous colonies and of technical artifacts from the microscopy itself. Manual annotation is inherently subjective, depending on the experience and opinion of annotators. Here, we built a deep learning approach entitled Candescence to parse images in an automated, quantitative, and objective fashion: each cell in an image is located and labeled with its morphology. Candescence effectively replaces simple rules based on visual phenotypes (size, shape, and shading) with neural circuitry capable of capturing subtle but salient features in images that may be too complex for human annotators.

Tasks for artificial intelligence in prostate MRI

The advent of precision medicine, increasing clinical needs, and imaging availability among many other factors in the prostate cancer diagnostic pathway has engendered the utilization of artificial intelligence (AI). AI carries a vast number of potential applications in every step of the prostate cancer diagnostic pathway from classifying/improving prostate multiparametric magnetic resonance image quality, prostate segmentation, anatomically segmenting cancer suspicious foci, detecting and differentiating clinically insignificant cancers from clinically significant cancers on a voxel-level, and classifying entire lesions into Prostate Imaging Reporting and Data System categories/Gleason scores. Multiple studies in all these areas have shown many promising results approximating accuracies of radiologists. Despite this flourishing research, more prospective multicenter studies are needed to uncover the full impact and utility of AI on improving radiologist performance and clinical management of prostate cancer. In this narrative review, we aim to introduce emerging medical imaging AI paper quality metrics such as the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) and Field-Weighted Citation Impact (FWCI), dive into some of the top AI models for segmentation, detection, and classification.

Ethical Principles in the Analysis of Prostate Cancer Diagnostics

Recent developments in prostate cancer diagnostics call for appropriate tools to frame the ethical assessment of diagnostic practice. The first aim is to identify ethically important features and ethical principles of key importance for prostate cancer diagnostics. Next, we need to argue which ethical theory justifies these principles and can therefore be used for ethical assessment in the field. The standard medical procedure for prostate cancer diagnostics offered by the Danish health care system is used as an example.

Deep learning-based artificial intelligence applications in prostate MRI: brief summary

Prostate cancer (PCa) is the most common cancer type in males in the Western World. MRI has an established role in diagnosis of PCa through guiding biopsies. Due to multistep complex nature of the MRI-guided PCa diagnosis pathway, diagnostic performance has a big variation. Developing artificial intelligence (AI) models using machine learning, particularly deep learning, has an expanding role in radiology. Specifically, for prostate MRI, several AI approaches have been defined in the literature for prostate segmentation, lesion detection and classification with the aim of improving diagnostic performance and interobserver agreement. In this review article, we summarize the use of radiology applications of AI in prostate MRI.

[Use of medical archives for research and patient care]

In recent years, technology in healthcare has experienced a dynamic increase, with the collection of data being a central component. In particular, artificial intelligence (AI), such as machine learning and deep learning, makes it possible to perform comprehensive analyses of large amounts of data and to draw conclusions based on correlations and pattern recognition. This paper describes the benefits and challenges of big data in patient care.

Correlation of in-vivo imaging with histopathology: A review

Despite tremendous advancements in in vivo imaging modalities, there remains substantial uncertainty with respect to tumor delineation on in these images. Histopathology remains the gold standard for determining the extent of malignancy, with in vivo imaging to histopathologic correlation enabling spatial comparisons. In this review, the steps necessary for successful imaging to histopathologic correlation are described, including in vivo imaging, resection, fixation, specimen sectioning (sectioning technique, securing technique, orientation matching, slice matching), microtome sectioning and staining, correlation (including image registration) and performance evaluation. The techniques used for each of these steps are also discussed. Hundreds of publications from the past 20 years were surveyed, and 62 selected for detailed analysis. For these 62 publications, each stage of the correlative pathology process (and the sub-steps of specimen sectioning) are listed. A statistical analysis was conducted based on 19 studies that reported target registration error as their performance metric. While some methods promise greater accuracy, they may be expensive. Due to the complexity of the processes involved, correlative pathology studies generally include a small number of subjects, which hinders advanced developments in this field.

Artificial Intelligence-assisted Prostate Cancer Diagnosis: Radiologic-Pathologic Correlation

The classic prostate cancer (PCa) diagnostic pathway that is based on prostate-specific antigen (PSA) levels and the findings of digital rectal examination followed by systematic biopsy has shown multiple limitations. The use of multiparametric MRI (mpMRI) is now widely accepted in men with clinical suspicion for PCa. In addition, clinical information, PSA density, risk calculators, and genomic and other "omics" biomarkers are being used to improve risk stratification. On the basis of mpMRI and MRI-targeted biopsies (MRI-TBx), new diagnostic pathways have been established, aiming to improve the limitations of the classic diagnostic approach. However, these pathways still show limitations associated with mpMRI and MRI-TBx. Definitive PCa diagnosis is made on the basis of histopathologic Gleason grading, which has demonstrated an excellent correlation with clinical outcomes. However, Gleason grading is done subjectively by pathologists and involves poor reproducibility, and PCa may have a heterogeneous distribution of histologic patterns. Thus, important discrepancies persist between biopsy tumor grading and final whole-organ pathologic assessment after radical prostatectomy. PCa offers a unique opportunity to establish a real radiologic-pathologic correlation, as whole-mount radical prostatectomy specimens permit a complete spatial relationship with mpMRI. Artificial intelligence is increasingly being applied to radiologic and pathologic images to improve clinical accuracy and efficiency in PCa diagnosis. This review delineates current PCa diagnostic pathways, with a focus on the role of mpMRI, MRI-TBx, and pathologic analysis. An overview of the expected improvements in PCa diagnosis derived from the use of artificial intelligence, integrated radiologic-pathologic systems, and decision support tools for multidisciplinary teams is provided. An invited commentary by Purysko is available online. Online supplemental material is available for this article. ^©RSNA, 2021.

MRI and Targeted Biopsy Essential Tools for an Accurate Diagnosis and Treatment Decision Making in Prostate Cancer

Prostate cancer (PCa) is one of the most frequent causes of cancer death worldwide. Historically, diagnosis was based on physical examination, transrectal (TRUS) images, and TRUS biopsy resulting in overdiagnosis and overtreatment. Recently magnetic resonance imaging (MRI) has been identified as an evolving tool in terms of diagnosis, staging, treatment decision, and follow-up. In this review we provide the key studies and concepts of MRI as a promising tool in the diagnosis and management of prostate cancer in the general population and in challenging scenarios, such as anteriorly located lesions, enlarged prostates determining extracapsular extension and seminal vesicle invasion, and prior negative biopsy and the future role of MRI in association with artificial intelligence (AI).

Artificial intelligence in urological oncology: An update and future applications

There continues to be rapid developments and research in the field of Artificial Intelligence (AI) in Urological Oncology worldwide. In this review we discuss the basics of AI, application of AI per tumour group (Renal, Prostate and Bladder Cancer) and application of AI in Robotic Urological Surgery. We also discuss future applications of AI being developed with the benefits to patients with Urological Oncology.

Challenges and opportunities for artificial intelligence in oncological imaging

Imaging plays a key role in oncology, including the diagnosis and detection of cancer, determining clinical management, assessing treatment response, and complications of treatment or disease. The current use of clinical oncology is predominantly qualitative in nature with some relatively crude size-based measurements of tumours for assessment of disease progression or treatment response; however, it is increasingly understood that there may be significantly more information about oncological disease that can be obtained from imaging that is not currently utilized. Artificial intelligence (AI) has the potential to harness quantitative techniques to improve oncological imaging. These may include improving the efficiency or accuracy of traditional roles of imaging such as diagnosis or detection. These may also include new roles for imaging such as risk-stratifying patients for different types of therapy or determining biological tumour subtypes. This review article outlines several major areas in oncological imaging where there may be opportunities for AI technology. These include (1) screening and detection of cancer, (2) diagnosis and risk stratification, (3) tumour segmentation, (4) precision oncology, and (5) predicting prognosis and assessing treatment response. This review will also address some of the potential barriers to AI research in oncological imaging.

Cervical cytology screening facilitated by an artificial intelligence microscope: A preliminary study

BACKGROUND

Cervical cytology screening is usually laborious with a heavy workload and poor diagnostic consistency. The authors have developed an artificial intelligence (AI) microscope that can provide onsite diagnostic assistance for cervical cytology screening in real time.

METHODS

A total of 2167 cervical cytology slides were selected from a cohort of 10,601 cases from Shenzhen Maternity and Child Healthcare Hospital, and the training data set consisted of 42,073 abnormal cervical epithelial cells. The recognition results of an AI technique were presented in a microscope eyepiece by an augmented reality technique. Potentially abnormal cells were highlighted with binary classification results in a 10× field of view (FOV) and with multiclassification results according to the Bethesda system in 20× and 40× FOVs. In addition, 486 slides were selected for the reader study to evaluate the performance of the AI microscope.

RESULTS

In the reader study, which compared manual reading with AI assistance, the sensitivities for the detection of low-grade squamous intraepithelial lesions and high-grade squamous intraepithelial lesions were significantly improved from 0.837 to 0.923 (P < .001) and from 0.830 to 0.917 (P < .01), respectively; the κ score for atypical squamous cells of undetermined significance (ASCUS) was improved from 0.581 to 0.637; the averaged pairwise κ of consistency for multiclassification was improved from 0.649 to 0.706; the averaged pairwise κ of consistency for binary classification was improved from 0.720 to 0.798; and the averaged pairwise κ of ASCUS was improved from 0.557 to 0.639.

CONCLUSIONS

The results of this study show that an AI microscope can provide real-time assistance for cervical cytology screening and improve the efficiency and accuracy of cervical cytology diagnosis.

Role of AI and Histopathological Images in Detecting Prostate Cancer: A Survey

Prostate cancer is one of the most identified cancers and second most prevalent among cancer-related deaths of men worldwide. Early diagnosis and treatment are substantial to stop or handle the increase and spread of cancer cells in the body. Histopathological image diagnosis is a gold standard for detecting prostate cancer as it has different visual characteristics but interpreting those type of images needs a high level of expertise and takes too much time. One of the ways to accelerate such an analysis is by employing artificial intelligence (AI) through the use of computer-aided diagnosis (CAD) systems. The recent developments in artificial intelligence along with its sub-fields of conventional machine learning and deep learning provide new insights to clinicians and researchers, and an abundance of research is presented specifically for histopathology images tailored for prostate cancer. However, there is a lack of comprehensive surveys that focus on prostate cancer using histopathology images. In this paper, we provide a very comprehensive review of most, if not all, studies that handled the prostate cancer diagnosis using histopathological images. The survey begins with an overview of histopathological image preparation and its challenges. We also briefly review the computing techniques that are commonly applied in image processing, segmentation, feature selection, and classification that can help in detecting prostate malignancies in histopathological images.

Artificial intelligence and computational pathology

Data processing and learning has become a spearhead for the advancement of medicine, with pathology and laboratory medicine has no exception. The incorporation of scientific research through clinical informatics, including genomics, proteomics, bioinformatics, and biostatistics, into clinical practice unlocks innovative approaches for patient care. Computational pathology is burgeoning subspecialty in pathology that promises a better-integrated solution to whole-slide images, multi-omics data, and clinical informatics. However, computational pathology faces several challenges, including the ability to integrate raw data from different sources, limitation of hardware processing capacity, and a lack of specific training programs, as well as issues on ethics and larger societal acceptable practices that are still solidifying. The establishment of the entire industry of computational pathology requires far-reaching changes of the three essential elements connecting patients and doctors: the local laboratory, the scan center, and the central cloud hub/portal for data processing and retrieval. Computational pathology, unlocked through information integration and advanced digital communication networks, has the potential to improve clinical workflow efficiency, diagnostic quality, and ultimately create personalized diagnosis and treatment plans for patients. This review describes clinical perspectives and discusses the statistical methods, clinical applications, potential obstacles, and future directions of computational pathology.

Artificial Intelligence and Machine Learning in Prostate Cancer Patient Management-Current Trends and Future Perspectives

Artificial intelligence (AI) is the field of computer science that aims to build smart devices performing tasks that currently require human intelligence. Through machine learning (ML), the deep learning (DL) model is teaching computers to learn by example, something that human beings are doing naturally. AI is revolutionizing healthcare. Digital pathology is becoming highly assisted by AI to help researchers in analyzing larger data sets and providing faster and more accurate diagnoses of prostate cancer lesions. When applied to diagnostic imaging, AI has shown excellent accuracy in the detection of prostate lesions as well as in the prediction of patient outcomes in terms of survival and treatment response. The enormous quantity of data coming from the prostate tumor genome requires fast, reliable and accurate computing power provided by machine learning algorithms. Radiotherapy is an essential part of the treatment of prostate cancer and it is often difficult to predict its toxicity for the patients. Artificial intelligence could have a future potential role in predicting how a patient will react to the therapy side effects. These technologies could provide doctors with better insights on how to plan radiotherapy treatment. The extension of the capabilities of surgical robots for more autonomous tasks will allow them to use information from the surgical field, recognize issues and implement the proper actions without the need for human intervention.

Diagnosis of Prostate Cancer in Patients with Prostate-Specific Antigen (PSA) in the Gray Area: Construction of 2 Predictive Models

Background

Two diagnostic models of prostate cancer (PCa) and clinically significant prostate cancer (CS-PCa) were established using clinical data of among patients whose prostate-specific antigen (PSA) levels are in the gray area (4.0–10.0 ng/ml).

Material/Methods

Data from 181 patients whose PSA levels were in the gray area were retrospectively analyzed, and the following data were collected: age, digital rectal examination, total PSA, PSA density (PSAD), free/total PSA (f/t PSA), transrectal ultrasound, multiparametric magnetic resonance imaging (mpMRI), and pathological reports. Patients were diagnosed with benign prostatic hyperplasia (BPH) and PCa by pathology reports, and PCa patients were separated into non-clinically significant PCa (NCS-PCa) and CS-PCa by Gleason score. Afterward, predictor models constructed by above parameters were researched to diagnose PCa and CS-PCa, respectively.

Results

According to the analysis of included clinical data, there were 109 patients with BPH, 44 patients with NCS-PCa, and 28 patients with CS-PCa. Regression analysis showed PCa was correlated with f/t PSA, PSAD, and mpMRI (P<0.01), and CS-PCa was correlated with PSAD and mpMRI (P<0.01). The area under the receiver operating characteristic curves of 2 models for PCa (sensitivity=73.64%, specificity=64.23%) and for CS-PCa (sensitivity=71.41%, specificity=81.82%) were 0.79 and 0.87, respectively.

Conclusions

The prediction models had satisfactory diagnostic value for PCa and CS-PCa among patients with PSA in the gray area, and use of these models may help reduce overdiagnosis.

Artificial intelligence in gastric cancer: a translational narrative review

Increasing clinical contributions and novel techniques have been made by artificial intelligence (AI) during the last decade. The role of AI is increasingly recognized in cancer research and clinical application. Cancers like gastric cancer, or stomach cancer, are ideal testing grounds to see if early undertakings of applying AI to medicine can yield valuable results. There are numerous concepts derived from AI, including machine learning (ML) and deep learning (DL). ML is defined as the ability to learn data features without being explicitly programmed. It arises at the intersection of data science and computer science and aims at the efficiency of computing algorithms. In cancer research, ML has been increasingly used in predictive prognostic models. DL is defined as a subset of ML targeting multilayer computation processes. DL is less dependent on the understanding of data features than ML. Therefore, the algorithms of DL are much more difficult to interpret than ML, even potentially impossible. This review discussed the role of AI in the diagnostic, therapeutic and prognostic advances of gastric cancer. Models like convolutional neural networks (CNNs) or artificial neural networks (ANNs) achieved significant praise in their application. There is much more to be fully covered across the clinical administration of gastric cancer. Despite growing efforts, adapting AI to improving diagnoses for gastric cancer is a worthwhile venture. The information yield can revolutionize how we approach gastric cancer problems. Though integration might be slow and labored, it can be given the ability to enhance diagnosing through visual modalities and augment treatment strategies. It can grow to become an invaluable tool for physicians. AI not only benefits diagnostic and therapeutic outcomes, but also reshapes perspectives over future medical trajectory.

Genomic and phenotypic heterogeneity in prostate cancer

From a clinical, morphological and molecular perspective, prostate cancer is a heterogeneous disease. Primary prostate cancers are often multifocal, having topographically and morphologically distinct tumour foci. Sequencing studies have revealed that individual tumour foci can arise as clonally distinct lesions with no shared driver gene alterations. This finding demonstrates that multiple genomically and phenotypically distinct primary prostate cancers can be present in an individual patient. Lethal metastatic prostate cancer seems to arise from a single clone in the primary tumour but can exhibit subclonal heterogeneity at the genomic, epigenetic and phenotypic levels. Collectively, this complex heterogeneous constellation of molecular alterations poses obstacles for the diagnosis and treatment of prostate cancer. However, advances in our understanding of intra-tumoural heterogeneity and the development of novel technologies will allow us to navigate these challenges, refine approaches for translational research and ultimately improve patient care.

A Systematic Review of Artificial Intelligence in Prostate Cancer

The diagnosis and management of prostate cancer involves the interpretation of data from multiple modalities to aid in decision making. Tools like PSA levels, MRI guided biopsies, genomic biomarkers, and Gleason grading are used to diagnose, risk stratify, and then monitor patients during respective follow-ups. Nevertheless, diagnosis tracking and subsequent risk stratification often lend itself to significant subjectivity. Artificial intelligence (AI) can allow clinicians to recognize difficult relationships and manage enormous data sets, which is a task that is both extraordinarily difficult and time consuming for humans. By using AI algorithms and reducing the level of subjectivity, it is possible to use fewer resources while improving the overall efficiency and accuracy in prostate cancer diagnosis and management. Thus, this systematic review focuses on analyzing advancements in AI-based artificial neural networks (ANN) and their current role in prostate cancer diagnosis and management.

The emergence of new trends in clinical laboratory diagnosis

Diagnostic processes typically rely on traditional and laborious methods, that are prone to human error, resulting in frequent misdiagnosis of diseases. Computational approaches are being increasingly used for more precise diagnosis of the clinical pathology, diagnosis of genetic and microbial diseases, and analysis of clinical chemistry data. These approaches are progressively used for improving the reliability of testing, resulting in reduced diagnostic errors. Artificial intelligence (AI)-based computational approaches mostly rely on training sets obtained from patient data stored in clinical databases. However, the use of AI is associated with several ethical issues, including patient privacy and data ownership. The capacity of AI-based mathematical models to interpret complex clinical data frequently leads to data bias and reporting of erroneous results based on patient data. In order to improve the reliability of computational approaches in clinical diagnostics, strategies to reduce data bias and analyzing real-life patient data need to be further refined.

Precision Medicine, Artificial Intelligence, and Genomic Markers in Urology. Do we need to Tailor our Clinical Practice?

Precision medicine plays a key role in urological oncology practice nowadays, with the breakthrough of the poly (ADP-ribose) polymerase inhibitors (PARPi), which play a critical role in different DNA damage repair (DDR) pathways, the immune checkpoint inhibitors, the genomic expression profiles and current genome manipulation-directed targeted therapy. Information and technology (IT) are set to change the way we assess and treat patients and should be reviewed and discussed. The aim of the present article is to demonstrate a detailed revision on precision medicine, including novel therapeutic targets, genomic markers, genomic stratification of urological patients, and the top-notch technological breakthroughs that could change our clinical practice

We performed a review of the literature in four different databases (PubMed, Embase, Lilacs, and Scielo) on any information concerning prostate, bladder, kidney and urothelial cancer novel treatments with PARPi, immune checkpoint inhibitors (ICIs), targeted therapy with fibroblast growth factor receptor inhibitors (FGFRi), and theranostics with prostate-specific membrane antigen (PSMA) targeted monoclonal antibodies. Artificial intelligence, machine learning, and deep learning algorithm in urological practice were also part of the search. We included all articles written in English, published within the past 7 years, that discussed outstanding therapies and genomics in urological cancer and artificial intelligence applied to urology. Meanwhile, we excluded articles with lack of a clear methodology and written in any other language than English.

One-hundred and twenty-six articles of interest were found; of these, 65 articles that presented novel treatments of urological neoplasms, discussed precision medicine, genomic expression profiles and biomarkers in urology, and latest deep learning and machine learning algorithms as well as the use of artificial intelligence in urological practice were selected. A critical review of the literature is presented in the present article.

Urology is a constantly changing specialty with a wide range of therapeutic breakthroughs, a huge understanding of the genomic expression profiles for each urological cancer and a tendency to use cutting-edge technology to treat our patients. All of these major developments must be analyzed objectively, taking into account costs to the health systems, risks and benefits to the patients, and the legal background that comes with them. A critical analysis of these new technologies and pharmacological breakthroughs should be made before considering changing our clinical practice. Nowadays, research needs to be strengthened to help us improve results in assessing and treating our patients.

A review on the use of artificial intelligence for medical imaging of the lungs of patients with coronavirus disease 2019

The results of research on the use of artificial intelligence (AI) for medical imaging of the lungs of patients with coronavirus disease 2019 (COVID-19) has been published in various forms. In this study, we reviewed the AI for diagnostic imaging of COVID-19 pneumonia. PubMed, arXiv, medRxiv, and Google scholar were used to search for AI studies. There were 15 studies of COVID-19 that used AI for medical imaging. Of these, 11 studies used AI for computed tomography (CT) and 4 used AI for chest radiography. Eight studies presented independent test data, 5 used disclosed data, and 4 disclosed the AI source codes. The number of datasets ranged from 106 to 5941, with sensitivities ranging from 0.67-1.00 and specificities ranging from 0.81-1.00 for prediction of COVID-19 pneumonia. Four studies with independent test datasets showed a breakdown of the data ratio and reported prediction of COVID-19 pneumonia with sensitivity, specificity, and area under the curve (AUC). These 4 studies showed very high sensitivity, specificity, and AUC, in the range of 0.9-0.98, 0.91-0.96, and 0.96-0.99, respectively.

MRI and Active Surveillance for Prostate Cancer

Since the introduction of Prostate-Specific Antigen (PSA) screening, prostate cancer mortality has decreased [...]

Role of multiparametric prostate MRI in the management of prostate cancer

INTRODUCTION

Prostate cancer has traditionally been diagnosed by an elevation in PSA or abnormal exam leading to a systematic transrectal ultrasound (TRUS)-guided biopsy. This diagnostic pathway underdiagnoses clinically significant disease while over diagnosing clinically insignificant disease. In this review, we aim to provide an overview of the recent literature regarding the role of multiparametric MRI (mpMRI) in the management of prostate cancer.

MATERIALS AND METHODS

A thorough literature review was performed using PubMed to identify articles discussing use of mpMRI of the prostate in management of prostate cancer.

CONCLUSION

The incorporation of mpMRI of the prostate addresses the shortcomings of the prostate biopsy while providing several other advantages. mpMRI allows some men to avoid an immediate biopsy and permits visualization of areas likely to harbor clinically significant cancer prior to biopsy to facilitate use of MR-targeted prostate biopsies. This allows for reduction in diagnosis of clinically insignificant disease as well as improved detection and better characterization of higher risk cancers, as well as the improved selection of patients for active surveillance. In addition, mpMRI can be used for selection and monitoring of patients for active surveillance and treatment planning during surgery and focal therapy.

Magnetic Resonance Imaging for the Detection of High Grade Cancer in the Canary Prostate Active Surveillance Study

PURPOSE

We investigated the ability of prostate magnetic resonance imaging to detect Gleason Grade Group 2 or greater cancer in a standardized, multi-institutional active surveillance cohort.

MATERIALS AND METHODS

We evaluated men enrolled in Canary Prostate Active Surveillance Study with Gleason Grade Group less than 2 and who underwent biopsy within 12 months of multiparametric magnetic resonance imaging. Our primary outcome was biopsy reclassification to Gleason Grade Group 2 or greater. We evaluated the performance of magnetic resonance imaging PI-RADS® score and clinical factors. Multivariable logistic regression models were fit with magnetic resonance imaging and clinical factors and used to perform receiver operating curve analyses.

RESULTS

There were 361 participants with 395 prostate magnetic resonance imaging studies with a median followup of 4.1 (IQR 2.0-7.6) years. Overall 108 (27%) biopsies showed reclassification. Defining positive magnetic resonance imaging as PI-RADS 3-5, the negative predictive value and positive predictive value for detecting Gleason Grade Group 2 or greater cancer was 83% (95% CI 76-90) and 31% (95% CI 26-37), respectively. PI-RADS was significantly associated with reclassification (PI-RADS 5 vs 1 and 2 OR 2.71, 95% CI 1.21-6.17, p=0.016) in a multivariable model but did not improve upon a model with only clinical factors (AUC 0.768 vs 0.762). In 194 fusion biopsies higher grade cancer was found in targeted cores in 21 (11%) instances, while 25 (13%) had higher grade cancer in the systematic cores.

CONCLUSIONS

This study adds the largest cohort data to the body of literature for magnetic resonance imaging in active surveillance, recommending systematic biopsy in patients with negative magnetic resonance imaging and the inclusion of systematic biopsy in patients with positive magnetic resonance imaging.

Towards implementation of AI in New Zealand national diabetic screening program: Cloud-based, robust, and bespoke

Convolutional Neural Networks (CNNs) have become a prominent method of AI implementation in medical classification tasks. Grading Diabetic Retinopathy (DR) has been at the forefront of the development of AI for ophthalmology. However, major obstacles remain in the generalization of these CNNs onto real-world DR screening programs. We believe these difficulties are due to use of 1) small training datasets (<5,000 images), 2) private and 'curated' repositories, 3) locally implemented CNN implementation methods, while 4) relying on measured Area Under the Curve (AUC) as the sole measure of CNN performance. To address these issues, the public EyePACS Kaggle Diabetic Retinopathy dataset was uploaded onto Microsoft Azure™ cloud platform. Two CNNs were trained; 1 a "Quality Assurance", and 2. a "Classifier". The Diabetic Retinopathy classifier CNN (DRCNN) performance was then tested both on 'un-curated' as well as the 'curated' test set created by the "Quality Assessment" CNN model. Finally, the sensitivity of the DRCNNs was boosted using two post-training techniques. Our DRCNN proved to be robust, as its performance was similar on 'curated' and 'un-curated' test sets. The implementation of 'cascading thresholds' and 'max margin' techniques led to significant improvements in the DRCNN's sensitivity, while also enhancing the specificity of other grades.

Liver-specific 3D sectioning molds for correlating in vivo CT and MRI with tumor histopathology in woodchucks (Marmota monax)

Purpose

To evaluate the spatial registration and correlation of liver and tumor histopathology sections with corresponding in vivo CT and MRI using 3D, liver-specific cutting molds in a woodchuck (Marmota monax) hepatic tumor model.

Methods

Five woodchucks chronically infected with woodchuck hepatitis virus following inoculation at birth and with confirmed hepatic tumors were imaged by contrast enhanced CT or MRI. Virtual 3D liver or tumor models were generated by segmentation of in vivo CT or MR imaging. A specimen-specific cavity was created inside a block containing cutting slots aligned with an imaging plane using computer-aided design software, and the final cutting molds were fabricated using a 3D printer. Livers were resected two days after initial imaging, fixed with formalin or left unfixed, inserted into the 3D molds, and cut into parallel pieces by passing a sharp blade through the parallel slots in the mold. Histopathology sections were acquired and their spatial overlap with in vivo image slices was quantified using the Dice similarity coefficient (DSC).

Results

Imaging of the woodchucks revealed heterogeneous hepatic tumors of varying size, number, and location. Specimen-specific 3D molds provided accurate co-localization of histopathology of whole livers, liver lobes, and pedunculated tumors with in vivo CT and MR imaging, with or without tissue fixation. Visual inspection of histopathology sections and corresponding in vivo image slices revealed spatial registration of analogous pathologic features. The mean DSC for all specimens was 0.83+/-0.05.

Conclusion

Use of specimen-specific 3D molds for en bloc liver dissection provided strong spatial overlap and feature correspondence between in vivo image slices and histopathology sections.

Radiomics with artificial intelligence: a practical guide for beginners

Radiomics is a relatively new word for the field of radiology, meaning the extraction of a high number of quantitative features from medical images. Artificial intelligence (AI) is broadly a set of advanced computational algorithms that basically learn the patterns in the data provided to make predictions on unseen data sets. Radiomics can be coupled with AI because of its better capability of handling a massive amount of data compared with the traditional statistical methods. Together, the primary purpose of these fields is to extract and analyze as much and meaningful hidden quantitative data as possible to be used in decision support. Nowadays, both radiomics and AI have been getting attention for their remarkable success in various radiological tasks, which has been met with anxiety by most of the radiologists due to the fear of replacement by intelligent machines. Considering ever-developing advances in computational power and availability of large data sets, the marriage of humans and machines in future clinical practice seems inevitable. Therefore, regardless of their feelings, the radiologists should be familiar with these concepts. Our goal in this paper was three-fold: first, to familiarize radiologists with the radiomics and AI; second, to encourage the radiologists to get involved in these ever-developing fields; and, third, to provide a set of recommendations for good practice in design and assessment of future works.

Data-driven translational prostate cancer research: from biomarker discovery to clinical decision

Prostate cancer (PCa) is a common malignant tumor with increasing incidence and high heterogeneity among males worldwide. In the era of big data and artificial intelligence, the paradigm of biomarker discovery is shifting from traditional experimental and small data-based identification toward big data-driven and systems-level screening. Complex interactions between genetic factors and environmental effects provide opportunities for systems modeling of PCa genesis and evolution. We hereby review the current research frontiers in informatics for PCa clinical translation. First, the heterogeneity and complexity in PCa development and clinical theranostics are introduced to raise the concern for PCa systems biology studies. Then biomarkers and risk factors ranging from molecular alternations to clinical phenotype and lifestyle changes are explicated for PCa personalized management. Methodologies and applications for multi-dimensional data integration and computational modeling are discussed. The future perspectives and challenges for PCa systems medicine and holistic healthcare are finally provided.