Autonomous Detection and Classification of PI-RADS Lesions in an MRI Screening Population Incorporating Multicenter-Labeled Deep Learning and Biparametric Imaging: Proof of Concept

A pilot study of AI-assisted reading of prostate MRI in Organized Prostate Cancer Testing

OBJECTIVES

To evaluate the feasibility of AI-assisted reading of prostate magnetic resonance imaging (MRI) in Organized Prostate cancer Testing (OPT).

METHODS

Retrospective cohort study including 57 men with elevated prostate-specific antigen (PSA) levels ≥3 µg/L that performed bi-parametric MRI in OPT. The results of a CE-marked deep learning (DL) algorithm for prostate MRI lesion detection were compared with assessments performed by on-site radiologists and reference radiologists. Per patient PI-RADS (Prostate Imaging-Reporting and Data System)/Likert scores were cross-tabulated and compared with biopsy outcomes, if performed. Positive MRI was defined as PI-RADS/Likert ≥4. Reader variability was assessed with weighted kappa scores.

RESULTS

The number of positive MRIs was 13 (23%), 8 (14%), and 29 (51%) for the local radiologists, expert consensus, and DL, respectively. Kappa scores were moderate for local radiologists versus expert consensus 0.55 (95% confidence interval [CI]: 0.37-0.74), slight for local radiologists versus DL 0.12 (95% CI: -0.07 to 0.32), and slight for expert consensus versus DL 0.17 (95% CI: -0.01 to 0.35). Out of 10 cases with biopsy proven prostate cancer with Gleason ≥3+4 the DL scored 7 as Likert ≥4.

INTERPRETATION

The Dl-algorithm showed low agreement with both local and expert radiologists. Training and validation of DL-algorithms in specific screening cohorts is essential before introduction in organized testing.

Prostate cancer screening in Switzerland: a literature review and consensus statement from the Swiss Society of Urology

Over a decade ago, the United States Preventive Services Taskforce (USPSTF) recommended against prostate-specific antigen (PSA)-based screening for prostate cancer in all men, which considerably influenced prostate cancer screening policies worldwide after that. Consequently, the world has seen increasing numbers of advanced stages and prostate cancer deaths, which later led the USPSTF to withdraw its initial statement. Meanwhile, the European Union has elaborated a directive to address the problem of implementing prostate cancer screening in "Europe's Beating Cancer Plan". In Switzerland, concerned urologists formed an open Swiss Prostate Cancer Screening Group to improve the early detection of prostate cancer. On the 20th of September 2023, during the annual general assembly of the Swiss Society of Urology (SGU/SSU) in Lausanne, members positively voted for a stepwise approach to evaluate the feasibility of implementing organised prostate cancer screening programs in Switzerland. The following article will summarise the events and scientific advances in the last decade during which evidence and promising additional modalities to complement PSA-based prostate cancer screening have emerged. It also aims to provide an overview of contemporary strategies and their potential harms and benefits.

Evaluation of a Cascaded Deep Learning-based Algorithm for Prostate Lesion Detection at Biparametric MRI

Background Multiparametric MRI (mpMRI) improves prostate cancer (PCa) detection compared with systematic biopsy, but its interpretation is prone to interreader variation, which results in performance inconsistency. Artificial intelligence (AI) models can assist in mpMRI interpretation, but large training data sets and extensive model testing are required. Purpose To evaluate a biparametric MRI AI algorithm for intraprostatic lesion detection and segmentation and to compare its performance with radiologist readings and biopsy results. Materials and Methods This secondary analysis of a prospective registry included consecutive patients with suspected or known PCa who underwent mpMRI, US-guided systematic biopsy, or combined systematic and MRI/US fusion-guided biopsy between April 2019 and September 2022. All lesions were prospectively evaluated using Prostate Imaging Reporting and Data System version 2.1. The lesion- and participant-level performance of a previously developed cascaded deep learning algorithm was compared with histopathologic outcomes and radiologist readings using sensitivity, positive predictive value (PPV), and Dice similarity coefficient (DSC). Results A total of 658 male participants (median age, 67 years [IQR, 61-71 years]) with 1029 MRI-visible lesions were included. At histopathologic analysis, 45% (294 of 658) of participants had lesions of International Society of Urological Pathology (ISUP) grade group (GG) 2 or higher. The algorithm identified 96% (282 of 294; 95% CI: 94%, 98%) of all participants with clinically significant PCa, whereas the radiologist identified 98% (287 of 294; 95% CI: 96%, 99%; P = .23). The algorithm identified 84% (103 of 122), 96% (152 of 159), 96% (47 of 49), 95% (38 of 40), and 98% (45 of 46) of participants with ISUP GG 1, 2, 3, 4, and 5 lesions, respectively. In the lesion-level analysis using radiologist ground truth, the detection sensitivity was 55% (569 of 1029; 95% CI: 52%, 58%), and the PPV was 57% (535 of 934; 95% CI: 54%, 61%). The mean number of false-positive lesions per participant was 0.61 (range, 0-3). The lesion segmentation DSC was 0.29. Conclusion The AI algorithm detected cancer-suspicious lesions on biparametric MRI scans with a performance comparable to that of an experienced radiologist. Moreover, the algorithm reliably predicted clinically significant lesions at histopathologic examination. ClinicalTrials.gov Identifier: NCT03354416 © RSNA, 2024 Supplemental material is available for this article.

The role of AI in prostate MRI quality and interpretation: Opportunities and challenges

Prostate MRI plays an important role in imaging the prostate gland and surrounding tissues, particularly in the diagnosis and management of prostate cancer. With the widespread adoption of multiparametric magnetic resonance imaging in recent years, the concerns surrounding the variability of imaging quality have garnered increased attention. Several factors contribute to the inconsistency of image quality, such as acquisition parameters, scanner differences and interobserver variabilities. While efforts have been made to standardize image acquisition and interpretation via the development of systems, such as PI-RADS and PI-QUAL, the scoring systems still depend on the subjective experience and acumen of humans. Artificial intelligence (AI) has been increasingly used in many applications, including medical imaging, due to its ability to automate tasks and lower human error rates. These advantages have the potential to standardize the tasks of image interpretation and quality control of prostate MRI. Despite its potential, thorough validation is required before the implementation of AI in clinical practice. In this article, we explore the opportunities and challenges of AI, with a focus on the interpretation and quality of prostate MRI.

A Brief Review of Artificial Intelligence in Genitourinary Oncological Imaging

Genitourinary (GU) system is among the most commonly involved malignancy sites in the human body. Imaging plays a crucial role not only in diagnosis of cancer but also in disease management and its prognosis. However, interpretation of conventional imaging methods such as CT or MR imaging (MRI) usually demonstrates variability across different readers and institutions. Artificial intelligence (AI) has emerged as a promising technology that could improve the patient care by providing helpful input to human readers through lesion detection algorithms and lesion classification systems. Moreover, the robustness of these models may be valuable in automating time-consuming tasks such as organ and lesion segmentations. Herein, we review the current state of imaging and existing challenges in GU malignancies, particularly for cancers of prostate, kidney and bladder; and briefly summarize the recent AI-based solutions to these challenges.

Anatomically guided self-adapting deep neural network for clinically significant prostate cancer detection on bi-parametric MRI: a multi-center study

OBJECTIVE

To evaluate the effectiveness of a self-adapting deep network, trained on large-scale bi-parametric MRI data, in detecting clinically significant prostate cancer (csPCa) in external multi-center data from men of diverse demographics; to investigate the advantages of transfer learning.

METHODS

We used two samples: (i) Publicly available multi-center and multi-vendor Prostate Imaging: Cancer AI (PI-CAI) training data, consisting of 1500 bi-parametric MRI scans, along with its unseen validation and testing samples; (ii) In-house multi-center testing and transfer learning data, comprising 1036 and 200 bi-parametric MRI scans. We trained a self-adapting 3D nnU-Net model using probabilistic prostate masks on the PI-CAI data and evaluated its performance on the hidden validation and testing samples and the in-house data with and without transfer learning. We used the area under the receiver operating characteristic (AUROC) curve to evaluate patient-level performance in detecting csPCa.

RESULTS

The PI-CAI training data had 425 scans with csPCa, while the in-house testing and fine-tuning data had 288 and 50 scans with csPCa, respectively. The nnU-Net model achieved an AUROC of 0.888 and 0.889 on the hidden validation and testing data. The model performed with an AUROC of 0.886 on the in-house testing data, with a slight decrease in performance to 0.870 using transfer learning.

CONCLUSIONS

The state-of-the-art deep learning method using prostate masks trained on large-scale bi-parametric MRI data provides high performance in detecting csPCa in internal and external testing data with different characteristics, demonstrating the robustness and generalizability of deep learning within and across datasets.

CLINICAL RELEVANCE STATEMENT

A self-adapting deep network, utilizing prostate masks and trained on large-scale bi-parametric MRI data, is effective in accurately detecting clinically significant prostate cancer across diverse datasets, highlighting the potential of deep learning methods for improving prostate cancer detection in clinical practice.

Future of prostate imaging: Artificial intelligence in assessing prostatic magnetic resonance imaging

Prostate cancer (Pca; adenocarcinoma) is one of the most common cancers in adult males and one of the leading causes of death in both men and women. The diagnosis of Pca requires substantial experience, and even then the lesions can be difficult to detect. Moreover, although the diagnostic approach for this disease has improved significantly with the advent of multiparametric magnetic resonance, that technology has certain unresolved limitations. In recent years artificial intelligence (AI) has been introduced to the field of radiology, providing new software solutions for prostate diagnostics. Precise mapping of the prostate has become possible through AI and this has greatly improved the accuracy of biopsy. AI has also allowed for certain suspicious lesions to be attributed to a given group according to the Prostate Imaging-Reporting & Data System classification. Finally, AI has facilitated the combination of data obtained from clinical, laboratory (prostate-specific antigen), imaging (magnetic resonance), and biopsy examinations, and in this way new regularities can be found which at the moment remain hidden. Further evolution of AI in this field is inevitable and it is almost certain to significantly expand the efficacy, accuracy and efficiency of diagnosis and treatment of Pca.

A multicenter study of artificial intelligence-aided software for detecting visible clinically significant prostate cancer on mpMRI

BACKGROUND

AI-based software may improve the performance of radiologists when detecting clinically significant prostate cancer (csPCa). This study aims to compare the performance of radiologists in detecting MRI-visible csPCa on MRI with and without AI-based software.

MATERIALS AND METHODS

In total, 480 multiparametric MRI (mpMRI) images were retrospectively collected from eleven different MR devices, with 349 csPCa lesions in 180 (37.5%) cases. The csPCa areas were annotated based on pathology. Sixteen radiologists from four hospitals participated in reading. Each radiologist was randomly assigned to 30 cases and diagnosed twice. Half cases were interpreted without AI, and the other half were interpreted with AI. After four weeks, the cases were read again in switched mode. The mean diagnostic performance was compared using sensitivity and specificity on lesion level and patient level. The median reading time and diagnostic confidence were assessed.

RESULTS

On lesion level, AI-aided improved the sensitivity from 40.1% to 59.0% (18.9% increased; 95% confidence interval (CI) [11.5, 26.1]; p < .001). On patient level, AI-aided improved the specificity from 57.7 to 71.7% (14.0% increase, 95% CI [6.4, 21.4]; p < .001) while preserving the sensitivity (88.3% vs. 93.9%, p = 0.06). AI-aided reduced the median reading time of one case by 56.3% from 423 to 185 s (238-s decrease, 95% CI [219, 260]; p < .001), and the median diagnostic confidence score was increased by 10.3% from 3.9 to 4.3 (0.4-score increase, 95% CI [0.3, 0.5]; p < .001).

CONCLUSIONS

AI software improves the performance of radiologists by reducing false positive detection of prostate cancer patients and also improving reading times and diagnostic confidence.

CLINICAL RELEVANCE STATEMENT

This study involves the process of data collection, randomization and crossover reading procedure.

Normalization Strategies in Multi-Center Radiomics Abdominal MRI: Systematic Review and Meta-Analyses

Goal: Artificial intelligence applied to medical image analysis has been extensively used to develop non-invasive diagnostic and prognostic signatures. However, these imaging biomarkers should be largely validated on multi-center datasets to prove their robustness before they can be introduced into clinical practice. The main challenge is represented by the great and unavoidable image variability which is usually addressed using different pre-processing techniques including spatial, intensity and feature normalization. The purpose of this study is to systematically summarize normalization methods and to evaluate their correlation with the radiomics model performances through meta-analyses. This review is carried out according to the PRISMA statement: 4777 papers were collected, but only 74 were included. Two meta-analyses were carried out according to two clinical aims: characterization and prediction of response. Findings of this review demonstrated that there are some commonly used normalization approaches, but not a commonly agreed pipeline that can allow to improve performance and to bridge the gap between bench and bedside.

Does deep learning software improve the consistency and performance of radiologists with various levels of experience in assessing bi-parametric prostate MRI?

OBJECTIVE

To investigate whether commercially available deep learning (DL) software improves the Prostate Imaging-Reporting and Data System (PI-RADS) scoring consistency on bi-parametric MRI among radiologists with various levels of experience; to assess whether the DL software improves the performance of the radiologists in identifying clinically significant prostate cancer (csPCa).

METHODS

We retrospectively enrolled consecutive men who underwent bi-parametric prostate MRI at a 3 T scanner due to suspicion of PCa. Four radiologists with 2, 3, 5, and > 20 years of experience evaluated the bi-parametric prostate MRI scans with and without the DL software. Whole-mount pathology or MRI/ultrasound fusion-guided biopsy was the reference. The area under the receiver operating curve (AUROC) was calculated for each radiologist with and without the DL software and compared using De Long's test. In addition, the inter-rater agreement was investigated using kappa statistics.

RESULTS

In all, 153 men with a mean age of 63.59 ± 7.56 years (range 53-80) were enrolled in the study. In the study sample, 45 men (29.80%) had clinically significant PCa. During the reading with the DL software, the radiologists changed their initial scores in 1/153 (0.65%), 2/153 (1.3%), 0/153 (0%), and 3/153 (1.9%) of the patients, yielding no significant increase in the AUROC (p > 0.05). Fleiss' kappa scores among the radiologists were 0.39 and 0.40 with and without the DL software (p = 0.56).

CONCLUSIONS

The commercially available DL software does not increase the consistency of the bi-parametric PI-RADS scoring or csPCa detection performance of radiologists with varying levels of experience.

Deep Learning-Based Computed Tomography Image Standardization to Improve Generalizability of Deep Learning-Based Hepatic Segmentation

OBJECTIVE

We aimed to investigate whether image standardization using deep learning-based computed tomography (CT) image conversion would improve the performance of deep learning-based automated hepatic segmentation across various reconstruction methods.

MATERIALS AND METHODS

We collected contrast-enhanced dual-energy CT of the abdomen that was obtained using various reconstruction methods, including filtered back projection, iterative reconstruction, optimum contrast, and monoenergetic images with 40, 60, and 80 keV. A deep learning based image conversion algorithm was developed to standardize the CT images using 142 CT examinations (128 for training and 14 for tuning). A separate set of 43 CT examinations from 42 patients (mean age, 10.1 years) was used as the test data. A commercial software program (MEDIP PRO v2.0.0.0, MEDICALIP Co. Ltd.) based on 2D U-NET was used to create liver segmentation masks with liver volume. The original 80 keV images were used as the ground truth. We used the paired t-test to compare the segmentation performance in the Dice similarity coefficient (DSC) and difference ratio of the liver volume relative to the ground truth volume before and after image standardization. The concordance correlation coefficient (CCC) was used to assess the agreement between the segmented liver volume and ground-truth volume.

RESULTS

The original CT images showed variable and poor segmentation performances. The standardized images achieved significantly higher DSCs for liver segmentation than the original images (DSC [original, 5.40%-91.27%] vs. [standardized, 93.16%-96.74%], all P < 0.001). The difference ratio of liver volume also decreased significantly after image conversion (original, 9.84%-91.37% vs. standardized, 1.99%-4.41%). In all protocols, CCCs improved after image conversion (original, -0.006-0.964 vs. standardized, 0.990-0.998).

CONCLUSION

Deep learning-based CT image standardization can improve the performance of automated hepatic segmentation using CT images reconstructed using various methods. Deep learning-based CT image conversion may have the potential to improve the generalizability of the segmentation network.

Exploring the Use of Artificial Intelligence in the Management of Prostate Cancer

PURPOSE OF REVIEW

This review aims to explore the current state of research on the use of artificial intelligence (AI) in the management of prostate cancer. We examine the various applications of AI in prostate cancer, including image analysis, prediction of treatment outcomes, and patient stratification. Additionally, the review will evaluate the current limitations and challenges faced in the implementation of AI in prostate cancer management.

RECENT FINDINGS

Recent literature has focused particularly on the use of AI in radiomics, pathomics, the evaluation of surgical skills, and patient outcomes. AI has the potential to revolutionize the future of prostate cancer management by improving diagnostic accuracy, treatment planning, and patient outcomes. Studies have shown improved accuracy and efficiency of AI models in the detection and treatment of prostate cancer, but further research is needed to understand its full potential as well as limitations.

The Low Rate of Adherence to Checklist for Artificial Intelligence in Medical Imaging Criteria Among Published Prostate MRI Artificial Intelligence Algorithms

OBJECTIVE

To determine the rigor, generalizability, and reproducibility of published classification and detection artificial intelligence (AI) models for prostate cancer (PCa) on MRI using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines, a 42-item checklist that is considered a measure of best practice for presenting and reviewing medical imaging AI research.

MATERIALS AND METHODS

This review searched English literature for studies proposing PCa AI detection and classification models on MRI. Each study was evaluated with the CLAIM checklist. The additional outcomes for which data were sought included measures of AI model performance (eg, area under the curve [AUC], sensitivity, specificity, free-response operating characteristic curves), training and validation and testing group sample size, AI approach, detection versus classification AI, public data set utilization, MRI sequences used, and definition of gold standard for ground truth. The percentage of CLAIM checklist fulfillment was used to stratify studies into quartiles. Wilcoxon's rank-sum test was used for pair-wise comparisons.

RESULTS

In all, 75 studies were identified, and 53 studies qualified for analysis. The original CLAIM items that most studies did not fulfill includes item 12 (77% no): de-identification methods; item 13 (68% no): handling missing data; item 15 (47% no): rationale for choosing ground truth reference standard; item 18 (55% no): measurements of inter- and intrareader variability; item 31 (60% no): inclusion of validated interpretability maps; item 37 (92% no): inclusion of failure analysis to elucidate AI model weaknesses. An AUC score versus percentage CLAIM fulfillment quartile revealed a significant difference of the mean AUC scores between quartile 1 versus quartile 2 (0.78 versus 0.86, P = .034) and quartile 1 versus quartile 4 (0.78 versus 0.89, P = .003) scores. Based on additional information and outcome metrics gathered in this study, additional measures of best practice are defined. These new items include disclosure of public dataset usage, ground truth definition in comparison to other referenced works in the defined task, and sample size power calculation.

CONCLUSION

A large proportion of AI studies do not fulfill key items in CLAIM guidelines within their methods and results sections. The percentage of CLAIM checklist fulfillment is weakly associated with improved AI model performance. Additions or supplementations to CLAIM are recommended to improve publishing standards and aid reviewers in determining study rigor.

Amide Proton Transfer-weighted MRI combined with serum prostate-specific antigen levels for differentiating malignant prostate lesions from benign prostate lesions: a retrospective cohort study

BACKGROUND

Early diagnosis of prostate cancer improves its prognosis, while it is essential to upgrade screening tools. This study aimed to explore the value of a novel functional magnetic resonance imaging (MRI) technique, namely amide proton transfer (APT)-weighted MRI, combined with serum prostate-specific antigen (PSA) levels to differentiate malignant prostate lesions from benign prostate lesions.

METHODS

Data of patients who underwent prostate examinations at Chongqing University Cancer Hospital between July 2019 and March 2022 were retrospectively analyzed. All patients underwent T2-weighted imaging (T2WI), APT, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE) MRI. Two radiologists analyzed the images independently. The ability of the quantitative parameters alone or in different combinations in differentiating malignant prostate lesions from benign prostate lesions were compared by using receiver operating characteristic (ROC) curves. According to the DeLong test, the combined parameters were significantly different from the corresponding single parameter (P < 0.05).

RESULTS

A total of 79 patients were finally enrolled, including 52 patients in the malignant group and 27 patients in the benign group. The separate assessment of indexes revealed that APTmax, APTmean, mean apparent diffusion coefficient (ADCmean), ADCmax, ADCmin, tPAD, free prostate-specific antigen (FPSA), FPSA/total prostate-specific antigen (tPSA), and PSA density (PSAD) were significantly different between the two groups (P < 0.05), while APTmin was not significantly different between the two groups (P > 0.05). APTmax and APTmean had the high values of area under the ROC curve (AUC), which were 0.780 and 0.710, respectively. APTmax had a high sensitivity, and APTmean had a high specificity. The combination of APTmax, APTmean, ADCmean, and PSAD had the highest AUC value (AUC: 0.880, sensitivity: 86.540, specificity: 78.260).

CONCLUSION

APTmax, APTmean, ADCmean, ADCmin, tPAD, FPSA, and PSAD showed to have a high value in differentiating malignant prostate lesions from benign prostate lesions in the separate assessment of indexes. The combination of APTmax, APTmean, ADCmean, and PSAD had the highest diagnostic value.

Risk Stratification and Artificial Intelligence in Early Magnetic Resonance Imaging-based Detection of Prostate Cancer

Magnetic resonance imaging (MRI) has transformed the diagnostic pathway for prostate cancer and now plays an upfront role before prostate biopsies. If a suspicious lesion is found on MRI, the subsequent biopsy can be targeted. A sharp increase is expected in the number of men who will undergo prostate MRI. The challenge is to provide good image quality and diagnostic accuracy while meeting the demands of the expected higher workload. A possible solution to this challenge is to include a suitable risk stratification tool before imaging. Other solutions, such as smarter and shorter MRI protocols, need to be explored. For most of these solutions, artificial intelligence (AI) can play an important role. AI applications have the potential to improve the diagnostic quality of the prostate MRI pathway and speed up the work. PATIENT SUMMARY: The use of prostate magnetic resonance imaging (MRI) for diagnosis of prostate cancer is increasing. Risk stratification of patients before imaging and the use of shorter scan protocols can help in managing MRI resources. Artificial intelligence can also play a role in automating some tasks.

Pseudoprospective Paraclinical Interaction of Radiology Residents With a Deep Learning System for Prostate Cancer Detection: Experience, Performance, and Identification of the Need for Intermittent Recalibration

OBJECTIVES

The aim of this study was to estimate the prospective utility of a previously retrospectively validated convolutional neural network (CNN) for prostate cancer (PC) detection on prostate magnetic resonance imaging (MRI).

MATERIALS AND METHODS

The biparametric (T2-weighted and diffusion-weighted) portion of clinical multiparametric prostate MRI from consecutive men included between November 2019 and September 2020 was fully automatically and individually analyzed by a CNN briefly after image acquisition (pseudoprospective design). Radiology residents performed 2 research Prostate Imaging Reporting and Data System (PI-RADS) assessments of the multiparametric dataset independent from clinical reporting (paraclinical design) before and after review of the CNN results and completed a survey. Presence of clinically significant PC was determined by the presence of an International Society of Urological Pathology grade 2 or higher PC on combined targeted and extended systematic transperineal MRI/transrectal ultrasound fusion biopsy. Sensitivities and specificities on a patient and prostate sextant basis were compared using the McNemar test and compared with the receiver operating characteristic (ROC) curve of CNN. Survey results were summarized as absolute counts and percentages.

RESULTS

A total of 201 men were included. The CNN achieved an ROC area under the curve of 0.77 on a patient basis. Using PI-RADS ≥3-emulating probability threshold (c3), CNN had a patient-based sensitivity of 81.8% and specificity of 54.8%, not statistically different from the current clinical routine PI-RADS ≥4 assessment at 90.9% and 54.8%, respectively ( P = 0.30/ P = 1.0). In general, residents achieved similar sensitivity and specificity before and after CNN review. On a prostate sextant basis, clinical assessment possessed the highest ROC area under the curve of 0.82, higher than CNN (AUC = 0.76, P = 0.21) and significantly higher than resident performance before and after CNN review (AUC = 0.76 / 0.76, P ≤ 0.03). The resident survey indicated CNN to be helpful and clinically useful.

CONCLUSIONS

Pseudoprospective paraclinical integration of fully automated CNN-based detection of suspicious lesions on prostate multiparametric MRI was demonstrated and showed good acceptance among residents, whereas no significant improvement in resident performance was found. General CNN performance was preserved despite an observed shift in CNN calibration, identifying the requirement for continuous quality control and recalibration.

The role of MRI in prostate cancer: current and future directions

There has been an increasing role of magnetic resonance imaging (MRI) in the management of prostate cancer. MRI already plays an essential role in the detection and staging, with the introduction of functional MRI sequences. Recent advancements in radiomics and artificial intelligence are being tested to potentially improve detection, assessment of aggressiveness, and provide usefulness as a prognostic marker. MRI can improve pretreatment risk stratification and therefore selection of and follow-up of patients for active surveillance. MRI can also assist in guiding targeted biopsy, treatment planning and follow-up after treatment to assess local recurrence. MRI has gained importance in the evaluation of metastatic disease with emerging technology including whole-body MRI and integrated positron emission tomography/MRI, allowing for not only better detection but also quantification. The main goal of this article is to review the most recent advances on MRI in prostate cancer and provide insights into its potential clinical roles from the radiologist's perspective. In each of the sections, specific roles of MRI tailored to each clinical setting are discussed along with its strengths and weakness including already established material related to MRI and the introduction of recent advancements on MRI.

Artificial intelligence for prostate MRI: open datasets, available applications, and grand challenges

Artificial intelligence (AI) for prostate magnetic resonance imaging (MRI) is starting to play a clinical role for prostate cancer (PCa) patients. AI-assisted reading is feasible, allowing workflow reduction. A total of 3,369 multi-vendor prostate MRI cases are available in open datasets, acquired from 2003 to 2021 in Europe or USA at 3 T (n = 3,018; 89.6%) or 1.5 T (n = 296; 8.8%), 346 cases scanned with endorectal coil (10.3%), 3,023 (89.7%) with phased-array surface coils; 412 collected for anatomical segmentation tasks, 3,096 for PCa detection/classification; for 2,240 cases lesions delineation is available and 56 cases have matching histopathologic images; for 2,620 cases the PSA level is provided; the total size of all open datasets amounts to approximately 253 GB. Of note, quality of annotations provided per dataset highly differ and attention must be paid when using these datasets (e.g., data overlap). Seven grand challenges and commercial applications from eleven vendors are here considered. Few small studies provided prospective validation. More work is needed, in particular validation on large-scale multi-institutional, well-curated public datasets to test general applicability. Moreover, AI needs to be explored for clinical stages other than detection/characterization (e.g., follow-up, prognosis, interventions, and focal treatment).

Role of Deep Learning in Prostate Cancer Management: Past, Present and Future Based on a Comprehensive Literature Review

This review aims to present the applications of deep learning (DL) in prostate cancer diagnosis and treatment. Computer vision is becoming an increasingly large part of our daily lives due to advancements in technology. These advancements in computational power have allowed more extensive and more complex DL models to be trained on large datasets. Urologists have found these technologies help them in their work, and many such models have been developed to aid in the identification, treatment and surgical practices in prostate cancer. This review will present a systematic outline and summary of these deep learning models and technologies used for prostate cancer management. A literature search was carried out for English language articles over the last two decades from 2000–2021, and present in Scopus, MEDLINE, Clinicaltrials.gov, Science Direct, Web of Science and Google Scholar. A total of 224 articles were identified on the initial search. After screening, 64 articles were identified as related to applications in urology, from which 24 articles were identified to be solely related to the diagnosis and treatment of prostate cancer. The constant improvement in DL models should drive more research focusing on deep learning applications. The focus should be on improving models to the stage where they are ready to be implemented in clinical practice. Future research should prioritize developing models that can train on encrypted images, allowing increased data sharing and accessibility.

Artificial intelligence: Advances and new frontiers in medical imaging

Artificial intelligence (AI) has been entwined with the field of radiology ever since digital imaging began replacing films over half a century ago. These algorithms, ranging from simplistic speech-to-text dictation programs to automated interpretation neural networks, have continuously sought to revolutionize medical imaging. With the number of imaging studies outpacing the amount of trained of readers, AI has been implemented to streamline workflow efficiency and provide quantitative, standardized interpretation. AI relies on massive amounts of data for its algorithms to function, and with the wide-spread adoption of Picture Archiving and Communication Systems (PACS), imaging data is accumulating rapidly. Current AI algorithms using machine-learning technology, or computer aided-detection, have been able to successfully pool this data for clinical use, although the scope of these algorithms remains narrow. Many systems have been developed to assist the workflow of the radiologist through PACS optimization and imaging study triage, however interpretation has generally remained a human responsibility for now. In this review article, we will summarize the current successes and limitations of AI in radiology, and explore the exciting prospects that deep-learning technology offers for the future.

Explainable AI for CNN-based prostate tumor segmentation in multi-parametric MRI correlated to whole mount histopathology

Automatic prostate tumor segmentation is often unable to identify the lesion even if multi-parametric MRI data is used as input, and the segmentation output is difficult to verify due to the lack of clinically established ground truth images. In this work we use an explainable deep learning model to interpret the predictions of a convolutional neural network (CNN) for prostate tumor segmentation. The CNN uses a U-Net architecture which was trained on multi-parametric MRI data from 122 patients to automatically segment the prostate gland and prostate tumor lesions. In addition, co-registered ground truth data from whole mount histopathology images were available in 15 patients that were used as a test set during CNN testing. To be able to interpret the segmentation results of the CNN, heat maps were generated using the Gradient Weighted Class Activation Map (Grad-CAM) method. The CNN achieved a mean Dice Sorensen Coefficient 0.62 and 0.31 for the prostate gland and the tumor lesions -with the radiologist drawn ground truth and 0.32 with whole-mount histology ground truth for tumor lesions. Dice Sorensen Coefficient between CNN predictions and manual segmentations from MRI and histology data were not significantly different. In the prostate the Grad-CAM heat maps could differentiate between tumor and healthy prostate tissue, which indicates that the image information in the tumor was essential for the CNN segmentation.

Current Value of Biparametric Prostate MRI with Machine-Learning or Deep-Learning in the Detection, Grading, and Characterization of Prostate Cancer: A Systematic Review

Prostate cancer detection with magnetic resonance imaging is based on a standardized MRI-protocol according to the PI-RADS guidelines including morphologic imaging, diffusion weighted imaging, and perfusion. To facilitate data acquisition and analysis the contrast-enhanced perfusion is often omitted resulting in a biparametric prostate MRI protocol. The intention of this review is to analyze the current value of biparametric prostate MRI in combination with methods of machine-learning and deep learning in the detection, grading, and characterization of prostate cancer; if available a direct comparison with human radiologist performance was performed. PubMed was systematically queried and 29 appropriate studies were identified and retrieved. The data show that detection of clinically significant prostate cancer and differentiation of prostate cancer from non-cancerous tissue using machine-learning and deep learning is feasible with promising results. Some techniques of machine-learning and deep-learning currently seem to be equally good as human radiologists in terms of classification of single lesion according to the PIRADS score.

Deep learning for fully automatic detection, segmentation, and Gleason grade estimation of prostate cancer in multiparametric magnetic resonance images

Although the emergence of multi-parametric magnetic resonance imaging (mpMRI) has had a profound impact on the diagnosis of prostate cancers (PCa), analyzing these images remains still complex even for experts. This paper proposes a fully automatic system based on Deep Learning that performs localization, segmentation and Gleason grade group (GGG) estimation of PCa lesions from prostate mpMRIs. It uses 490 mpMRIs for training/validation and 75 for testing from two different datasets: ProstateX and Valencian Oncology Institute Foundation. In the test set, it achieves an excellent lesion-level AUC/sensitivity/specificity for the GGG[Formula: see text]2 significance criterion of 0.96/1.00/0.79 for the ProstateX dataset, and 0.95/1.00/0.80 for the IVO dataset. At a patient level, the results are 0.87/1.00/0.375 in ProstateX, and 0.91/1.00/0.762 in IVO. Furthermore, on the online ProstateX grand challenge, the model obtained an AUC of 0.85 (0.87 when trained only on the ProstateX data, tying up with the original winner of the challenge). For expert comparison, IVO radiologist's PI-RADS 4 sensitivity/specificity were 0.88/0.56 at a lesion level, and 0.85/0.58 at a patient level. The full code for the ProstateX-trained model is openly available at https://github.com/OscarPellicer/prostate_lesion_detection . We hope that this will represent a landmark for future research to use, compare and improve upon.

Fully Automatic Deep Learning in Bi-institutional Prostate Magnetic Resonance Imaging: Effects of Cohort Size and Heterogeneity

BACKGROUND

The potential of deep learning to support radiologist prostate magnetic resonance imaging (MRI) interpretation has been demonstrated.

PURPOSE

The aim of this study was to evaluate the effects of increased and diversified training data (TD) on deep learning performance for detection and segmentation of clinically significant prostate cancer-suspicious lesions.

MATERIALS AND METHODS

In this retrospective study, biparametric (T2-weighted and diffusion-weighted) prostate MRI acquired with multiple 1.5-T and 3.0-T MRI scanners in consecutive men was used for training and testing of prostate segmentation and lesion detection networks. Ground truth was the combination of targeted and extended systematic MRI-transrectal ultrasound fusion biopsies, with significant prostate cancer defined as International Society of Urological Pathology grade group greater than or equal to 2. U-Nets were internally validated on full, reduced, and PROSTATEx-enhanced training sets and subsequently externally validated on the institutional test set and the PROSTATEx test set. U-Net segmentation was calibrated to clinically desired levels in cross-validation, and test performance was subsequently compared using sensitivities, specificities, predictive values, and Dice coefficient.

RESULTS

One thousand four hundred eighty-eight institutional examinations (median age, 64 years; interquartile range, 58-70 years) were temporally split into training (2014-2017, 806 examinations, supplemented by 204 PROSTATEx examinations) and test (2018-2020, 682 examinations) sets. In the test set, Prostate Imaging-Reporting and Data System (PI-RADS) cutoffs greater than or equal to 3 and greater than or equal to 4 on a per-patient basis had sensitivity of 97% (241/249) and 90% (223/249) at specificity of 19% (82/433) and 56% (242/433), respectively. The full U-Net had corresponding sensitivity of 97% (241/249) and 88% (219/249) with specificity of 20% (86/433) and 59% (254/433), not statistically different from PI-RADS (P > 0.3 for all comparisons). U-Net trained using a reduced set of 171 consecutive examinations achieved inferior performance (P < 0.001). PROSTATEx training enhancement did not improve performance. Dice coefficients were 0.90 for prostate and 0.42/0.53 for MRI lesion segmentation at PI-RADS category 3/4 equivalents.

CONCLUSIONS

In a large institutional test set, U-Net confirms similar performance to clinical PI-RADS assessment and benefits from more TD, with neither institutional nor PROSTATEx performance improved by adding multiscanner or bi-institutional TD.

A Novel Deep Learning Based Computer-Aided Diagnosis System Improves the Accuracy and Efficiency of Radiologists in Reading Biparametric Magnetic Resonance Images of the Prostate: Results of a Multireader, Multicase Study

OBJECTIVE

The aim of this study was to evaluate the effect of a deep learning based computer-aided diagnosis (DL-CAD) system on radiologists' interpretation accuracy and efficiency in reading biparametric prostate magnetic resonance imaging scans.

MATERIALS AND METHODS

We selected 100 consecutive prostate magnetic resonance imaging cases from a publicly available data set (PROSTATEx Challenge) with and without histopathologically confirmed prostate cancer. Seven board-certified radiologists were tasked to read each case twice in 2 reading blocks (with and without the assistance of a DL-CAD), with a separation between the 2 reading sessions of at least 2 weeks. Reading tasks were to localize and classify lesions according to Prostate Imaging Reporting and Data System (PI-RADS) v2.0 and to assign a radiologist's level of suspicion score (scale from 1-5 in 0.5 increments; 1, benign; 5, malignant). Ground truth was established by consensus readings of 3 experienced radiologists. The detection performance (receiver operating characteristic curves), variability (Fleiss κ), and average reading time without DL-CAD assistance were evaluated.

RESULTS

The average accuracy of radiologists in terms of area under the curve in detecting clinically significant cases (PI-RADS ≥4) was 0.84 (95% confidence interval [CI], 0.79-0.89), whereas the same using DL-CAD was 0.88 (95% CI, 0.83-0.94) with an improvement of 4.4% (95% CI, 1.1%-7.7%; P = 0.010). Interreader concordance (in terms of Fleiss κ) increased from 0.22 to 0.36 (P = 0.003). Accuracy of radiologists in detecting cases with PI-RADS ≥3 was improved by 2.9% (P = 0.10). The median reading time in the unaided/aided scenario was reduced by 21% from 103 to 81 seconds (P < 0.001).

CONCLUSIONS

Using a DL-CAD system increased the diagnostic accuracy in detecting highly suspicious prostate lesions and reduced both the interreader variability and the reading time.

Applications of artificial intelligence in prostate cancer imaging

PURPOSE OF REVIEW

The purpose of this review was to identify the most recent lines of research focusing on the application of artificial intelligence (AI) in the diagnosis and staging of prostate cancer (PCa) with imaging.

RECENT FINDINGS

The majority of studies focused on the improvement in the interpretation of bi-parametric and multiparametric magnetic resonance imaging, and in the planning of image guided biopsy. These initial studies showed that AI methods based on convolutional neural networks could achieve a diagnostic performance close to that of radiologists. In addition, these methods could improve segmentation and reduce inter-reader variability. Methods based on both clinical and imaging findings could help in the identification of high-grade PCa and more aggressive disease, thus guiding treatment decisions. Though these initial results are promising, only few studies addressed the repeatability and reproducibility of the investigated AI tools. Further, large-scale validation studies are missing and no diagnostic phase III or higher studies proving improved outcomes regarding clinical decision making have been conducted.

SUMMARY

AI techniques have the potential to significantly improve and simplify diagnosis, risk stratification and staging of PCa. Larger studies with a focus on quality standards are needed to allow a widespread introduction of AI in clinical practice.

Artificial Intelligence Based Algorithms for Prostate Cancer Classification and Detection on Magnetic Resonance Imaging: A Narrative Review

Due to the upfront role of magnetic resonance imaging (MRI) for prostate cancer (PCa) diagnosis, a multitude of artificial intelligence (AI) applications have been suggested to aid in the diagnosis and detection of PCa. In this review, we provide an overview of the current field, including studies between 2018 and February 2021, describing AI algorithms for (1) lesion classification and (2) lesion detection for PCa. Our evaluation of 59 included studies showed that most research has been conducted for the task of PCa lesion classification (66%) followed by PCa lesion detection (34%). Studies showed large heterogeneity in cohort sizes, ranging between 18 to 499 patients (median = 162) combined with different approaches for performance validation. Furthermore, 85% of the studies reported on the stand-alone diagnostic accuracy, whereas 15% demonstrated the impact of AI on diagnostic thinking efficacy, indicating limited proof for the clinical utility of PCa AI applications. In order to introduce AI within the clinical workflow of PCa assessment, robustness and generalizability of AI applications need to be further validated utilizing external validation and clinical workflow experiments.

The future direction of imaging in prostate cancer: MRI with or without contrast injection

BACKGROUND

Multiparametric MRI (mpMRI) is the "state of the art" management tool for patients with suspicion of prostate cancer (PCa). The role of non-contrast MRI is investigated to move toward a more personalized, less invasive, and highly cost-effective PCa diagnostic workup.

OBJECTIVE

To perform a non-systematic review of the existing literature to highlight strength and flaws of performing non-contrast MRI, and to provide a critical overview of the international scientific production on the topic.

MATERIALS AND METHODS

Online databases (Medline, PubMed, and Web of Science) were searched for original articles, systematic review and meta-analysis, and expert opinion papers.

RESULTS

Several investigations have shown comparable diagnostic accuracy of biparametric (bpMRI) and mpMRI for the detection of PCa. The advantage of abandoning contrast-enhanced sequences improves operational logistics, lowering costs, acquisition time, and side effects. The main limitations of bpMRI are that most studies comparing non-contrast with contrast MRI come from centers with high expertise that might not be reproducible in the general community setting; besides, reduced protocols might be insufficient for estimation of the intra- and extra-prostatic extension and regional disease. The mentioned observations suggest that low-quality mpMRI for the general population might represent the main shortage to overcome.

DISCUSSION

Non-contrast MRI future trends are likely represented by PCa screening and the application of artificial intelligence (AI) tools. PCa screening is still a controversial topic; bpMRI has become one of the most promising diagnostic applications, as it is a more sensitive test for PCa early detection, compared to serum PSA level test. Also, AI applications and radiomic have been the object of several studies investigating PCa detection using bpMRI, showing encouraging results.

CONCLUSION

Today, the accessibility to MRI for early detection of PCa is a priority. Results from prospective, multicenter, multireader, and paired validation studies are needed to provide evidence supporting its role in the clinical practice.

The Way of the Future: Personalizing Treatment Plans Through Technology

Advances in tissue analysis methods, image analysis, high-throughput molecular profiling, and computational tools increasingly allow us to capture and quantify patient-to patient variations that impact cancer risk, prognosis, and treatment response. Statistical models that integrate patient-specific information from multiple sources (e.g., family history, demographics, germline variants, imaging features) can provide individualized cancer risk predictions that can guide screening and prevention strategies. The precision, quality, and standardization of diagnostic imaging are improving through computer-aided solutions, and multigene prognostic and predictive tests improved predictions of prognosis and treatment response in various cancer types. A common theme across many of these advances is that individually moderately informative variables are combined into more accurate multivariable prediction models. Advances in machine learning and the availability of large data sets fuel rapid progress in this field. Molecular dissection of the cancer genome has become a reality in the clinic, and molecular target profiling is now routinely used to select patients for various targeted therapies. These technology-driven increasingly more precise and quantitative estimates of benefit versus risk from a given intervention empower patients and physicians to tailor treatment strategies that match patient values and expectations.