Convolutional Neural Networks for Automated Classification of Prostate Multiparametric Magnetic Resonance Imaging Based on Image Quality

Picture Perfect: The Status of Image Quality in Prostate MRI

Magnetic resonance imaging is the gold standard imaging modality for the diagnosis of prostate cancer (PCa). Image quality is a fundamental prerequisite for the ability to detect clinically significant disease. In this critical review, we separate the issue of image quality into quality improvement and quality assessment. Beginning with the evolution of technical recommendations for scan acquisition, we investigate the role of patient preparation, scanner factors, and more advanced sequences, including those featuring Artificial Intelligence (AI), in determining image quality. As means of quality appraisal, the published literature on scoring systems (including the Prostate Imaging Quality score), is evaluated. Finally, the application of AI and teaching courses as ways to facilitate quality assessment are discussed, encouraging the implementation of future image quality initiatives along the PCa diagnostic and monitoring pathway. EVIDENCE LEVEL: 3 TECHNICAL EFFICACY: Stage 3.

Deep Learning-Based T2-Weighted MR Image Quality Assessment and Its Impact on Prostate Cancer Detection Rates

BACKGROUND

Image quality evaluation of prostate MRI is important for successful implementation of MRI into localized prostate cancer diagnosis.

PURPOSE

To examine the impact of image quality on prostate cancer detection using an in-house previously developed artificial intelligence (AI) algorithm.

STUDY TYPE

Retrospective.

SUBJECTS

615 consecutive patients (median age 67 [interquartile range [IQR]: 61-71] years) with elevated serum PSA (median PSA 6.6 [IQR: 4.6-9.8] ng/mL) prior to prostate biopsy.

FIELD STRENGTH/SEQUENCE

3.0T/T2-weighted turbo-spin-echo MRI, high b-value echo-planar diffusion-weighted imaging, and gradient recalled echo dynamic contrast-enhanced.

ASSESSMENTS

Scans were prospectively evaluated during clinical readout using PI-RADSv2.1 by one genitourinary radiologist with 17 years of experience. For each patient, T2-weighted images (T2WIs) were classified as high-quality or low-quality based on evaluation of both general distortions (eg, motion, distortion, noise, and aliasing) and perceptual distortions (eg, obscured delineation of prostatic capsule, prostatic zones, and excess rectal gas) by a previously developed in-house AI algorithm. Patients with PI-RADS category 1 underwent 12-core ultrasound-guided systematic biopsy while those with PI-RADS category 2-5 underwent combined systematic and targeted biopsies. Patient-level cancer detection rates (CDRs) were calculated for clinically significant prostate cancer (csPCa, International Society of Urological Pathology Grade Group ≥2) by each biopsy method and compared between high- and low-quality images in each PI-RADS category.

STATISTICAL TESTS

Fisher's exact test. Bootstrap 95% confidence intervals (CI). A P value <0.05 was considered statistically significant.

RESULTS

385 (63%) T2WIs were classified as high-quality and 230 (37%) as low-quality by AI. Targeted biopsy with high-quality T2WIs resulted in significantly higher clinically significant CDR than low-quality images for PI-RADS category 4 lesions (52% [95% CI: 43-61] vs. 32% [95% CI: 22-42]). For combined biopsy, there was no significant difference in patient-level CDRs for PI-RADS 4 between high- and low-quality T2WIs (56% [95% CI: 47-64] vs. 44% [95% CI: 34-55]; P = 0.09).

DATA CONCLUSION

Higher quality T2WIs were associated with better targeted biopsy clinically significant cancer detection performance for PI-RADS 4 lesions. Combined biopsy might be needed when T2WI is lower quality.

LEVEL OF EVIDENCE

2 TECHNICAL EFFICACY: Stage 1.

PI-QUAL version 2: an update of a standardised scoring system for the assessment of image quality of prostate MRI

Multiparametric MRI is the optimal primary investigation when prostate cancer is suspected, and its ability to rule in and rule out clinically significant disease relies on high-quality anatomical and functional images. Avenues for achieving consistent high-quality acquisitions include meticulous patient preparation, scanner setup, optimised pulse sequences, personnel training, and artificial intelligence systems. The impact of these interventions on the final images needs to be quantified. The prostate imaging quality (PI-QUAL) scoring system was the first standardised quantification method that demonstrated the potential for clinical benefit by relating image quality to cancer detection ability by MRI. We present the updated version of PI-QUAL (PI-QUAL v2) which applies to prostate MRI performed with or without intravenous contrast medium using a simplified 3-point scale focused on critical technical and qualitative image parameters. CLINICAL RELEVANCE STATEMENT: High image quality is crucial for prostate MRI, and the updated version of the PI-QUAL score (PI-QUAL v2) aims to address the limitations of version 1. It is now applicable to both multiparametric MRI and MRI without intravenous contrast medium. KEY POINTS: High-quality images are essential for prostate cancer diagnosis and management using MRI. PI-QUAL v2 simplifies image assessment and expands its applicability to prostate MRI without contrast medium. PI-QUAL v2 focuses on critical technical and qualitative image parameters and emphasises T2-WI and DWI.

Clinical efficacy of different androgen deprivation therapies for prostate cancer and evaluation based on dynamic-contrast enhanced magnetic resonance imaging

Objective

To evaluate the clinical efficacy of different androgen deprivation therapies for prostate cancer (PCa) based on dynamic-contrast enhanced magnetic resonance imaging (DCE-MRI).

Methods

104 patients with PCa were studied, all of whom were treated with androgen deprivation therapy. The patients were divided into a continuous group (continuous androgen deprivation therapy) and an intermittent group (intermittent androgen deprivation therapy) by random number table method, 52 cases/group. The therapeutic effect and DCE-MRI indices were compared and the relationship between DCE-MRI indices and clinical efficacy and the evaluation value of therapeutic efficacy were analyzed.

Results

The objective response rate (ORR) of the intermittent group was higher than that of the continuous group (p < 0.05), and there was no significant difference in disease control rate (DCR) between the two groups (p > 0.05). After treatment, volume transfer coefficient (Ktrans), reverse transfer constant (Kep), volume fraction (Ve), blood volume (BV), and blood flow (BF) in both groups were lowered, and those in the intermittent group were lower than the continuous group (p < 0.05). Ktrans, Kep, Ve, BF, and BV in the ORR group were lower than those in the non-ORR group (p < 0.05). Ktrans, Kep, Ve, BF, and BV were correlated with the therapeutic effect of PCa (p < 0.05). The AUC value of the combined detection of DCE-MRI indices in evaluating the therapeutic effect of PCa was greater than that of each index alone (p < 0.05).

Conclusion

Compared with continuous androgen deprivation therapy, intermittent androgen deprivation therapy has better clinical efficacy in the treatment of PCa, and DCE-MRI indices are related to the treatment efficacy of PCa and have an evaluation value.

Deep Learning-Based Interpretable AI for Prostate T2W MRI Quality Evaluation

RATIONALE AND OBJECTIVES

Prostate MRI quality is essential in guiding prostate biopsies. However, assessment of MRI quality is subjective with variation. Quality degradation sources exert varying impacts based on the sequence under consideration, such as T2W versus DWI. As a result, employing sequence-specific techniques for quality assessment could yield more advantageous outcomes. This study aims to develop an AI tool that offers a more consistent evaluation of T2W prostate MRI quality, efficiently identifying suboptimal scans while minimizing user bias.

MATERIALS AND METHODS

This retrospective study included 1046 patients from three cohorts (ProstateX [n = 347], All-comer in-house [n = 602], enriched bad-quality MRI in-house [n = 97]) scanned between January 2011 and May 2022. An expert reader assigned T2W MRIs a quality score. A train-validation-test split of 70:15:15 was applied, ensuring equal distribution of MRI scanners and protocols across all partitions. T2W quality AI classification model was based on 3D DenseNet121 architecture using MONAI framework. In addition to multiclassification, binary classification was utilized (Classes 0/1 vs. 2). A score of 0 was given to scans considered non-diagnostic or unusable, a score of 1 was given to those with acceptable diagnostic quality with some usability but with some quality distortions present, and a score of 2 was given to those considered optimal diagnostic quality and usability. Partial occlusion sensitivity maps were generated for anatomical correlation. Three body radiologists assessed reproducibility within a subgroup of 60 test cases using weighted Cohen Kappa.

RESULTS

The best validation multiclass accuracy of 77.1% (121/157) was achieved during training. In the test dataset, multiclassification accuracy was 73.9% (116/157), whereas binary accuracy was 84.7% (133/157). Sub-class sensitivity for binary quality distortion classification for class 0 was 100% (18/18), and sub-class specificity for T2W classification of absence/minimal quality distortions for class 2 was 90.5% (95/105). All three readers showed moderate to substantial agreement with ground truth (R1-R3 κ = 0.588, κ = 0.649, κ = 0.487, respectively), moderate to substantial agreement with each other (R1-R2 κ = 0.599, R1-R3 κ = 0.612, R2-R3 κ = 0.685), fair to moderate agreement with AI (R1-R3 κ = 0.445, κ = 0.410, κ = 0.292, respectively). AI showed substantial agreement with ground truth (κ = 0.704). 3D quality heatmap evaluation revealed that the most critical non-diagnostic quality imaging features from an AI perspective related to obscuration of the rectoprostatic space (94.4%, 17/18).

CONCLUSION

The 3D AI model can assess T2W prostate MRI quality with moderate accuracy and translate whole sequence-level classification labels into 3D voxel-level quality heatmaps for interpretation. Image quality has a significant downstream impact on ruling out clinically significant cancers. AI may be able to help with reproducible identification of MRI sequences requiring re-acquisition with explainability.

Machine learning based prediction of image quality in prostate MRI using rapid localizer images

Purpose

Diagnostic performance of prostate MRI depends on high-quality imaging. Prostate MRI quality is inversely proportional to the amount of rectal gas and distention. Early detection of poor-quality MRI may enable intervention to remove gas or exam rescheduling, saving time. We developed a machine learning based quality prediction of yet-to-be acquired MRI images solely based on MRI rapid localizer sequence, which can be acquired in a few seconds.

Approach

The dataset consists of 213 (147 for training and 64 for testing) prostate sagittal T2-weighted (T2W) MRI localizer images and rectal content, manually labeled by an expert radiologist. Each MRI localizer contains seven two-dimensional (2D) slices of the patient, accompanied by manual segmentations of rectum for each slice. Cascaded and end-to-end deep learning models were used to predict the quality of yet-to-be T2W, DWI, and apparent diffusion coefficient (ADC) MRI images. Predictions were compared to quality scores determined by the experts using area under the receiver operator characteristic curve and intra-class correlation coefficient.

Results

In the test set of 64 patients, optimal versus suboptimal exams occurred in 95.3% (61/64) versus 4.7% (3/64) for T2W, 90.6% (58/64) versus 9.4% (6/64) for DWI, and 89.1% (57/64) versus 10.9% (7/64) for ADC. The best performing segmentation model was 2D U-Net with ResNet-34 encoder and ImageNet weights. The best performing classifier was the radiomics based classifier.

Conclusions

A radiomics based classifier applied to localizer images achieves accurate diagnosis of subsequent image quality for T2W, DWI, and ADC prostate MRI sequences.

Update on Optimization of Prostate MR Imaging Technique and Image Quality

Prostate MR imaging quality has improved dramatically over recent times, driven by advances in hardware, software, and improved functional imaging techniques. MRI now plays a key role in prostate cancer diagnostic work-up, but outcomes of the MRI-directed pathway are heavily dependent on image quality and optimization. MR sequences can be affected by patient-related degradations relating to motion and susceptibility artifacts which may enable only partial mitigation. In this Review, we explore issues relating to prostate MRI acquisition and interpretation, mitigation strategies at a patient and scanner level, PI-QUAL reporting, and future directions in image quality, including artificial intelligence solutions.

Design of a magnetic resonance imaging-based screening program for early diagnosis of prostate cancer: preliminary results of a randomized controlled trial-Prostate Cancer Secondary Screening in Sapienza (PROSA)

OBJECTIVES

The main objective is to propose an MRI-based screening protocol, investigating the role of MRI without the injection of contrast media (bi-parametric MRI, bpMRI) as a secondary prevention test for prostate cancer (PCa) early diagnosis, comparing MRI with the prostate specific antigen (PSA) test. For this reason, preliminary results of Prostate Cancer Secondary Screening in Sapienza (PROSA) are presented, to investigate the efficiency of an MRI-based screening protocol. PROSA is a prospective, randomized, single-center study. To date, 351 men have been enrolled and blindly randomized into two different arms: (A) Men underwent a bpMRI regardless of their PSA values (175); (B) Men followed as per clinical practice: those with increased PSA (61) were referred to bpMRI, while those with normal PSA (112) were not. Men who screened positive on MRI were directed to MR-directed targeted biopsy. On arm A, 4 clinically significant PCa have been detected, while none was found on arm B (p = 0.046). To evaluate the efficiency of the screening protocol, we calculated the experimental event rate (EER, 3.6%), control event rate (CER, 1.2%.), absolute risk reduction (ARR, 2.5%), and number needed to treat (NNT, 40.3). PROSA represents an interesting experience in the field of imaging-based PCa screening. The preliminary data from this trial highlight the promising role of non-contrast MRI as a screening tool for early detection of PCa. Further data will finally validate the most appropriate screening program.

CLINICAL RELEVANCE STATEMENT

PROSA depicts an interesting experience in the field of research focused on imaging-based prostate cancer screening. Its preliminary data highlight the promising role of non-contrast MRI as a screening tool for early detection of PCa.

KEY POINTS

• Promotion of an MRI-based screening protocol, investigating the role of non-contrast MRI as a secondary prevention test for prostate cancer early diagnosis, comparing MRI with PSA test. • Prostate Cancer Secondary Screening in Sapienza (PROSA) represents an interesting experience in the field of research focused on imaging-based prostate cancer screening; its preliminary results indicate that it is possible to use non-contrast MRI as a screening tool for early detection of PCa. • This new approach to PCa screening could facilitate the early diagnosis of clinically significant prostate cancer while reducing the number of unnecessary prostate biopsies and the detection of clinically insignificant prostate cancer.

Radiomics based automated quality assessment for T2W prostate MR images

PURPOSE

The guidelines for prostate cancer recommend the use of MRI in the prostate cancer pathway. Due to the variability in prostate MR image quality, the reliability of this technique in the detection of prostate cancer is highly variable in clinical practice. This leads to the need for an objective and automated assessment of image quality to ensure an adequate acquisition and hereby to improve the reliability of MRI. The aim of this study is to investigate the feasibility of Blind/referenceless image spatial quality evaluator (Brisque) and radiomics in automated image quality assessment of T2-weighted (T2W) images.

METHOD

Anonymized axial T2W images from 140 patients were scored for quality using a five-point Likert scale (low, suboptimal, acceptable, good, very good quality) in consensus by two readers. Images were dichotomized into clinically acceptable (very good, good and acceptable quality images) and clinically unacceptable (low and suboptimal quality images) in order to train and verify the model. Radiomics and Brisque features were extracted from a central cuboid volume including the prostate. A reduced feature set was used to fit a Linear Discriminant Analysis (LDA) model to predict image quality. Two hundred times repeated 5-fold cross-validation was used to train the model and test performance by assessing the classification accuracy, the discrimination accuracy as receiver operating curve - area under curve (ROC-AUC), and by generating confusion matrices.

RESULTS

Thirty-four images were classified as clinically unacceptable and 106 were classified as clinically acceptable. The accuracy of the independent test set (mean ± standard deviation) was 85.4 ± 5.5%. The ROC-AUC was 0.856 (0.851 - 0.861) (mean; 95% confidence interval).

CONCLUSIONS

Radiomics AI can automatically detect a significant portion of T2W images of suboptimal image quality. This can help improve image quality at the time of acquisition, thus reducing repeat scans and improving diagnostic accuracy.

Low cancer yield in PI-RADS 3 upgraded to 4 by dynamic contrast-enhanced MRI: is it time to reconsider scoring categorization?

OBJECTIVES

To evaluate MRI diagnostic performance in detecting clinically significant prostate cancer (csPCa) in peripheral-zone PI-RADS 4 lesions, comparing those with clearly restricted diffusion (DWI-score 4), and those with equivocal diffusion pattern (DWI-score 3) and positive dynamic contrast-enhanced (DCE) MRI.

METHODS

This observational prospective study enrolled 389 men referred to MRI and, if positive (PI-RADS 3 with PSA-density [PSAD] ≥ 0.15 ng/mL/mL, 4 and 5), to MRI-directed biopsy. Lesions with DWI-score 3 and positive DCE were classified as "PI-RADS 3up," instead of PI-RADS 4. Univariable and multivariable analyses were implemented to determine features correlated to csPCa detection.

RESULTS

Prevalence of csPCa was 14.5% and 53.3% in PI-RADS categories 3up and 4, respectively (p < 0.001). MRI showed a sensitivity of 100.0%, specificity 40.9%, PPV 46.5%, NPV 100.0%, and accuracy 60.9% for csPCa detection. Modifying the threshold to consider MRI positive and to indicate biopsy (same as previously described, but PI-RADS 3up only when associated with elevated PSAD), the sensitivity changed to 93.9%, specificity 57.2%, PPV 53.0%, NPV 94.8%, and accuracy 69.7%. Age (p < 0.001), PSAD (p < 0.001), positive DWI (p < 0.001), and PI-RADS score (p = 0.04) resulted in independent predictors of csPCa.

CONCLUSIONS

Most cases of PI-RADS 3up were false-positives, suggesting that upgrading peripheral lesions with DWI-score 3 to PI-RADS 4 because of positive DCE has a detrimental effect on MRI accuracy, decreasing the true prevalence of csPCa in the PI-RADS 4 category. PI-RADS 3up should not be upgraded and directed to biopsy only if associated with increased PSAD.

KEY POINTS

• As per PI-RADS v2.1 recommendations, in case of a peripheral zone lesion with equivocal diffusion-weighted imaging (DWI score 3), but positive dynamic contrast-enhanced (DCE) MRI, the overall PI-RADS score should be upgraded to 4. • The current PI-RADS recommendation of upgrading PI-RADS 3 lesions of the peripheral zone to PI-RADS 4 because of positive DCE decreased clinically significant prostate cancer detection rate in our series. • According to our results, the most accurate threshold for setting indication to prostate biopsy is PI-RADS 3 or PI-RADS 3 with positive DCE both associated with increased PSA density.

The role of AI in prostate MRI quality and interpretation: Opportunities and challenges

Prostate MRI plays an important role in imaging the prostate gland and surrounding tissues, particularly in the diagnosis and management of prostate cancer. With the widespread adoption of multiparametric magnetic resonance imaging in recent years, the concerns surrounding the variability of imaging quality have garnered increased attention. Several factors contribute to the inconsistency of image quality, such as acquisition parameters, scanner differences and interobserver variabilities. While efforts have been made to standardize image acquisition and interpretation via the development of systems, such as PI-RADS and PI-QUAL, the scoring systems still depend on the subjective experience and acumen of humans. Artificial intelligence (AI) has been increasingly used in many applications, including medical imaging, due to its ability to automate tasks and lower human error rates. These advantages have the potential to standardize the tasks of image interpretation and quality control of prostate MRI. Despite its potential, thorough validation is required before the implementation of AI in clinical practice. In this article, we explore the opportunities and challenges of AI, with a focus on the interpretation and quality of prostate MRI.

Prostate MRI and image Quality: It is time to take stock

Multiparametric magnetic resonance imaging (mpMRI) plays a vital role in prostate cancer diagnosis and management. With the increase in use of mpMRI, obtaining the best possible quality images has become a priority. The Prostate Imaging Reporting and Data System (PI-RADS) was introduced to standardize and optimize patient preparation, scanning techniques, and interpretation. However, the quality of the MRI sequences depends not only on the hardware/software and scanning parameters, but also on patient-related factors. Common patient-related factors include bowel peristalsis, rectal distension, and patient motion. There is currently no consensus regarding the best approaches to address these issues and improve the quality of mpMRI. New evidence has been accrued since the release of PI-RADS, and this review aims to explore the key strategies which aim to improve prostate MRI quality, such as imaging techniques, patient preparation methods, the new Prostate Imaging Quality (PI-QUAL) criteria, and artificial intelligence on prostate MRI quality.

Quality checkpoints in the MRI-directed prostate cancer diagnostic pathway

Multiparametric MRI of the prostate is now recommended as the initial diagnostic test for men presenting with suspected prostate cancer, with a negative MRI enabling safe avoidance of biopsy and a positive result enabling MRI-directed sampling of lesions. The diagnostic pathway consists of several steps, from initial patient presentation and preparation to performing and interpreting MRI, communicating the imaging findings, outlining the prostate and intra-prostatic target lesions, performing the biopsy and assessing the cores. Each component of this pathway requires experienced clinicians, optimized equipment, good inter-disciplinary communication between specialists, and standardized workflows in order to achieve the expected outcomes. Assessment of quality and mitigation measures are essential for the success of the MRI-directed prostate cancer diagnostic pathway. Quality assurance processes including Prostate Imaging-Reporting and Data System, template biopsy, and pathology guidelines help to minimize variation and ensure optimization of the diagnostic pathway. Quality control systems including the Prostate Imaging Quality scoring system, patient-level outcomes (such as Prostate Imaging-Reporting and Data System MRI score assignment and cancer detection rates), multidisciplinary meeting review and audits might also be used to provide consistency of outcomes and ensure that all the benefits of the MRI-directed pathway are achieved.

A Multimodal Ensemble Driven by Multiobjective Optimisation to Predict Overall Survival in Non-Small-Cell Lung Cancer

Lung cancer accounts for more deaths worldwide than any other cancer disease. In order to provide patients with the most effective treatment for these aggressive tumours, multimodal learning is emerging as a new and promising field of research that aims to extract complementary information from the data of different modalities for prognostic and predictive purposes. This knowledge could be used to optimise current treatments and maximise their effectiveness. To predict overall survival, in this work, we investigate the use of multimodal learning on the CLARO dataset, which includes CT images and clinical data collected from a cohort of non-small-cell lung cancer patients. Our method allows the identification of the optimal set of classifiers to be included in the ensemble in a late fusion approach. Specifically, after training unimodal models on each modality, it selects the best ensemble by solving a multiobjective optimisation problem that maximises both the recognition performance and the diversity of the predictions. In the ensemble, the labels of each sample are assigned using the majority voting rule. As further validation, we show that the proposed ensemble outperforms the models learning a single modality, obtaining state-of-the-art results on the task at hand.