Ovarian imaging radiomics quality score assessment: an EuSoMII radiomics auditing group initiative

Role of artificial intelligence applied to ultrasound in gynecology oncology: A systematic review

The aim of this paper was to explore the role of artificial intelligence (AI) applied to ultrasound imaging in gynecology oncology. Web of Science, PubMed, and Scopus databases were searched. All studies were imported to RAYYAN QCRI software. The overall quality of the included studies was assessed using QUADAS-AI tool. Fifty studies were included, of these 37/50 (74.0%) on ovarian masses or ovarian cancer, 5/50 (10.0%) on endometrial cancer, 5/50 (10.0%) on cervical cancer, and 3/50 (6.0%) on other malignancies. Most studies were at high risk of bias for subject selection (i.e., sample size, source, or scanner model were not specified; data were not derived from open-source datasets; imaging preprocessing was not performed) and index test (AI models was not externally validated) and at low risk of bias for reference standard (i.e., the reference standard correctly classified the target condition) and workflow (i.e., the time between index test and reference standard was reasonable). Most studies presented machine learning models (33/50, 66.0%) for the diagnosis and histopathological correlation of ovarian masses, while others focused on automatic segmentation, reproducibility of radiomics features, improvement of image quality, prediction of therapy resistance, progression-free survival, and genetic mutation. The current evidence supports the role of AI as a complementary clinical and research tool in diagnosis, patient stratification, and prediction of histopathological correlation in gynecological malignancies. For example, the high performance of AI models to discriminate between benign and malignant ovarian masses or to predict their specific histology can improve the diagnostic accuracy of imaging methods.

Radiomics for the identification of extraprostatic extension with prostate MRI: a systematic review and meta-analysis

OBJECTIVES

Extraprostatic extension (EPE) of prostate cancer (PCa) is predicted using clinical nomograms. Incorporating MRI could represent a leap forward, although poor sensitivity and standardization represent unsolved issues. MRI radiomics has been proposed for EPE prediction. The aim of the study was to systematically review the literature and perform a meta-analysis of MRI-based radiomics approaches for EPE prediction.

MATERIALS AND METHODS

Multiple databases were systematically searched for radiomics studies on EPE detection up to June 2022. Methodological quality was appraised according to Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and radiomics quality score (RQS). The area under the receiver operating characteristic curves (AUC) was pooled to estimate predictive accuracy. A random-effects model estimated overall effect size. Statistical heterogeneity was assessed with I2 value. Publication bias was evaluated with a funnel plot. Subgroup analyses were performed to explore heterogeneity.

RESULTS

Thirteen studies were included, showing limitations in study design and methodological quality (median RQS 10/36), with high statistical heterogeneity. Pooled AUC for EPE identification was 0.80. In subgroup analysis, test-set and cross-validation-based studies had pooled AUC of 0.85 and 0.89 respectively. Pooled AUC was 0.72 for deep learning (DL)-based and 0.82 for handcrafted radiomics studies and 0.79 and 0.83 for studies with multiple and single scanner data, respectively. Finally, models with the best predictive performance obtained using radiomics features showed pooled AUC of 0.82, while those including clinical data of 0.76.

CONCLUSION

MRI radiomics-powered models to identify EPE in PCa showed a promising predictive performance overall. However, methodologically robust, clinically driven research evaluating their diagnostic and therapeutic impact is still needed.

CLINICAL RELEVANCE STATEMENT

Radiomics might improve the management of prostate cancer patients increasing the value of MRI in the assessment of extraprostatic extension. However, it is imperative that forthcoming research prioritizes confirmation studies and a stronger clinical orientation to solidify these advancements.

KEY POINTS

• MRI radiomics deserves attention as a tool to overcome the limitations of MRI in prostate cancer local staging. • Pooled AUC was 0.80 for the 13 included studies, with high heterogeneity (84.7%, p < .001), methodological issues, and poor clinical orientation. • Methodologically robust radiomics research needs to focus on increasing MRI sensitivity and bringing added value to clinical nomograms at patient level.

Application of magnetic resonance imaging radiomics in endometrial cancer: a systematic review and meta-analysis

PURPOSE

We aimed to systematically assess the methodological quality and clinical potential application of published magnetic resonance imaging (MRI)-based radiomics studies about endometrial cancer (EC).

METHODS

Studies of EC radiomics analyses published between 1 January 2000 and 19 March 2023 were extracted, and their methodological quality was evaluated using the radiomics quality score (RQS) and Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Pairwise correlation analyses and separate meta-analyses of studies exploring differential diagnoses and risk prediction were also performed.

RESULTS

Forty-five studies involving 3 aims were included. The mean RQS was 13.77 (range: 9-22.5); publication bias was observed in the areas of 'index test' and 'flow and timing'. A high RQS was significantly associated with therapy selection-aimed studies, low QUADAS-2 risk, recent publication year, and high-performance metrics. Raw data from 6 differential diagnosis and 34 risk prediction models were subjected to meta-analysis, revealing diagnostic odds ratios of 23.81 (95% confidence interval [CI] 8.48-66.83) and 18.23 (95% CI 13.68-24.29), respectively.

CONCLUSION

The methodological quality of radiomics studies involving patients with EC is unsatisfactory. However, MRI-based radiomics analyses showed promising utility in terms of differential diagnosis and risk prediction.

Current status and quality of radiomics studies for predicting outcome in acute ischemic stroke patients: a systematic review and meta-analysis

Background

Pre-treatment prediction of reperfusion and long-term prognosis in acute ischemic stroke (AIS) patients is crucial for effective treatment and decision-making. Recent studies have demonstrated that the inclusion of radiomics data can improve the performance of predictive models. This paper reviews published studies focused on radiomics-based prediction of reperfusion and long-term prognosis in AIS patients.

Methods

We systematically searched PubMed, Web of Science, and Cochrane databases up to September 9, 2023, for studies on radiomics-based prediction of AIS patient outcomes. The methodological quality of the included studies was evaluated using the phase classification criteria, the radiomics quality scoring (RQS) tool, and the Prediction model Risk Of Bias Assessment Tool (PROBAST). Two separate meta-analyses were performed of these studies that predict long-term prognosis and reperfusion in AIS patients.

Results

Sixteen studies with sample sizes ranging from 67 to 3,001 were identified. Ten studies were classified as phase II, and the remaining were categorized as phase 0 (n = 2), phase I (n = 1), and phase III (n = 3). The mean RQS score of all studies was 39.41%, ranging from 5.56 to 75%. Most studies (87.5%, 14/16) were at high risk of bias due to their retrospective design. The remaining two studies were categorized as low risk and unclear risk, respectively. The pooled area under the curve (AUC) was 0.88 [95% confidence interval (CI) 0.84-0.92] for predicting the long-term prognosis and 0.80 (95% CI 0.74-0.86) for predicting reperfusion in AIS.

Conclusion

Radiomics has the potential to predict immediate reperfusion and long-term outcomes in AIS patients. Further external validation and evaluation within the clinical workflow can facilitate personalized treatment for AIS patients. This systematic review provides valuable insights for optimizing radiomics prediction systems for both reperfusion and long-term outcomes in AIS patients.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023461671, identifier CRD42023461671.

Radiomics Applications in Spleen Imaging: A Systematic Review and Methodological Quality Assessment

The spleen, often referred to as the "forgotten organ", plays numerous important roles in various diseases. Recently, there has been an increased interest in the application of radiomics in different areas of medical imaging. This systematic review aims to assess the current state of the art and evaluate the methodological quality of radiomics applications in spleen imaging. A systematic search was conducted on PubMed, Scopus, and Web of Science. All the studies were analyzed, and several characteristics, such as year of publication, research objectives, and number of patients, were collected. The methodological quality was evaluated using the radiomics quality score (RQS). Fourteen articles were ultimately included in this review. The majority of these articles were published in non-radiological journals (78%), utilized computed tomography (CT) for extracting radiomic features (71%), and involved not only the spleen but also other organs for feature extraction (71%). Overall, the included papers achieved an average RQS total score of 9.71 ± 6.37, corresponding to an RQS percentage of 27.77 ± 16.04. In conclusion, radiomics applications in spleen imaging demonstrate promising results in various clinical scenarios. However, despite all the included papers reporting positive outcomes, there is a lack of consistency in the methodological approaches employed.

A systematic review and meta-analysis of CT and MRI radiomics in ovarian cancer: methodological issues and clinical utility

OBJECTIVES

We aimed to present the state of the art of CT- and MRI-based radiomics in the context of ovarian cancer (OC), with a focus on the methodological quality of these studies and the clinical utility of these proposed radiomics models.

METHODS

Original articles investigating radiomics in OC published in PubMed, Embase, Web of Science, and the Cochrane Library between January 1, 2002, and January 6, 2023, were extracted. The methodological quality was evaluated using the radiomics quality score (RQS) and Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Pairwise correlation analyses were performed to compare the methodological quality, baseline information, and performance metrics. Additional meta-analyses of studies exploring differential diagnoses and prognostic prediction in patients with OC were performed separately.

RESULTS

Fifty-seven studies encompassing 11,693 patients were included. The mean RQS was 30.7% (range - 4 to 22); less than 25% of studies had a high risk of bias and applicability concerns in each domain of QUADAS-2. A high RQS was significantly associated with a low QUADAS-2 risk and recent publication year. Significantly higher performance metrics were observed in studies examining differential diagnosis; 16 such studies as well as 13 exploring prognostic prediction were included in a separate meta-analysis, which revealed diagnostic odds ratios of 25.76 (95% confidence interval (CI) 13.50-49.13) and 12.55 (95% CI 8.38-18.77), respectively.

CONCLUSION

Current evidence suggests that the methodological quality of OC-related radiomics studies is unsatisfactory. Radiomics analysis based on CT and MRI showed promising results in terms of differential diagnosis and prognostic prediction.

CRITICAL RELEVANCE STATEMENT

Radiomics analysis has potential clinical utility; however, shortcomings persist in existing studies in terms of reproducibility. We suggest that future radiomics studies should be more standardized to better bridge the gap between concepts and clinical applications.

Artificial intelligence and radiomics in magnetic resonance imaging of rectal cancer: a review

Rectal cancer (RC) is one of the most common tumours worldwide in both males and females, with significant morbidity and mortality rates, and it accounts for approximately one-third of colorectal cancers (CRCs). Magnetic resonance imaging (MRI) has been demonstrated to be accurate in evaluating the tumour location and stage, mucin content, invasion depth, lymph node (LN) metastasis, extramural vascular invasion (EMVI), and involvement of the mesorectal fascia (MRF). However, these features alone remain insufficient to precisely guide treatment decisions. Therefore, new imaging biomarkers are necessary to define tumour characteristics for staging and restaging patients with RC. During the last decades, RC evaluation via MRI-based radiomics and artificial intelligence (AI) tools has been a research hotspot. The aim of this review was to summarise the achievement of MRI-based radiomics and AI for the evaluation of staging, response to therapy, genotyping, prediction of high-risk factors, and prognosis in the field of RC. Moreover, future challenges and limitations of these tools that need to be solved to favour the transition from academic research to the clinical setting will be discussed.

Radiomics Analysis for Multiple Myeloma: A Systematic Review with Radiomics Quality Scoring

Multiple myeloma (MM) is one of the most common hematological malignancies affecting the bone marrow. Radiomics analysis has been employed in the literature in an attempt to evaluate the bone marrow of MM patients. This manuscript aimed to systematically review radiomics research on MM while employing a radiomics quality score (RQS) to accurately assess research quality in the field. A systematic search was performed on Web of Science, PubMed, and Scopus. The selected manuscripts were evaluated (data extraction and RQS scoring) by three independent readers (R1, R2, and R3) with experience in radiomics analysis. A total of 23 studies with 2682 patients were included, and the median RQS was 10 for R1 (IQR 5.5-12) and R3 (IQR 8.3-12) and 11 (IQR 7.5-12.5) for R2. RQS was not significantly correlated with any of the assessed bibliometric data (impact factor, quartile, year of publication, and imaging modality) (p > 0.05). Our results demonstrated the low quality of published radiomics research in MM, similarly to other fields of radiomics research, highlighting the need to tighten publication standards.

A first look into radiomics application in testicular imaging: A systematic review

The aim of this systematic review was to evaluate the state of the art of radiomics in testicular imaging by assessing the quality of radiomic workflow using the Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). A systematic literature search was performed to find potentially relevant articles on the applications of radiomics in testicular imaging, and 6 final articles were extracted. The mean RQS was 11,33 ± 3,88 resulting in a percentage of 31,48% ± 10,78%. Regarding QUADAS-2 criteria, no relevant biases were found in the included papers in the patient selection, index test, reference standard criteria and flow-and-timing domain. In conclusion, despite the publication of promising studies, radiomic research on testicular imaging is in its very beginning and still hindered by methodological limitations, and the potential applications of radiomics for this field are still largely unexplored.