A systematic review of prognosis predictive role of radiomics in pancreatic cancer: heterogeneity markers or statistical tricks?

Can our experience with surveillance for inherited pancreatic cancer help to identify early pancreatic cancer in the general population?

Screening of the general population for cancer is a matter of primary prevention reducing the burden of disease. Whilst this is successful for several cancers including breast, colon and prostate, the situation to screen and hence prevent pancreatic cancer is different. The organ is not as accessible to simple physical exam or biological samples (fecal or blood test). Neither exists a blood test such as PSA that is cost-effective. Reviewing the evidence from screening risk groups for pancreatic cancer, one must conclude that there is no rational at present to screen the general population, for a lack of appropriate tests.

Differential diagnostic value of radiomics models in benign versus malignant vertebral compression fractures: A systematic review and meta-analysis

PURPOSE

Early diagnosis of benign and malignant vertebral compression fractures by analyzing imaging data is crucial to guide treatment and assess prognosis, and the development of radiomics made it an alternative option to biopsy examination. This systematic review and meta-analysis was conducted with the purpose of quantifying the diagnostic efficacy of radiomics models in distinguishing between benign and malignant vertebral compression fractures.

METHODS

Searching on PubMed, Embase, Web of Science and Cochrane Library was conducted to identify eligible studies published before September 23, 2023. After evaluating for methodological quality and risk of bias using the Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2), we selected studies providing confusion matrix results to be included in random-effects meta-analysis.

RESULTS

A total of sixteen articles, involving 1,519 vertebrae with pathological-diagnosed tumor infiltration, were included in our meta-analysis. The combined sensitivity and specificity of the top-performing models were 0.92 (95 % CI: 0.87-0.96) and 0.93 (95 % CI: 0.88-0.96), respectively. Their AUC was 0.97 (95 % CI: 0.96-0.99). By contrast, radiologists' combined sensitivity was 0.90 (95 %CI: 0.75-0.97) and specificity was 0.92 (95 %CI: 0.67-0.98). The AUC was 0.96 (95 %CI: 0.94-0.97). Subsequent subgroup analysis and sensitivity test suggested that part of the heterogeneity might be explained by differences in imaging modality, segmentation, deep learning and cross-validation.

CONCLUSION

We found remarkable diagnosis potential in correctly distinguishing vertebral compression fractures in complex clinical contexts. However, the published radiomics models still have a great heterogeneity, and more large-scale clinical trials are essential to validate their generalizability.

Radiomics Beyond the Hype: A Critical Evaluation Toward Oncologic Clinical Use

Radiomics is a promising and fast-developing field within oncology that involves the mining of quantitative high-dimensional data from medical images. Radiomics has the potential to transform cancer management, whereby radiomics data can be used to aid early tumor characterization, prognosis, risk stratification, treatment planning, treatment response assessment, and surveillance. Nevertheless, certain challenges have delayed the clinical adoption and acceptability of radiomics in routine clinical practice. The objectives of this report are to (a) provide a perspective on the translational potential and potential impact of radiomics in oncology; (b) explore frequent challenges and mistakes in its derivation, encompassing study design, technical requirements, standardization, model reproducibility, transparency, data sharing, privacy concerns, quality control, as well as the complexity of multistep processes resulting in less radiologist-friendly interfaces; (c) discuss strategies to overcome these challenges and mistakes; and (d) propose measures to increase the clinical use and acceptability of radiomics, taking into account the different perspectives of patients, health care workers, and health care systems. Keywords: Radiomics, Oncology, Cancer Management, Artificial Intelligence © RSNA, 2024.

Diagnostic accuracy of radiomics-based machine learning for neoadjuvant chemotherapy response and survival prediction in gastric cancer patients: A systematic review and meta-analysis

BACKGROUND

In recent years, researchers have explored the use of radiomics to predict neoadjuvant chemotherapy outcomes in gastric cancer (GC). Yet, a lingering debate persists regarding the accuracy of these predictions. Against this backdrop, this study was conducted to examine the accuracy of radiomics in predicting the response to neoadjuvant chemotherapy in GC patients.

METHODS

An exhaustive search of relevant studies was conducted in PubMed, Cochrane, Embase, and Web of Science databases up to February 21, 2023. The radiomics quality scoring (RQS) tool was employed to assess study quality. Tumor response to neoadjuvant chemotherapy and survival outcomes were examined as outcome measures.

RESULTS

Fourteen studies involving 3,373 GC patients who had received neoadjuvant chemotherapy were incorporated in our meta-analysis. The mean RQS score across all studies was 36.3%, ranging between 0 and 63.9%. On the validation cohort, when the modeling variables were restricted to radiomic features alone, the predictive performance was characterized by a c-index of 0.750 (95% CI: 0.710-0.790), with a sensitivity of 0.67 (95% CI: 0.58-0.75) and a specificity of 0.77 (95% CI: 0.69-0.84) for the prediction of neoadjuvant chemotherapy response. When clinical data was integrated with radiomic features as modeling variables, the predictive performance improved, yielding a c-index of 0.814 (95% CI: 0.780-0.847), a sensitivity of 0.78 [95% CI: 0.70-0.84], and a specificity of 0.73 [95% CI: 0.67-0.79].

CONCLUSIONS

Radiomics holds promise to noninvasively predict neoadjuvant chemotherapy response and survival outcomes among patients with locally advanced GC. Additionally, we underscore the need for future multicenter studies and the development of imaging-sourced tools for risk stratification in this patient population.

Application of magnetic resonance imaging radiomics in endometrial cancer: a systematic review and meta-analysis

PURPOSE

We aimed to systematically assess the methodological quality and clinical potential application of published magnetic resonance imaging (MRI)-based radiomics studies about endometrial cancer (EC).

METHODS

Studies of EC radiomics analyses published between 1 January 2000 and 19 March 2023 were extracted, and their methodological quality was evaluated using the radiomics quality score (RQS) and Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Pairwise correlation analyses and separate meta-analyses of studies exploring differential diagnoses and risk prediction were also performed.

RESULTS

Forty-five studies involving 3 aims were included. The mean RQS was 13.77 (range: 9-22.5); publication bias was observed in the areas of 'index test' and 'flow and timing'. A high RQS was significantly associated with therapy selection-aimed studies, low QUADAS-2 risk, recent publication year, and high-performance metrics. Raw data from 6 differential diagnosis and 34 risk prediction models were subjected to meta-analysis, revealing diagnostic odds ratios of 23.81 (95% confidence interval [CI] 8.48-66.83) and 18.23 (95% CI 13.68-24.29), respectively.

CONCLUSION

The methodological quality of radiomics studies involving patients with EC is unsatisfactory. However, MRI-based radiomics analyses showed promising utility in terms of differential diagnosis and risk prediction.

Preoperative prediction of early recurrence in resectable pancreatic cancer integrating clinical, radiologic, and CT radiomics features

OBJECTIVES

To use clinical, radiographic, and CT radiomics features to develop and validate a preoperative prediction model for the early recurrence of pancreatic cancer.

METHODS

We retrospectively analyzed 190 patients (150 and 40 in the development and test cohort from different centers) with pancreatic cancer who underwent pancreatectomy between January 2018 and June 2021. Radiomics, clinical-radiologic (CR), and clinical-radiologic-radiomics (CRR) models were developed for the prediction of recurrence within 12 months after surgery. Performance was evaluated using the area under the curve (AUC), Brier score, sensitivity, and specificity.

RESULTS

Early recurrence occurred in 36.7% and 42.5% of the development and test cohorts, respectively (P = 0.62). The features for the CR model included carbohydrate antigen 19-9 > 500 U/mL (odds ratio [OR], 3.60; P = 0.01), abutment to the portal and/or superior mesenteric vein (OR, 2.54; P = 0.054), and adjacent organ invasion (OR, 2.91; P = 0.03). The CRR model demonstrated significantly higher AUCs than the radiomics model in the internal (0.77 vs. 0.73; P = 0.048) and external (0.83 vs. 0.69; P = 0.038) validations. Although we found no significant difference between AUCs of the CR and CRR models (0.83 vs. 0.76; P = 0.17), CRR models showed more balanced sensitivity and specificity (0.65 and 0.87) than CR model (0.41 and 0.91) in the test cohort.

CONCLUSIONS

The CRR model outperformed the radiomics and CR models in predicting the early recurrence of pancreatic cancer, providing valuable information for risk stratification and treatment guidance.

Advances in the management of pancreatic cancer

Pancreatic cancer remains among the malignancies with the worst outcomes. Survival has been improving, but at a slower rate than other cancers. Multimodal treatment, including chemotherapy, surgical resection, and radiotherapy, has been under investigation for many years. Because of the anatomical characteristics of the pancreas, more emphasis on treatment selection has been placed on local extension into major vessels. Recently, the development of more effective treatment regimens has opened up new treatment strategies, but urgent research questions have also become apparent. This review outlines the current management of pancreatic cancer, and the recent advances in its treatment. The review discusses future treatment pathways aimed at integrating novel findings of translational and clinical research.

Avoid non-diagnostic EUS-FNA: a DNN model as a possible gatekeeper to distinguish pancreatic lesions prone to inconclusive biopsy

OBJECTIVE

This work aimed to explore the utility of CT radiomics with machine learning for distinguishing the pancreatic lesions prone to non-diagnostic ultrasound-guided fine-needle aspiration (EUS-FNA).

METHODS

498 patients with pancreatic EUS-FNA were retrospectively reviewed [Development cohort: 147 pancreatic ductal adenocarcinoma (PDAC); Validation cohort: 37 PDAC]. Pancreatic lesions not PDAC were also tested exploratively. Radiomics extracted from contrast-enhanced CT was integrated with deep neural networks (DNN) after dimension reduction. The receiver operating characteristic (ROC) curve, and decision curve analysis (DCA) were performed for model evaluation. And, the explainability of the DNN model was analyzed by integrated gradients.

RESULTS

The DNN model was effective in distinguishing PDAC lesions prone to non-diagnostic EUS-FNA (Development cohort: AUC = 0.821, 95% CI: 0.742-0.900; Validation cohort: AUC = 0.745, 95% CI: 0.534-0.956). In all cohorts, the DNN model showed better utility than the logistic model based on traditional lesion characteristics with NRI >0 (p < 0.05). And, the DNN model had net benefits of 21.6% at the risk threshold of 0.60 in the validation cohort. As for the model explainability, gray-level co-occurrence matrix (GLCM) features contributed the most averagely and the first-order features were the most important in the sum attribution.

CONCLUSION

The CT radiomics-based DNN model can be a useful auxiliary tool for distinguishing the pancreatic lesions prone to nondiagnostic EUS-FNA and provide alerts for endoscopists preoperatively to reduce unnecessary EUS-FNA.

ADVANCES IN KNOWLEDGE

This is the first investigation into the utility of CT radiomics-based machine learning in avoiding non-diagnostic EUS-FNA for patients with pancreatic masses and providing potential pre-operative assistance for endoscopists.

Predicting the risk of distant metastasis in patients with locally advanced rectal cancer using model based on pre-treatment T2WI-based radiomic features plus postoperative pathological stage

Objective

To assess the prognostic value of a model based on pre-treatment T2WI-based radiomic features and postoperative pathological staging in patients with locally advanced rectal cancer who have undergone neoadjuvant chemoradiotherapy.

Methods

Radiomic features were derived from T2WI, and a radiomic signature (RS) was established and validated for the prediction of distant metastases (DM). Subsequently, we designed and validated a nomogram model that combined the radiomic signature and postoperative pathological staging for enhanced DM prediction. Performance measures such as the concordance index (C-index) and area under the curve (AUC) were computed to assess the predictive accuracy of the models.

Results

A total of 260 patients participated in this study, of whom 197 (75.8%) were male, and the mean age was 57.2 years with a standard deviation of 11.2 years. 15 radiomic features were selected to define the radiomic signature. Patients with a high-risk radiomic signature demonstrated significantly shorter distant metastasis-free survival (DMFS) in both the development and validation cohorts. A nomogram, incorporating the radiomic signature, pathological T stage, and N stage, achieved an area under the curve (AUC) value of 0.72 (95% CI, 0.60-0.83) in the development cohort and 0.83 (95% CI, 0.73-0.92) in the validation cohort.

Conclusion

A radiomic signature derived from T2WI-based radiomic features can effectively distinguish patients with varying risks of DM. Furthermore, a nomogram integrating the radiomic signature and postoperative pathological stage proves to be a robust predictor of DMFS.

Methodological quality of radiomic-based prognostic studies in gastric cancer: a cross-sectional study

Background

Machine learning radiomics models are increasingly being used to predict gastric cancer prognoses. However, the methodological quality of these models has not been evaluated. Therefore, this study aimed to evaluate the methodological quality of radiomics studies in predicting the prognosis of gastric cancer, summarize their methodological characteristics and performance.

Methods

The PubMed and Embase databases were searched for radiomics studies used to predict the prognosis of gastric cancer published in last 5 years. The characteristics of the studies and the performance of the models were extracted from the eligible full texts. The methodological quality, reporting completeness and risk of bias of the included studies were evaluated using the RQS, TRIPOD and PROBAST. The discrimination ability scores of the models were also compared.

Results

Out of 283 identified records, 22 studies met the inclusion criteria. The study endpoints included survival time, treatment response, and recurrence, with reported discriminations ranging between 0.610 and 0.878 in the validation dataset. The mean overall RQS value was 15.32 ± 3.20 (range: 9 to 21). The mean adhered items of the 35 item of TRIPOD checklist was 20.45 ± 1.83. The PROBAST showed all included studies were at high risk of bias.

Conclusion

The current methodological quality of gastric cancer radiomics studies is insufficient. Large and reasonable sample, prospective, multicenter and rigorously designed studies are required to improve the quality of radiomics models for gastric cancer prediction.

Study registration

This protocol was prospectively registered in the Open Science Framework Registry (https://osf.io/ja52b).

Clinical-radiomics-based treatment decision support for KIT Exon 11 deletion in gastrointestinal stromal tumors: a multi-institutional retrospective study

Objective

gastrointestinal stromal tumors (GISTs) with KIT exon 11 deletions have more malignant clinical outcomes. A radiomics model was constructed for the preoperative prediction of KIT exon 11 deletion in GISTs.

Methods

Overall, 126 patients with GISTs who underwent preoperative enhanced CT were included. GISTs were manually segmented using ITK-SNAP in the arterial phase (AP) and portal venous phase (PVP) images of enhanced CT. Features were extracted using Anaconda (version 4.2.0) with PyRadiomics. Radiomics models were constructed by LASSO. The clinical-radiomics model (combined model) was constructed by combining the clinical model with the best diagnostic effective radiomics model. ROC curves were used to compare the diagnostic effectiveness of radiomics model, clinical model, and combined model. Diagnostic effectiveness among radiomics model, clinical model and combine model were analyzed in external cohort (n=57). Statistics were carried out using R 3.6.1.

Results

The Radscore showed favorable diagnostic efficacy. Among all radiomics models, the AP-PVP radiomics model exhibited excellent performance in the training cohort, with an AUC of 0.787 (95% CI: 0.687-0.866), which was verified in the test cohort (AUC=0.775, 95% CI: 0.608-0.895). Clinical features were also analyzed. Among the radiomics, clinical and combined models, the combined model showed favorable diagnostic efficacy in the training (AUC=0.863) and test cohorts (AUC=0.851). The combined model yielded the largest AUC of 0.829 (95% CI, 0.621-0.950) for the external validation of the combined model. GIST patients could be divided into high or low risk subgroups of recurrence and mortality by the Radscore.

Conclusion

The radiomics models based on enhanced CT for predicting KIT exon 11 deletion mutations have good diagnostic performance.

A systematic review and meta-analysis of CT and MRI radiomics in ovarian cancer: methodological issues and clinical utility

OBJECTIVES

We aimed to present the state of the art of CT- and MRI-based radiomics in the context of ovarian cancer (OC), with a focus on the methodological quality of these studies and the clinical utility of these proposed radiomics models.

METHODS

Original articles investigating radiomics in OC published in PubMed, Embase, Web of Science, and the Cochrane Library between January 1, 2002, and January 6, 2023, were extracted. The methodological quality was evaluated using the radiomics quality score (RQS) and Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Pairwise correlation analyses were performed to compare the methodological quality, baseline information, and performance metrics. Additional meta-analyses of studies exploring differential diagnoses and prognostic prediction in patients with OC were performed separately.

RESULTS

Fifty-seven studies encompassing 11,693 patients were included. The mean RQS was 30.7% (range - 4 to 22); less than 25% of studies had a high risk of bias and applicability concerns in each domain of QUADAS-2. A high RQS was significantly associated with a low QUADAS-2 risk and recent publication year. Significantly higher performance metrics were observed in studies examining differential diagnosis; 16 such studies as well as 13 exploring prognostic prediction were included in a separate meta-analysis, which revealed diagnostic odds ratios of 25.76 (95% confidence interval (CI) 13.50-49.13) and 12.55 (95% CI 8.38-18.77), respectively.

CONCLUSION

Current evidence suggests that the methodological quality of OC-related radiomics studies is unsatisfactory. Radiomics analysis based on CT and MRI showed promising results in terms of differential diagnosis and prognostic prediction.

CRITICAL RELEVANCE STATEMENT

Radiomics analysis has potential clinical utility; however, shortcomings persist in existing studies in terms of reproducibility. We suggest that future radiomics studies should be more standardized to better bridge the gap between concepts and clinical applications.

An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation

OBJECTIVE

To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level.

METHODS

A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated.

RESULTS

We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation.

CONCLUSIONS

The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence.

CLINICAL RELEVANCE STATEMENT

The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.

Blood- and Imaging-Derived Biomarkers for Oncological Outcome Modelling in Oropharyngeal Cancer: Exploring the Low-Hanging Fruit

Aims: To assess whether CT-based radiomics and blood-derived biomarkers could improve the prediction of overall survival (OS) and locoregional progression-free survival (LRPFS) in patients with oropharyngeal cancer (OPC) treated with curative-intent RT. Methods: Consecutive OPC patients with primary tumors treated between 2005 and 2021 were included. Analyzed clinical variables included gender, age, smoking history, staging, subsite, HPV status, and blood parameters (baseline hemoglobin levels, neutrophils, monocytes, and platelets, and derived measurements). Radiomic features were extracted from the gross tumor volumes (GTVs) of the primary tumor using pyradiomics. Outcomes of interest were LRPFS and OS. Following feature selection, a radiomic score (RS) was calculated for each patient. Significant variables, along with age and gender, were included in multivariable analysis, and models were retained if statistically significant. The models’ performance was compared by the C-index. Results: One hundred and five patients, predominately male (71%), were included in the analysis. The median age was 59 (IQR: 52–66) years, and stage IVA was the most represented (70%). HPV status was positive in 63 patients, negative in 7, and missing in 35 patients. The median OS follow-up was 6.3 (IQR: 5.5–7.9) years. A statistically significant association between low Hb levels and poorer LRPFS in the HPV-positive subgroup (p = 0.038) was identified. The calculation of the RS successfully stratified patients according to both OS (log-rank p < 0.0001) and LRPFS (log-rank p = 0.0002). The C-index of the clinical and radiomic model resulted in 0.82 [CI: 0.80–0.84] for OS and 0.77 [CI: 0.75–0.79] for LRPFS. Conclusions: Our results show that radiomics could provide clinically significant informative content in this scenario. The best performances were obtained by combining clinical and quantitative imaging variables, thus suggesting the potential of integrative modeling for outcome predictions in this setting of patients.

CT Radiomics and Whole Genome Sequencing in Patients with Pancreatic Ductal Adenocarcinoma: Predictive Radiogenomics Modeling

We investigate whether computed tomography (CT) derived radiomics may correlate with driver gene mutations in patients with pancreatic ductal adenocarcinoma (PDAC). In this retrospective study, 47 patients (mean age 64 ± 11 years; range: 42-86 years) with PDAC, who were treated surgically and who underwent preoperative CT imaging at our institution were included in the study. Image segmentation and feature extraction was performed semi-automatically with a commonly used open-source software platform. Genomic data from whole genome sequencing (WGS) were collected from our institution's web-based resource. Two statistical models were then built, in order to evaluate the predictive ability of CT-derived radiomics feature for driver gene mutations in PDAC. 30/47 of all tumor samples harbored 2 or more gene mutations. Overall, 81% of tumor samples demonstrated mutations in KRAS, 68% of samples had alterations in TP53, 26% in SMAD4 and 19% in CDKN2A. Extended statistical analysis revealed acceptable predictive ability for KRAS and TP53 (Youden Index 0.56 and 0.67, respectively) and mild to acceptable predictive signal for SMAD4 and CDKN2A (Youden Index 0.5, respectively). Our study establishes acceptable correlation of radiomics features and driver gene mutations in PDAC, indicating an acceptable prognostication of genomic profiles using CT-derived radiomics. A larger and more homogenous cohort may further enhance the predictive ability.

Comment on “Prognostic value of preoperative enhanced computed tomography as a quantitative imaging biomarker in pancreatic cancer”

Pancreatic ductal adenocarcinoma (PDAC) is one of the most lethal malignancies because of its high invasiveness and metastatic potential. Computed tomography (CT) is often used as a preliminary diagnostic tool for pancreatic cancer, and it is increasingly used to predict treatment response and disease stage. Recently, a study published in World Journal of Gastroenterology reported that quantitative analysis of preoperative enhanced CT data can be used to predict postoperative overall survival in patients with PDAC. A tumor relative enhancement ratio of ≤ 0.7 indicates a higher tumor stage and poor prognosis.

Imaging of Pancreatic Ductal Adenocarcinoma: An Update on Recent Advances

Pancreatic ductal carcinoma (PDAC) is one of the leading causes of cancer-related death worldwide. Computed tomography (CT) remains the primary imaging modality for diagnosis of PDAC. However, CT has limitations for early pancreatic tumor detection and tumor characterization so that it is currently challenged by magnetic resonance imaging. More recently, a particular attention has been given to radiomics for the characterization of pancreatic lesions using extraction and analysis of quantitative imaging features. In addition, radiomics has currently many applications that are developed in conjunction with artificial intelligence (AI) with the aim of better characterizing pancreatic lesions and providing a more precise assessment of tumor burden. This review article sums up recent advances in imaging of PDAC in the field of image/data acquisition, tumor detection, tumor characterization, treatment response evaluation, and preoperative planning. In addition, current applications of radiomics and AI in the field of PDAC are discussed.