Why did European Radiology reject my radiomic biomarker paper? How to correctly evaluate imaging biomarkers in a clinical setting

Prognostic factors to identify resolution of small bowel obstruction without need for operative management: systematic review

OBJECTIVES

To identify imaging, clinical, and laboratory variables potentially prognostic for surgical management of small bowel obstruction.

METHODS

Two researchers systematically reviewed indexed literature 2001-2021 inclusive for imaging, clinical, and laboratory variables potentially predictive of surgical management of small bowl obstruction and/or ischaemia at surgery, where performed. Risk of bias was assessed. Contingency tables for variables reported in at least 5 studies were extracted and meta-analysed to identify strong evidence of association with clinical outcomes, across studies.

RESULTS

Thirty-one studies were ultimately included, reporting 4638 patients (44 to 313 per study). 11 (35%) studies raised no risk of bias concerns. CT was the modality reported most (29 studies, 94%). Meta-analysis of 21 predictors identified 5 strongly associated with surgical intervention, 3 derived from CT (peritoneal free fluid, odds ratio [OR] 3.24, 95%CI 2.45 to 4.29; high grade obstruction, OR 3.58, 95%CI 2.46 to 5.20; mesenteric inflammation, OR 2.61, 95%CI 1.94 to 3.50; abdominal distension, OR 2.43, 95%CI 1.34 to 4.42; peritonism, OR 3.97, 95%CI 2.67 to 5.90) and one with conservative management (previous abdominopelvic surgery, OR 0.58, 95%CI 0.40 to 0.85). Meta-analysis of 10 predictors identified 3 strongly associated with ischaemia at surgery, 2 derived from CT (peritoneal free fluid, OR 3.49, 95%CI 2.28 to 5.35; bowel thickening, OR 3.26 95%CI 1.91 to 5.55; white cell count, OR 4.76, 95%CI 2.71 to 8.36).

CONCLUSIONS

Systematic review of patients with small bowel obstruction identified four imaging, three clinical, and one laboratory predictors associated strongly with surgical intervention and/or ischaemia at surgery.

CLINICAL RELEVANCE STATEMENT

Via systematic review and meta-analysis, we identified imaging, clinical, and laboratory predictors strongly associated with surgical management of small bowel obstruction and/or ischaemia. Multivariable model development to guide management should incorporate these since they display strong evidence of potential utility.

KEY POINTS

• While multivariable models incorporating clinical, laboratory, and imaging factors could predict surgical management of small bowel obstruction, none are used widely. • Via systematic review and meta-analysis we identified imaging, clinical, and laboratory variables strongly associated with surgical management and/or ischaemia at surgery. • Development of multivariable models to guide management should incorporate these predictors, notably CT scanning, since they display strong evidence of potential utility.

Systematic review and meta-analysis of the prognostic value of 18F-Fluorodeoxyglucose (18F-FDG) positron emission tomography (PET) and/or computed tomography (CT)-based radiomics in head and neck cancer

AIM

Radiomics involves the extraction of quantitative data from medical images to facilitate the diagnosis, prognosis, and staging of tumors. This study provides a comprehensive overview of the efficacy of radiomics in prognostic applications for head and neck cancer (HNC) in recent years. It undertakes a systematic review of prognostic models specific to HNC and conducts a meta-analysis to evaluate their predictive performance.

MATERIALS AND METHODS

This study adhered rigorously to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for literature searches. The literature databases, including PubMed, Embase, Cochrane, and Scopus were systematically searched individually. The methodological quality of the incorporated studies underwent assessment utilizing the radiomics quality score (RQS) tool. A random-effects meta-analysis employing the Harrell concordance index (C-index) was conducted to evaluate the performance of all radiomics models.

RESULTS

Among the 388 studies retrieved, 24 studies encompassing a total of 6,978 cases were incorporated into the systematic review. Furthermore, eight studies, focusing on overall survival as an endpoint, were included in the meta-analysis. The meta-analysis revealed that the estimated random effect of the C-index for all studies utilizing radiomics alone was 0.77 (0.71-0.82), with a substantial degree of heterogeneity indicated by an I2 of 80.17%.

CONCLUSIONS

Based on this review, prognostic modeling utilizing radiomics has demonstrated enhanced efficacy for head and neck cancers; however, there remains room for improvement in this approach. In the future, advancements are warranted in the integration of clinical parameters and multimodal features, balancing multicenter data, as well as in feature screening and model construction within this field.

Utilization of Radiomics Features Extracted From Preoperative Medical Images to Detect Metastatic Lymph Nodes in Cholangiocarcinoma and Gallbladder Cancer Patients: A Systemic Review and Meta-analysis

OBJECTIVES

This study aimed to determine the methodological quality and evaluate the diagnostic performance of radiomics features in detecting lymph node metastasis on preoperative images in patients with cholangiocarcinoma and gallbladder cancer.

METHODS

Publications between January 2005 and October 2022 were considered for inclusion. Databases such as Pubmed/Medline, Scopus, Embase, and Google Scholar were searched for relevant studies. The quality of the methodology of the manuscripts was determined using the Radiomics Quality Score and Quality Assessment of Diagnostic Accuracy Studies 2. Pooled results with corresponding 95% confidence intervals (CIs) were calculated using the DerSimonian-Liard method (random-effect model). Forest plots were used to visually represent the diagnostic profile of radiomics signature in each of the data sets pertaining to each study. Fagan plot was used to determine clinical applicability.

RESULTS

Overall sensitivity was 0.748 (95% CI, 0.703-0.789). Overall specificity was 0.795 (95% CI, 0.742-0.839). The combined negative likelihood ratio was 0.299 (95% CI, 0.266-0.350), and the positive likelihood ratio was 3.545 (95% CI, 2.850-4.409). The combined odds ratio of the studies was 12.184 (95% CI, 8.477-17.514). The overall summary receiver operating characteristics area under the curve was 0.83 (95% CI, 0.80-0.86). Three studies applied nomograms to 8 data sets and achieved a higher pooled sensitivity and specificity (0.85 [0.80-0.89] and 0.85 [0.71-0.93], respectively).

CONCLUSIONS

The pooled analysis showed that predictive models fed with radiomics features achieve good sensitivity and specificity in detecting lymph node metastasis in computed tomography and magnetic resonance imaging images. Supplementation of the models with biological correlates increased sensitivity and specificity in all data sets.

Clinical-Radiologic Morphology-Radiomics Model on Gadobenate Dimeglumine-Enhanced MRI for Identification of Highly Aggressive Hepatocellular Carcinoma: Temporal Validation and Multiscanner Validation

BACKGROUND

Highly aggressive hepatocellular carcinoma (HCC) is characterized by high tumor recurrence and poor outcomes, but its definition and imaging characteristics have not been clearly described.

PURPOSE

To develop and validate a fusion model on gadobenate dimeglumine-enhanced MRI for identifying highly aggressive HCC.

STUDY TYPE

Retrospective.

POPULATION

341 patients (M/F = 294/47) with surgically resected HCC, divided into a training cohort (n = 177), temporal validation cohort (n = 77), and multiscanner validation cohort (n = 87).

FIELD STRENGTH/SEQUENCE

3T, dynamic contrast-enhanced MRI with T1-weighted volumetric interpolated breath-hold examination gradient-echo sequences, especially arterial phase (AP) and hepatobiliary phase (HBP, 80-100 min).

ASSESSMENT

Clinical factors and diagnosis assessment based on radiologic morphology characteristics associated with highly aggressive HCCs were evaluated. The radiomics signatures were extracted from AP and HBP. Multivariable logistic regression was performed to construct clinical-radiologic morphology (CR) model and clinical-radiologic morphology-radiomics (CRR) model. A nomogram based on the optimal model was established. Early recurrence-free survival (RFS) was evaluated in actual groups and risk groups calculated by the nomogram.

STATISTICAL TESTS

The performance was evaluated by receiver operating characteristic curve (ROC) analysis, calibration curves analysis, and decision curves. Early RFS was evaluated by using Kaplan-Meier analysis. A P value <0.05 was considered statistically significant.

RESULTS

The CRR model incorporating corona enhancement, cloud-like hyperintensity on HBP, and radiomics signatures showed the highest diagnostic performance. The area under the curves (AUCs) of CRR were significantly higher than those of the CR model (AUC = 0.883 vs. 0.815, respectively, for the training cohort), 0.874 vs. 0.769 for temporal validation, and 0.892 vs. 0.792 for multiscanner validation. In both actual and risk groups, highly and low aggressive HCCs showed statistically significant differences in early recurrence.

DATA CONCLUSION

The clinical-radiologic morphology-radiomics model on gadobenate dimeglumine-enhanced MRI has potential to identify highly aggressive HCCs and non-invasively obtain prognostic information.

LEVEL OF EVIDENCE

4 TECHNICAL EFFICACY: Stage 2.

Model incorporating multiple diffusion MRI features: development and validation of a radiomics-based model to predict adult-type diffuse gliomas grade

OBJECTIVES

To develop and validate a radiomics-based model (ADGGIP) for predicting adult-type diffuse gliomas (ADG) grade by combining multiple diffusion modalities and clinical and imaging morphologic features.

METHODS

In this prospective study, we recruited 103 participants diagnosed with ADG and collected their preoperative conventional MRI and multiple diffusion imaging (diffusion tensor imaging, diffusion kurtosis imaging, neurite orientation dispersion and density imaging, and mean apparent propagator diffusion-MRI) data in our hospital, as well as clinical information. Radiomic features of the diffusion images and clinical information and morphological data from the radiological reports were extracted, and multiple pipelines were used to construct the optimal model. Model validation was performed through a time-independent validation cohort. ROC curves were used to evaluate model performance. The clinical benefit was determined by decision curve analysis.

RESULTS

From June 2018 to May 2021, 72 participants were recruited for the training cohort. Between June 2021 and February 2022, 31 participants were enrolled in the prospective validation cohort. In the training cohort (AUC 0.958), internal validation cohort (0.942), and prospective validation cohort (0.880), ADGGIP had good accuracy in predicting ADG grade. ADGGIP was also significantly better than the single-modality prediction model (AUC 0.860) and clinical imaging morphology model (0.841) (all p < .01) in the prospective validation cohort. When the threshold probability was greater than 5%, ADGGIP provided the greatest net benefit.

CONCLUSION

ADGGIP, which is based on advanced diffusion modalities, can predict the grade of ADG with high accuracy and robustness and can help improve clinical decision-making.

CLINICAL RELEVANCE STATEMENT

Integrated multi-modal predictive modeling is beneficial for early detection and treatment planning of adult-type diffuse gliomas, as well as for investigating the genuine clinical significance of biomarkers.

KEY POINTS

• Integrated model exhibits the highest performance and stability. • When the threshold is greater than 5%, the integrated model has the greatest net benefit. • The advanced diffusion models do not demonstrate better performance than the simple technology.

Unlocking Early Cancer Detection: Exploring Biomarkers, Circulating DNA, and Innovative Technological Approaches

Research and development improvements in early cancer diagnosis have had a significant positive impact on health. In the treatment and prevention of cancer, early detection is essential. In this context, biomarkers are essential because they offer important information on the state of cells at any particular time. Cells go through unique changes when they shift from a healthy condition to a malignant state, changes that appropriate biomarkers may pick up. Recent advancements have been made to identify and characterize circulating cancer-specific mutations in cell-free circulating DNA derived from tumors and tumor cells. A patient's delay between the time they first detect symptoms and the time they contact a doctor has been noted for many cancer forms. The tumor's location and features significantly impact the presentation of symptoms judged appropriate for early diagnosis. Lack of knowledge of the severity of the symptoms may be one cause for this delay. Our review is largely focused on the ongoing developments of early diagnosis in the study of biomarkers, circulating DNA for diagnosis, the biology of early challenges, early symptoms, liquid biopsies, detectable by imaging, established tumor markers, plasma DNA technologies, gender differences, and artificial intelligence (AI) in diagnosis. This review aims to determine and evaluate Indicators for detecting early cancer, assessing medical conditions, and evaluating potential risks. For Individuals with a heightened likelihood of developing cancer or who have already been diagnosed, early identification is crucial for enhancing prognosis and raising the likelihood of effective treatment.

A Radiomics-Based Machine Learning Perspective on the Parotid Gland as a Potential Surrogate Marker for HPV in Oropharyngeal Cancer

BACKGROUND

In treatment of oropharyngeal squamous cell carcinoma (OPSCC), human papillomavirus status (HPV) plays a crucial role. The HPV-positive subtype tends to affect younger patients and is associated with a more favorable prognosis. HPV-associated lesions have been described in the parotid gland, which is included in routine imaging for OPSCC. This work aims to explore the ability of an ML system to classify HPV status based on imaging of the parotid gland, which is routinely depicted on staging imaging.

METHODS

Using a radiomics approach, we investigate the ability of five contemporary machine learning (ML) models to distinguish between HPV-positive and HPV-negative OPSCC based on non-contrast computed tomography (CT) data of tumor volume (TM), locoregional lymph node metastasis (LNM), and the parotid gland (Parotid). After exclusion of cases affected by streak artefacts, 53 patients (training set: 39; evaluation set: 14) were retrospectively evaluated. Classification performances were tested for significance against random optimistic results.

RESULTS

The best results are AUC 0.71 by XGBoost (XGB) for TM, AUC 0.82 by multi-layer perceptron (MLP) for LNM, AUC 0.76 by random forest (RF) for Parotid, and AUC 0.86 by XGB for a combination of all three regions of interest (ROIs).

CONCLUSIONS

The results suggest involvement of the parotid gland in HPV infections of the oropharyngeal region. While the role of HPV in parotid lesions is under active discussion, the migration of the virus from the oral cavity to the parotid gland seems plausible. The imaging of the parotid gland offers the benefit of fewer streak artifacts due to teeth and dental implants and the potential to screen for HPV in cases of an absent or unlocatable tumor. Future investigation can be directed to validation of the results in independent datasets and to the potential of improvement of current classification models by addition of information based on the parotid gland.

MRI-based radiomic signatures for pretreatment prognostication in cervical cancer

BACKGROUND

Accurate pretherapeutic prognostication is important for tailoring treatment in cervical cancer (CC).

PURPOSE

To investigate whether pretreatment MRI-based radiomic signatures predict disease-specific survival (DSS) in CC.

STUDY TYPE

Retrospective.

POPULATION

CC patients (n = 133) allocated into training(T) (nT  = 89)/validation(V) (nV  = 44) cohorts.

FIELD STRENGTH/SEQUENCE

T2-weighted imaging (T2WI) and diffusion-weighted imaging (DWI) at 1.5T or 3.0T.

ASSESSMENT

Radiomic features from segmented tumors were extracted from T2WI and DWI (high b-value DWI and apparent diffusion coefficient (ADC) maps).

STATISTICAL TESTS

Radiomic signatures for prediction of DSS from T2WI (T2rad ) and T2WI with DWI (T2 + DWIrad ) were constructed by least absolute shrinkage and selection operator (LASSO) Cox regression. Area under time-dependent receiver operating characteristics curves (AUC) were used to evaluate and compare the prognostic performance of the radiomic signatures, MRI-derived maximum tumor size ≤/> 4 cm (MAXsize ), and 2018 International Federation of Gynecology and Obstetrics (FIGO) stage (I-II/III-IV). Survival was analyzed using Cox model estimating hazard ratios (HR) and Kaplan-Meier method with log-rank tests.

RESULTS

The radiomic signatures T2rad and T2 + DWIrad yielded AUCT /AUCV of 0.80/0.62 and 0.81/0.75, respectively, for predicting 5-year DSS. Both signatures yielded better or equal prognostic performance to that of MAXsize (AUCT /AUCV : 0.69/0.65) and FIGO (AUCT /AUCV : 0.77/0.64) and were significant predictors of DSS after adjusting for FIGO (HRT /HRV for T2rad : 4.0/2.5 and T2 + DWIrad : 4.8/2.1). Adding T2rad and T2 + DWIrad to FIGO significantly improved DSS prediction compared to FIGO alone in cohort(T) (AUCT 0.86 and 0.88 vs. 0.77), and FIGO with T2 + DWIrad tended to the same in cohort(V) (AUCV 0.75 vs. 0.64, p = 0.07). High radiomic score for T2 + DWIrad was significantly associated with reduced DSS in both cohorts.

DATA CONCLUSION

Radiomic signatures from T2WI and T2WI with DWI may provide added value for pretreatment risk assessment and for guiding tailored treatment strategies in CC.

The differential diagnosis value of radiomics-based machine learning in Parkinson's disease: a systematic review and meta-analysis

Background

In recent years, radiomics has been increasingly utilized for the differential diagnosis of Parkinson's disease (PD). However, the application of radiomics in PD diagnosis still lacks sufficient evidence-based support. To address this gap, we carried out a systematic review and meta-analysis to evaluate the diagnostic value of radiomics-based machine learning (ML) for PD.

Methods

We systematically searched Embase, Cochrane, PubMed, and Web of Science databases as of November 14, 2022. The radiomics quality assessment scale (RQS) was used to evaluate the quality of the included studies. The outcome measures were the c-index, which reflects the overall accuracy of the model, as well as sensitivity and specificity. During this meta-analysis, we discussed the differential diagnostic value of radiomics-based ML for Parkinson's disease and various atypical parkinsonism syndromes (APS).

Results

Twenty-eight articles with a total of 6,057 participants were included. The mean RQS score for all included articles was 10.64, with a relative score of 29.56%. The pooled c-index, sensitivity, and specificity of radiomics for predicting PD were 0.862 (95% CI: 0.833-0.891), 0.91 (95% CI: 0.86-0.94), and 0.93 (95% CI: 0.87-0.96) in the training set, and 0.871 (95% CI: 0.853-0.890), 0.86 (95% CI: 0.81-0.89), and 0.87 (95% CI: 0.83-0.91) in the validation set, respectively. Additionally, the pooled c-index, sensitivity, and specificity of radiomics for differentiating PD from APS were 0.866 (95% CI: 0.843-0.889), 0.86 (95% CI: 0.84-0.88), and 0.80 (95% CI: 0.75-0.84) in the training set, and 0.879 (95% CI: 0.854-0.903), 0.87 (95% CI: 0.85-0.89), and 0.82 (95% CI: 0.77-0.86) in the validation set, respectively.

Conclusion

Radiomics-based ML can serve as a potential tool for PD diagnosis. Moreover, it has an excellent performance in distinguishing Parkinson's disease from APS. The support vector machine (SVM) model exhibits excellent robustness when the number of samples is relatively abundant. However, due to the diverse implementation process of radiomics, it is expected that more large-scale, multi-class image data can be included to develop radiomics intelligent tools with broader applicability, promoting the application and development of radiomics in the diagnosis and prediction of Parkinson's disease and related fields.

Systematic review registration

https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=383197, identifier ID: CRD42022383197.

An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation

OBJECTIVE

To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level.

METHODS

A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated.

RESULTS

We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation.

CONCLUSIONS

The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence.

CLINICAL RELEVANCE STATEMENT

The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.

A systematic review of radiomics in giant cell tumor of bone (GCTB): the potential of analysis on individual radiomics feature for identifying genuine promising imaging biomarkers

PURPOSE

To systematically assess the quality of radiomics research in giant cell tumor of bone (GCTB) and to test the feasibility of analysis at the level of radiomics feature.

METHODS

We searched PubMed, Embase, Web of Science, China National Knowledge Infrastructure, and Wanfang Data to identify articles of GCTB radiomics until 31 July 2022. The studies were assessed by radiomics quality score (RQS), transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) statement, checklist for artificial intelligence in medical imaging (CLAIM), and modified quality assessment of diagnostic accuracy studies (QUADAS-2) tool. The radiomic features selected for model development were documented.

RESULTS

Nine articles were included. The average of the ideal percentage of RQS, the TRIPOD adherence rate and the CLAIM adherence rate were 26%, 56%, and 57%, respectively. The risk of bias and applicability concerns were mainly related to the index test. The shortness in external validation and open science were repeatedly emphasized. In GCTB radiomics models, the gray level co-occurrence matrix features (40%), first order features (28%), and gray-level run-length matrix features (18%) were most selected features out of all reported features. However, none of the individual feature has appeared repeatably in multiple studies. It is not possible to meta-analyze radiomics features at present.

CONCLUSION

The quality of GCTB radiomics studies is suboptimal. The reporting of individual radiomics feature data is encouraged. The analysis at the level of radiomics feature has potential to generate more practicable evidence for translating radiomics into clinical application.

Is the radiomics-clinical combined model helpful in distinguishing between pancreatic cancer and mass-forming pancreatitis?

PURPOSE

To develop CT-based radiomics models for distinguishing between resectable PDAC and mass-forming pancreatitis (MFP) and to provide a non-invasive tool for cases of equivocal imaging findings with EUS-FNA needed.

METHODS

A total of 201 patients with resectable PDAC and 54 patients with MFP were included. Development cohort: patients without preoperative EUS-FNA (175 PDAC cases, 38 MFP cases); validation cohort: patients with EUS-FNA (26 PDAC cases, 16 MFP cases). Two radiomic signatures (LASSOscore, PCAscore) were developed based on the LASSO model and principal component analysis. LASSOCli and PCACli prediction models were established by combining clinical features with CT radiomic features. ROC analysis and decision curve analysis (DCA) were performed to evaluate the utility of the model versus EUS-FNA in the validation cohort.

RESULTS

In the validation cohort, the radiomic signatures (LASSOscore, PCAscore) were both effective in distinguishing between resectable PDAC and MFP (AUC_LASSO = 0.743, 95% CI: 0.590-0.896; AUC_PCA = 0.788, 95% CI: 0.639-0.938) and improved the diagnostic accuracy of the baseline onlyCli model (AUC_onlyCli = 0.760, 95% CI: 0.614-0.960) after combination with variables including age, CA19-9, and the double-duct sign (AUC_PCACli = 0.880, 95% CI: 0.776-0.983; AUC_LASSOCli = 0.825, 95% CI: 0.694-0.955). The PCACli model showed comparable performance to FNA (AUC_FNA = 0.810, 95% CI: 0.685-0.935). In DCA, the net benefit of the PCACli model was superior to that of EUS-FNA, avoiding biopsies in 70 per 1000 patients at a risk threshold of 35%.

CONCLUSIONS

The PCACli model showed comparable performance with EUS-FNA in discriminating resectable PDAC from MFP.

Systematic review of the radiomics quality score applications: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVE

The main aim of the present systematic review was a comprehensive overview of the Radiomics Quality Score (RQS)-based systematic reviews to highlight common issues and challenges of radiomics research application and evaluate the relationship between RQS and review features.

METHODS

The literature search was performed on multiple medical literature archives according to PRISMA guidelines for systematic reviews that reported radiomic quality assessment through the RQS. Reported scores were converted to a 0-100% scale. The Mann-Whitney and Kruskal-Wallis tests were used to compare RQS scores and review features.

RESULTS

The literature research yielded 345 articles, from which 44 systematic reviews were finally included in the analysis. Overall, the median of RQS was 21.00% (IQR = 11.50). No significant differences of RQS were observed in subgroup analyses according to targets (oncological/not oncological target, neuroradiology/body imaging focus and one imaging technique/more than one imaging technique, characterization/prognosis/detection/other).

CONCLUSIONS

Our review did not reveal a significant difference of quality of radiomic articles reported in systematic reviews, divided in different subgroups. Furthermore, low overall methodological quality of radiomics research was found independent of specific application domains. While the RQS can serve as a reference tool to improve future study designs, future research should also be aimed at improving its reliability and developing new tools to meet an ever-evolving research space.

KEY POINTS

• Radiomics is a promising high-throughput method that may generate novel imaging biomarkers to improve clinical decision-making process, but it is an inherently complex analysis and often lacks reproducibility and generalizability. • The Radiomics Quality Score serves a necessary role as the de facto reference tool for assessing radiomics studies. • External auditing of radiomics studies, in addition to the standard peer-review process, is valuable to highlight common limitations and provide insights to improve future study designs and practical applicability of the radiomics models.

Multi-algorithms analysis for pre-treatment prediction of response to transarterial chemoembolization in hepatocellular carcinoma on multiphase MRI

OBJECTIVES

This study compared the accuracy of predicting transarterial chemoembolization (TACE) outcomes for hepatocellular carcinoma (HCC) patients in the four different classifiers, and comprehensive models were constructed to improve predictive performance.

METHODS

The subjects recruited for this study were HCC patients who had received TACE treatment from April 2016 to June 2021. All participants underwent enhanced MRI scans before and after intervention, and pertinent clinical information was collected. Registry data for the 144 patients were randomly assigned to training and test datasets. The robustness of the trained models was verified by another independent external validation set of 28 HCC patients. The following classifiers were employed in the radiomics experiment: machine learning classifiers k-nearest neighbor (KNN), support vector machine (SVM), the least absolute shrinkage and selection operator (Lasso), and deep learning classifier deep neural network (DNN).

RESULTS

DNN and Lasso models were comparable in the training set, while DNN performed better in the test set and the external validation set. The CD model (Clinical & DNN merged model) achieved an AUC of 0.974 (95% CI: 0.951-0.998) in the training set, superior to other models whose AUCs varied from 0.637 to 0.943 (p < 0.05). The CD model generalized well on the test set (AUC = 0.831) and external validation set (AUC = 0.735).

CONCLUSIONS

DNN model performs better than other classifiers in predicting TACE response. Integrating with clinically significant factors, the CD model may be valuable in pre-treatment counseling of HCC patients who may benefit the most from TACE intervention.

Prognostic value of 18F-FDG PET/CT-based radiomics combining dosiomics and dose volume histogram for head and neck cancer

OBJECTIVES

By comparing the prognostic performance of ¹⁸F-FDG PET/CT-based radiomics combining dose features [Includes Dosiomics feature and the dose volume histogram (DVH) features] with that of conventional radiomics in head and neck cancer (HNC), multidimensional prognostic models were constructed to investigate the overall survival (OS) in HNC.

MATERIALS AND METHODS

A total of 220 cases from four centres based on the Cancer Imaging Archive public dataset were used in this study, 2260 radiomics features and 1116 dosiomics features and 8 DVH features were extracted for each case, and classified into seven different models of PET, CT, Dose, PET+CT, PET+Dose, CT+Dose and PET+CT+Dose. Features were selected by univariate Cox and Spearman correlation coefficients, and the selected features were brought into the least absolute shrinkage and selection operator (LASSO)-Cox model. A nomogram was constructed to visually analyse the prognostic impact of the incorporated dose features. C-index and Kaplan-Meier curves (log-rank analysis) were used to evaluate and compare these models.

RESULTS

The cases from the four centres were divided into three different training and validation sets according to the hospitals. The PET+CT+Dose model had C-indexes of 0.873 (95% CI 0.812-0.934), 0.759 (95% CI 0.663-0.855) and 0.835 (95% CI 0.745-0.925) in the validation set respectively, outperforming the rest models overall. The PET+CT+Dose model did well in classifying patients into high- and low-risk groups under all three different sets of experiments (p < 0.05).

CONCLUSION

Multidimensional model of radiomics features combining dosiomics features and DVH features showed high prognostic performance for predicting OS in patients with HNC.

Radiomics-based intracranial thrombus features on preoperative noncontrast CT predicts successful recanalization of mechanical thrombectomy in acute ischemic stroke

Background

To evaluate the predictive value of radiomics features extracted from the thrombus on preoperative computed tomography images to identify successful recanalization after stent retrieve (SR) treatment in patients with acute ischemic stroke (AIS).

Methods

Two hundred fifty-six patients newly diagnosed AIS between March 2017 and September 2020 from two institutes, including the first affiliated hospital of Soochow university (institute I) and Northern Jiangsu People's hospital (institute II), were enrolled continuously and retrospectively. Patients with unsatisfactory image quality were excluded. The remaining patients of institute I were randomly divided into the training and internal validation cohorts at a ratio of 7 to 3, and patients of institute II were collected as the external validation cohort. After extraction and selection of the optimal radiomics features from training cohort, six machine learning (ML) classifiers including naïve Bayes (NB), random forest (RF), logistic regression (LR), linear support vector machine (L.SVM), radial SVM (R.SVM), and an artificial neural network (ANN) were developed to predict successful recanalization with SR treatment and compared. A combined model based on the optimal ML classifier was constructed using the optimal radiomics model and clinical-radiological risk variables. Finally, the performance of the model was selected based on the Matthews correlation coefficient (MCC) and the area under the receiver operating (AUC) and independently evaluated on the internal validation and external validation cohorts.

Results

We automatically extracted 1,130 radiomics features from the voxel of interest (VOI) using PyRadiomics. The eight most relevant radiomics features were identified using Intraclass coefficient, single-factor logistic regression analysis, and least absolute shrinkage and selection operator algorithm in the training cohort. Among the six ML classifiers, the ANN classifier using thrombus radiomics features achieved the best prediction of early recanalization under SR with MCCs of 0.913, 0.693 and 0.505 in training, internal and external validation cohorts, respectively. Moreover, receiver operating characteristic curves showed that the combined model [AUC =0.860, 95% confidence interval (CI): 0.731-0.936; AUC =0.849, 95% CI: 0.759-0.831] was not significantly better than radiomics model based on the ANN classifier alone (AUC =0.873, 95% CI: 0.803-0.891; AUC =0.805, 95% CI: 0.864-0.971) (P>0.05, Delong test) in internal and external validation cohorts.

Conclusions

A radiomics model based on the ANN classifier has the ability to predict successful recanalization after SR in patients with AIS, thus allowing a potentially better selection of mechanical thrombectomy treatment.

Comparison of MRI and CT-based radiomics for preoperative prediction of lymph node metastasis in pancreatic ductal adenocarcinoma

Background

The preoperative prediction of lymph node metastasis (LNM) in pancreatic ductal adenocarcinoma (PDAC) is essential in prognosis and treatment strategy formulation.

Purpose

To compare the performance of computed tomography (CT) and magnetic resonance imaging (MRI) radiomics models for the preoperative prediction of LNM in PDAC.

Material and Methods

In total, 160 consecutive patients with PDAC were retrospectively included, who were divided into the training and validation sets (ratio of 8:2). Two radiologists evaluated LNM basing on morphological abnormalities. Radiomics features were extracted from T2-weighted imaging, T1-weighted imaging, and multiphase contrast enhanced MRI and multiphase CT, respectively. Overall, 1184 radiomics features were extracted from each volume of interest drawn. Only features with an intraclass correlation coefficient ≥0.75 were included. Three sequential feature selection steps—variance threshold, variance thresholding and least absolute shrinkage selection operator—were repeated 20 times with fivefold cross-validation in the training set. Two radiomics models based on multiphase CT and multiparametric MRI were built with the five most frequent features. Model performance was evaluated using the area under the curve (AUC) values.

Results

Multiparametric MRI radiomics model achieved improved AUCs (0.791 and 0.786 in the training and validation sets, respectively) than that of the CT radiomics model (0.672 and 0.655 in the training and validation sets, respectively) and of the radiologists’ assessment (0.600–0.613 and 0.560–0.587 in the training and validation sets, respectively).

Conclusion

Multiparametric MRI radiomics model may serve as a potential tool for preoperatively evaluating LNM in PDAC and had superior predictive performance to multiphase CT-based model and radiologists’ assessment.

Radiomics can differentiate high-grade glioma from brain metastasis: a systematic review and meta-analysis

OBJECTIVE

(1) To evaluate the diagnostic performance of radiomics in differentiating high-grade glioma from brain metastasis and how to improve the model. (2) To assess the methodological quality of radiomics studies and explore ways of embracing the clinical application of radiomics.

METHODS

Studies using radiomics to differentiate high-grade glioma from brain metastasis published by 26 July 2021 were systematically reviewed. Methodological quality and risk of bias were assessed using the Radiomics Quality Score (RQS) system and Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool, respectively. Pooled sensitivity and specificity of the radiomics model were also calculated.

RESULTS

Seventeen studies combining 1,717 patients were included in the systematic review, of which 10 studies without data leakage suspicion were employed for the quantitative statistical analysis. The average RQS was 5.13 (14.25% of total), with substantial or almost perfect inter-rater agreements. The inclusion of clinical features in the radiomics model was only reported in one study, as was the case for publicly available algorithm code. The pooled sensitivity and specificity were 84% (95% CI, 80-88%) and 84% (95% CI, 81-87%), respectively. The performances of feature extraction from the volume of interest (VOI) or (semi) automatic segmentation in the radiomics models were superior to those of protocols employing region of interest (ROI) or manual segmentation.

CONCLUSION

Radiomics can accurately differentiate high-grade glioma from brain metastasis. The adoption of standardized workflow to avoid potential data leakage as well as the integration of clinical features and radiomics are advised to consider in future studies.

KEY POINTS

• The pooled sensitivity and specificity of radiomics for differentiating high-grade gliomas from brain metastasis were 84% and 84%, respectively. • Avoiding potential data leakage by adopting an intensive and standardized workflow is essential to improve the quality and generalizability of the radiomics model. • The application of radiomics in combination with clinical features in differentiating high-grade gliomas from brain metastasis needs further validation.

Intensity standardization of MRI prior to radiomic feature extraction for artificial intelligence research in glioma-a systematic review

OBJECTIVES

Radiomics is a promising avenue in non-invasive characterisation of diffuse glioma. Clinical translation is hampered by lack of reproducibility across centres and difficulty in standardising image intensity in MRI datasets. The study aim was to perform a systematic review of different methods of MRI intensity standardisation prior to radiomic feature extraction.

METHODS

MEDLINE, EMBASE, and SCOPUS were searched for articles meeting the following eligibility criteria: MRI radiomic studies where one method of intensity normalisation was compared with another or no normalisation, and original research concerning patients diagnosed with diffuse gliomas. Using PRISMA criteria, data were extracted from short-listed studies including number of patients, MRI sequences, validation status, radiomics software, method of segmentation, and intensity standardisation. QUADAS-2 was used for quality appraisal.

RESULTS

After duplicate removal, 741 results were returned from database and reference searches and, from these, 12 papers were eligible. Due to a lack of common pre-processing and different analyses, a narrative synthesis was sought. Three different intensity standardisation techniques have been studied: histogram matching (5/12), limiting or rescaling signal intensity (8/12), and deep learning (1/12)-only two papers compared different methods. From these studies, histogram matching produced the more reliable features compared to other methods of altering MRI signal intensity.

CONCLUSION

Multiple methods of intensity standardisation have been described in the literature without clear consensus. Further research that directly compares different methods of intensity standardisation on glioma MRI datasets is required.

KEY POINTS

• Intensity standardisation is a key pre-processing step in the development of robust radiomic signatures to evaluate diffuse glioma. • A minority of studies compared the impact of two or more methods. • Further research is required to directly compare multiple methods of MRI intensity standardisation on glioma datasets.

Pancreatic cancer, radiomics and artificial intelligence

Patients with pancreatic ductal adenocarcinoma (PDAC) are generally classified into four categories based on contrast-enhanced CT at diagnosis: resectable, borderline resectable, unresectable, and metastatic disease. In the initial grading and staging of PDAC, structured radiological templates are useful but limited, as there is a need to define the aggressiveness and microscopic disease stage of these tumours to ensure adequate treatment allocation. Quantitative imaging analysis allows radiomics and dynamic imaging features to provide information of clinical outcomes, and to construct clinical models based on radiomics signatures or imaging phenotypes. These quantitative features may be used as prognostic and predictive biomarkers in clinical decision-making, enabling personalised management of advanced PDAC. Deep learning and convolutional neural networks also provide high level bioinformatics tools that can help define features associated with a given aspect of PDAC biology and aggressiveness, paving the way to define outcomes based on these features. Thus, the prediction of tumour phenotype, treatment response and patient prognosis may be feasible by using such comprehensive and integrated radiomics models. Despite these promising results, quantitative imaging is not ready for clinical implementation in PDAC. Limitations include the instability of metrics and lack of external validation. Large properly annotated datasets, including relevant semantic features (demographics, blood markers, genomics), image harmonisation, robust radiomics analysis, clinically significant tasks as outputs, comparisons with gold-standards (such as TNM or pretreatment classifications) and fully independent validation cohorts, will be required for the development of trustworthy radiomics and artificial intelligence solutions to predict PDAC aggressiveness in a clinical setting.

A Dual-Energy CT Radiomics of the Regional Largest Short-Axis Lymph Node Can Improve the Prediction of Lymph Node Metastasis in Patients With Rectal Cancer

Objective

To explore the value of dual-energy computed tomography (DECT) radiomics of the regional largest short-axis lymph nodes for evaluating lymph node metastasis in patients with rectal cancer.

Materials and Methods

One hundred forty-one patients with rectal cancer (58 in LNM+ group, 83 in LNM- group) who underwent preoperative total abdominal DECT were divided into a training group and testing group (7:3 ratio). After post-processing DECT venous phase images, 120kVp-like images and iodine (water) images were obtained. The highest-risk lymph nodes were identified, and their long-axis and short-axis diameter and DECT quantitative parameters were measured manually by two experienced radiologists who were blind to the postoperative pathological results. Four DECT parameters were analyzed: arterial phase (AP) normalized iodine concentration, AP normalized effective atomic number, the venous phase (VP) normalized iodine concentration, and the venous phase normalized effective atomic number. The carcinoembryonic antigen (CEA) levels were recorded one week before surgery. Radiomics features of the largest lymph nodes were extracted, standardized, and reduced before modeling. Radomics signatures of 120kVp-like images (Rad-signature120kVp) and iodine map (Rad-signatureImap) were built based on Logistic Regression via Least Absolute Shrinkage and Selection Operator (LASSO).

Results

Eight hundred thirty-three features were extracted from 120kVp-like and iodine images, respectively. In testing group, the radiomics features based on 120kVp-like images showed the best diagnostic performance (AUC=0.922) compared to other predictors [CT morphological indicators (short-axis diameter (AUC=0.779, IDI=0.262) and long-axis diameter alone (AUC=0.714, IDI=0.329)), CEA alone (AUC=0.540, IDI=0.414), and normalized DECT parameters alone (AUC=0.504-0.718, IDI=0.290-0.476)](P&lt;0.05 in Delong test). Contrary, DECT iodine map-based radiomic signatures showed similar performance in predicting lymph node metastasis (AUC=0.866). The decision curve showed that the 120kVp-like-based radiomics signature has the highest net income.

Conclusion

Predictive model based on DECT and the largest short-axis diameter lymph nodes has the highest diagnostic value in predicting lymph node metastasis in patients with rectal cancer.

Are preoperative CT variables associated with the success or failure of subsequent ventral hernia repair: nested case-control study

OBJECTIVES

Systematic review of CT measurements to predict the success or failure of subsequent ventral hernia repair has found limited data available in the indexed literature. To rectify this, we investigated multiple preoperative CT metrics to identify if any were associated with postoperative reherniation.

METHODS

Following ethical permission, we identified patients who had undergone ventral hernia repair and had preoperative CT scanning available. Two radiologists made multiple measurements of the hernia and abdominal musculature from these scans, including loss of domain. Patients were divided subsequently into two groups, defined by hernia recurrence at 1-year subsequent to surgery. Hypothesis testing investigated any differences between CT measurements from each group.

RESULTS

One hundred eighty-eight patients (95 male) were identified, 34 (18%) whose hernia had recurred by 1-year. Only three of 34 CT measurements were significantly different when patients whose hernia had recurred were compared to those who had not; these significant findings were assumed contingent on multiple testing. In particular, preoperative hernia volume (recurrence 155.3 cc [IQR 355.65] vs. no recurrence 78.2 [IQR 303.52], p = 0.26) nor loss of domain, whether calculated using the Tanaka (recurrence 0.02 [0.04] vs. no recurrence 0.009 [0.04], p = 0.33) or Sabbagh (recurrence 0.019 [0.05] vs. no recurrence 0.009 [0.04], p = 0.25) methods, differed between significantly between groups.

CONCLUSIONS

Preoperative CT measurements of ventral hernia morphology, including loss of domain, appear unrelated to postoperative recurrence. It is likely that the importance of such measurements to predict recurrence is outweighed by other patient factors and surgical reconstruction technique.

KEY POINTS

• Preoperative CT scanning is often performed for ventral hernia but systematic review revealed little data regarding whether CT variables predict postoperative reherniation. • We found that the large majority of CT measurements, including loss of domain, did not differ significantly between patients whose hernia did and did not recur. • It is likely that the importance of CT measurements to predict recurrence is outweighed by other patient factors and surgical reconstruction technique.

Advances in liver US, CT, and MRI: moving toward the future

Over the past two decades, the epidemiology of chronic liver disease has changed with an increase in the prevalence of nonalcoholic fatty liver disease in parallel to the advent of curative treatments for hepatitis C. Recent developments provided new tools for diagnosis and monitoring of liver diseases based on ultrasound (US), computed tomography (CT), and magnetic resonance imaging (MRI), as applied for assessing steatosis, fibrosis, and focal lesions. This narrative review aims to discuss the emerging approaches for qualitative and quantitative liver imaging, focusing on those expected to become adopted in clinical practice in the next 5 to 10 years. While radiomics is an emerging tool for many of these applications, dedicated techniques have been investigated for US (controlled attenuation parameter, backscatter coefficient, elastography methods such as point shear wave elastography [pSWE] and transient elastography [TE], novel Doppler techniques, and three-dimensional contrast-enhanced ultrasound [3D-CEUS]), CT (dual-energy, spectral photon counting, extracellular volume fraction, perfusion, and surface nodularity), and MRI (proton density fat fraction [PDFF], elastography [MRE], contrast enhancement index, relative enhancement, T1 mapping on the hepatobiliary phase, perfusion). Concurrently, the advent of abbreviated MRI protocols will help fulfill an increasing number of examination requests in an era of healthcare resource constraints.